2026-04-24 01:40:39.498720 | Job console starting 2026-04-24 01:40:39.516952 | Updating git repos 2026-04-24 01:40:40.144496 | Cloning repos into workspace 2026-04-24 01:40:40.344259 | Restoring repo states 2026-04-24 01:40:40.368764 | Merging changes 2026-04-24 01:40:40.368787 | Checking out repos 2026-04-24 01:40:40.609997 | Preparing playbooks 2026-04-24 01:40:41.293460 | Running Ansible setup 2026-04-24 01:40:45.558236 | PRE-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/pre.yaml@main] 2026-04-24 01:40:46.314332 | 2026-04-24 01:40:46.314507 | PLAY [Base pre] 2026-04-24 01:40:46.331291 | 2026-04-24 01:40:46.331445 | TASK [Setup log path fact] 2026-04-24 01:40:46.362649 | orchestrator | ok 2026-04-24 01:40:46.382799 | 2026-04-24 01:40:46.383016 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-24 01:40:46.423385 | orchestrator | ok 2026-04-24 01:40:46.435272 | 2026-04-24 01:40:46.435443 | TASK [emit-job-header : Print job information] 2026-04-24 01:40:46.497123 | # Job Information 2026-04-24 01:40:46.497478 | Ansible Version: 2.16.14 2026-04-24 01:40:46.497549 | Job: testbed-upgrade-stable-ubuntu-24.04 2026-04-24 01:40:46.497608 | Pipeline: periodic-midnight 2026-04-24 01:40:46.497648 | Executor: 521e9411259a 2026-04-24 01:40:46.497684 | Triggered by: https://github.com/osism/testbed 2026-04-24 01:40:46.497722 | Event ID: 4d51adcd7fb04c4686aa06d869450f6f 2026-04-24 01:40:46.507781 | 2026-04-24 01:40:46.507919 | LOOP [emit-job-header : Print node information] 2026-04-24 01:40:46.631646 | orchestrator | ok: 2026-04-24 01:40:46.631874 | orchestrator | # Node Information 2026-04-24 01:40:46.631911 | orchestrator | Inventory Hostname: orchestrator 2026-04-24 01:40:46.631938 | orchestrator | Hostname: zuul-static-regiocloud-infra-1 2026-04-24 01:40:46.631962 | orchestrator | Username: zuul-testbed01 2026-04-24 01:40:46.631984 | orchestrator | Distro: Debian 12.13 2026-04-24 01:40:46.632009 | orchestrator | Provider: static-testbed 2026-04-24 01:40:46.632030 | orchestrator | Region: 2026-04-24 01:40:46.632051 | orchestrator | Label: testbed-orchestrator 2026-04-24 01:40:46.632070 | orchestrator | Product Name: OpenStack Nova 2026-04-24 01:40:46.632090 | orchestrator | Interface IP: 81.163.193.140 2026-04-24 01:40:46.669793 | 2026-04-24 01:40:46.670018 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-24 01:40:47.167337 | orchestrator -> localhost | changed 2026-04-24 01:40:47.175813 | 2026-04-24 01:40:47.175939 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-24 01:40:48.236695 | orchestrator -> localhost | changed 2026-04-24 01:40:48.259415 | 2026-04-24 01:40:48.259549 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-24 01:40:48.541003 | orchestrator -> localhost | ok 2026-04-24 01:40:48.558053 | 2026-04-24 01:40:48.558207 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-24 01:40:48.594143 | orchestrator | ok 2026-04-24 01:40:48.610777 | orchestrator | included: /var/lib/zuul/builds/c7092bc154f64b45bd6781508d54d3bb/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-24 01:40:48.618763 | 2026-04-24 01:40:48.618887 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-24 01:40:49.502423 | orchestrator -> localhost | Generating public/private rsa key pair. 2026-04-24 01:40:49.502829 | orchestrator -> localhost | Your identification has been saved in /var/lib/zuul/builds/c7092bc154f64b45bd6781508d54d3bb/work/c7092bc154f64b45bd6781508d54d3bb_id_rsa 2026-04-24 01:40:49.502949 | orchestrator -> localhost | Your public key has been saved in /var/lib/zuul/builds/c7092bc154f64b45bd6781508d54d3bb/work/c7092bc154f64b45bd6781508d54d3bb_id_rsa.pub 2026-04-24 01:40:49.503005 | orchestrator -> localhost | The key fingerprint is: 2026-04-24 01:40:49.503055 | orchestrator -> localhost | SHA256:aLeNI2UdVCFH+NQKHAcZLqh8/n60DX6/9UH3q+9GLZM zuul-build-sshkey 2026-04-24 01:40:49.503100 | orchestrator -> localhost | The key's randomart image is: 2026-04-24 01:40:49.503159 | orchestrator -> localhost | +---[RSA 3072]----+ 2026-04-24 01:40:49.503204 | orchestrator -> localhost | | .*O*o | 2026-04-24 01:40:49.503248 | orchestrator -> localhost | | . o=+. . | 2026-04-24 01:40:49.503288 | orchestrator -> localhost | | . . o+ . | 2026-04-24 01:40:49.503326 | orchestrator -> localhost | | . . . o .o | 2026-04-24 01:40:49.503364 | orchestrator -> localhost | | o + S . oo| 2026-04-24 01:40:49.503427 | orchestrator -> localhost | | + + +o E.+| 2026-04-24 01:40:49.503469 | orchestrator -> localhost | | o +o.+ .+o| 2026-04-24 01:40:49.503508 | orchestrator -> localhost | | o .+ o o+| 2026-04-24 01:40:49.503548 | orchestrator -> localhost | | .o. . oB=.| 2026-04-24 01:40:49.503587 | orchestrator -> localhost | +----[SHA256]-----+ 2026-04-24 01:40:49.503688 | orchestrator -> localhost | ok: Runtime: 0:00:00.375448 2026-04-24 01:40:49.517028 | 2026-04-24 01:40:49.517173 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-24 01:40:49.551231 | orchestrator | ok 2026-04-24 01:40:49.564857 | orchestrator | included: /var/lib/zuul/builds/c7092bc154f64b45bd6781508d54d3bb/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-24 01:40:49.574972 | 2026-04-24 01:40:49.575072 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-24 01:40:49.598761 | orchestrator | skipping: Conditional result was False 2026-04-24 01:40:49.608031 | 2026-04-24 01:40:49.608143 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-24 01:40:50.266476 | orchestrator | changed 2026-04-24 01:40:50.276976 | 2026-04-24 01:40:50.277112 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-24 01:40:50.612639 | orchestrator | ok 2026-04-24 01:40:50.623604 | 2026-04-24 01:40:50.623746 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-24 01:40:51.052939 | orchestrator | ok 2026-04-24 01:40:51.059459 | 2026-04-24 01:40:51.059581 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-24 01:40:51.513602 | orchestrator | ok 2026-04-24 01:40:51.522446 | 2026-04-24 01:40:51.522574 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-24 01:40:51.557138 | orchestrator | skipping: Conditional result was False 2026-04-24 01:40:51.572921 | 2026-04-24 01:40:51.573109 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-24 01:40:52.054323 | orchestrator -> localhost | changed 2026-04-24 01:40:52.068259 | 2026-04-24 01:40:52.068386 | TASK [add-build-sshkey : Add back temp key] 2026-04-24 01:40:52.416168 | orchestrator -> localhost | Identity added: /var/lib/zuul/builds/c7092bc154f64b45bd6781508d54d3bb/work/c7092bc154f64b45bd6781508d54d3bb_id_rsa (zuul-build-sshkey) 2026-04-24 01:40:52.416546 | orchestrator -> localhost | ok: Runtime: 0:00:00.017675 2026-04-24 01:40:52.424291 | 2026-04-24 01:40:52.424435 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-24 01:40:52.886106 | orchestrator | ok 2026-04-24 01:40:52.894722 | 2026-04-24 01:40:52.894895 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-24 01:40:52.929513 | orchestrator | skipping: Conditional result was False 2026-04-24 01:40:52.985174 | 2026-04-24 01:40:52.985301 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-04-24 01:40:53.418266 | orchestrator | ok 2026-04-24 01:40:53.434111 | 2026-04-24 01:40:53.434248 | TASK [validate-host : Define zuul_info_dir fact] 2026-04-24 01:40:53.482363 | orchestrator | ok 2026-04-24 01:40:53.493637 | 2026-04-24 01:40:53.493760 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-04-24 01:40:53.800973 | orchestrator -> localhost | ok 2026-04-24 01:40:53.808674 | 2026-04-24 01:40:53.808783 | TASK [validate-host : Collect information about the host] 2026-04-24 01:40:55.186763 | orchestrator | ok 2026-04-24 01:40:55.203978 | 2026-04-24 01:40:55.204112 | TASK [validate-host : Sanitize hostname] 2026-04-24 01:40:55.283104 | orchestrator | ok 2026-04-24 01:40:55.292368 | 2026-04-24 01:40:55.292553 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-04-24 01:40:55.876375 | orchestrator -> localhost | changed 2026-04-24 01:40:55.894588 | 2026-04-24 01:40:55.894877 | TASK [validate-host : Collect information about zuul worker] 2026-04-24 01:40:56.381053 | orchestrator | ok 2026-04-24 01:40:56.389971 | 2026-04-24 01:40:56.390124 | TASK [validate-host : Write out all zuul information for each host] 2026-04-24 01:40:56.993236 | orchestrator -> localhost | changed 2026-04-24 01:40:57.005307 | 2026-04-24 01:40:57.005448 | TASK [prepare-workspace-log : Start zuul_console daemon.] 2026-04-24 01:40:57.313252 | orchestrator | ok 2026-04-24 01:40:57.322069 | 2026-04-24 01:40:57.322183 | TASK [prepare-workspace-log : Synchronize src repos to workspace directory.] 2026-04-24 01:41:21.136866 | orchestrator | changed: 2026-04-24 01:41:21.137144 | orchestrator | .d..t...... src/ 2026-04-24 01:41:21.137188 | orchestrator | .d..t...... src/github.com/ 2026-04-24 01:41:21.137219 | orchestrator | .d..t...... src/github.com/osism/ 2026-04-24 01:41:21.137245 | orchestrator | .d..t...... src/github.com/osism/ansible-collection-commons/ 2026-04-24 01:41:21.137271 | orchestrator | RedHat.yml 2026-04-24 01:41:21.153326 | orchestrator | .L..t...... src/github.com/osism/ansible-collection-commons/roles/repository/tasks/CentOS.yml -> RedHat.yml 2026-04-24 01:41:21.153344 | orchestrator | RedHat.yml 2026-04-24 01:41:21.153399 | orchestrator | = 1.53.0"... 2026-04-24 01:41:34.260242 | orchestrator | - Finding hashicorp/local versions matching ">= 2.2.0"... 2026-04-24 01:41:34.276393 | orchestrator | - Finding latest version of hashicorp/null... 2026-04-24 01:41:35.239938 | orchestrator | - Installing terraform-provider-openstack/openstack v3.4.0... 2026-04-24 01:41:36.284174 | orchestrator | - Installed terraform-provider-openstack/openstack v3.4.0 (signed, key ID 4F80527A391BEFD2) 2026-04-24 01:41:36.545001 | orchestrator | - Installing hashicorp/local v2.8.0... 2026-04-24 01:41:37.185772 | orchestrator | - Installed hashicorp/local v2.8.0 (signed, key ID 0C0AF313E5FD9F80) 2026-04-24 01:41:37.243217 | orchestrator | - Installing hashicorp/null v3.2.4... 2026-04-24 01:41:37.871189 | orchestrator | - Installed hashicorp/null v3.2.4 (signed, key ID 0C0AF313E5FD9F80) 2026-04-24 01:41:37.871310 | orchestrator | 2026-04-24 01:41:37.871331 | orchestrator | Providers are signed by their developers. 2026-04-24 01:41:37.871348 | orchestrator | If you'd like to know more about provider signing, you can read about it here: 2026-04-24 01:41:37.871364 | orchestrator | https://opentofu.org/docs/cli/plugins/signing/ 2026-04-24 01:41:37.871400 | orchestrator | 2026-04-24 01:41:37.871417 | orchestrator | OpenTofu has created a lock file .terraform.lock.hcl to record the provider 2026-04-24 01:41:37.871433 | orchestrator | selections it made above. Include this file in your version control repository 2026-04-24 01:41:37.871476 | orchestrator | so that OpenTofu can guarantee to make the same selections by default when 2026-04-24 01:41:37.871493 | orchestrator | you run "tofu init" in the future. 2026-04-24 01:41:37.871708 | orchestrator | 2026-04-24 01:41:37.871736 | orchestrator | OpenTofu has been successfully initialized! 2026-04-24 01:41:37.871762 | orchestrator | 2026-04-24 01:41:37.871778 | orchestrator | You may now begin working with OpenTofu. Try running "tofu plan" to see 2026-04-24 01:41:37.871793 | orchestrator | any changes that are required for your infrastructure. All OpenTofu commands 2026-04-24 01:41:37.871808 | orchestrator | should now work. 2026-04-24 01:41:37.871823 | orchestrator | 2026-04-24 01:41:37.871837 | orchestrator | If you ever set or change modules or backend configuration for OpenTofu, 2026-04-24 01:41:37.871852 | orchestrator | rerun this command to reinitialize your working directory. If you forget, other 2026-04-24 01:41:37.871861 | orchestrator | commands will detect it and remind you to do so if necessary. 2026-04-24 01:41:38.034692 | orchestrator | Created and switched to workspace "ci"! 2026-04-24 01:41:38.034770 | orchestrator | 2026-04-24 01:41:38.034778 | orchestrator | You're now on a new, empty workspace. Workspaces isolate their state, 2026-04-24 01:41:38.034784 | orchestrator | so if you run "tofu plan" OpenTofu will not see any existing state 2026-04-24 01:41:38.034788 | orchestrator | for this configuration. 2026-04-24 01:41:38.169237 | orchestrator | ci.auto.tfvars 2026-04-24 01:41:38.172386 | orchestrator | default_custom.tf 2026-04-24 01:41:39.545050 | orchestrator | data.openstack_networking_network_v2.public: Reading... 2026-04-24 01:41:40.105888 | orchestrator | data.openstack_networking_network_v2.public: Read complete after 0s [id=e6be7364-bfd8-4de7-8120-8f41c69a139a] 2026-04-24 01:41:40.358938 | orchestrator | 2026-04-24 01:41:40.359006 | orchestrator | OpenTofu used the selected providers to generate the following execution 2026-04-24 01:41:40.359015 | orchestrator | plan. Resource actions are indicated with the following symbols: 2026-04-24 01:41:40.359038 | orchestrator | + create 2026-04-24 01:41:40.359053 | orchestrator | <= read (data resources) 2026-04-24 01:41:40.359066 | orchestrator | 2026-04-24 01:41:40.359071 | orchestrator | OpenTofu will perform the following actions: 2026-04-24 01:41:40.359176 | orchestrator | 2026-04-24 01:41:40.359190 | orchestrator | # data.openstack_images_image_v2.image will be read during apply 2026-04-24 01:41:40.359195 | orchestrator | # (config refers to values not yet known) 2026-04-24 01:41:40.359199 | orchestrator | <= data "openstack_images_image_v2" "image" { 2026-04-24 01:41:40.359204 | orchestrator | + checksum = (known after apply) 2026-04-24 01:41:40.359208 | orchestrator | + created_at = (known after apply) 2026-04-24 01:41:40.359212 | orchestrator | + file = (known after apply) 2026-04-24 01:41:40.359216 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.359240 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.359244 | orchestrator | + min_disk_gb = (known after apply) 2026-04-24 01:41:40.359248 | orchestrator | + min_ram_mb = (known after apply) 2026-04-24 01:41:40.359252 | orchestrator | + most_recent = true 2026-04-24 01:41:40.359257 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.359261 | orchestrator | + protected = (known after apply) 2026-04-24 01:41:40.359264 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.359272 | orchestrator | + schema = (known after apply) 2026-04-24 01:41:40.359275 | orchestrator | + size_bytes = (known after apply) 2026-04-24 01:41:40.359279 | orchestrator | + tags = (known after apply) 2026-04-24 01:41:40.359283 | orchestrator | + updated_at = (known after apply) 2026-04-24 01:41:40.359287 | orchestrator | } 2026-04-24 01:41:40.359374 | orchestrator | 2026-04-24 01:41:40.359387 | orchestrator | # data.openstack_images_image_v2.image_node will be read during apply 2026-04-24 01:41:40.359392 | orchestrator | # (config refers to values not yet known) 2026-04-24 01:41:40.359396 | orchestrator | <= data "openstack_images_image_v2" "image_node" { 2026-04-24 01:41:40.359400 | orchestrator | + checksum = (known after apply) 2026-04-24 01:41:40.359404 | orchestrator | + created_at = (known after apply) 2026-04-24 01:41:40.359408 | orchestrator | + file = (known after apply) 2026-04-24 01:41:40.359412 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.359415 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.359419 | orchestrator | + min_disk_gb = (known after apply) 2026-04-24 01:41:40.359423 | orchestrator | + min_ram_mb = (known after apply) 2026-04-24 01:41:40.359426 | orchestrator | + most_recent = true 2026-04-24 01:41:40.359431 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.359434 | orchestrator | + protected = (known after apply) 2026-04-24 01:41:40.359438 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.359442 | orchestrator | + schema = (known after apply) 2026-04-24 01:41:40.359445 | orchestrator | + size_bytes = (known after apply) 2026-04-24 01:41:40.359449 | orchestrator | + tags = (known after apply) 2026-04-24 01:41:40.359453 | orchestrator | + updated_at = (known after apply) 2026-04-24 01:41:40.359456 | orchestrator | } 2026-04-24 01:41:40.359530 | orchestrator | 2026-04-24 01:41:40.359542 | orchestrator | # local_file.MANAGER_ADDRESS will be created 2026-04-24 01:41:40.359547 | orchestrator | + resource "local_file" "MANAGER_ADDRESS" { 2026-04-24 01:41:40.359551 | orchestrator | + content = (known after apply) 2026-04-24 01:41:40.359555 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-24 01:41:40.359558 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-24 01:41:40.359562 | orchestrator | + content_md5 = (known after apply) 2026-04-24 01:41:40.359566 | orchestrator | + content_sha1 = (known after apply) 2026-04-24 01:41:40.359569 | orchestrator | + content_sha256 = (known after apply) 2026-04-24 01:41:40.359573 | orchestrator | + content_sha512 = (known after apply) 2026-04-24 01:41:40.359577 | orchestrator | + directory_permission = "0777" 2026-04-24 01:41:40.359581 | orchestrator | + file_permission = "0644" 2026-04-24 01:41:40.359584 | orchestrator | + filename = ".MANAGER_ADDRESS.ci" 2026-04-24 01:41:40.359588 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.359592 | orchestrator | } 2026-04-24 01:41:40.359704 | orchestrator | 2026-04-24 01:41:40.359719 | orchestrator | # local_file.id_rsa_pub will be created 2026-04-24 01:41:40.359723 | orchestrator | + resource "local_file" "id_rsa_pub" { 2026-04-24 01:41:40.359727 | orchestrator | + content = (known after apply) 2026-04-24 01:41:40.359731 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-24 01:41:40.359734 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-24 01:41:40.359738 | orchestrator | + content_md5 = (known after apply) 2026-04-24 01:41:40.359742 | orchestrator | + content_sha1 = (known after apply) 2026-04-24 01:41:40.359745 | orchestrator | + content_sha256 = (known after apply) 2026-04-24 01:41:40.359749 | orchestrator | + content_sha512 = (known after apply) 2026-04-24 01:41:40.359753 | orchestrator | + directory_permission = "0777" 2026-04-24 01:41:40.359756 | orchestrator | + file_permission = "0644" 2026-04-24 01:41:40.359766 | orchestrator | + filename = ".id_rsa.ci.pub" 2026-04-24 01:41:40.359770 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.359774 | orchestrator | } 2026-04-24 01:41:40.359845 | orchestrator | 2026-04-24 01:41:40.359866 | orchestrator | # local_file.inventory will be created 2026-04-24 01:41:40.359871 | orchestrator | + resource "local_file" "inventory" { 2026-04-24 01:41:40.359875 | orchestrator | + content = (known after apply) 2026-04-24 01:41:40.359878 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-24 01:41:40.359882 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-24 01:41:40.359886 | orchestrator | + content_md5 = (known after apply) 2026-04-24 01:41:40.359889 | orchestrator | + content_sha1 = (known after apply) 2026-04-24 01:41:40.359893 | orchestrator | + content_sha256 = (known after apply) 2026-04-24 01:41:40.359897 | orchestrator | + content_sha512 = (known after apply) 2026-04-24 01:41:40.359901 | orchestrator | + directory_permission = "0777" 2026-04-24 01:41:40.359904 | orchestrator | + file_permission = "0644" 2026-04-24 01:41:40.359908 | orchestrator | + filename = "inventory.ci" 2026-04-24 01:41:40.359912 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.359916 | orchestrator | } 2026-04-24 01:41:40.359992 | orchestrator | 2026-04-24 01:41:40.360004 | orchestrator | # local_sensitive_file.id_rsa will be created 2026-04-24 01:41:40.360008 | orchestrator | + resource "local_sensitive_file" "id_rsa" { 2026-04-24 01:41:40.360012 | orchestrator | + content = (sensitive value) 2026-04-24 01:41:40.360016 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-24 01:41:40.360020 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-24 01:41:40.360023 | orchestrator | + content_md5 = (known after apply) 2026-04-24 01:41:40.360027 | orchestrator | + content_sha1 = (known after apply) 2026-04-24 01:41:40.360031 | orchestrator | + content_sha256 = (known after apply) 2026-04-24 01:41:40.360035 | orchestrator | + content_sha512 = (known after apply) 2026-04-24 01:41:40.360038 | orchestrator | + directory_permission = "0700" 2026-04-24 01:41:40.360042 | orchestrator | + file_permission = "0600" 2026-04-24 01:41:40.360046 | orchestrator | + filename = ".id_rsa.ci" 2026-04-24 01:41:40.360049 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360053 | orchestrator | } 2026-04-24 01:41:40.360074 | orchestrator | 2026-04-24 01:41:40.360085 | orchestrator | # null_resource.node_semaphore will be created 2026-04-24 01:41:40.360090 | orchestrator | + resource "null_resource" "node_semaphore" { 2026-04-24 01:41:40.360093 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360098 | orchestrator | } 2026-04-24 01:41:40.360164 | orchestrator | 2026-04-24 01:41:40.360176 | orchestrator | # openstack_blockstorage_volume_v3.manager_base_volume[0] will be created 2026-04-24 01:41:40.360181 | orchestrator | + resource "openstack_blockstorage_volume_v3" "manager_base_volume" { 2026-04-24 01:41:40.360185 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.360188 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.360192 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360196 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.360200 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.360203 | orchestrator | + name = "testbed-volume-manager-base" 2026-04-24 01:41:40.360207 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.360211 | orchestrator | + size = 80 2026-04-24 01:41:40.360215 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.360218 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.360222 | orchestrator | } 2026-04-24 01:41:40.360289 | orchestrator | 2026-04-24 01:41:40.360301 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[0] will be created 2026-04-24 01:41:40.360306 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-24 01:41:40.360310 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.360313 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.360317 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360325 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.360329 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.360332 | orchestrator | + name = "testbed-volume-0-node-base" 2026-04-24 01:41:40.360336 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.360340 | orchestrator | + size = 80 2026-04-24 01:41:40.360344 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.360347 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.360351 | orchestrator | } 2026-04-24 01:41:40.360446 | orchestrator | 2026-04-24 01:41:40.360462 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[1] will be created 2026-04-24 01:41:40.360467 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-24 01:41:40.360471 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.360474 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.360479 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360482 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.360486 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.360490 | orchestrator | + name = "testbed-volume-1-node-base" 2026-04-24 01:41:40.360493 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.360497 | orchestrator | + size = 80 2026-04-24 01:41:40.360501 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.360505 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.360508 | orchestrator | } 2026-04-24 01:41:40.360576 | orchestrator | 2026-04-24 01:41:40.360587 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[2] will be created 2026-04-24 01:41:40.360592 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-24 01:41:40.360595 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.360599 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.360603 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360606 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.360610 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.360614 | orchestrator | + name = "testbed-volume-2-node-base" 2026-04-24 01:41:40.360618 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.360621 | orchestrator | + size = 80 2026-04-24 01:41:40.360625 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.360629 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.360632 | orchestrator | } 2026-04-24 01:41:40.360717 | orchestrator | 2026-04-24 01:41:40.360729 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[3] will be created 2026-04-24 01:41:40.360733 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-24 01:41:40.360737 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.360741 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.360745 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360748 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.360752 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.360760 | orchestrator | + name = "testbed-volume-3-node-base" 2026-04-24 01:41:40.360764 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.360767 | orchestrator | + size = 80 2026-04-24 01:41:40.360771 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.360775 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.360778 | orchestrator | } 2026-04-24 01:41:40.360838 | orchestrator | 2026-04-24 01:41:40.360849 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[4] will be created 2026-04-24 01:41:40.360854 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-24 01:41:40.360858 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.360861 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.360865 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360873 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.360877 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.360881 | orchestrator | + name = "testbed-volume-4-node-base" 2026-04-24 01:41:40.360885 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.360888 | orchestrator | + size = 80 2026-04-24 01:41:40.360892 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.360896 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.360899 | orchestrator | } 2026-04-24 01:41:40.360961 | orchestrator | 2026-04-24 01:41:40.360973 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[5] will be created 2026-04-24 01:41:40.360978 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-24 01:41:40.360981 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.360985 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.360989 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.360992 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.360996 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.361000 | orchestrator | + name = "testbed-volume-5-node-base" 2026-04-24 01:41:40.361004 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.361007 | orchestrator | + size = 80 2026-04-24 01:41:40.361011 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.361015 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.361018 | orchestrator | } 2026-04-24 01:41:40.361076 | orchestrator | 2026-04-24 01:41:40.361087 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[0] will be created 2026-04-24 01:41:40.361092 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.361096 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.361100 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.361103 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.361107 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.361111 | orchestrator | + name = "testbed-volume-0-node-3" 2026-04-24 01:41:40.361115 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.361118 | orchestrator | + size = 20 2026-04-24 01:41:40.361122 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.361126 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.361130 | orchestrator | } 2026-04-24 01:41:40.361182 | orchestrator | 2026-04-24 01:41:40.361193 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[1] will be created 2026-04-24 01:41:40.361198 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.361201 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.361205 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.361209 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.361213 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.361216 | orchestrator | + name = "testbed-volume-1-node-4" 2026-04-24 01:41:40.361220 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.361224 | orchestrator | + size = 20 2026-04-24 01:41:40.361227 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.361231 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.361235 | orchestrator | } 2026-04-24 01:41:40.361294 | orchestrator | 2026-04-24 01:41:40.361305 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[2] will be created 2026-04-24 01:41:40.361310 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.361314 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.361317 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.361321 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.361325 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.361329 | orchestrator | + name = "testbed-volume-2-node-5" 2026-04-24 01:41:40.361332 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.361396 | orchestrator | + size = 20 2026-04-24 01:41:40.361400 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.361404 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.361407 | orchestrator | } 2026-04-24 01:41:40.361464 | orchestrator | 2026-04-24 01:41:40.361475 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[3] will be created 2026-04-24 01:41:40.361479 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.361483 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.361487 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.361490 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.361494 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.361498 | orchestrator | + name = "testbed-volume-3-node-3" 2026-04-24 01:41:40.361501 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.361505 | orchestrator | + size = 20 2026-04-24 01:41:40.361509 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.361513 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.361516 | orchestrator | } 2026-04-24 01:41:40.361573 | orchestrator | 2026-04-24 01:41:40.361584 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[4] will be created 2026-04-24 01:41:40.361589 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.361593 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.361596 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.361600 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.361604 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.361607 | orchestrator | + name = "testbed-volume-4-node-4" 2026-04-24 01:41:40.361611 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.361618 | orchestrator | + size = 20 2026-04-24 01:41:40.361622 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.361626 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.361630 | orchestrator | } 2026-04-24 01:41:40.361758 | orchestrator | 2026-04-24 01:41:40.361770 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[5] will be created 2026-04-24 01:41:40.361774 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.361778 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.361782 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.361786 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.361789 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.361793 | orchestrator | + name = "testbed-volume-5-node-5" 2026-04-24 01:41:40.361797 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.361801 | orchestrator | + size = 20 2026-04-24 01:41:40.361804 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.361808 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.361812 | orchestrator | } 2026-04-24 01:41:40.361877 | orchestrator | 2026-04-24 01:41:40.361889 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[6] will be created 2026-04-24 01:41:40.361893 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.361897 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.361900 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.361904 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.361908 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.361912 | orchestrator | + name = "testbed-volume-6-node-3" 2026-04-24 01:41:40.361915 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.361919 | orchestrator | + size = 20 2026-04-24 01:41:40.361923 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.361926 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.361930 | orchestrator | } 2026-04-24 01:41:40.361991 | orchestrator | 2026-04-24 01:41:40.362002 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[7] will be created 2026-04-24 01:41:40.362007 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.362046 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.362051 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.362055 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.362059 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.362062 | orchestrator | + name = "testbed-volume-7-node-4" 2026-04-24 01:41:40.362066 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.362070 | orchestrator | + size = 20 2026-04-24 01:41:40.362073 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.362077 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.362081 | orchestrator | } 2026-04-24 01:41:40.362148 | orchestrator | 2026-04-24 01:41:40.362160 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[8] will be created 2026-04-24 01:41:40.362164 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-24 01:41:40.362168 | orchestrator | + attachment = (known after apply) 2026-04-24 01:41:40.362172 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.362175 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.362179 | orchestrator | + metadata = (known after apply) 2026-04-24 01:41:40.362183 | orchestrator | + name = "testbed-volume-8-node-5" 2026-04-24 01:41:40.362187 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.362190 | orchestrator | + size = 20 2026-04-24 01:41:40.362194 | orchestrator | + volume_retype_policy = "never" 2026-04-24 01:41:40.362198 | orchestrator | + volume_type = "ssd" 2026-04-24 01:41:40.362201 | orchestrator | } 2026-04-24 01:41:40.362407 | orchestrator | 2026-04-24 01:41:40.362419 | orchestrator | # openstack_compute_instance_v2.manager_server will be created 2026-04-24 01:41:40.362423 | orchestrator | + resource "openstack_compute_instance_v2" "manager_server" { 2026-04-24 01:41:40.362427 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-24 01:41:40.362431 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-24 01:41:40.362435 | orchestrator | + all_metadata = (known after apply) 2026-04-24 01:41:40.362439 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.362443 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.362446 | orchestrator | + config_drive = true 2026-04-24 01:41:40.362450 | orchestrator | + created = (known after apply) 2026-04-24 01:41:40.362454 | orchestrator | + flavor_id = (known after apply) 2026-04-24 01:41:40.362457 | orchestrator | + flavor_name = "OSISM-4V-16" 2026-04-24 01:41:40.362461 | orchestrator | + force_delete = false 2026-04-24 01:41:40.362465 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-24 01:41:40.362468 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.362472 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.362476 | orchestrator | + image_name = (known after apply) 2026-04-24 01:41:40.362479 | orchestrator | + key_pair = "testbed" 2026-04-24 01:41:40.362483 | orchestrator | + name = "testbed-manager" 2026-04-24 01:41:40.362487 | orchestrator | + power_state = "active" 2026-04-24 01:41:40.362490 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.362494 | orchestrator | + security_groups = (known after apply) 2026-04-24 01:41:40.362498 | orchestrator | + stop_before_destroy = false 2026-04-24 01:41:40.362501 | orchestrator | + updated = (known after apply) 2026-04-24 01:41:40.362505 | orchestrator | + user_data = (sensitive value) 2026-04-24 01:41:40.362509 | orchestrator | 2026-04-24 01:41:40.362513 | orchestrator | + block_device { 2026-04-24 01:41:40.362516 | orchestrator | + boot_index = 0 2026-04-24 01:41:40.362520 | orchestrator | + delete_on_termination = false 2026-04-24 01:41:40.362529 | orchestrator | + destination_type = "volume" 2026-04-24 01:41:40.362533 | orchestrator | + multiattach = false 2026-04-24 01:41:40.362536 | orchestrator | + source_type = "volume" 2026-04-24 01:41:40.362540 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.362553 | orchestrator | } 2026-04-24 01:41:40.362556 | orchestrator | 2026-04-24 01:41:40.362560 | orchestrator | + network { 2026-04-24 01:41:40.362564 | orchestrator | + access_network = false 2026-04-24 01:41:40.362568 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-24 01:41:40.362571 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-24 01:41:40.362575 | orchestrator | + mac = (known after apply) 2026-04-24 01:41:40.362579 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.362582 | orchestrator | + port = (known after apply) 2026-04-24 01:41:40.362586 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.362590 | orchestrator | } 2026-04-24 01:41:40.362593 | orchestrator | } 2026-04-24 01:41:40.362820 | orchestrator | 2026-04-24 01:41:40.362834 | orchestrator | # openstack_compute_instance_v2.node_server[0] will be created 2026-04-24 01:41:40.362838 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-24 01:41:40.362842 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-24 01:41:40.362846 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-24 01:41:40.362850 | orchestrator | + all_metadata = (known after apply) 2026-04-24 01:41:40.362853 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.362857 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.362861 | orchestrator | + config_drive = true 2026-04-24 01:41:40.362864 | orchestrator | + created = (known after apply) 2026-04-24 01:41:40.362868 | orchestrator | + flavor_id = (known after apply) 2026-04-24 01:41:40.362872 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-24 01:41:40.362876 | orchestrator | + force_delete = false 2026-04-24 01:41:40.362879 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-24 01:41:40.362883 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.362887 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.362890 | orchestrator | + image_name = (known after apply) 2026-04-24 01:41:40.362894 | orchestrator | + key_pair = "testbed" 2026-04-24 01:41:40.362898 | orchestrator | + name = "testbed-node-0" 2026-04-24 01:41:40.362901 | orchestrator | + power_state = "active" 2026-04-24 01:41:40.362905 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.362909 | orchestrator | + security_groups = (known after apply) 2026-04-24 01:41:40.362913 | orchestrator | + stop_before_destroy = false 2026-04-24 01:41:40.362916 | orchestrator | + updated = (known after apply) 2026-04-24 01:41:40.362920 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-24 01:41:40.362924 | orchestrator | 2026-04-24 01:41:40.362927 | orchestrator | + block_device { 2026-04-24 01:41:40.362931 | orchestrator | + boot_index = 0 2026-04-24 01:41:40.362935 | orchestrator | + delete_on_termination = false 2026-04-24 01:41:40.362939 | orchestrator | + destination_type = "volume" 2026-04-24 01:41:40.362942 | orchestrator | + multiattach = false 2026-04-24 01:41:40.362946 | orchestrator | + source_type = "volume" 2026-04-24 01:41:40.362950 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.362953 | orchestrator | } 2026-04-24 01:41:40.362957 | orchestrator | 2026-04-24 01:41:40.362961 | orchestrator | + network { 2026-04-24 01:41:40.362964 | orchestrator | + access_network = false 2026-04-24 01:41:40.362968 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-24 01:41:40.362972 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-24 01:41:40.362976 | orchestrator | + mac = (known after apply) 2026-04-24 01:41:40.362979 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.362983 | orchestrator | + port = (known after apply) 2026-04-24 01:41:40.362987 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.362990 | orchestrator | } 2026-04-24 01:41:40.362994 | orchestrator | } 2026-04-24 01:41:40.363180 | orchestrator | 2026-04-24 01:41:40.363192 | orchestrator | # openstack_compute_instance_v2.node_server[1] will be created 2026-04-24 01:41:40.363197 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-24 01:41:40.363200 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-24 01:41:40.363211 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-24 01:41:40.363215 | orchestrator | + all_metadata = (known after apply) 2026-04-24 01:41:40.363218 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.363222 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.363226 | orchestrator | + config_drive = true 2026-04-24 01:41:40.363229 | orchestrator | + created = (known after apply) 2026-04-24 01:41:40.363233 | orchestrator | + flavor_id = (known after apply) 2026-04-24 01:41:40.363237 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-24 01:41:40.363240 | orchestrator | + force_delete = false 2026-04-24 01:41:40.363244 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-24 01:41:40.363247 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.363251 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.363255 | orchestrator | + image_name = (known after apply) 2026-04-24 01:41:40.363258 | orchestrator | + key_pair = "testbed" 2026-04-24 01:41:40.363262 | orchestrator | + name = "testbed-node-1" 2026-04-24 01:41:40.363266 | orchestrator | + power_state = "active" 2026-04-24 01:41:40.363270 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.363273 | orchestrator | + security_groups = (known after apply) 2026-04-24 01:41:40.363277 | orchestrator | + stop_before_destroy = false 2026-04-24 01:41:40.363281 | orchestrator | + updated = (known after apply) 2026-04-24 01:41:40.363284 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-24 01:41:40.363288 | orchestrator | 2026-04-24 01:41:40.363292 | orchestrator | + block_device { 2026-04-24 01:41:40.363296 | orchestrator | + boot_index = 0 2026-04-24 01:41:40.363299 | orchestrator | + delete_on_termination = false 2026-04-24 01:41:40.363303 | orchestrator | + destination_type = "volume" 2026-04-24 01:41:40.363306 | orchestrator | + multiattach = false 2026-04-24 01:41:40.363310 | orchestrator | + source_type = "volume" 2026-04-24 01:41:40.363314 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.363317 | orchestrator | } 2026-04-24 01:41:40.363321 | orchestrator | 2026-04-24 01:41:40.363325 | orchestrator | + network { 2026-04-24 01:41:40.363329 | orchestrator | + access_network = false 2026-04-24 01:41:40.363332 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-24 01:41:40.363336 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-24 01:41:40.363340 | orchestrator | + mac = (known after apply) 2026-04-24 01:41:40.363343 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.363347 | orchestrator | + port = (known after apply) 2026-04-24 01:41:40.363351 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.363355 | orchestrator | } 2026-04-24 01:41:40.363358 | orchestrator | } 2026-04-24 01:41:40.363533 | orchestrator | 2026-04-24 01:41:40.363545 | orchestrator | # openstack_compute_instance_v2.node_server[2] will be created 2026-04-24 01:41:40.363549 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-24 01:41:40.363553 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-24 01:41:40.363557 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-24 01:41:40.363561 | orchestrator | + all_metadata = (known after apply) 2026-04-24 01:41:40.363565 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.363573 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.363576 | orchestrator | + config_drive = true 2026-04-24 01:41:40.363580 | orchestrator | + created = (known after apply) 2026-04-24 01:41:40.363584 | orchestrator | + flavor_id = (known after apply) 2026-04-24 01:41:40.363587 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-24 01:41:40.363591 | orchestrator | + force_delete = false 2026-04-24 01:41:40.363595 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-24 01:41:40.363599 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.363602 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.363609 | orchestrator | + image_name = (known after apply) 2026-04-24 01:41:40.363613 | orchestrator | + key_pair = "testbed" 2026-04-24 01:41:40.363617 | orchestrator | + name = "testbed-node-2" 2026-04-24 01:41:40.363621 | orchestrator | + power_state = "active" 2026-04-24 01:41:40.363624 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.363628 | orchestrator | + security_groups = (known after apply) 2026-04-24 01:41:40.363632 | orchestrator | + stop_before_destroy = false 2026-04-24 01:41:40.363635 | orchestrator | + updated = (known after apply) 2026-04-24 01:41:40.363639 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-24 01:41:40.363643 | orchestrator | 2026-04-24 01:41:40.363647 | orchestrator | + block_device { 2026-04-24 01:41:40.363650 | orchestrator | + boot_index = 0 2026-04-24 01:41:40.363654 | orchestrator | + delete_on_termination = false 2026-04-24 01:41:40.363658 | orchestrator | + destination_type = "volume" 2026-04-24 01:41:40.363661 | orchestrator | + multiattach = false 2026-04-24 01:41:40.363681 | orchestrator | + source_type = "volume" 2026-04-24 01:41:40.363685 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.363689 | orchestrator | } 2026-04-24 01:41:40.363692 | orchestrator | 2026-04-24 01:41:40.363696 | orchestrator | + network { 2026-04-24 01:41:40.363700 | orchestrator | + access_network = false 2026-04-24 01:41:40.363704 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-24 01:41:40.363707 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-24 01:41:40.363711 | orchestrator | + mac = (known after apply) 2026-04-24 01:41:40.363715 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.363718 | orchestrator | + port = (known after apply) 2026-04-24 01:41:40.363722 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.363726 | orchestrator | } 2026-04-24 01:41:40.363729 | orchestrator | } 2026-04-24 01:41:40.363919 | orchestrator | 2026-04-24 01:41:40.363932 | orchestrator | # openstack_compute_instance_v2.node_server[3] will be created 2026-04-24 01:41:40.363936 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-24 01:41:40.363940 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-24 01:41:40.363943 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-24 01:41:40.363947 | orchestrator | + all_metadata = (known after apply) 2026-04-24 01:41:40.363951 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.363955 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.363958 | orchestrator | + config_drive = true 2026-04-24 01:41:40.363962 | orchestrator | + created = (known after apply) 2026-04-24 01:41:40.363966 | orchestrator | + flavor_id = (known after apply) 2026-04-24 01:41:40.363970 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-24 01:41:40.363973 | orchestrator | + force_delete = false 2026-04-24 01:41:40.363977 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-24 01:41:40.363981 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.363984 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.363988 | orchestrator | + image_name = (known after apply) 2026-04-24 01:41:40.363992 | orchestrator | + key_pair = "testbed" 2026-04-24 01:41:40.363996 | orchestrator | + name = "testbed-node-3" 2026-04-24 01:41:40.363999 | orchestrator | + power_state = "active" 2026-04-24 01:41:40.364003 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.364007 | orchestrator | + security_groups = (known after apply) 2026-04-24 01:41:40.364010 | orchestrator | + stop_before_destroy = false 2026-04-24 01:41:40.364014 | orchestrator | + updated = (known after apply) 2026-04-24 01:41:40.364018 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-24 01:41:40.364022 | orchestrator | 2026-04-24 01:41:40.364025 | orchestrator | + block_device { 2026-04-24 01:41:40.364033 | orchestrator | + boot_index = 0 2026-04-24 01:41:40.364037 | orchestrator | + delete_on_termination = false 2026-04-24 01:41:40.364041 | orchestrator | + destination_type = "volume" 2026-04-24 01:41:40.364048 | orchestrator | + multiattach = false 2026-04-24 01:41:40.364052 | orchestrator | + source_type = "volume" 2026-04-24 01:41:40.364055 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.364059 | orchestrator | } 2026-04-24 01:41:40.364063 | orchestrator | 2026-04-24 01:41:40.364066 | orchestrator | + network { 2026-04-24 01:41:40.364070 | orchestrator | + access_network = false 2026-04-24 01:41:40.364074 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-24 01:41:40.364077 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-24 01:41:40.364081 | orchestrator | + mac = (known after apply) 2026-04-24 01:41:40.364085 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.364088 | orchestrator | + port = (known after apply) 2026-04-24 01:41:40.364092 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.364096 | orchestrator | } 2026-04-24 01:41:40.364100 | orchestrator | } 2026-04-24 01:41:40.364287 | orchestrator | 2026-04-24 01:41:40.364300 | orchestrator | # openstack_compute_instance_v2.node_server[4] will be created 2026-04-24 01:41:40.364304 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-24 01:41:40.364308 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-24 01:41:40.364312 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-24 01:41:40.364315 | orchestrator | + all_metadata = (known after apply) 2026-04-24 01:41:40.364319 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.364323 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.364326 | orchestrator | + config_drive = true 2026-04-24 01:41:40.364330 | orchestrator | + created = (known after apply) 2026-04-24 01:41:40.364334 | orchestrator | + flavor_id = (known after apply) 2026-04-24 01:41:40.364337 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-24 01:41:40.364341 | orchestrator | + force_delete = false 2026-04-24 01:41:40.364345 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-24 01:41:40.364348 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.364352 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.364356 | orchestrator | + image_name = (known after apply) 2026-04-24 01:41:40.364359 | orchestrator | + key_pair = "testbed" 2026-04-24 01:41:40.364363 | orchestrator | + name = "testbed-node-4" 2026-04-24 01:41:40.364367 | orchestrator | + power_state = "active" 2026-04-24 01:41:40.364371 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.364374 | orchestrator | + security_groups = (known after apply) 2026-04-24 01:41:40.364378 | orchestrator | + stop_before_destroy = false 2026-04-24 01:41:40.364382 | orchestrator | + updated = (known after apply) 2026-04-24 01:41:40.364385 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-24 01:41:40.364389 | orchestrator | 2026-04-24 01:41:40.364393 | orchestrator | + block_device { 2026-04-24 01:41:40.364397 | orchestrator | + boot_index = 0 2026-04-24 01:41:40.364400 | orchestrator | + delete_on_termination = false 2026-04-24 01:41:40.364404 | orchestrator | + destination_type = "volume" 2026-04-24 01:41:40.364408 | orchestrator | + multiattach = false 2026-04-24 01:41:40.364412 | orchestrator | + source_type = "volume" 2026-04-24 01:41:40.364415 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.364419 | orchestrator | } 2026-04-24 01:41:40.364423 | orchestrator | 2026-04-24 01:41:40.364426 | orchestrator | + network { 2026-04-24 01:41:40.364430 | orchestrator | + access_network = false 2026-04-24 01:41:40.364434 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-24 01:41:40.364437 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-24 01:41:40.364441 | orchestrator | + mac = (known after apply) 2026-04-24 01:41:40.364445 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.364449 | orchestrator | + port = (known after apply) 2026-04-24 01:41:40.364452 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.364456 | orchestrator | } 2026-04-24 01:41:40.364460 | orchestrator | } 2026-04-24 01:41:40.364686 | orchestrator | 2026-04-24 01:41:40.364699 | orchestrator | # openstack_compute_instance_v2.node_server[5] will be created 2026-04-24 01:41:40.364704 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-24 01:41:40.364707 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-24 01:41:40.364711 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-24 01:41:40.364715 | orchestrator | + all_metadata = (known after apply) 2026-04-24 01:41:40.364719 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.364722 | orchestrator | + availability_zone = "nova" 2026-04-24 01:41:40.364726 | orchestrator | + config_drive = true 2026-04-24 01:41:40.364730 | orchestrator | + created = (known after apply) 2026-04-24 01:41:40.364734 | orchestrator | + flavor_id = (known after apply) 2026-04-24 01:41:40.364737 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-24 01:41:40.364741 | orchestrator | + force_delete = false 2026-04-24 01:41:40.364748 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-24 01:41:40.364752 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.364756 | orchestrator | + image_id = (known after apply) 2026-04-24 01:41:40.364759 | orchestrator | + image_name = (known after apply) 2026-04-24 01:41:40.364763 | orchestrator | + key_pair = "testbed" 2026-04-24 01:41:40.364767 | orchestrator | + name = "testbed-node-5" 2026-04-24 01:41:40.364771 | orchestrator | + power_state = "active" 2026-04-24 01:41:40.364774 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.364778 | orchestrator | + security_groups = (known after apply) 2026-04-24 01:41:40.364782 | orchestrator | + stop_before_destroy = false 2026-04-24 01:41:40.364785 | orchestrator | + updated = (known after apply) 2026-04-24 01:41:40.364789 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-24 01:41:40.364793 | orchestrator | 2026-04-24 01:41:40.364797 | orchestrator | + block_device { 2026-04-24 01:41:40.364800 | orchestrator | + boot_index = 0 2026-04-24 01:41:40.364804 | orchestrator | + delete_on_termination = false 2026-04-24 01:41:40.364808 | orchestrator | + destination_type = "volume" 2026-04-24 01:41:40.364811 | orchestrator | + multiattach = false 2026-04-24 01:41:40.364815 | orchestrator | + source_type = "volume" 2026-04-24 01:41:40.364819 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.364822 | orchestrator | } 2026-04-24 01:41:40.364826 | orchestrator | 2026-04-24 01:41:40.364830 | orchestrator | + network { 2026-04-24 01:41:40.364833 | orchestrator | + access_network = false 2026-04-24 01:41:40.364837 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-24 01:41:40.364841 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-24 01:41:40.364845 | orchestrator | + mac = (known after apply) 2026-04-24 01:41:40.364848 | orchestrator | + name = (known after apply) 2026-04-24 01:41:40.364852 | orchestrator | + port = (known after apply) 2026-04-24 01:41:40.364856 | orchestrator | + uuid = (known after apply) 2026-04-24 01:41:40.364859 | orchestrator | } 2026-04-24 01:41:40.364863 | orchestrator | } 2026-04-24 01:41:40.364910 | orchestrator | 2026-04-24 01:41:40.364922 | orchestrator | # openstack_compute_keypair_v2.key will be created 2026-04-24 01:41:40.364926 | orchestrator | + resource "openstack_compute_keypair_v2" "key" { 2026-04-24 01:41:40.364930 | orchestrator | + fingerprint = (known after apply) 2026-04-24 01:41:40.364934 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.364938 | orchestrator | + name = "testbed" 2026-04-24 01:41:40.364941 | orchestrator | + private_key = (sensitive value) 2026-04-24 01:41:40.364945 | orchestrator | + public_key = (known after apply) 2026-04-24 01:41:40.364949 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.364952 | orchestrator | + user_id = (known after apply) 2026-04-24 01:41:40.364956 | orchestrator | } 2026-04-24 01:41:40.364998 | orchestrator | 2026-04-24 01:41:40.365010 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[0] will be created 2026-04-24 01:41:40.365014 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365022 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365026 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365030 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365034 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365037 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365041 | orchestrator | } 2026-04-24 01:41:40.365077 | orchestrator | 2026-04-24 01:41:40.365089 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[1] will be created 2026-04-24 01:41:40.365093 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365097 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365101 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365105 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365109 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365112 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365116 | orchestrator | } 2026-04-24 01:41:40.365156 | orchestrator | 2026-04-24 01:41:40.365168 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[2] will be created 2026-04-24 01:41:40.365172 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365176 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365180 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365183 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365187 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365191 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365194 | orchestrator | } 2026-04-24 01:41:40.365236 | orchestrator | 2026-04-24 01:41:40.365248 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[3] will be created 2026-04-24 01:41:40.365252 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365256 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365259 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365263 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365267 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365270 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365274 | orchestrator | } 2026-04-24 01:41:40.365309 | orchestrator | 2026-04-24 01:41:40.365320 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[4] will be created 2026-04-24 01:41:40.365325 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365329 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365332 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365336 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365343 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365347 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365351 | orchestrator | } 2026-04-24 01:41:40.365388 | orchestrator | 2026-04-24 01:41:40.365399 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[5] will be created 2026-04-24 01:41:40.365404 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365407 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365411 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365415 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365419 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365422 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365426 | orchestrator | } 2026-04-24 01:41:40.365467 | orchestrator | 2026-04-24 01:41:40.365479 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[6] will be created 2026-04-24 01:41:40.365484 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365488 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365491 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365495 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365499 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365507 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365510 | orchestrator | } 2026-04-24 01:41:40.365547 | orchestrator | 2026-04-24 01:41:40.365560 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[7] will be created 2026-04-24 01:41:40.365564 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365568 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365571 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365575 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365579 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365583 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365586 | orchestrator | } 2026-04-24 01:41:40.365620 | orchestrator | 2026-04-24 01:41:40.365632 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[8] will be created 2026-04-24 01:41:40.365636 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-24 01:41:40.365640 | orchestrator | + device = (known after apply) 2026-04-24 01:41:40.365643 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365647 | orchestrator | + instance_id = (known after apply) 2026-04-24 01:41:40.365651 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365654 | orchestrator | + volume_id = (known after apply) 2026-04-24 01:41:40.365658 | orchestrator | } 2026-04-24 01:41:40.365745 | orchestrator | 2026-04-24 01:41:40.365758 | orchestrator | # openstack_networking_floatingip_associate_v2.manager_floating_ip_association will be created 2026-04-24 01:41:40.365764 | orchestrator | + resource "openstack_networking_floatingip_associate_v2" "manager_floating_ip_association" { 2026-04-24 01:41:40.365768 | orchestrator | + fixed_ip = (known after apply) 2026-04-24 01:41:40.365772 | orchestrator | + floating_ip = (known after apply) 2026-04-24 01:41:40.365775 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365779 | orchestrator | + port_id = (known after apply) 2026-04-24 01:41:40.365783 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365786 | orchestrator | } 2026-04-24 01:41:40.365849 | orchestrator | 2026-04-24 01:41:40.365861 | orchestrator | # openstack_networking_floatingip_v2.manager_floating_ip will be created 2026-04-24 01:41:40.365866 | orchestrator | + resource "openstack_networking_floatingip_v2" "manager_floating_ip" { 2026-04-24 01:41:40.365869 | orchestrator | + address = (known after apply) 2026-04-24 01:41:40.365873 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.365877 | orchestrator | + dns_domain = (known after apply) 2026-04-24 01:41:40.365881 | orchestrator | + dns_name = (known after apply) 2026-04-24 01:41:40.365884 | orchestrator | + fixed_ip = (known after apply) 2026-04-24 01:41:40.365888 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.365892 | orchestrator | + pool = "public" 2026-04-24 01:41:40.365896 | orchestrator | + port_id = (known after apply) 2026-04-24 01:41:40.365899 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.365903 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.365907 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.365911 | orchestrator | } 2026-04-24 01:41:40.366004 | orchestrator | 2026-04-24 01:41:40.366036 | orchestrator | # openstack_networking_network_v2.net_management will be created 2026-04-24 01:41:40.366041 | orchestrator | + resource "openstack_networking_network_v2" "net_management" { 2026-04-24 01:41:40.366045 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.366048 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.366052 | orchestrator | + availability_zone_hints = [ 2026-04-24 01:41:40.366056 | orchestrator | + "nova", 2026-04-24 01:41:40.366060 | orchestrator | ] 2026-04-24 01:41:40.366064 | orchestrator | + dns_domain = (known after apply) 2026-04-24 01:41:40.366067 | orchestrator | + external = (known after apply) 2026-04-24 01:41:40.366071 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.366075 | orchestrator | + mtu = (known after apply) 2026-04-24 01:41:40.366078 | orchestrator | + name = "net-testbed-management" 2026-04-24 01:41:40.366082 | orchestrator | + port_security_enabled = (known after apply) 2026-04-24 01:41:40.366091 | orchestrator | + qos_policy_id = (known after apply) 2026-04-24 01:41:40.366094 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.366098 | orchestrator | + shared = (known after apply) 2026-04-24 01:41:40.366102 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.366105 | orchestrator | + transparent_vlan = (known after apply) 2026-04-24 01:41:40.366109 | orchestrator | 2026-04-24 01:41:40.366113 | orchestrator | + segments (known after apply) 2026-04-24 01:41:40.366117 | orchestrator | } 2026-04-24 01:41:40.366257 | orchestrator | 2026-04-24 01:41:40.366274 | orchestrator | # openstack_networking_port_v2.manager_port_management will be created 2026-04-24 01:41:40.366278 | orchestrator | + resource "openstack_networking_port_v2" "manager_port_management" { 2026-04-24 01:41:40.366282 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.366286 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-24 01:41:40.366290 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-24 01:41:40.366297 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.366301 | orchestrator | + device_id = (known after apply) 2026-04-24 01:41:40.366305 | orchestrator | + device_owner = (known after apply) 2026-04-24 01:41:40.366308 | orchestrator | + dns_assignment = (known after apply) 2026-04-24 01:41:40.366312 | orchestrator | + dns_name = (known after apply) 2026-04-24 01:41:40.366316 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.366319 | orchestrator | + mac_address = (known after apply) 2026-04-24 01:41:40.366323 | orchestrator | + network_id = (known after apply) 2026-04-24 01:41:40.366326 | orchestrator | + port_security_enabled = (known after apply) 2026-04-24 01:41:40.366330 | orchestrator | + qos_policy_id = (known after apply) 2026-04-24 01:41:40.366334 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.366338 | orchestrator | + security_group_ids = (known after apply) 2026-04-24 01:41:40.366341 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.366345 | orchestrator | 2026-04-24 01:41:40.366349 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.366352 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-24 01:41:40.366356 | orchestrator | } 2026-04-24 01:41:40.366360 | orchestrator | 2026-04-24 01:41:40.366364 | orchestrator | + binding (known after apply) 2026-04-24 01:41:40.366367 | orchestrator | 2026-04-24 01:41:40.366371 | orchestrator | + fixed_ip { 2026-04-24 01:41:40.366375 | orchestrator | + ip_address = "192.168.16.5" 2026-04-24 01:41:40.366379 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.366382 | orchestrator | } 2026-04-24 01:41:40.366386 | orchestrator | } 2026-04-24 01:41:40.366554 | orchestrator | 2026-04-24 01:41:40.366567 | orchestrator | # openstack_networking_port_v2.node_port_management[0] will be created 2026-04-24 01:41:40.366572 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-24 01:41:40.366575 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.366579 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-24 01:41:40.366583 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-24 01:41:40.366586 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.366590 | orchestrator | + device_id = (known after apply) 2026-04-24 01:41:40.366594 | orchestrator | + device_owner = (known after apply) 2026-04-24 01:41:40.366597 | orchestrator | + dns_assignment = (known after apply) 2026-04-24 01:41:40.366601 | orchestrator | + dns_name = (known after apply) 2026-04-24 01:41:40.366605 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.366609 | orchestrator | + mac_address = (known after apply) 2026-04-24 01:41:40.366612 | orchestrator | + network_id = (known after apply) 2026-04-24 01:41:40.366616 | orchestrator | + port_security_enabled = (known after apply) 2026-04-24 01:41:40.366620 | orchestrator | + qos_policy_id = (known after apply) 2026-04-24 01:41:40.366623 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.366635 | orchestrator | + security_group_ids = (known after apply) 2026-04-24 01:41:40.366639 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.366642 | orchestrator | 2026-04-24 01:41:40.366646 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.366650 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-24 01:41:40.366654 | orchestrator | } 2026-04-24 01:41:40.366657 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.366661 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-24 01:41:40.366683 | orchestrator | } 2026-04-24 01:41:40.366687 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.366692 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-24 01:41:40.366698 | orchestrator | } 2026-04-24 01:41:40.366704 | orchestrator | 2026-04-24 01:41:40.366710 | orchestrator | + binding (known after apply) 2026-04-24 01:41:40.366715 | orchestrator | 2026-04-24 01:41:40.366721 | orchestrator | + fixed_ip { 2026-04-24 01:41:40.366728 | orchestrator | + ip_address = "192.168.16.10" 2026-04-24 01:41:40.366734 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.366739 | orchestrator | } 2026-04-24 01:41:40.366748 | orchestrator | } 2026-04-24 01:41:40.366936 | orchestrator | 2026-04-24 01:41:40.366952 | orchestrator | # openstack_networking_port_v2.node_port_management[1] will be created 2026-04-24 01:41:40.366957 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-24 01:41:40.366960 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.366964 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-24 01:41:40.366968 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-24 01:41:40.366971 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.366975 | orchestrator | + device_id = (known after apply) 2026-04-24 01:41:40.366979 | orchestrator | + device_owner = (known after apply) 2026-04-24 01:41:40.366983 | orchestrator | + dns_assignment = (known after apply) 2026-04-24 01:41:40.366986 | orchestrator | + dns_name = (known after apply) 2026-04-24 01:41:40.366990 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.366994 | orchestrator | + mac_address = (known after apply) 2026-04-24 01:41:40.366997 | orchestrator | + network_id = (known after apply) 2026-04-24 01:41:40.367001 | orchestrator | + port_security_enabled = (known after apply) 2026-04-24 01:41:40.367004 | orchestrator | + qos_policy_id = (known after apply) 2026-04-24 01:41:40.367008 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.367012 | orchestrator | + security_group_ids = (known after apply) 2026-04-24 01:41:40.367016 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.367019 | orchestrator | 2026-04-24 01:41:40.367023 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367027 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-24 01:41:40.367030 | orchestrator | } 2026-04-24 01:41:40.367034 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367038 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-24 01:41:40.367041 | orchestrator | } 2026-04-24 01:41:40.367045 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367049 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-24 01:41:40.367053 | orchestrator | } 2026-04-24 01:41:40.367056 | orchestrator | 2026-04-24 01:41:40.367060 | orchestrator | + binding (known after apply) 2026-04-24 01:41:40.367064 | orchestrator | 2026-04-24 01:41:40.367067 | orchestrator | + fixed_ip { 2026-04-24 01:41:40.367071 | orchestrator | + ip_address = "192.168.16.11" 2026-04-24 01:41:40.367075 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.367079 | orchestrator | } 2026-04-24 01:41:40.367082 | orchestrator | } 2026-04-24 01:41:40.367254 | orchestrator | 2026-04-24 01:41:40.367269 | orchestrator | # openstack_networking_port_v2.node_port_management[2] will be created 2026-04-24 01:41:40.367274 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-24 01:41:40.367277 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.367282 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-24 01:41:40.367285 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-24 01:41:40.367292 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.367306 | orchestrator | + device_id = (known after apply) 2026-04-24 01:41:40.367313 | orchestrator | + device_owner = (known after apply) 2026-04-24 01:41:40.367320 | orchestrator | + dns_assignment = (known after apply) 2026-04-24 01:41:40.367326 | orchestrator | + dns_name = (known after apply) 2026-04-24 01:41:40.367338 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.367344 | orchestrator | + mac_address = (known after apply) 2026-04-24 01:41:40.367349 | orchestrator | + network_id = (known after apply) 2026-04-24 01:41:40.367355 | orchestrator | + port_security_enabled = (known after apply) 2026-04-24 01:41:40.367361 | orchestrator | + qos_policy_id = (known after apply) 2026-04-24 01:41:40.367368 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.367375 | orchestrator | + security_group_ids = (known after apply) 2026-04-24 01:41:40.367381 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.367388 | orchestrator | 2026-04-24 01:41:40.367394 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367401 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-24 01:41:40.367408 | orchestrator | } 2026-04-24 01:41:40.367414 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367422 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-24 01:41:40.367425 | orchestrator | } 2026-04-24 01:41:40.367429 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367433 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-24 01:41:40.367437 | orchestrator | } 2026-04-24 01:41:40.367440 | orchestrator | 2026-04-24 01:41:40.367444 | orchestrator | + binding (known after apply) 2026-04-24 01:41:40.367448 | orchestrator | 2026-04-24 01:41:40.367452 | orchestrator | + fixed_ip { 2026-04-24 01:41:40.367455 | orchestrator | + ip_address = "192.168.16.12" 2026-04-24 01:41:40.367459 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.367463 | orchestrator | } 2026-04-24 01:41:40.367467 | orchestrator | } 2026-04-24 01:41:40.367619 | orchestrator | 2026-04-24 01:41:40.367637 | orchestrator | # openstack_networking_port_v2.node_port_management[3] will be created 2026-04-24 01:41:40.367644 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-24 01:41:40.367650 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.367656 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-24 01:41:40.367660 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-24 01:41:40.367664 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.367709 | orchestrator | + device_id = (known after apply) 2026-04-24 01:41:40.367713 | orchestrator | + device_owner = (known after apply) 2026-04-24 01:41:40.367717 | orchestrator | + dns_assignment = (known after apply) 2026-04-24 01:41:40.367721 | orchestrator | + dns_name = (known after apply) 2026-04-24 01:41:40.367725 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.367729 | orchestrator | + mac_address = (known after apply) 2026-04-24 01:41:40.367733 | orchestrator | + network_id = (known after apply) 2026-04-24 01:41:40.367737 | orchestrator | + port_security_enabled = (known after apply) 2026-04-24 01:41:40.367740 | orchestrator | + qos_policy_id = (known after apply) 2026-04-24 01:41:40.367744 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.367748 | orchestrator | + security_group_ids = (known after apply) 2026-04-24 01:41:40.367752 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.367755 | orchestrator | 2026-04-24 01:41:40.367759 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367763 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-24 01:41:40.367767 | orchestrator | } 2026-04-24 01:41:40.367771 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367774 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-24 01:41:40.367778 | orchestrator | } 2026-04-24 01:41:40.367782 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.367786 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-24 01:41:40.367790 | orchestrator | } 2026-04-24 01:41:40.367793 | orchestrator | 2026-04-24 01:41:40.367804 | orchestrator | + binding (known after apply) 2026-04-24 01:41:40.367808 | orchestrator | 2026-04-24 01:41:40.367812 | orchestrator | + fixed_ip { 2026-04-24 01:41:40.367816 | orchestrator | + ip_address = "192.168.16.13" 2026-04-24 01:41:40.367819 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.367823 | orchestrator | } 2026-04-24 01:41:40.367827 | orchestrator | } 2026-04-24 01:41:40.367995 | orchestrator | 2026-04-24 01:41:40.368009 | orchestrator | # openstack_networking_port_v2.node_port_management[4] will be created 2026-04-24 01:41:40.368014 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-24 01:41:40.368017 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.368021 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-24 01:41:40.368025 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-24 01:41:40.368029 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.368033 | orchestrator | + device_id = (known after apply) 2026-04-24 01:41:40.368036 | orchestrator | + device_owner = (known after apply) 2026-04-24 01:41:40.368040 | orchestrator | + dns_assignment = (known after apply) 2026-04-24 01:41:40.368044 | orchestrator | + dns_name = (known after apply) 2026-04-24 01:41:40.368047 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.368051 | orchestrator | + mac_address = (known after apply) 2026-04-24 01:41:40.368055 | orchestrator | + network_id = (known after apply) 2026-04-24 01:41:40.368058 | orchestrator | + port_security_enabled = (known after apply) 2026-04-24 01:41:40.368062 | orchestrator | + qos_policy_id = (known after apply) 2026-04-24 01:41:40.368066 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.368072 | orchestrator | + security_group_ids = (known after apply) 2026-04-24 01:41:40.368079 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.368087 | orchestrator | 2026-04-24 01:41:40.368093 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.368099 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-24 01:41:40.368105 | orchestrator | } 2026-04-24 01:41:40.368110 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.368116 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-24 01:41:40.368122 | orchestrator | } 2026-04-24 01:41:40.368128 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.368134 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-24 01:41:40.368140 | orchestrator | } 2026-04-24 01:41:40.368147 | orchestrator | 2026-04-24 01:41:40.368153 | orchestrator | + binding (known after apply) 2026-04-24 01:41:40.368159 | orchestrator | 2026-04-24 01:41:40.368165 | orchestrator | + fixed_ip { 2026-04-24 01:41:40.368169 | orchestrator | + ip_address = "192.168.16.14" 2026-04-24 01:41:40.368173 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.368177 | orchestrator | } 2026-04-24 01:41:40.368181 | orchestrator | } 2026-04-24 01:41:40.368361 | orchestrator | 2026-04-24 01:41:40.368375 | orchestrator | # openstack_networking_port_v2.node_port_management[5] will be created 2026-04-24 01:41:40.368380 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-24 01:41:40.368384 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.368387 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-24 01:41:40.368391 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-24 01:41:40.368395 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.368399 | orchestrator | + device_id = (known after apply) 2026-04-24 01:41:40.368403 | orchestrator | + device_owner = (known after apply) 2026-04-24 01:41:40.368406 | orchestrator | + dns_assignment = (known after apply) 2026-04-24 01:41:40.368410 | orchestrator | + dns_name = (known after apply) 2026-04-24 01:41:40.368414 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.368417 | orchestrator | + mac_address = (known after apply) 2026-04-24 01:41:40.368421 | orchestrator | + network_id = (known after apply) 2026-04-24 01:41:40.368425 | orchestrator | + port_security_enabled = (known after apply) 2026-04-24 01:41:40.368429 | orchestrator | + qos_policy_id = (known after apply) 2026-04-24 01:41:40.368439 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.368442 | orchestrator | + security_group_ids = (known after apply) 2026-04-24 01:41:40.368446 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.368450 | orchestrator | 2026-04-24 01:41:40.368453 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.368457 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-24 01:41:40.368461 | orchestrator | } 2026-04-24 01:41:40.368464 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.368468 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-24 01:41:40.368471 | orchestrator | } 2026-04-24 01:41:40.368475 | orchestrator | + allowed_address_pairs { 2026-04-24 01:41:40.368479 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-24 01:41:40.368482 | orchestrator | } 2026-04-24 01:41:40.368486 | orchestrator | 2026-04-24 01:41:40.368495 | orchestrator | + binding (known after apply) 2026-04-24 01:41:40.368499 | orchestrator | 2026-04-24 01:41:40.368503 | orchestrator | + fixed_ip { 2026-04-24 01:41:40.368506 | orchestrator | + ip_address = "192.168.16.15" 2026-04-24 01:41:40.368510 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.368514 | orchestrator | } 2026-04-24 01:41:40.368518 | orchestrator | } 2026-04-24 01:41:40.368576 | orchestrator | 2026-04-24 01:41:40.368593 | orchestrator | # openstack_networking_router_interface_v2.router_interface will be created 2026-04-24 01:41:40.368601 | orchestrator | + resource "openstack_networking_router_interface_v2" "router_interface" { 2026-04-24 01:41:40.368606 | orchestrator | + force_destroy = false 2026-04-24 01:41:40.368609 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.368613 | orchestrator | + port_id = (known after apply) 2026-04-24 01:41:40.368617 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.368621 | orchestrator | + router_id = (known after apply) 2026-04-24 01:41:40.368624 | orchestrator | + subnet_id = (known after apply) 2026-04-24 01:41:40.368628 | orchestrator | } 2026-04-24 01:41:40.368746 | orchestrator | 2026-04-24 01:41:40.368761 | orchestrator | # openstack_networking_router_v2.router will be created 2026-04-24 01:41:40.368769 | orchestrator | + resource "openstack_networking_router_v2" "router" { 2026-04-24 01:41:40.368774 | orchestrator | + admin_state_up = (known after apply) 2026-04-24 01:41:40.368781 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.368787 | orchestrator | + availability_zone_hints = [ 2026-04-24 01:41:40.368793 | orchestrator | + "nova", 2026-04-24 01:41:40.368799 | orchestrator | ] 2026-04-24 01:41:40.368804 | orchestrator | + distributed = (known after apply) 2026-04-24 01:41:40.368810 | orchestrator | + enable_snat = (known after apply) 2026-04-24 01:41:40.368816 | orchestrator | + external_network_id = "e6be7364-bfd8-4de7-8120-8f41c69a139a" 2026-04-24 01:41:40.368822 | orchestrator | + external_qos_policy_id = (known after apply) 2026-04-24 01:41:40.368827 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.368833 | orchestrator | + name = "testbed" 2026-04-24 01:41:40.368839 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.368845 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.368851 | orchestrator | 2026-04-24 01:41:40.368856 | orchestrator | + external_fixed_ip (known after apply) 2026-04-24 01:41:40.368862 | orchestrator | } 2026-04-24 01:41:40.368986 | orchestrator | 2026-04-24 01:41:40.369001 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule1 will be created 2026-04-24 01:41:40.369007 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule1" { 2026-04-24 01:41:40.369011 | orchestrator | + description = "ssh" 2026-04-24 01:41:40.369014 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.369018 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.369022 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.369026 | orchestrator | + port_range_max = 22 2026-04-24 01:41:40.369030 | orchestrator | + port_range_min = 22 2026-04-24 01:41:40.369034 | orchestrator | + protocol = "tcp" 2026-04-24 01:41:40.369037 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.369048 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.369052 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.369056 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-24 01:41:40.369060 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.369063 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.369067 | orchestrator | } 2026-04-24 01:41:40.369155 | orchestrator | 2026-04-24 01:41:40.369171 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule2 will be created 2026-04-24 01:41:40.369177 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule2" { 2026-04-24 01:41:40.369184 | orchestrator | + description = "wireguard" 2026-04-24 01:41:40.369190 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.369196 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.369201 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.369206 | orchestrator | + port_range_max = 51820 2026-04-24 01:41:40.369213 | orchestrator | + port_range_min = 51820 2026-04-24 01:41:40.369219 | orchestrator | + protocol = "udp" 2026-04-24 01:41:40.369225 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.369231 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.369237 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.369243 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-24 01:41:40.369250 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.369256 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.369261 | orchestrator | } 2026-04-24 01:41:40.369342 | orchestrator | 2026-04-24 01:41:40.369355 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule3 will be created 2026-04-24 01:41:40.369360 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule3" { 2026-04-24 01:41:40.369364 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.369368 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.369371 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.369375 | orchestrator | + protocol = "tcp" 2026-04-24 01:41:40.369379 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.369383 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.369387 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.369390 | orchestrator | + remote_ip_prefix = "192.168.16.0/20" 2026-04-24 01:41:40.369394 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.369398 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.369402 | orchestrator | } 2026-04-24 01:41:40.369468 | orchestrator | 2026-04-24 01:41:40.369481 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule4 will be created 2026-04-24 01:41:40.369488 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule4" { 2026-04-24 01:41:40.369494 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.369499 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.369506 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.369512 | orchestrator | + protocol = "udp" 2026-04-24 01:41:40.369518 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.369524 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.369530 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.369536 | orchestrator | + remote_ip_prefix = "192.168.16.0/20" 2026-04-24 01:41:40.369542 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.369548 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.369552 | orchestrator | } 2026-04-24 01:41:40.369621 | orchestrator | 2026-04-24 01:41:40.369633 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule5 will be created 2026-04-24 01:41:40.369644 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule5" { 2026-04-24 01:41:40.369648 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.369652 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.369656 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.369659 | orchestrator | + protocol = "icmp" 2026-04-24 01:41:40.369663 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.369689 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.369693 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.369697 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-24 01:41:40.369701 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.369705 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.369709 | orchestrator | } 2026-04-24 01:41:40.369781 | orchestrator | 2026-04-24 01:41:40.369793 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule1 will be created 2026-04-24 01:41:40.369800 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule1" { 2026-04-24 01:41:40.369806 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.369812 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.369818 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.369824 | orchestrator | + protocol = "tcp" 2026-04-24 01:41:40.369830 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.369836 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.369851 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.369855 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-24 01:41:40.369859 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.369862 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.369866 | orchestrator | } 2026-04-24 01:41:40.369932 | orchestrator | 2026-04-24 01:41:40.369947 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule2 will be created 2026-04-24 01:41:40.369954 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule2" { 2026-04-24 01:41:40.369959 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.369965 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.369972 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.369976 | orchestrator | + protocol = "udp" 2026-04-24 01:41:40.369979 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.369983 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.369987 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.369991 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-24 01:41:40.369995 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.369999 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.370002 | orchestrator | } 2026-04-24 01:41:40.370099 | orchestrator | 2026-04-24 01:41:40.370117 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule3 will be created 2026-04-24 01:41:40.370124 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule3" { 2026-04-24 01:41:40.370132 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.370143 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.370150 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.370153 | orchestrator | + protocol = "icmp" 2026-04-24 01:41:40.370157 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.370161 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.370165 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.370168 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-24 01:41:40.370172 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.370176 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.370187 | orchestrator | } 2026-04-24 01:41:40.370260 | orchestrator | 2026-04-24 01:41:40.370271 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_rule_vrrp will be created 2026-04-24 01:41:40.370275 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_rule_vrrp" { 2026-04-24 01:41:40.370280 | orchestrator | + description = "vrrp" 2026-04-24 01:41:40.370284 | orchestrator | + direction = "ingress" 2026-04-24 01:41:40.370287 | orchestrator | + ethertype = "IPv4" 2026-04-24 01:41:40.370291 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.370295 | orchestrator | + protocol = "112" 2026-04-24 01:41:40.370298 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.370302 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-24 01:41:40.370306 | orchestrator | + remote_group_id = (known after apply) 2026-04-24 01:41:40.370310 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-24 01:41:40.370313 | orchestrator | + security_group_id = (known after apply) 2026-04-24 01:41:40.370317 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.370321 | orchestrator | } 2026-04-24 01:41:40.370373 | orchestrator | 2026-04-24 01:41:40.370384 | orchestrator | # openstack_networking_secgroup_v2.security_group_management will be created 2026-04-24 01:41:40.370389 | orchestrator | + resource "openstack_networking_secgroup_v2" "security_group_management" { 2026-04-24 01:41:40.370393 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.370396 | orchestrator | + description = "management security group" 2026-04-24 01:41:40.370400 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.370404 | orchestrator | + name = "testbed-management" 2026-04-24 01:41:40.370407 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.370411 | orchestrator | + stateful = (known after apply) 2026-04-24 01:41:40.370415 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.370419 | orchestrator | } 2026-04-24 01:41:40.370477 | orchestrator | 2026-04-24 01:41:40.370489 | orchestrator | # openstack_networking_secgroup_v2.security_group_node will be created 2026-04-24 01:41:40.370494 | orchestrator | + resource "openstack_networking_secgroup_v2" "security_group_node" { 2026-04-24 01:41:40.370498 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.370501 | orchestrator | + description = "node security group" 2026-04-24 01:41:40.370505 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.370509 | orchestrator | + name = "testbed-node" 2026-04-24 01:41:40.370513 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.370516 | orchestrator | + stateful = (known after apply) 2026-04-24 01:41:40.370520 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.370524 | orchestrator | } 2026-04-24 01:41:40.370729 | orchestrator | 2026-04-24 01:41:40.370747 | orchestrator | # openstack_networking_subnet_v2.subnet_management will be created 2026-04-24 01:41:40.370752 | orchestrator | + resource "openstack_networking_subnet_v2" "subnet_management" { 2026-04-24 01:41:40.370756 | orchestrator | + all_tags = (known after apply) 2026-04-24 01:41:40.370760 | orchestrator | + cidr = "192.168.16.0/20" 2026-04-24 01:41:40.370764 | orchestrator | + dns_nameservers = [ 2026-04-24 01:41:40.370768 | orchestrator | + "8.8.8.8", 2026-04-24 01:41:40.370772 | orchestrator | + "9.9.9.9", 2026-04-24 01:41:40.370775 | orchestrator | ] 2026-04-24 01:41:40.370779 | orchestrator | + enable_dhcp = true 2026-04-24 01:41:40.370783 | orchestrator | + gateway_ip = (known after apply) 2026-04-24 01:41:40.370787 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.370791 | orchestrator | + ip_version = 4 2026-04-24 01:41:40.370795 | orchestrator | + ipv6_address_mode = (known after apply) 2026-04-24 01:41:40.370799 | orchestrator | + ipv6_ra_mode = (known after apply) 2026-04-24 01:41:40.370803 | orchestrator | + name = "subnet-testbed-management" 2026-04-24 01:41:40.370806 | orchestrator | + network_id = (known after apply) 2026-04-24 01:41:40.370810 | orchestrator | + no_gateway = false 2026-04-24 01:41:40.370814 | orchestrator | + region = (known after apply) 2026-04-24 01:41:40.370818 | orchestrator | + service_types = (known after apply) 2026-04-24 01:41:40.370828 | orchestrator | + tenant_id = (known after apply) 2026-04-24 01:41:40.370832 | orchestrator | 2026-04-24 01:41:40.370836 | orchestrator | + allocation_pool { 2026-04-24 01:41:40.370840 | orchestrator | + end = "192.168.31.250" 2026-04-24 01:41:40.370843 | orchestrator | + start = "192.168.31.200" 2026-04-24 01:41:40.370847 | orchestrator | } 2026-04-24 01:41:40.370851 | orchestrator | } 2026-04-24 01:41:40.370885 | orchestrator | 2026-04-24 01:41:40.370897 | orchestrator | # terraform_data.image will be created 2026-04-24 01:41:40.370901 | orchestrator | + resource "terraform_data" "image" { 2026-04-24 01:41:40.370905 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.370909 | orchestrator | + input = "Ubuntu 24.04" 2026-04-24 01:41:40.370916 | orchestrator | + output = (known after apply) 2026-04-24 01:41:40.370922 | orchestrator | } 2026-04-24 01:41:40.370973 | orchestrator | 2026-04-24 01:41:40.370986 | orchestrator | # terraform_data.image_node will be created 2026-04-24 01:41:40.370990 | orchestrator | + resource "terraform_data" "image_node" { 2026-04-24 01:41:40.370994 | orchestrator | + id = (known after apply) 2026-04-24 01:41:40.370997 | orchestrator | + input = "Ubuntu 24.04" 2026-04-24 01:41:40.371001 | orchestrator | + output = (known after apply) 2026-04-24 01:41:40.371005 | orchestrator | } 2026-04-24 01:41:40.371022 | orchestrator | 2026-04-24 01:41:40.371026 | orchestrator | Plan: 64 to add, 0 to change, 0 to destroy. 2026-04-24 01:41:40.371038 | orchestrator | 2026-04-24 01:41:40.371042 | orchestrator | Changes to Outputs: 2026-04-24 01:41:40.371053 | orchestrator | + manager_address = (sensitive value) 2026-04-24 01:41:40.371057 | orchestrator | + private_key = (sensitive value) 2026-04-24 01:41:40.624608 | orchestrator | terraform_data.image_node: Creating... 2026-04-24 01:41:40.624689 | orchestrator | terraform_data.image: Creating... 2026-04-24 01:41:40.624698 | orchestrator | terraform_data.image_node: Creation complete after 0s [id=713337d7-4de3-33ba-b233-9a2550788f03] 2026-04-24 01:41:40.626383 | orchestrator | terraform_data.image: Creation complete after 0s [id=0fe2a302-69a3-a3ef-71f8-f487006a923c] 2026-04-24 01:41:40.632525 | orchestrator | data.openstack_images_image_v2.image_node: Reading... 2026-04-24 01:41:40.632606 | orchestrator | data.openstack_images_image_v2.image: Reading... 2026-04-24 01:41:40.646101 | orchestrator | openstack_compute_keypair_v2.key: Creating... 2026-04-24 01:41:40.646181 | orchestrator | openstack_blockstorage_volume_v3.node_volume[3]: Creating... 2026-04-24 01:41:40.646191 | orchestrator | openstack_blockstorage_volume_v3.node_volume[1]: Creating... 2026-04-24 01:41:40.646198 | orchestrator | openstack_blockstorage_volume_v3.node_volume[4]: Creating... 2026-04-24 01:41:40.647981 | orchestrator | openstack_blockstorage_volume_v3.node_volume[8]: Creating... 2026-04-24 01:41:40.649536 | orchestrator | openstack_blockstorage_volume_v3.node_volume[6]: Creating... 2026-04-24 01:41:40.649578 | orchestrator | openstack_blockstorage_volume_v3.node_volume[7]: Creating... 2026-04-24 01:41:40.661595 | orchestrator | openstack_networking_network_v2.net_management: Creating... 2026-04-24 01:41:41.164303 | orchestrator | data.openstack_images_image_v2.image_node: Read complete after 0s [id=846820b2-039e-4b42-adad-daf72e0f8ea4] 2026-04-24 01:41:41.170528 | orchestrator | openstack_blockstorage_volume_v3.node_volume[0]: Creating... 2026-04-24 01:41:41.171854 | orchestrator | data.openstack_images_image_v2.image: Read complete after 0s [id=846820b2-039e-4b42-adad-daf72e0f8ea4] 2026-04-24 01:41:41.175785 | orchestrator | openstack_blockstorage_volume_v3.node_volume[5]: Creating... 2026-04-24 01:41:41.196128 | orchestrator | openstack_compute_keypair_v2.key: Creation complete after 0s [id=testbed] 2026-04-24 01:41:41.207202 | orchestrator | openstack_blockstorage_volume_v3.node_volume[2]: Creating... 2026-04-24 01:41:41.715775 | orchestrator | openstack_networking_network_v2.net_management: Creation complete after 1s [id=a07d9ab2-77be-4533-9145-7a7180bdc5bb] 2026-04-24 01:41:41.728376 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[1]: Creating... 2026-04-24 01:41:44.284975 | orchestrator | openstack_blockstorage_volume_v3.node_volume[1]: Creation complete after 3s [id=dbcc85a9-d466-4412-94d7-531bcea533f1] 2026-04-24 01:41:44.290840 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[2]: Creating... 2026-04-24 01:41:44.315755 | orchestrator | openstack_blockstorage_volume_v3.node_volume[6]: Creation complete after 3s [id=92dd2642-12ef-4670-adde-b0a5f7905f76] 2026-04-24 01:41:44.320868 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[4]: Creating... 2026-04-24 01:41:44.329963 | orchestrator | openstack_blockstorage_volume_v3.node_volume[8]: Creation complete after 3s [id=076ca587-f8dc-4c3d-b6bc-5e82e8686229] 2026-04-24 01:41:44.333980 | orchestrator | openstack_blockstorage_volume_v3.node_volume[4]: Creation complete after 3s [id=36b4f46e-172b-4813-855c-03c71aa1e4cd] 2026-04-24 01:41:44.338400 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[0]: Creating... 2026-04-24 01:41:44.338591 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[3]: Creating... 2026-04-24 01:41:44.365190 | orchestrator | openstack_blockstorage_volume_v3.node_volume[3]: Creation complete after 3s [id=b35d6460-4113-4a0d-a6ba-fa54e4693f23] 2026-04-24 01:41:44.365284 | orchestrator | openstack_blockstorage_volume_v3.node_volume[7]: Creation complete after 3s [id=f6fcddf9-6575-4466-bfb5-c404028d7cf5] 2026-04-24 01:41:44.370307 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[5]: Creating... 2026-04-24 01:41:44.375199 | orchestrator | openstack_blockstorage_volume_v3.manager_base_volume[0]: Creating... 2026-04-24 01:41:44.421629 | orchestrator | openstack_blockstorage_volume_v3.node_volume[0]: Creation complete after 3s [id=1241754e-3b17-41ae-8e6a-e32bbefa282c] 2026-04-24 01:41:44.426472 | orchestrator | openstack_blockstorage_volume_v3.node_volume[5]: Creation complete after 3s [id=730aee50-bba4-43d1-8d84-d1615bb19025] 2026-04-24 01:41:44.437780 | orchestrator | local_file.id_rsa_pub: Creating... 2026-04-24 01:41:44.443685 | orchestrator | local_file.id_rsa_pub: Creation complete after 0s [id=ff4cc61969fab84f3791aa3b1df4210b547d214f] 2026-04-24 01:41:44.446833 | orchestrator | local_sensitive_file.id_rsa: Creating... 2026-04-24 01:41:44.449570 | orchestrator | openstack_blockstorage_volume_v3.node_volume[2]: Creation complete after 3s [id=67f938a5-276d-4b3e-96c0-2eb342d0722d] 2026-04-24 01:41:44.452786 | orchestrator | openstack_networking_subnet_v2.subnet_management: Creating... 2026-04-24 01:41:44.453495 | orchestrator | local_sensitive_file.id_rsa: Creation complete after 0s [id=d4045472bfdff8ed92abfde4526616dd2e978986] 2026-04-24 01:41:45.070486 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[1]: Creation complete after 3s [id=922a5bfc-9600-4150-ae8a-25af0bf28f1a] 2026-04-24 01:41:45.406252 | orchestrator | openstack_networking_subnet_v2.subnet_management: Creation complete after 1s [id=98b0bc37-7cb9-42bf-b85f-e117f749ac4b] 2026-04-24 01:41:45.414195 | orchestrator | openstack_networking_router_v2.router: Creating... 2026-04-24 01:41:47.678555 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[2]: Creation complete after 4s [id=f837a177-fc6d-44f1-95c8-fd24e6372293] 2026-04-24 01:41:47.696026 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[4]: Creation complete after 4s [id=8aa3c015-a6b1-410f-8914-592a6a65cb5b] 2026-04-24 01:41:47.718435 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[0]: Creation complete after 4s [id=890efc9d-fc13-4d63-b232-fe77c11b084a] 2026-04-24 01:41:47.753191 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[5]: Creation complete after 4s [id=457a59b4-1b41-430f-abbe-5f9506edbd5c] 2026-04-24 01:41:47.776527 | orchestrator | openstack_blockstorage_volume_v3.manager_base_volume[0]: Creation complete after 4s [id=0df50765-4d8a-4916-b175-030c2009f2f3] 2026-04-24 01:41:47.877728 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[3]: Creation complete after 4s [id=3ccf7d33-589c-4274-be28-035704dd3951] 2026-04-24 01:41:48.266285 | orchestrator | openstack_networking_router_v2.router: Creation complete after 3s [id=ee70fb72-97d5-48e2-aa6b-1ab0d1a73954] 2026-04-24 01:41:48.272602 | orchestrator | openstack_networking_secgroup_v2.security_group_node: Creating... 2026-04-24 01:41:48.272906 | orchestrator | openstack_networking_router_interface_v2.router_interface: Creating... 2026-04-24 01:41:48.275096 | orchestrator | openstack_networking_secgroup_v2.security_group_management: Creating... 2026-04-24 01:41:48.457959 | orchestrator | openstack_networking_secgroup_v2.security_group_management: Creation complete after 0s [id=c7127b23-9b03-419d-b4c7-ba8825900f1b] 2026-04-24 01:41:48.473151 | orchestrator | openstack_networking_secgroup_v2.security_group_node: Creation complete after 0s [id=b2b3e76e-5184-460a-a0ff-f798cff0f5ab] 2026-04-24 01:41:48.480062 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule3: Creating... 2026-04-24 01:41:48.480200 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule2: Creating... 2026-04-24 01:41:48.480745 | orchestrator | openstack_networking_port_v2.manager_port_management: Creating... 2026-04-24 01:41:48.481025 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule4: Creating... 2026-04-24 01:41:48.481230 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule1: Creating... 2026-04-24 01:41:48.483856 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule5: Creating... 2026-04-24 01:41:48.487773 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule1: Creating... 2026-04-24 01:41:48.487956 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule2: Creating... 2026-04-24 01:41:48.488882 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_rule_vrrp: Creating... 2026-04-24 01:41:48.674549 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule2: Creation complete after 1s [id=524e89f0-2af8-4bf2-b2c5-c917ddd055df] 2026-04-24 01:41:48.690318 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule3: Creation complete after 1s [id=56f4b186-9aff-4b52-bfb4-e399ac8b2452] 2026-04-24 01:41:48.694738 | orchestrator | openstack_networking_port_v2.node_port_management[4]: Creating... 2026-04-24 01:41:48.700363 | orchestrator | openstack_networking_port_v2.node_port_management[3]: Creating... 2026-04-24 01:41:48.873381 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule2: Creation complete after 1s [id=138f96d5-5763-4373-a40a-37ea08912d03] 2026-04-24 01:41:48.888170 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_rule_vrrp: Creation complete after 1s [id=6a5d1112-fd36-45ce-9190-74c849711d16] 2026-04-24 01:41:48.893338 | orchestrator | openstack_networking_port_v2.node_port_management[5]: Creating... 2026-04-24 01:41:48.900363 | orchestrator | openstack_networking_port_v2.node_port_management[1]: Creating... 2026-04-24 01:41:49.063105 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule1: Creation complete after 1s [id=9cdb55e4-c677-44dd-885e-427661f0ae73] 2026-04-24 01:41:49.080717 | orchestrator | openstack_networking_port_v2.manager_port_management: Creation complete after 1s [id=639f2fea-06f4-4057-bda4-696e567fd778] 2026-04-24 01:41:49.081108 | orchestrator | openstack_networking_port_v2.node_port_management[0]: Creating... 2026-04-24 01:41:49.096316 | orchestrator | openstack_networking_port_v2.node_port_management[2]: Creating... 2026-04-24 01:41:49.213312 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule4: Creation complete after 1s [id=1380c74c-7984-4a26-9d36-a1deee15bc25] 2026-04-24 01:41:49.218237 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule3: Creating... 2026-04-24 01:41:49.333534 | orchestrator | openstack_networking_port_v2.node_port_management[4]: Creation complete after 0s [id=1a004b2a-5d55-401d-bf1d-eef45024d8b4] 2026-04-24 01:41:49.400088 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule1: Creation complete after 1s [id=c92d83de-1975-4983-b6d2-4dbaa8a4f906] 2026-04-24 01:41:49.419900 | orchestrator | openstack_networking_port_v2.node_port_management[3]: Creation complete after 0s [id=b0e6edce-05a6-429c-a73f-ee02bd5cc852] 2026-04-24 01:41:49.421117 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule3: Creation complete after 0s [id=e0a3a33a-ce11-45f6-acd5-03d8636de9a9] 2026-04-24 01:41:49.566162 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule5: Creation complete after 2s [id=0f62604f-aaf5-4c7e-bed0-5c966abac093] 2026-04-24 01:41:49.640137 | orchestrator | openstack_networking_port_v2.node_port_management[0]: Creation complete after 1s [id=ac95dbee-5a18-48d2-977b-2de524c0948d] 2026-04-24 01:41:49.641537 | orchestrator | openstack_networking_port_v2.node_port_management[1]: Creation complete after 1s [id=bc479451-32bf-4741-8d9a-ad356eba78c9] 2026-04-24 01:41:49.731997 | orchestrator | openstack_networking_port_v2.node_port_management[5]: Creation complete after 1s [id=7eaf8618-9607-4e80-b84c-b3fcbdaf4e67] 2026-04-24 01:41:49.860280 | orchestrator | openstack_networking_port_v2.node_port_management[2]: Creation complete after 1s [id=8921d982-7de3-4524-bdef-68e1f9dcff0c] 2026-04-24 01:41:50.796278 | orchestrator | openstack_networking_router_interface_v2.router_interface: Creation complete after 3s [id=1a4497bb-5764-43d5-b082-56d76f59dbdb] 2026-04-24 01:41:50.817079 | orchestrator | openstack_networking_floatingip_v2.manager_floating_ip: Creating... 2026-04-24 01:41:50.830234 | orchestrator | openstack_compute_instance_v2.node_server[4]: Creating... 2026-04-24 01:41:50.837590 | orchestrator | openstack_compute_instance_v2.node_server[0]: Creating... 2026-04-24 01:41:50.838628 | orchestrator | openstack_compute_instance_v2.node_server[5]: Creating... 2026-04-24 01:41:50.847434 | orchestrator | openstack_compute_instance_v2.node_server[3]: Creating... 2026-04-24 01:41:50.847903 | orchestrator | openstack_compute_instance_v2.node_server[2]: Creating... 2026-04-24 01:41:50.849317 | orchestrator | openstack_compute_instance_v2.node_server[1]: Creating... 2026-04-24 01:41:52.179575 | orchestrator | openstack_networking_floatingip_v2.manager_floating_ip: Creation complete after 1s [id=616d6f00-c17e-4b88-bc4f-2afd4ce7ed5b] 2026-04-24 01:41:52.190924 | orchestrator | openstack_networking_floatingip_associate_v2.manager_floating_ip_association: Creating... 2026-04-24 01:41:52.192312 | orchestrator | local_file.MANAGER_ADDRESS: Creating... 2026-04-24 01:41:52.200451 | orchestrator | local_file.MANAGER_ADDRESS: Creation complete after 0s [id=cc5c18cd9b46a6fdebe0f8627fbea6b933658e5f] 2026-04-24 01:41:52.201326 | orchestrator | local_file.inventory: Creating... 2026-04-24 01:41:52.212854 | orchestrator | local_file.inventory: Creation complete after 0s [id=c4c1530b333294bcb375c4353229b88ede0db389] 2026-04-24 01:41:52.890069 | orchestrator | openstack_networking_floatingip_associate_v2.manager_floating_ip_association: Creation complete after 1s [id=616d6f00-c17e-4b88-bc4f-2afd4ce7ed5b] 2026-04-24 01:42:00.837495 | orchestrator | openstack_compute_instance_v2.node_server[4]: Still creating... [10s elapsed] 2026-04-24 01:42:00.847942 | orchestrator | openstack_compute_instance_v2.node_server[0]: Still creating... [10s elapsed] 2026-04-24 01:42:00.849158 | orchestrator | openstack_compute_instance_v2.node_server[5]: Still creating... [10s elapsed] 2026-04-24 01:42:00.851830 | orchestrator | openstack_compute_instance_v2.node_server[2]: Still creating... [10s elapsed] 2026-04-24 01:42:00.851947 | orchestrator | openstack_compute_instance_v2.node_server[3]: Still creating... [10s elapsed] 2026-04-24 01:42:00.852963 | orchestrator | openstack_compute_instance_v2.node_server[1]: Still creating... [10s elapsed] 2026-04-24 01:42:10.846754 | orchestrator | openstack_compute_instance_v2.node_server[4]: Still creating... [20s elapsed] 2026-04-24 01:42:10.849059 | orchestrator | openstack_compute_instance_v2.node_server[0]: Still creating... [20s elapsed] 2026-04-24 01:42:10.849234 | orchestrator | openstack_compute_instance_v2.node_server[5]: Still creating... [20s elapsed] 2026-04-24 01:42:10.852813 | orchestrator | openstack_compute_instance_v2.node_server[3]: Still creating... [20s elapsed] 2026-04-24 01:42:10.852894 | orchestrator | openstack_compute_instance_v2.node_server[2]: Still creating... [20s elapsed] 2026-04-24 01:42:10.853930 | orchestrator | openstack_compute_instance_v2.node_server[1]: Still creating... [20s elapsed] 2026-04-24 01:42:11.307099 | orchestrator | openstack_compute_instance_v2.node_server[3]: Creation complete after 20s [id=c99e2e24-ac46-49af-a64d-2772ef51a57e] 2026-04-24 01:42:11.315917 | orchestrator | openstack_compute_instance_v2.node_server[2]: Creation complete after 20s [id=c0ef5508-76ba-4617-9661-3e1985804b84] 2026-04-24 01:42:11.395983 | orchestrator | openstack_compute_instance_v2.node_server[1]: Creation complete after 20s [id=b4a68fec-5363-4720-99c4-0ce6c62cd620] 2026-04-24 01:42:11.448811 | orchestrator | openstack_compute_instance_v2.node_server[5]: Creation complete after 20s [id=61a78d7e-1ba9-4afd-90df-8d463f29e113] 2026-04-24 01:42:20.847221 | orchestrator | openstack_compute_instance_v2.node_server[4]: Still creating... [30s elapsed] 2026-04-24 01:42:20.849562 | orchestrator | openstack_compute_instance_v2.node_server[0]: Still creating... [30s elapsed] 2026-04-24 01:42:21.634430 | orchestrator | openstack_compute_instance_v2.node_server[0]: Creation complete after 31s [id=ab2822dd-f920-45e8-a6a3-58d7af3038da] 2026-04-24 01:42:21.798282 | orchestrator | openstack_compute_instance_v2.node_server[4]: Creation complete after 31s [id=27e682ef-c23f-4764-b362-97d25107814f] 2026-04-24 01:42:21.816415 | orchestrator | null_resource.node_semaphore: Creating... 2026-04-24 01:42:21.826329 | orchestrator | null_resource.node_semaphore: Creation complete after 0s [id=3822281359265344245] 2026-04-24 01:42:21.840582 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[0]: Creating... 2026-04-24 01:42:21.841745 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[6]: Creating... 2026-04-24 01:42:21.841859 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[4]: Creating... 2026-04-24 01:42:21.842234 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[8]: Creating... 2026-04-24 01:42:21.844237 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[7]: Creating... 2026-04-24 01:42:21.851167 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[1]: Creating... 2026-04-24 01:42:21.855249 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[5]: Creating... 2026-04-24 01:42:21.856838 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[2]: Creating... 2026-04-24 01:42:21.867650 | orchestrator | openstack_compute_instance_v2.manager_server: Creating... 2026-04-24 01:42:21.869989 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[3]: Creating... 2026-04-24 01:42:25.232616 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[8]: Creation complete after 3s [id=61a78d7e-1ba9-4afd-90df-8d463f29e113/076ca587-f8dc-4c3d-b6bc-5e82e8686229] 2026-04-24 01:42:25.240550 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[6]: Creation complete after 3s [id=c99e2e24-ac46-49af-a64d-2772ef51a57e/92dd2642-12ef-4670-adde-b0a5f7905f76] 2026-04-24 01:42:25.261841 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[4]: Creation complete after 3s [id=27e682ef-c23f-4764-b362-97d25107814f/36b4f46e-172b-4813-855c-03c71aa1e4cd] 2026-04-24 01:42:25.268454 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[5]: Creation complete after 3s [id=61a78d7e-1ba9-4afd-90df-8d463f29e113/730aee50-bba4-43d1-8d84-d1615bb19025] 2026-04-24 01:42:25.287633 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[0]: Creation complete after 3s [id=c99e2e24-ac46-49af-a64d-2772ef51a57e/1241754e-3b17-41ae-8e6a-e32bbefa282c] 2026-04-24 01:42:25.295440 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[1]: Creation complete after 3s [id=27e682ef-c23f-4764-b362-97d25107814f/dbcc85a9-d466-4412-94d7-531bcea533f1] 2026-04-24 01:42:31.369839 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[2]: Creation complete after 9s [id=61a78d7e-1ba9-4afd-90df-8d463f29e113/67f938a5-276d-4b3e-96c0-2eb342d0722d] 2026-04-24 01:42:31.382007 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[3]: Creation complete after 9s [id=c99e2e24-ac46-49af-a64d-2772ef51a57e/b35d6460-4113-4a0d-a6ba-fa54e4693f23] 2026-04-24 01:42:31.402437 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[7]: Creation complete after 9s [id=27e682ef-c23f-4764-b362-97d25107814f/f6fcddf9-6575-4466-bfb5-c404028d7cf5] 2026-04-24 01:42:31.869807 | orchestrator | openstack_compute_instance_v2.manager_server: Still creating... [10s elapsed] 2026-04-24 01:42:41.870431 | orchestrator | openstack_compute_instance_v2.manager_server: Still creating... [20s elapsed] 2026-04-24 01:42:42.223227 | orchestrator | openstack_compute_instance_v2.manager_server: Creation complete after 20s [id=d5846845-8102-4ef0-9731-8259d443eedb] 2026-04-24 01:42:42.245919 | orchestrator | 2026-04-24 01:42:42.246115 | orchestrator | Apply complete! Resources: 64 added, 0 changed, 0 destroyed. 2026-04-24 01:42:42.246135 | orchestrator | 2026-04-24 01:42:42.246146 | orchestrator | Outputs: 2026-04-24 01:42:42.246156 | orchestrator | 2026-04-24 01:42:42.246166 | orchestrator | manager_address = 2026-04-24 01:42:42.246176 | orchestrator | private_key = 2026-04-24 01:42:42.569743 | orchestrator | ok: Runtime: 0:01:08.258684 2026-04-24 01:42:42.610549 | 2026-04-24 01:42:42.610689 | TASK [Fetch manager address] 2026-04-24 01:42:43.101063 | orchestrator | ok 2026-04-24 01:42:43.111776 | 2026-04-24 01:42:43.111886 | TASK [Set manager_host address] 2026-04-24 01:42:43.191261 | orchestrator | ok 2026-04-24 01:42:43.200579 | 2026-04-24 01:42:43.200696 | LOOP [Update ansible collections] 2026-04-24 01:42:44.447049 | orchestrator | [WARNING]: Collection osism.services does not support Ansible version 2.15.2 2026-04-24 01:42:44.447394 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-24 01:42:44.447458 | orchestrator | Starting galaxy collection install process 2026-04-24 01:42:44.447492 | orchestrator | Process install dependency map 2026-04-24 01:42:44.447521 | orchestrator | Starting collection install process 2026-04-24 01:42:44.447547 | orchestrator | Installing 'osism.commons:999.0.0' to '/home/zuul-testbed01/.ansible/collections/ansible_collections/osism/commons' 2026-04-24 01:42:44.447577 | orchestrator | Created collection for osism.commons:999.0.0 at /home/zuul-testbed01/.ansible/collections/ansible_collections/osism/commons 2026-04-24 01:42:44.447607 | orchestrator | osism.commons:999.0.0 was installed successfully 2026-04-24 01:42:44.447673 | orchestrator | ok: Item: commons Runtime: 0:00:00.882343 2026-04-24 01:42:45.437767 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-24 01:42:45.437948 | orchestrator | [WARNING]: Collection osism.services does not support Ansible version 2.15.2 2026-04-24 01:42:45.438002 | orchestrator | Starting galaxy collection install process 2026-04-24 01:42:45.438043 | orchestrator | Process install dependency map 2026-04-24 01:42:45.438099 | orchestrator | Starting collection install process 2026-04-24 01:42:45.438135 | orchestrator | Installing 'osism.services:999.0.0' to '/home/zuul-testbed01/.ansible/collections/ansible_collections/osism/services' 2026-04-24 01:42:45.438170 | orchestrator | Created collection for osism.services:999.0.0 at /home/zuul-testbed01/.ansible/collections/ansible_collections/osism/services 2026-04-24 01:42:45.438204 | orchestrator | osism.services:999.0.0 was installed successfully 2026-04-24 01:42:45.438258 | orchestrator | ok: Item: services Runtime: 0:00:00.682070 2026-04-24 01:42:45.460586 | 2026-04-24 01:42:45.460786 | TASK [Wait up to 300 seconds for port 22 to become open and contain "OpenSSH"] 2026-04-24 01:42:56.054023 | orchestrator | ok 2026-04-24 01:42:56.063907 | 2026-04-24 01:42:56.064037 | TASK [Wait a little longer for the manager so that everything is ready] 2026-04-24 01:43:56.115085 | orchestrator | ok 2026-04-24 01:43:56.125952 | 2026-04-24 01:43:56.126074 | TASK [Fetch manager ssh hostkey] 2026-04-24 01:43:57.701150 | orchestrator | Output suppressed because no_log was given 2026-04-24 01:43:57.717221 | 2026-04-24 01:43:57.717391 | TASK [Get ssh keypair from terraform environment] 2026-04-24 01:43:58.254727 | orchestrator | ok: Runtime: 0:00:00.011422 2026-04-24 01:43:58.270806 | 2026-04-24 01:43:58.271000 | TASK [Point out that the following task takes some time and does not give any output] 2026-04-24 01:43:58.310900 | orchestrator | ok: The task 'Run manager part 0' runs an Ansible playbook on the manager. There is no further output of this here. It takes a few minutes for this task to complete. 2026-04-24 01:43:58.321324 | 2026-04-24 01:43:58.321477 | TASK [Run manager part 0] 2026-04-24 01:43:59.299089 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-24 01:43:59.344780 | orchestrator | 2026-04-24 01:43:59.344837 | orchestrator | PLAY [Wait for cloud-init to finish] ******************************************* 2026-04-24 01:43:59.344845 | orchestrator | 2026-04-24 01:43:59.344859 | orchestrator | TASK [Check /var/lib/cloud/instance/boot-finished] ***************************** 2026-04-24 01:44:01.437123 | orchestrator | ok: [testbed-manager] 2026-04-24 01:44:01.437187 | orchestrator | 2026-04-24 01:44:01.437211 | orchestrator | PLAY [Run manager part 0] ****************************************************** 2026-04-24 01:44:01.437221 | orchestrator | 2026-04-24 01:44:01.437230 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 01:44:03.446529 | orchestrator | ok: [testbed-manager] 2026-04-24 01:44:03.446599 | orchestrator | 2026-04-24 01:44:03.446609 | orchestrator | TASK [Get home directory of ansible user] ************************************** 2026-04-24 01:44:04.161283 | orchestrator | ok: [testbed-manager] 2026-04-24 01:44:04.161345 | orchestrator | 2026-04-24 01:44:04.161354 | orchestrator | TASK [Set repo_path fact] ****************************************************** 2026-04-24 01:44:04.215133 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:44:04.215178 | orchestrator | 2026-04-24 01:44:04.215188 | orchestrator | TASK [Fail if Ubuntu version is lower than 24.04] ****************************** 2026-04-24 01:44:04.251718 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:44:04.251771 | orchestrator | 2026-04-24 01:44:04.251784 | orchestrator | TASK [Fail if Debian version is lower than 12] ********************************* 2026-04-24 01:44:04.277540 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:44:04.277576 | orchestrator | 2026-04-24 01:44:04.277581 | orchestrator | TASK [Set APT options on manager] ********************************************** 2026-04-24 01:44:05.077920 | orchestrator | changed: [testbed-manager] 2026-04-24 01:44:05.077983 | orchestrator | 2026-04-24 01:44:05.077997 | orchestrator | TASK [Update APT cache and run dist-upgrade] *********************************** 2026-04-24 01:47:16.322977 | orchestrator | changed: [testbed-manager] 2026-04-24 01:47:16.323049 | orchestrator | 2026-04-24 01:47:16.323058 | orchestrator | TASK [Install HWE kernel package on Ubuntu] ************************************ 2026-04-24 01:48:41.008783 | orchestrator | changed: [testbed-manager] 2026-04-24 01:48:41.008919 | orchestrator | 2026-04-24 01:48:41.008944 | orchestrator | TASK [Install required packages] *********************************************** 2026-04-24 01:49:05.154753 | orchestrator | changed: [testbed-manager] 2026-04-24 01:49:05.154877 | orchestrator | 2026-04-24 01:49:05.154907 | orchestrator | TASK [Remove some python packages] ********************************************* 2026-04-24 01:49:14.533544 | orchestrator | changed: [testbed-manager] 2026-04-24 01:49:14.533613 | orchestrator | 2026-04-24 01:49:14.533622 | orchestrator | TASK [Set venv_command fact (Debian)] ****************************************** 2026-04-24 01:49:14.580248 | orchestrator | ok: [testbed-manager] 2026-04-24 01:49:14.580302 | orchestrator | 2026-04-24 01:49:14.580311 | orchestrator | TASK [Get current user] ******************************************************** 2026-04-24 01:49:15.419869 | orchestrator | ok: [testbed-manager] 2026-04-24 01:49:15.420023 | orchestrator | 2026-04-24 01:49:15.420041 | orchestrator | TASK [Create venv directory] *************************************************** 2026-04-24 01:49:16.211525 | orchestrator | changed: [testbed-manager] 2026-04-24 01:49:16.211618 | orchestrator | 2026-04-24 01:49:16.211638 | orchestrator | TASK [Install netaddr in venv] ************************************************* 2026-04-24 01:49:22.922889 | orchestrator | changed: [testbed-manager] 2026-04-24 01:49:22.923048 | orchestrator | 2026-04-24 01:49:22.923066 | orchestrator | TASK [Install ansible-core in venv] ******************************************** 2026-04-24 01:49:29.117882 | orchestrator | changed: [testbed-manager] 2026-04-24 01:49:29.117927 | orchestrator | 2026-04-24 01:49:29.117992 | orchestrator | TASK [Install requests >= 2.32.2] ********************************************** 2026-04-24 01:49:31.913680 | orchestrator | changed: [testbed-manager] 2026-04-24 01:49:31.913722 | orchestrator | 2026-04-24 01:49:31.913730 | orchestrator | TASK [Install docker >= 7.1.0] ************************************************* 2026-04-24 01:49:33.746688 | orchestrator | changed: [testbed-manager] 2026-04-24 01:49:33.746732 | orchestrator | 2026-04-24 01:49:33.746741 | orchestrator | TASK [Create directories in /opt/src] ****************************************** 2026-04-24 01:49:34.972288 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-commons) 2026-04-24 01:49:34.972345 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-services) 2026-04-24 01:49:34.972352 | orchestrator | 2026-04-24 01:49:34.972359 | orchestrator | TASK [Sync sources in /opt/src] ************************************************ 2026-04-24 01:49:35.061460 | orchestrator | [DEPRECATION WARNING]: The connection's stdin object is deprecated. Call 2026-04-24 01:49:35.061528 | orchestrator | display.prompt_until(msg) instead. This feature will be removed in version 2026-04-24 01:49:35.061537 | orchestrator | 2.19. Deprecation warnings can be disabled by setting 2026-04-24 01:49:35.061547 | orchestrator | deprecation_warnings=False in ansible.cfg. 2026-04-24 01:49:38.519978 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-commons) 2026-04-24 01:49:38.520225 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-services) 2026-04-24 01:49:38.520235 | orchestrator | 2026-04-24 01:49:38.520242 | orchestrator | TASK [Create /usr/share/ansible directory] ************************************* 2026-04-24 01:49:39.146836 | orchestrator | changed: [testbed-manager] 2026-04-24 01:49:39.146879 | orchestrator | 2026-04-24 01:49:39.146886 | orchestrator | TASK [Install collections from Ansible galaxy] ********************************* 2026-04-24 01:52:59.431337 | orchestrator | changed: [testbed-manager] => (item=ansible.netcommon) 2026-04-24 01:52:59.431407 | orchestrator | changed: [testbed-manager] => (item=ansible.posix) 2026-04-24 01:52:59.431421 | orchestrator | changed: [testbed-manager] => (item=community.docker>=3.10.2) 2026-04-24 01:52:59.431431 | orchestrator | 2026-04-24 01:52:59.431442 | orchestrator | TASK [Install local collections] *********************************************** 2026-04-24 01:53:01.847714 | orchestrator | changed: [testbed-manager] => (item=ansible-collection-commons) 2026-04-24 01:53:01.847828 | orchestrator | changed: [testbed-manager] => (item=ansible-collection-services) 2026-04-24 01:53:01.847845 | orchestrator | 2026-04-24 01:53:01.847861 | orchestrator | PLAY [Create operator user] **************************************************** 2026-04-24 01:53:01.847874 | orchestrator | 2026-04-24 01:53:01.847886 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 01:53:03.286534 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:03.286587 | orchestrator | 2026-04-24 01:53:03.286594 | orchestrator | TASK [osism.commons.operator : Gather variables for each operating system] ***** 2026-04-24 01:53:03.334885 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:03.334941 | orchestrator | 2026-04-24 01:53:03.334949 | orchestrator | TASK [osism.commons.operator : Set operator_groups variable to default value] *** 2026-04-24 01:53:03.401916 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:03.401972 | orchestrator | 2026-04-24 01:53:03.401981 | orchestrator | TASK [osism.commons.operator : Create operator group] ************************** 2026-04-24 01:53:04.239617 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:04.239668 | orchestrator | 2026-04-24 01:53:04.239682 | orchestrator | TASK [osism.commons.operator : Create user] ************************************ 2026-04-24 01:53:05.023407 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:05.023523 | orchestrator | 2026-04-24 01:53:05.023541 | orchestrator | TASK [osism.commons.operator : Add user to additional groups] ****************** 2026-04-24 01:53:06.526173 | orchestrator | changed: [testbed-manager] => (item=adm) 2026-04-24 01:53:06.526278 | orchestrator | changed: [testbed-manager] => (item=sudo) 2026-04-24 01:53:06.526293 | orchestrator | 2026-04-24 01:53:06.526306 | orchestrator | TASK [osism.commons.operator : Copy user sudoers file] ************************* 2026-04-24 01:53:08.031806 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:08.031914 | orchestrator | 2026-04-24 01:53:08.031930 | orchestrator | TASK [osism.commons.operator : Set language variables in .bashrc configuration file] *** 2026-04-24 01:53:09.934496 | orchestrator | changed: [testbed-manager] => (item=export LANGUAGE=C.UTF-8) 2026-04-24 01:53:09.934543 | orchestrator | changed: [testbed-manager] => (item=export LANG=C.UTF-8) 2026-04-24 01:53:09.934560 | orchestrator | changed: [testbed-manager] => (item=export LC_ALL=C.UTF-8) 2026-04-24 01:53:09.934567 | orchestrator | 2026-04-24 01:53:09.934574 | orchestrator | TASK [osism.commons.operator : Set custom environment variables in .bashrc configuration file] *** 2026-04-24 01:53:09.999533 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:09.999575 | orchestrator | 2026-04-24 01:53:09.999583 | orchestrator | TASK [osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file] *** 2026-04-24 01:53:10.078760 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:10.078809 | orchestrator | 2026-04-24 01:53:10.078820 | orchestrator | TASK [osism.commons.operator : Create .ssh directory] ************************** 2026-04-24 01:53:10.658974 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:10.659108 | orchestrator | 2026-04-24 01:53:10.659129 | orchestrator | TASK [osism.commons.operator : Check number of SSH authorized keys] ************ 2026-04-24 01:53:10.758683 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:10.758790 | orchestrator | 2026-04-24 01:53:10.758808 | orchestrator | TASK [osism.commons.operator : Set ssh authorized keys] ************************ 2026-04-24 01:53:11.706116 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-24 01:53:11.706229 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:11.706249 | orchestrator | 2026-04-24 01:53:11.706261 | orchestrator | TASK [osism.commons.operator : Delete ssh authorized keys] ********************* 2026-04-24 01:53:11.747446 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:11.747552 | orchestrator | 2026-04-24 01:53:11.747570 | orchestrator | TASK [osism.commons.operator : Set authorized GitHub accounts] ***************** 2026-04-24 01:53:11.788566 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:11.788710 | orchestrator | 2026-04-24 01:53:11.788729 | orchestrator | TASK [osism.commons.operator : Delete authorized GitHub accounts] ************** 2026-04-24 01:53:11.823315 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:11.823402 | orchestrator | 2026-04-24 01:53:11.823416 | orchestrator | TASK [osism.commons.operator : Set password] *********************************** 2026-04-24 01:53:11.903294 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:11.903399 | orchestrator | 2026-04-24 01:53:11.903416 | orchestrator | TASK [osism.commons.operator : Unset & lock password] ************************** 2026-04-24 01:53:12.643450 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:12.643569 | orchestrator | 2026-04-24 01:53:12.643594 | orchestrator | PLAY [Run manager part 0] ****************************************************** 2026-04-24 01:53:12.643613 | orchestrator | 2026-04-24 01:53:12.643633 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 01:53:14.138317 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:14.138431 | orchestrator | 2026-04-24 01:53:14.138448 | orchestrator | TASK [Recursively change ownership of /opt/venv] ******************************* 2026-04-24 01:53:15.133436 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:15.133525 | orchestrator | 2026-04-24 01:53:15.133542 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 01:53:15.133557 | orchestrator | testbed-manager : ok=33 changed=23 unreachable=0 failed=0 skipped=10 rescued=0 ignored=0 2026-04-24 01:53:15.133570 | orchestrator | 2026-04-24 01:53:15.727481 | orchestrator | ok: Runtime: 0:09:16.578382 2026-04-24 01:53:15.751640 | 2026-04-24 01:53:15.751863 | TASK [Point out that the log in on the manager is now possible] 2026-04-24 01:53:15.791727 | orchestrator | ok: It is now already possible to log in to the manager with 'make login'. 2026-04-24 01:53:15.801151 | 2026-04-24 01:53:15.801273 | TASK [Point out that the following task takes some time and does not give any output] 2026-04-24 01:53:15.849159 | orchestrator | ok: The task 'Run manager part 1 + 2' runs an Ansible playbook on the manager. There is no further output of this here. It takes a few minuts for this task to complete. 2026-04-24 01:53:15.858349 | 2026-04-24 01:53:15.858476 | TASK [Run manager part 1 + 2] 2026-04-24 01:53:16.739800 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-24 01:53:16.799735 | orchestrator | 2026-04-24 01:53:16.799788 | orchestrator | PLAY [Run manager part 1] ****************************************************** 2026-04-24 01:53:16.799796 | orchestrator | 2026-04-24 01:53:16.799810 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 01:53:19.850775 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:19.850833 | orchestrator | 2026-04-24 01:53:19.850858 | orchestrator | TASK [Set venv_command fact (RedHat)] ****************************************** 2026-04-24 01:53:19.896624 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:19.896686 | orchestrator | 2026-04-24 01:53:19.896702 | orchestrator | TASK [Set venv_command fact (Debian)] ****************************************** 2026-04-24 01:53:19.945466 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:19.945534 | orchestrator | 2026-04-24 01:53:19.945548 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-24 01:53:19.995637 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:19.995688 | orchestrator | 2026-04-24 01:53:19.995697 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-24 01:53:20.065646 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:20.065721 | orchestrator | 2026-04-24 01:53:20.065734 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-24 01:53:20.131517 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:20.131576 | orchestrator | 2026-04-24 01:53:20.131586 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-24 01:53:20.177429 | orchestrator | included: /home/zuul-testbed01/.ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-manager 2026-04-24 01:53:20.177478 | orchestrator | 2026-04-24 01:53:20.177484 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-24 01:53:20.961436 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:20.961498 | orchestrator | 2026-04-24 01:53:20.961511 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-24 01:53:21.013451 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:21.013502 | orchestrator | 2026-04-24 01:53:21.013510 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-24 01:53:22.401711 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:22.401764 | orchestrator | 2026-04-24 01:53:22.401776 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-24 01:53:22.951322 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:22.951377 | orchestrator | 2026-04-24 01:53:22.951385 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-24 01:53:24.070149 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:24.070234 | orchestrator | 2026-04-24 01:53:24.070253 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-24 01:53:40.135179 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:40.135289 | orchestrator | 2026-04-24 01:53:40.135316 | orchestrator | TASK [Get home directory of ansible user] ************************************** 2026-04-24 01:53:40.886853 | orchestrator | ok: [testbed-manager] 2026-04-24 01:53:40.886964 | orchestrator | 2026-04-24 01:53:40.886985 | orchestrator | TASK [Set repo_path fact] ****************************************************** 2026-04-24 01:53:40.947860 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:40.947982 | orchestrator | 2026-04-24 01:53:40.947999 | orchestrator | TASK [Copy SSH public key] ***************************************************** 2026-04-24 01:53:41.953126 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:41.953234 | orchestrator | 2026-04-24 01:53:41.953252 | orchestrator | TASK [Copy SSH private key] **************************************************** 2026-04-24 01:53:42.968873 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:42.968972 | orchestrator | 2026-04-24 01:53:42.968990 | orchestrator | TASK [Create configuration directory] ****************************************** 2026-04-24 01:53:43.563314 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:43.563463 | orchestrator | 2026-04-24 01:53:43.563491 | orchestrator | TASK [Copy testbed repo] ******************************************************* 2026-04-24 01:53:43.610910 | orchestrator | [DEPRECATION WARNING]: The connection's stdin object is deprecated. Call 2026-04-24 01:53:43.611009 | orchestrator | display.prompt_until(msg) instead. This feature will be removed in version 2026-04-24 01:53:43.611016 | orchestrator | 2.19. Deprecation warnings can be disabled by setting 2026-04-24 01:53:43.611021 | orchestrator | deprecation_warnings=False in ansible.cfg. 2026-04-24 01:53:45.704911 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:45.705230 | orchestrator | 2026-04-24 01:53:45.705252 | orchestrator | TASK [Install python requirements in venv] ************************************* 2026-04-24 01:53:55.112655 | orchestrator | ok: [testbed-manager] => (item=Jinja2) 2026-04-24 01:53:55.112756 | orchestrator | ok: [testbed-manager] => (item=PyYAML) 2026-04-24 01:53:55.112772 | orchestrator | ok: [testbed-manager] => (item=packaging) 2026-04-24 01:53:55.112783 | orchestrator | changed: [testbed-manager] => (item=python-gilt==1.2.3) 2026-04-24 01:53:55.112803 | orchestrator | ok: [testbed-manager] => (item=requests>=2.32.2) 2026-04-24 01:53:55.112813 | orchestrator | ok: [testbed-manager] => (item=docker>=7.1.0) 2026-04-24 01:53:55.112822 | orchestrator | 2026-04-24 01:53:55.112832 | orchestrator | TASK [Copy testbed custom CA certificate on Debian/Ubuntu] ********************* 2026-04-24 01:53:56.194746 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:56.194784 | orchestrator | 2026-04-24 01:53:56.194791 | orchestrator | TASK [Run update-ca-certificates on Debian/Ubuntu] ***************************** 2026-04-24 01:53:59.388843 | orchestrator | changed: [testbed-manager] 2026-04-24 01:53:59.388955 | orchestrator | 2026-04-24 01:53:59.388980 | orchestrator | TASK [Run update-ca-trust on RedHat] ******************************************* 2026-04-24 01:53:59.429345 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:53:59.429435 | orchestrator | 2026-04-24 01:53:59.429454 | orchestrator | TASK [Run manager part 2] ****************************************************** 2026-04-24 01:55:44.910593 | orchestrator | changed: [testbed-manager] 2026-04-24 01:55:44.910638 | orchestrator | 2026-04-24 01:55:44.910645 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-24 01:55:46.136250 | orchestrator | ok: [testbed-manager] 2026-04-24 01:55:46.136300 | orchestrator | 2026-04-24 01:55:46.136311 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 01:55:46.136320 | orchestrator | testbed-manager : ok=21 changed=11 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 2026-04-24 01:55:46.136327 | orchestrator | 2026-04-24 01:55:46.487270 | orchestrator | ok: Runtime: 0:02:30.092875 2026-04-24 01:55:46.495127 | 2026-04-24 01:55:46.495217 | TASK [Reboot manager] 2026-04-24 01:55:48.028790 | orchestrator | ok: Runtime: 0:00:01.027713 2026-04-24 01:55:48.044303 | 2026-04-24 01:55:48.044461 | TASK [Wait up to 300 seconds for port 22 to become open and contain "OpenSSH"] 2026-04-24 01:56:04.458161 | orchestrator | ok 2026-04-24 01:56:04.468512 | 2026-04-24 01:56:04.468663 | TASK [Wait a little longer for the manager so that everything is ready] 2026-04-24 01:57:04.516603 | orchestrator | ok 2026-04-24 01:57:04.525410 | 2026-04-24 01:57:04.525529 | TASK [Deploy manager + bootstrap nodes] 2026-04-24 01:57:07.246702 | orchestrator | 2026-04-24 01:57:07.246981 | orchestrator | # DEPLOY MANAGER 2026-04-24 01:57:07.247041 | orchestrator | 2026-04-24 01:57:07.247083 | orchestrator | + set -e 2026-04-24 01:57:07.247107 | orchestrator | + echo 2026-04-24 01:57:07.247176 | orchestrator | + echo '# DEPLOY MANAGER' 2026-04-24 01:57:07.247199 | orchestrator | + echo 2026-04-24 01:57:07.247251 | orchestrator | + cat /opt/manager-vars.sh 2026-04-24 01:57:07.249734 | orchestrator | export NUMBER_OF_NODES=6 2026-04-24 01:57:07.249798 | orchestrator | 2026-04-24 01:57:07.249811 | orchestrator | export CEPH_VERSION=reef 2026-04-24 01:57:07.249825 | orchestrator | export CONFIGURATION_VERSION=main 2026-04-24 01:57:07.249838 | orchestrator | export MANAGER_VERSION=9.5.0 2026-04-24 01:57:07.249863 | orchestrator | export OPENSTACK_VERSION=2024.2 2026-04-24 01:57:07.249875 | orchestrator | 2026-04-24 01:57:07.249894 | orchestrator | export ARA=false 2026-04-24 01:57:07.249905 | orchestrator | export DEPLOY_MODE=manager 2026-04-24 01:57:07.249923 | orchestrator | export TEMPEST=false 2026-04-24 01:57:07.249934 | orchestrator | export IS_ZUUL=true 2026-04-24 01:57:07.249961 | orchestrator | 2026-04-24 01:57:07.249980 | orchestrator | export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 01:57:07.249992 | orchestrator | export EXTERNAL_API=false 2026-04-24 01:57:07.250003 | orchestrator | 2026-04-24 01:57:07.250048 | orchestrator | export IMAGE_USER=ubuntu 2026-04-24 01:57:07.250069 | orchestrator | export IMAGE_NODE_USER=ubuntu 2026-04-24 01:57:07.250080 | orchestrator | 2026-04-24 01:57:07.250091 | orchestrator | export CEPH_STACK=ceph-ansible 2026-04-24 01:57:07.250114 | orchestrator | 2026-04-24 01:57:07.250143 | orchestrator | + echo 2026-04-24 01:57:07.250162 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 01:57:07.250906 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 01:57:07.250925 | orchestrator | ++ INTERACTIVE=false 2026-04-24 01:57:07.250939 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 01:57:07.250953 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 01:57:07.251051 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 01:57:07.251066 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 01:57:07.251077 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 01:57:07.251088 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 01:57:07.251099 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 01:57:07.251247 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 01:57:07.251264 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 01:57:07.251275 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 01:57:07.251286 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 01:57:07.251297 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 01:57:07.251318 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 01:57:07.251330 | orchestrator | ++ export ARA=false 2026-04-24 01:57:07.251341 | orchestrator | ++ ARA=false 2026-04-24 01:57:07.251352 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 01:57:07.251367 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 01:57:07.251379 | orchestrator | ++ export TEMPEST=false 2026-04-24 01:57:07.251390 | orchestrator | ++ TEMPEST=false 2026-04-24 01:57:07.251401 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 01:57:07.251412 | orchestrator | ++ IS_ZUUL=true 2026-04-24 01:57:07.251423 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 01:57:07.251435 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 01:57:07.251454 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 01:57:07.251472 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 01:57:07.251492 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 01:57:07.251510 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 01:57:07.251529 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 01:57:07.251546 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 01:57:07.251565 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 01:57:07.251577 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 01:57:07.251588 | orchestrator | + sudo ln -sf /opt/configuration/contrib/semver2.sh /usr/local/bin/semver 2026-04-24 01:57:07.317806 | orchestrator | + docker version 2026-04-24 01:57:07.433112 | orchestrator | Client: Docker Engine - Community 2026-04-24 01:57:07.433257 | orchestrator | Version: 27.5.1 2026-04-24 01:57:07.433276 | orchestrator | API version: 1.47 2026-04-24 01:57:07.433287 | orchestrator | Go version: go1.22.11 2026-04-24 01:57:07.433299 | orchestrator | Git commit: 9f9e405 2026-04-24 01:57:07.433310 | orchestrator | Built: Wed Jan 22 13:41:48 2025 2026-04-24 01:57:07.433323 | orchestrator | OS/Arch: linux/amd64 2026-04-24 01:57:07.433334 | orchestrator | Context: default 2026-04-24 01:57:07.433345 | orchestrator | 2026-04-24 01:57:07.433359 | orchestrator | Server: Docker Engine - Community 2026-04-24 01:57:07.433378 | orchestrator | Engine: 2026-04-24 01:57:07.433413 | orchestrator | Version: 27.5.1 2026-04-24 01:57:07.433433 | orchestrator | API version: 1.47 (minimum version 1.24) 2026-04-24 01:57:07.433488 | orchestrator | Go version: go1.22.11 2026-04-24 01:57:07.433506 | orchestrator | Git commit: 4c9b3b0 2026-04-24 01:57:07.433522 | orchestrator | Built: Wed Jan 22 13:41:48 2025 2026-04-24 01:57:07.433539 | orchestrator | OS/Arch: linux/amd64 2026-04-24 01:57:07.433556 | orchestrator | Experimental: false 2026-04-24 01:57:07.433574 | orchestrator | containerd: 2026-04-24 01:57:07.433592 | orchestrator | Version: v2.2.3 2026-04-24 01:57:07.433608 | orchestrator | GitCommit: 77c84241c7cbdd9b4eca2591793e3d4f4317c590 2026-04-24 01:57:07.433625 | orchestrator | runc: 2026-04-24 01:57:07.433641 | orchestrator | Version: 1.3.5 2026-04-24 01:57:07.433658 | orchestrator | GitCommit: v1.3.5-0-g488fc13e 2026-04-24 01:57:07.433676 | orchestrator | docker-init: 2026-04-24 01:57:07.433704 | orchestrator | Version: 0.19.0 2026-04-24 01:57:07.433724 | orchestrator | GitCommit: de40ad0 2026-04-24 01:57:07.437069 | orchestrator | + sh -c /opt/configuration/scripts/deploy/000-manager.sh 2026-04-24 01:57:07.448297 | orchestrator | + set -e 2026-04-24 01:57:07.448388 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 01:57:07.448402 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 01:57:07.448413 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 01:57:07.448423 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 01:57:07.448433 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 01:57:07.448443 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 01:57:07.448470 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 01:57:07.448490 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 01:57:07.448501 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 01:57:07.448511 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 01:57:07.448521 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 01:57:07.448531 | orchestrator | ++ export ARA=false 2026-04-24 01:57:07.448542 | orchestrator | ++ ARA=false 2026-04-24 01:57:07.448552 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 01:57:07.448572 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 01:57:07.448582 | orchestrator | ++ export TEMPEST=false 2026-04-24 01:57:07.448592 | orchestrator | ++ TEMPEST=false 2026-04-24 01:57:07.448601 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 01:57:07.448611 | orchestrator | ++ IS_ZUUL=true 2026-04-24 01:57:07.448621 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 01:57:07.448632 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 01:57:07.448654 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 01:57:07.448664 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 01:57:07.448674 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 01:57:07.448684 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 01:57:07.448694 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 01:57:07.448704 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 01:57:07.448713 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 01:57:07.448723 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 01:57:07.448733 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 01:57:07.448742 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 01:57:07.448752 | orchestrator | ++ INTERACTIVE=false 2026-04-24 01:57:07.448762 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 01:57:07.448776 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 01:57:07.448846 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-24 01:57:07.448858 | orchestrator | + /opt/configuration/scripts/set-manager-version.sh 9.5.0 2026-04-24 01:57:07.456345 | orchestrator | + set -e 2026-04-24 01:57:07.456475 | orchestrator | + VERSION=9.5.0 2026-04-24 01:57:07.456510 | orchestrator | + sed -i 's/manager_version: .*/manager_version: 9.5.0/g' /opt/configuration/environments/manager/configuration.yml 2026-04-24 01:57:07.464874 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-24 01:57:07.464957 | orchestrator | + sed -i /ceph_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-24 01:57:07.470297 | orchestrator | + sed -i /openstack_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-24 01:57:07.475566 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-24 01:57:07.485188 | orchestrator | /opt/configuration ~ 2026-04-24 01:57:07.485269 | orchestrator | + set -e 2026-04-24 01:57:07.485283 | orchestrator | + pushd /opt/configuration 2026-04-24 01:57:07.485295 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-24 01:57:07.487675 | orchestrator | + source /opt/venv/bin/activate 2026-04-24 01:57:07.488961 | orchestrator | ++ deactivate nondestructive 2026-04-24 01:57:07.489038 | orchestrator | ++ '[' -n '' ']' 2026-04-24 01:57:07.489057 | orchestrator | ++ '[' -n '' ']' 2026-04-24 01:57:07.489095 | orchestrator | ++ hash -r 2026-04-24 01:57:07.489108 | orchestrator | ++ '[' -n '' ']' 2026-04-24 01:57:07.489119 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-24 01:57:07.489165 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-24 01:57:07.489182 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-24 01:57:07.489203 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-24 01:57:07.489221 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-24 01:57:07.489251 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-24 01:57:07.489268 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-24 01:57:07.489285 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 01:57:07.489303 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 01:57:07.489321 | orchestrator | ++ export PATH 2026-04-24 01:57:07.489339 | orchestrator | ++ '[' -n '' ']' 2026-04-24 01:57:07.489496 | orchestrator | ++ '[' -z '' ']' 2026-04-24 01:57:07.489515 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-24 01:57:07.489526 | orchestrator | ++ PS1='(venv) ' 2026-04-24 01:57:07.489537 | orchestrator | ++ export PS1 2026-04-24 01:57:07.489548 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-24 01:57:07.489559 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-24 01:57:07.489575 | orchestrator | ++ hash -r 2026-04-24 01:57:07.489586 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-24 01:57:08.710250 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-24 01:57:08.711457 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-24 01:57:08.712668 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-24 01:57:08.714340 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-24 01:57:08.715479 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.1) 2026-04-24 01:57:08.725460 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.3) 2026-04-24 01:57:08.726555 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-24 01:57:08.727548 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-24 01:57:08.728900 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-24 01:57:08.760523 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-24 01:57:08.761750 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.13) 2026-04-24 01:57:08.763588 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-24 01:57:08.764541 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.4.22) 2026-04-24 01:57:08.768350 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-24 01:57:08.973789 | orchestrator | ++ which gilt 2026-04-24 01:57:08.978264 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-24 01:57:08.978371 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-24 01:57:09.241375 | orchestrator | osism.generics: 2026-04-24 01:57:09.404700 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-24 01:57:09.404816 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-24 01:57:09.404926 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-24 01:57:09.404940 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-24 01:57:10.217291 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-24 01:57:10.226774 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-24 01:57:10.583392 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-24 01:57:10.631966 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-24 01:57:10.632048 | orchestrator | + deactivate 2026-04-24 01:57:10.632060 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-24 01:57:10.632070 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 01:57:10.632077 | orchestrator | + export PATH 2026-04-24 01:57:10.632085 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-24 01:57:10.632093 | orchestrator | + '[' -n '' ']' 2026-04-24 01:57:10.632102 | orchestrator | + hash -r 2026-04-24 01:57:10.632110 | orchestrator | + '[' -n '' ']' 2026-04-24 01:57:10.632117 | orchestrator | + unset VIRTUAL_ENV 2026-04-24 01:57:10.632146 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-24 01:57:10.632155 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-24 01:57:10.632163 | orchestrator | + unset -f deactivate 2026-04-24 01:57:10.632170 | orchestrator | + popd 2026-04-24 01:57:10.632178 | orchestrator | ~ 2026-04-24 01:57:10.633915 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-24 01:57:10.633946 | orchestrator | + [[ ceph-ansible == \r\o\o\k ]] 2026-04-24 01:57:10.634944 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-24 01:57:10.692029 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 01:57:10.692193 | orchestrator | + echo 'enable_osism_kubernetes: true' 2026-04-24 01:57:10.692211 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-24 01:57:10.693200 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-24 01:57:10.755227 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-24 01:57:10.755914 | orchestrator | ++ semver 2024.2 2025.1 2026-04-24 01:57:10.819852 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-24 01:57:10.819949 | orchestrator | + /opt/configuration/scripts/enable-resource-nodes.sh 2026-04-24 01:57:10.915112 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-24 01:57:10.915283 | orchestrator | + source /opt/venv/bin/activate 2026-04-24 01:57:10.915310 | orchestrator | ++ deactivate nondestructive 2026-04-24 01:57:10.915333 | orchestrator | ++ '[' -n '' ']' 2026-04-24 01:57:10.915351 | orchestrator | ++ '[' -n '' ']' 2026-04-24 01:57:10.915374 | orchestrator | ++ hash -r 2026-04-24 01:57:10.915395 | orchestrator | ++ '[' -n '' ']' 2026-04-24 01:57:10.915414 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-24 01:57:10.915435 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-24 01:57:10.915456 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-24 01:57:10.915478 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-24 01:57:10.915498 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-24 01:57:10.915518 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-24 01:57:10.915538 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-24 01:57:10.915771 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 01:57:10.915839 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 01:57:10.915861 | orchestrator | ++ export PATH 2026-04-24 01:57:10.915879 | orchestrator | ++ '[' -n '' ']' 2026-04-24 01:57:10.915897 | orchestrator | ++ '[' -z '' ']' 2026-04-24 01:57:10.915915 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-24 01:57:10.915933 | orchestrator | ++ PS1='(venv) ' 2026-04-24 01:57:10.915951 | orchestrator | ++ export PS1 2026-04-24 01:57:10.915970 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-24 01:57:10.915988 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-24 01:57:10.916004 | orchestrator | ++ hash -r 2026-04-24 01:57:10.916016 | orchestrator | + ansible-playbook -i testbed-manager, --vault-password-file /opt/configuration/environments/.vault_pass /opt/configuration/ansible/manager-part-3.yml 2026-04-24 01:57:12.245213 | orchestrator | 2026-04-24 01:57:12.245321 | orchestrator | PLAY [Copy custom facts] ******************************************************* 2026-04-24 01:57:12.245339 | orchestrator | 2026-04-24 01:57:12.245352 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-24 01:57:12.846733 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:12.846857 | orchestrator | 2026-04-24 01:57:12.846886 | orchestrator | TASK [Copy fact files] ********************************************************* 2026-04-24 01:57:13.846900 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:13.847026 | orchestrator | 2026-04-24 01:57:13.847073 | orchestrator | PLAY [Before the deployment of the manager] ************************************ 2026-04-24 01:57:13.847088 | orchestrator | 2026-04-24 01:57:13.854050 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 01:57:16.278102 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:16.278324 | orchestrator | 2026-04-24 01:57:16.278346 | orchestrator | TASK [Get /opt/manager-vars.sh] ************************************************ 2026-04-24 01:57:16.332218 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:16.332341 | orchestrator | 2026-04-24 01:57:16.332365 | orchestrator | TASK [Add ara_server_mariadb_volume_type parameter] **************************** 2026-04-24 01:57:16.827861 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:16.827969 | orchestrator | 2026-04-24 01:57:16.827989 | orchestrator | TASK [Add netbox_enable parameter] ********************************************* 2026-04-24 01:57:16.871815 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:57:16.871935 | orchestrator | 2026-04-24 01:57:16.871962 | orchestrator | TASK [Install HWE kernel package on Ubuntu] ************************************ 2026-04-24 01:57:17.214833 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:17.214917 | orchestrator | 2026-04-24 01:57:17.214928 | orchestrator | TASK [Check if /etc/OTC_region exist] ****************************************** 2026-04-24 01:57:17.560727 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:17.560843 | orchestrator | 2026-04-24 01:57:17.560860 | orchestrator | TASK [Add nova_compute_virt_type parameter] ************************************ 2026-04-24 01:57:17.690350 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:57:17.690447 | orchestrator | 2026-04-24 01:57:17.690464 | orchestrator | PLAY [Apply role traefik] ****************************************************** 2026-04-24 01:57:17.690477 | orchestrator | 2026-04-24 01:57:17.690488 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 01:57:19.534484 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:19.534599 | orchestrator | 2026-04-24 01:57:19.534616 | orchestrator | TASK [Apply traefik role] ****************************************************** 2026-04-24 01:57:19.630815 | orchestrator | included: osism.services.traefik for testbed-manager 2026-04-24 01:57:19.630901 | orchestrator | 2026-04-24 01:57:19.630912 | orchestrator | TASK [osism.services.traefik : Include config tasks] *************************** 2026-04-24 01:57:19.690260 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/traefik/tasks/config.yml for testbed-manager 2026-04-24 01:57:19.690324 | orchestrator | 2026-04-24 01:57:19.690339 | orchestrator | TASK [osism.services.traefik : Create required directories] ******************** 2026-04-24 01:57:20.856478 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik) 2026-04-24 01:57:20.856605 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik/certificates) 2026-04-24 01:57:20.856629 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik/configuration) 2026-04-24 01:57:20.856646 | orchestrator | 2026-04-24 01:57:20.856668 | orchestrator | TASK [osism.services.traefik : Copy configuration files] *********************** 2026-04-24 01:57:22.765452 | orchestrator | changed: [testbed-manager] => (item=traefik.yml) 2026-04-24 01:57:22.765529 | orchestrator | changed: [testbed-manager] => (item=traefik.env) 2026-04-24 01:57:22.765537 | orchestrator | changed: [testbed-manager] => (item=certificates.yml) 2026-04-24 01:57:22.765543 | orchestrator | 2026-04-24 01:57:22.765550 | orchestrator | TASK [osism.services.traefik : Copy certificate cert files] ******************** 2026-04-24 01:57:23.431840 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-24 01:57:23.431943 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:23.431961 | orchestrator | 2026-04-24 01:57:23.431974 | orchestrator | TASK [osism.services.traefik : Copy certificate key files] ********************* 2026-04-24 01:57:24.094579 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-24 01:57:24.094682 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:24.094699 | orchestrator | 2026-04-24 01:57:24.094712 | orchestrator | TASK [osism.services.traefik : Copy dynamic configuration] ********************* 2026-04-24 01:57:24.153547 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:57:24.153642 | orchestrator | 2026-04-24 01:57:24.153656 | orchestrator | TASK [osism.services.traefik : Remove dynamic configuration] ******************* 2026-04-24 01:57:24.543303 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:24.543407 | orchestrator | 2026-04-24 01:57:24.543423 | orchestrator | TASK [osism.services.traefik : Include service tasks] ************************** 2026-04-24 01:57:24.609417 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/traefik/tasks/service.yml for testbed-manager 2026-04-24 01:57:24.609503 | orchestrator | 2026-04-24 01:57:24.609514 | orchestrator | TASK [osism.services.traefik : Create traefik external network] **************** 2026-04-24 01:57:25.770276 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:25.770380 | orchestrator | 2026-04-24 01:57:25.770398 | orchestrator | TASK [osism.services.traefik : Copy docker-compose.yml file] ******************* 2026-04-24 01:57:26.618337 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:26.618448 | orchestrator | 2026-04-24 01:57:26.618466 | orchestrator | TASK [osism.services.traefik : Manage traefik service] ************************* 2026-04-24 01:57:40.078524 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:40.078640 | orchestrator | 2026-04-24 01:57:40.078677 | orchestrator | RUNNING HANDLER [osism.services.traefik : Restart traefik service] ************* 2026-04-24 01:57:40.128458 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:57:40.128559 | orchestrator | 2026-04-24 01:57:40.128599 | orchestrator | PLAY [Deploy manager service] ************************************************** 2026-04-24 01:57:40.128613 | orchestrator | 2026-04-24 01:57:40.128624 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 01:57:42.012631 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:42.012741 | orchestrator | 2026-04-24 01:57:42.012759 | orchestrator | TASK [Apply manager role] ****************************************************** 2026-04-24 01:57:42.135731 | orchestrator | included: osism.services.manager for testbed-manager 2026-04-24 01:57:42.135829 | orchestrator | 2026-04-24 01:57:42.135843 | orchestrator | TASK [osism.services.manager : Include install tasks] ************************** 2026-04-24 01:57:42.211303 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 01:57:42.211406 | orchestrator | 2026-04-24 01:57:42.211425 | orchestrator | TASK [osism.services.manager : Install required packages] ********************** 2026-04-24 01:57:44.851784 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:44.851891 | orchestrator | 2026-04-24 01:57:44.851907 | orchestrator | TASK [osism.services.manager : Gather variables for each operating system] ***** 2026-04-24 01:57:44.910473 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:44.910551 | orchestrator | 2026-04-24 01:57:44.910561 | orchestrator | TASK [osism.services.manager : Include config tasks] *************************** 2026-04-24 01:57:45.047857 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config.yml for testbed-manager 2026-04-24 01:57:45.047948 | orchestrator | 2026-04-24 01:57:45.047961 | orchestrator | TASK [osism.services.manager : Create required directories] ******************** 2026-04-24 01:57:47.978158 | orchestrator | changed: [testbed-manager] => (item=/opt/ansible) 2026-04-24 01:57:47.978277 | orchestrator | changed: [testbed-manager] => (item=/opt/archive) 2026-04-24 01:57:47.978294 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/configuration) 2026-04-24 01:57:47.978307 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/data) 2026-04-24 01:57:47.978318 | orchestrator | ok: [testbed-manager] => (item=/opt/manager) 2026-04-24 01:57:47.978330 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/secrets) 2026-04-24 01:57:47.978341 | orchestrator | changed: [testbed-manager] => (item=/opt/ansible/secrets) 2026-04-24 01:57:47.978352 | orchestrator | changed: [testbed-manager] => (item=/opt/state) 2026-04-24 01:57:47.978363 | orchestrator | 2026-04-24 01:57:47.978375 | orchestrator | TASK [osism.services.manager : Copy all environment file] ********************** 2026-04-24 01:57:48.617165 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:48.617293 | orchestrator | 2026-04-24 01:57:48.617315 | orchestrator | TASK [osism.services.manager : Copy client environment file] ******************* 2026-04-24 01:57:49.277209 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:49.277318 | orchestrator | 2026-04-24 01:57:49.277335 | orchestrator | TASK [osism.services.manager : Include ara config tasks] *********************** 2026-04-24 01:57:49.354548 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ara.yml for testbed-manager 2026-04-24 01:57:49.354643 | orchestrator | 2026-04-24 01:57:49.354673 | orchestrator | TASK [osism.services.manager : Copy ARA environment files] ********************* 2026-04-24 01:57:50.601430 | orchestrator | changed: [testbed-manager] => (item=ara) 2026-04-24 01:57:50.601500 | orchestrator | changed: [testbed-manager] => (item=ara-server) 2026-04-24 01:57:50.601506 | orchestrator | 2026-04-24 01:57:50.601511 | orchestrator | TASK [osism.services.manager : Copy MariaDB environment file] ****************** 2026-04-24 01:57:51.261037 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:51.261181 | orchestrator | 2026-04-24 01:57:51.261200 | orchestrator | TASK [osism.services.manager : Include vault config tasks] ********************* 2026-04-24 01:57:51.314744 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:57:51.314871 | orchestrator | 2026-04-24 01:57:51.314898 | orchestrator | TASK [osism.services.manager : Include frontend config tasks] ****************** 2026-04-24 01:57:51.399611 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-frontend.yml for testbed-manager 2026-04-24 01:57:51.399702 | orchestrator | 2026-04-24 01:57:51.399717 | orchestrator | TASK [osism.services.manager : Copy frontend environment file] ***************** 2026-04-24 01:57:52.107690 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:52.107791 | orchestrator | 2026-04-24 01:57:52.107808 | orchestrator | TASK [osism.services.manager : Include ansible config tasks] ******************* 2026-04-24 01:57:52.177688 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ansible.yml for testbed-manager 2026-04-24 01:57:52.177787 | orchestrator | 2026-04-24 01:57:52.177802 | orchestrator | TASK [osism.services.manager : Copy private ssh keys] ************************** 2026-04-24 01:57:53.626008 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-24 01:57:53.626285 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-24 01:57:53.626303 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:53.626317 | orchestrator | 2026-04-24 01:57:53.626330 | orchestrator | TASK [osism.services.manager : Copy ansible environment file] ****************** 2026-04-24 01:57:54.272833 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:54.272938 | orchestrator | 2026-04-24 01:57:54.272956 | orchestrator | TASK [osism.services.manager : Include netbox config tasks] ******************** 2026-04-24 01:57:54.324495 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:57:54.324594 | orchestrator | 2026-04-24 01:57:54.324610 | orchestrator | TASK [osism.services.manager : Include celery config tasks] ******************** 2026-04-24 01:57:54.424264 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-celery.yml for testbed-manager 2026-04-24 01:57:54.424383 | orchestrator | 2026-04-24 01:57:54.424407 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_watches] **************** 2026-04-24 01:57:55.988630 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:55.988771 | orchestrator | 2026-04-24 01:57:55.988789 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_instances] ************** 2026-04-24 01:57:56.407409 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:56.407510 | orchestrator | 2026-04-24 01:57:56.407527 | orchestrator | TASK [osism.services.manager : Copy celery environment files] ****************** 2026-04-24 01:57:57.653502 | orchestrator | changed: [testbed-manager] => (item=conductor) 2026-04-24 01:57:57.653606 | orchestrator | changed: [testbed-manager] => (item=openstack) 2026-04-24 01:57:57.653623 | orchestrator | 2026-04-24 01:57:57.653637 | orchestrator | TASK [osism.services.manager : Copy listener environment file] ***************** 2026-04-24 01:57:58.311317 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:58.311423 | orchestrator | 2026-04-24 01:57:58.311440 | orchestrator | TASK [osism.services.manager : Check for conductor.yml] ************************ 2026-04-24 01:57:58.715084 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:58.715256 | orchestrator | 2026-04-24 01:57:58.715278 | orchestrator | TASK [osism.services.manager : Copy conductor configuration file] ************** 2026-04-24 01:57:59.100295 | orchestrator | changed: [testbed-manager] 2026-04-24 01:57:59.100377 | orchestrator | 2026-04-24 01:57:59.100389 | orchestrator | TASK [osism.services.manager : Copy empty conductor configuration file] ******** 2026-04-24 01:57:59.137787 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:57:59.137871 | orchestrator | 2026-04-24 01:57:59.137881 | orchestrator | TASK [osism.services.manager : Include wrapper config tasks] ******************* 2026-04-24 01:57:59.209919 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-wrapper.yml for testbed-manager 2026-04-24 01:57:59.209992 | orchestrator | 2026-04-24 01:57:59.209998 | orchestrator | TASK [osism.services.manager : Include wrapper vars file] ********************** 2026-04-24 01:57:59.261912 | orchestrator | ok: [testbed-manager] 2026-04-24 01:57:59.261993 | orchestrator | 2026-04-24 01:57:59.262005 | orchestrator | TASK [osism.services.manager : Copy wrapper scripts] *************************** 2026-04-24 01:58:01.400626 | orchestrator | changed: [testbed-manager] => (item=osism) 2026-04-24 01:58:01.400723 | orchestrator | changed: [testbed-manager] => (item=osism-update-docker) 2026-04-24 01:58:01.400783 | orchestrator | changed: [testbed-manager] => (item=osism-update-manager) 2026-04-24 01:58:01.400795 | orchestrator | 2026-04-24 01:58:01.400806 | orchestrator | TASK [osism.services.manager : Copy cilium wrapper script] ********************* 2026-04-24 01:58:02.135672 | orchestrator | changed: [testbed-manager] 2026-04-24 01:58:02.135774 | orchestrator | 2026-04-24 01:58:02.135792 | orchestrator | TASK [osism.services.manager : Copy hubble wrapper script] ********************* 2026-04-24 01:58:02.865473 | orchestrator | changed: [testbed-manager] 2026-04-24 01:58:02.865597 | orchestrator | 2026-04-24 01:58:02.865617 | orchestrator | TASK [osism.services.manager : Copy flux wrapper script] *********************** 2026-04-24 01:58:03.711008 | orchestrator | changed: [testbed-manager] 2026-04-24 01:58:03.711167 | orchestrator | 2026-04-24 01:58:03.711187 | orchestrator | TASK [osism.services.manager : Include scripts config tasks] ******************* 2026-04-24 01:58:03.796151 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-scripts.yml for testbed-manager 2026-04-24 01:58:03.796286 | orchestrator | 2026-04-24 01:58:03.796318 | orchestrator | TASK [osism.services.manager : Include scripts vars file] ********************** 2026-04-24 01:58:03.846339 | orchestrator | ok: [testbed-manager] 2026-04-24 01:58:03.846442 | orchestrator | 2026-04-24 01:58:03.846459 | orchestrator | TASK [osism.services.manager : Copy scripts] *********************************** 2026-04-24 01:58:04.598458 | orchestrator | changed: [testbed-manager] => (item=osism-include) 2026-04-24 01:58:04.598561 | orchestrator | 2026-04-24 01:58:04.598578 | orchestrator | TASK [osism.services.manager : Include service tasks] ************************** 2026-04-24 01:58:04.699216 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/service.yml for testbed-manager 2026-04-24 01:58:04.699316 | orchestrator | 2026-04-24 01:58:04.699331 | orchestrator | TASK [osism.services.manager : Copy manager systemd unit file] ***************** 2026-04-24 01:58:05.446371 | orchestrator | changed: [testbed-manager] 2026-04-24 01:58:05.446475 | orchestrator | 2026-04-24 01:58:05.446493 | orchestrator | TASK [osism.services.manager : Create traefik external network] **************** 2026-04-24 01:58:06.085509 | orchestrator | ok: [testbed-manager] 2026-04-24 01:58:06.085609 | orchestrator | 2026-04-24 01:58:06.085624 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb < 11.0.0] *** 2026-04-24 01:58:06.145446 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:58:06.145578 | orchestrator | 2026-04-24 01:58:06.145608 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb >= 11.0.0] *** 2026-04-24 01:58:06.209547 | orchestrator | ok: [testbed-manager] 2026-04-24 01:58:06.209680 | orchestrator | 2026-04-24 01:58:06.209706 | orchestrator | TASK [osism.services.manager : Copy docker-compose.yml file] ******************* 2026-04-24 01:58:07.035137 | orchestrator | changed: [testbed-manager] 2026-04-24 01:58:07.035241 | orchestrator | 2026-04-24 01:58:07.035256 | orchestrator | TASK [osism.services.manager : Pull container images] ************************** 2026-04-24 01:59:22.226391 | orchestrator | changed: [testbed-manager] 2026-04-24 01:59:22.226555 | orchestrator | 2026-04-24 01:59:22.226576 | orchestrator | TASK [osism.services.manager : Stop and disable old service docker-compose@manager] *** 2026-04-24 01:59:23.253614 | orchestrator | ok: [testbed-manager] 2026-04-24 01:59:23.253729 | orchestrator | 2026-04-24 01:59:23.253756 | orchestrator | TASK [osism.services.manager : Do a manual start of the manager service] ******* 2026-04-24 01:59:23.316909 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:59:23.317022 | orchestrator | 2026-04-24 01:59:23.317042 | orchestrator | TASK [osism.services.manager : Manage manager service] ************************* 2026-04-24 01:59:26.147663 | orchestrator | changed: [testbed-manager] 2026-04-24 01:59:26.147832 | orchestrator | 2026-04-24 01:59:26.147863 | orchestrator | TASK [osism.services.manager : Register that manager service was started] ****** 2026-04-24 01:59:26.195709 | orchestrator | ok: [testbed-manager] 2026-04-24 01:59:26.195802 | orchestrator | 2026-04-24 01:59:26.195819 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-24 01:59:26.195832 | orchestrator | 2026-04-24 01:59:26.195843 | orchestrator | RUNNING HANDLER [osism.services.manager : Restart manager service] ************* 2026-04-24 01:59:26.348836 | orchestrator | skipping: [testbed-manager] 2026-04-24 01:59:26.348937 | orchestrator | 2026-04-24 01:59:26.348955 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for manager service to start] *** 2026-04-24 02:00:26.412103 | orchestrator | Pausing for 60 seconds 2026-04-24 02:00:26.412223 | orchestrator | changed: [testbed-manager] 2026-04-24 02:00:26.412239 | orchestrator | 2026-04-24 02:00:26.412252 | orchestrator | RUNNING HANDLER [osism.services.manager : Ensure that all containers are up] *** 2026-04-24 02:00:29.642631 | orchestrator | changed: [testbed-manager] 2026-04-24 02:00:29.642753 | orchestrator | 2026-04-24 02:00:29.642773 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for an healthy manager service] *** 2026-04-24 02:01:31.800208 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (50 retries left). 2026-04-24 02:01:31.800317 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (49 retries left). 2026-04-24 02:01:31.800362 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (48 retries left). 2026-04-24 02:01:31.800380 | orchestrator | changed: [testbed-manager] 2026-04-24 02:01:31.800397 | orchestrator | 2026-04-24 02:01:31.800413 | orchestrator | RUNNING HANDLER [osism.services.manager : Copy osismclient bash completion script] *** 2026-04-24 02:01:42.660099 | orchestrator | changed: [testbed-manager] 2026-04-24 02:01:42.660182 | orchestrator | 2026-04-24 02:01:42.660190 | orchestrator | TASK [osism.services.manager : Include initialize tasks] *********************** 2026-04-24 02:01:42.753681 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/initialize.yml for testbed-manager 2026-04-24 02:01:42.753766 | orchestrator | 2026-04-24 02:01:42.753778 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-24 02:01:42.753788 | orchestrator | 2026-04-24 02:01:42.753796 | orchestrator | TASK [osism.services.manager : Include vault initialize tasks] ***************** 2026-04-24 02:01:42.808228 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:01:42.808323 | orchestrator | 2026-04-24 02:01:42.808338 | orchestrator | TASK [osism.services.manager : Include version verification tasks] ************* 2026-04-24 02:01:42.879134 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/verify-versions.yml for testbed-manager 2026-04-24 02:01:42.879218 | orchestrator | 2026-04-24 02:01:42.879227 | orchestrator | TASK [osism.services.manager : Deploy service manager version check script] **** 2026-04-24 02:01:43.649216 | orchestrator | changed: [testbed-manager] 2026-04-24 02:01:43.649318 | orchestrator | 2026-04-24 02:01:43.649337 | orchestrator | TASK [osism.services.manager : Execute service manager version check] ********** 2026-04-24 02:01:47.121730 | orchestrator | ok: [testbed-manager] 2026-04-24 02:01:47.121831 | orchestrator | 2026-04-24 02:01:47.121847 | orchestrator | TASK [osism.services.manager : Display version check results] ****************** 2026-04-24 02:01:47.194395 | orchestrator | ok: [testbed-manager] => { 2026-04-24 02:01:47.194460 | orchestrator | "version_check_result.stdout_lines": [ 2026-04-24 02:01:47.194466 | orchestrator | "=== OSISM Container Version Check ===", 2026-04-24 02:01:47.194471 | orchestrator | "Checking running containers against expected versions...", 2026-04-24 02:01:47.194476 | orchestrator | "", 2026-04-24 02:01:47.194482 | orchestrator | "Checking service: inventory_reconciler (Inventory Reconciler Service)", 2026-04-24 02:01:47.194486 | orchestrator | " Expected: registry.osism.tech/osism/inventory-reconciler:0.20251130.0", 2026-04-24 02:01:47.194491 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194495 | orchestrator | " Running: registry.osism.tech/osism/inventory-reconciler:0.20251130.0", 2026-04-24 02:01:47.194499 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194503 | orchestrator | "", 2026-04-24 02:01:47.194508 | orchestrator | "Checking service: osism-ansible (OSISM Ansible Service)", 2026-04-24 02:01:47.194530 | orchestrator | " Expected: registry.osism.tech/osism/osism-ansible:0.20251130.0", 2026-04-24 02:01:47.194534 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194539 | orchestrator | " Running: registry.osism.tech/osism/osism-ansible:0.20251130.0", 2026-04-24 02:01:47.194543 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194546 | orchestrator | "", 2026-04-24 02:01:47.194551 | orchestrator | "Checking service: osism-kubernetes (Osism-Kubernetes Service)", 2026-04-24 02:01:47.194555 | orchestrator | " Expected: registry.osism.tech/osism/osism-kubernetes:0.20251130.0", 2026-04-24 02:01:47.194559 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194562 | orchestrator | " Running: registry.osism.tech/osism/osism-kubernetes:0.20251130.0", 2026-04-24 02:01:47.194566 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194570 | orchestrator | "", 2026-04-24 02:01:47.194574 | orchestrator | "Checking service: ceph-ansible (Ceph-Ansible Service)", 2026-04-24 02:01:47.194578 | orchestrator | " Expected: registry.osism.tech/osism/ceph-ansible:0.20251130.0", 2026-04-24 02:01:47.194581 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194585 | orchestrator | " Running: registry.osism.tech/osism/ceph-ansible:0.20251130.0", 2026-04-24 02:01:47.194589 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194593 | orchestrator | "", 2026-04-24 02:01:47.194599 | orchestrator | "Checking service: kolla-ansible (Kolla-Ansible Service)", 2026-04-24 02:01:47.194603 | orchestrator | " Expected: registry.osism.tech/osism/kolla-ansible:0.20251130.0", 2026-04-24 02:01:47.194606 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194610 | orchestrator | " Running: registry.osism.tech/osism/kolla-ansible:0.20251130.0", 2026-04-24 02:01:47.194614 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194618 | orchestrator | "", 2026-04-24 02:01:47.194621 | orchestrator | "Checking service: osismclient (OSISM Client)", 2026-04-24 02:01:47.194625 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194629 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194633 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194637 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194640 | orchestrator | "", 2026-04-24 02:01:47.194644 | orchestrator | "Checking service: ara-server (ARA Server)", 2026-04-24 02:01:47.194648 | orchestrator | " Expected: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-24 02:01:47.194652 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194656 | orchestrator | " Running: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-24 02:01:47.194660 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194664 | orchestrator | "", 2026-04-24 02:01:47.194668 | orchestrator | "Checking service: mariadb (MariaDB for ARA)", 2026-04-24 02:01:47.194671 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-24 02:01:47.194675 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194679 | orchestrator | " Running: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-24 02:01:47.194683 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194686 | orchestrator | "", 2026-04-24 02:01:47.194690 | orchestrator | "Checking service: frontend (OSISM Frontend)", 2026-04-24 02:01:47.194694 | orchestrator | " Expected: registry.osism.tech/osism/osism-frontend:0.20251130.1", 2026-04-24 02:01:47.194698 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194701 | orchestrator | " Running: registry.osism.tech/osism/osism-frontend:0.20251130.1", 2026-04-24 02:01:47.194705 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194709 | orchestrator | "", 2026-04-24 02:01:47.194713 | orchestrator | "Checking service: redis (Redis Cache)", 2026-04-24 02:01:47.194717 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-24 02:01:47.194720 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194724 | orchestrator | " Running: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-24 02:01:47.194728 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194732 | orchestrator | "", 2026-04-24 02:01:47.194735 | orchestrator | "Checking service: api (OSISM API Service)", 2026-04-24 02:01:47.194743 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194747 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194750 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194754 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194758 | orchestrator | "", 2026-04-24 02:01:47.194762 | orchestrator | "Checking service: listener (OpenStack Event Listener)", 2026-04-24 02:01:47.194766 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194769 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194773 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194778 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194781 | orchestrator | "", 2026-04-24 02:01:47.194785 | orchestrator | "Checking service: openstack (OpenStack Integration)", 2026-04-24 02:01:47.194789 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194793 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194797 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194800 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194804 | orchestrator | "", 2026-04-24 02:01:47.194808 | orchestrator | "Checking service: beat (Celery Beat Scheduler)", 2026-04-24 02:01:47.194811 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194815 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194819 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194833 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194837 | orchestrator | "", 2026-04-24 02:01:47.194841 | orchestrator | "Checking service: flower (Celery Flower Monitor)", 2026-04-24 02:01:47.194845 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194853 | orchestrator | " Enabled: true", 2026-04-24 02:01:47.194857 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-24 02:01:47.194861 | orchestrator | " Status: ✅ MATCH", 2026-04-24 02:01:47.194865 | orchestrator | "", 2026-04-24 02:01:47.194869 | orchestrator | "=== Summary ===", 2026-04-24 02:01:47.194873 | orchestrator | "Errors (version mismatches): 0", 2026-04-24 02:01:47.194877 | orchestrator | "Warnings (expected containers not running): 0", 2026-04-24 02:01:47.194881 | orchestrator | "", 2026-04-24 02:01:47.194884 | orchestrator | "✅ All running containers match expected versions!" 2026-04-24 02:01:47.194889 | orchestrator | ] 2026-04-24 02:01:47.194892 | orchestrator | } 2026-04-24 02:01:47.194897 | orchestrator | 2026-04-24 02:01:47.194901 | orchestrator | TASK [osism.services.manager : Skip version check due to service configuration] *** 2026-04-24 02:01:47.240875 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:01:47.240950 | orchestrator | 2026-04-24 02:01:47.240959 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:01:47.240967 | orchestrator | testbed-manager : ok=70 changed=37 unreachable=0 failed=0 skipped=12 rescued=0 ignored=0 2026-04-24 02:01:47.240973 | orchestrator | 2026-04-24 02:01:47.353777 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-24 02:01:47.353881 | orchestrator | + deactivate 2026-04-24 02:01:47.353899 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-24 02:01:47.353913 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 02:01:47.353924 | orchestrator | + export PATH 2026-04-24 02:01:47.353936 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-24 02:01:47.353948 | orchestrator | + '[' -n '' ']' 2026-04-24 02:01:47.353959 | orchestrator | + hash -r 2026-04-24 02:01:47.353970 | orchestrator | + '[' -n '' ']' 2026-04-24 02:01:47.353981 | orchestrator | + unset VIRTUAL_ENV 2026-04-24 02:01:47.353992 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-24 02:01:47.354004 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-24 02:01:47.354140 | orchestrator | + unset -f deactivate 2026-04-24 02:01:47.354153 | orchestrator | + cp /home/dragon/.ssh/id_rsa.pub /opt/ansible/secrets/id_rsa.operator.pub 2026-04-24 02:01:47.361171 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-24 02:01:47.361305 | orchestrator | + wait_for_container_healthy 60 ceph-ansible 2026-04-24 02:01:47.361330 | orchestrator | + local max_attempts=60 2026-04-24 02:01:47.361351 | orchestrator | + local name=ceph-ansible 2026-04-24 02:01:47.361371 | orchestrator | + local attempt_num=1 2026-04-24 02:01:47.362269 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:01:47.408621 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:01:47.408705 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-24 02:01:47.408717 | orchestrator | + local max_attempts=60 2026-04-24 02:01:47.408728 | orchestrator | + local name=kolla-ansible 2026-04-24 02:01:47.408737 | orchestrator | + local attempt_num=1 2026-04-24 02:01:47.408746 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-24 02:01:47.443340 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:01:47.443432 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-24 02:01:47.443448 | orchestrator | + local max_attempts=60 2026-04-24 02:01:47.443461 | orchestrator | + local name=osism-ansible 2026-04-24 02:01:47.443473 | orchestrator | + local attempt_num=1 2026-04-24 02:01:47.444667 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-24 02:01:47.473345 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:01:47.473433 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-24 02:01:47.473445 | orchestrator | + sh -c /opt/configuration/scripts/disable-ara.sh 2026-04-24 02:01:48.203872 | orchestrator | + docker compose --project-directory /opt/manager ps 2026-04-24 02:01:48.384201 | orchestrator | NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS 2026-04-24 02:01:48.384396 | orchestrator | ceph-ansible registry.osism.tech/osism/ceph-ansible:0.20251130.0 "/entrypoint.sh osis…" ceph-ansible 2 minutes ago Up About a minute (healthy) 2026-04-24 02:01:48.384417 | orchestrator | kolla-ansible registry.osism.tech/osism/kolla-ansible:0.20251130.0 "/entrypoint.sh osis…" kolla-ansible 2 minutes ago Up About a minute (healthy) 2026-04-24 02:01:48.384430 | orchestrator | manager-api-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" api 2 minutes ago Up 2 minutes (healthy) 192.168.16.5:8000->8000/tcp 2026-04-24 02:01:48.384444 | orchestrator | manager-ara-server-1 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" ara-server 2 minutes ago Up 2 minutes (healthy) 8000/tcp 2026-04-24 02:01:48.384479 | orchestrator | manager-beat-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" beat 2 minutes ago Up 2 minutes (healthy) 2026-04-24 02:01:48.384492 | orchestrator | manager-flower-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" flower 2 minutes ago Up 2 minutes (healthy) 2026-04-24 02:01:48.384503 | orchestrator | manager-inventory_reconciler-1 registry.osism.tech/osism/inventory-reconciler:0.20251130.0 "/sbin/tini -- /entr…" inventory_reconciler 2 minutes ago Up About a minute (healthy) 2026-04-24 02:01:48.384516 | orchestrator | manager-listener-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" listener 2 minutes ago Up 2 minutes (healthy) 2026-04-24 02:01:48.384529 | orchestrator | manager-mariadb-1 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" mariadb 2 minutes ago Up 2 minutes (healthy) 3306/tcp 2026-04-24 02:01:48.384542 | orchestrator | manager-openstack-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" openstack 2 minutes ago Up 2 minutes (healthy) 2026-04-24 02:01:48.384554 | orchestrator | manager-redis-1 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" redis 2 minutes ago Up 2 minutes (healthy) 6379/tcp 2026-04-24 02:01:48.384592 | orchestrator | osism-ansible registry.osism.tech/osism/osism-ansible:0.20251130.0 "/entrypoint.sh osis…" osism-ansible 2 minutes ago Up About a minute (healthy) 2026-04-24 02:01:48.384612 | orchestrator | osism-frontend registry.osism.tech/osism/osism-frontend:0.20251130.1 "docker-entrypoint.s…" frontend 2 minutes ago Up 2 minutes 192.168.16.5:3000->3000/tcp 2026-04-24 02:01:48.384632 | orchestrator | osism-kubernetes registry.osism.tech/osism/osism-kubernetes:0.20251130.0 "/entrypoint.sh osis…" osism-kubernetes 2 minutes ago Up About a minute (healthy) 2026-04-24 02:01:48.384650 | orchestrator | osismclient registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- sleep…" osismclient 2 minutes ago Up 2 minutes (healthy) 2026-04-24 02:01:48.388919 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-24 02:01:48.436556 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 02:01:48.436641 | orchestrator | + sed -i s/community.general.yaml/osism.commons.still_alive/ /opt/configuration/environments/ansible.cfg 2026-04-24 02:01:48.439488 | orchestrator | + osism apply resolvconf -l testbed-manager 2026-04-24 02:02:00.781161 | orchestrator | 2026-04-24 02:02:00 | INFO  | Task 64d4c435-13e6-4b30-a476-7a0b3ef0e094 (resolvconf) was prepared for execution. 2026-04-24 02:02:00.781240 | orchestrator | 2026-04-24 02:02:00 | INFO  | It takes a moment until task 64d4c435-13e6-4b30-a476-7a0b3ef0e094 (resolvconf) has been started and output is visible here. 2026-04-24 02:02:15.339133 | orchestrator | 2026-04-24 02:02:15.339284 | orchestrator | PLAY [Apply role resolvconf] *************************************************** 2026-04-24 02:02:15.339304 | orchestrator | 2026-04-24 02:02:15.339316 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 02:02:15.339368 | orchestrator | Friday 24 April 2026 02:02:04 +0000 (0:00:00.142) 0:00:00.142 ********** 2026-04-24 02:02:15.339381 | orchestrator | ok: [testbed-manager] 2026-04-24 02:02:15.339393 | orchestrator | 2026-04-24 02:02:15.339405 | orchestrator | TASK [osism.commons.resolvconf : Check minimum and maximum number of name servers] *** 2026-04-24 02:02:15.339417 | orchestrator | Friday 24 April 2026 02:02:08 +0000 (0:00:04.020) 0:00:04.163 ********** 2026-04-24 02:02:15.339428 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:02:15.339440 | orchestrator | 2026-04-24 02:02:15.339451 | orchestrator | TASK [osism.commons.resolvconf : Include resolvconf tasks] ********************* 2026-04-24 02:02:15.339464 | orchestrator | Friday 24 April 2026 02:02:09 +0000 (0:00:00.068) 0:00:04.231 ********** 2026-04-24 02:02:15.339485 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-resolv.yml for testbed-manager 2026-04-24 02:02:15.339514 | orchestrator | 2026-04-24 02:02:15.339534 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific installation tasks] *** 2026-04-24 02:02:15.339553 | orchestrator | Friday 24 April 2026 02:02:09 +0000 (0:00:00.077) 0:00:04.309 ********** 2026-04-24 02:02:15.339594 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 02:02:15.339615 | orchestrator | 2026-04-24 02:02:15.339634 | orchestrator | TASK [osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf] *** 2026-04-24 02:02:15.339652 | orchestrator | Friday 24 April 2026 02:02:09 +0000 (0:00:00.087) 0:00:04.397 ********** 2026-04-24 02:02:15.339671 | orchestrator | ok: [testbed-manager] 2026-04-24 02:02:15.339691 | orchestrator | 2026-04-24 02:02:15.339710 | orchestrator | TASK [osism.commons.resolvconf : Install package systemd-resolved] ************* 2026-04-24 02:02:15.339730 | orchestrator | Friday 24 April 2026 02:02:10 +0000 (0:00:01.222) 0:00:05.620 ********** 2026-04-24 02:02:15.339749 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:02:15.339770 | orchestrator | 2026-04-24 02:02:15.339790 | orchestrator | TASK [osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf] ***** 2026-04-24 02:02:15.339808 | orchestrator | Friday 24 April 2026 02:02:10 +0000 (0:00:00.067) 0:00:05.687 ********** 2026-04-24 02:02:15.339862 | orchestrator | ok: [testbed-manager] 2026-04-24 02:02:15.339882 | orchestrator | 2026-04-24 02:02:15.339896 | orchestrator | TASK [osism.commons.resolvconf : Archive existing file /etc/resolv.conf] ******* 2026-04-24 02:02:15.339909 | orchestrator | Friday 24 April 2026 02:02:11 +0000 (0:00:00.537) 0:00:06.225 ********** 2026-04-24 02:02:15.339922 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:02:15.339939 | orchestrator | 2026-04-24 02:02:15.339957 | orchestrator | TASK [osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf] *** 2026-04-24 02:02:15.339977 | orchestrator | Friday 24 April 2026 02:02:11 +0000 (0:00:00.082) 0:00:06.308 ********** 2026-04-24 02:02:15.339994 | orchestrator | changed: [testbed-manager] 2026-04-24 02:02:15.340045 | orchestrator | 2026-04-24 02:02:15.340062 | orchestrator | TASK [osism.commons.resolvconf : Copy configuration files] ********************* 2026-04-24 02:02:15.340074 | orchestrator | Friday 24 April 2026 02:02:11 +0000 (0:00:00.592) 0:00:06.900 ********** 2026-04-24 02:02:15.340085 | orchestrator | changed: [testbed-manager] 2026-04-24 02:02:15.340096 | orchestrator | 2026-04-24 02:02:15.340107 | orchestrator | TASK [osism.commons.resolvconf : Start/enable systemd-resolved service] ******** 2026-04-24 02:02:15.340118 | orchestrator | Friday 24 April 2026 02:02:12 +0000 (0:00:01.121) 0:00:08.021 ********** 2026-04-24 02:02:15.340129 | orchestrator | ok: [testbed-manager] 2026-04-24 02:02:15.340140 | orchestrator | 2026-04-24 02:02:15.340151 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific configuration tasks] *** 2026-04-24 02:02:15.340165 | orchestrator | Friday 24 April 2026 02:02:13 +0000 (0:00:00.997) 0:00:09.018 ********** 2026-04-24 02:02:15.340184 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-Debian-family.yml for testbed-manager 2026-04-24 02:02:15.340195 | orchestrator | 2026-04-24 02:02:15.340206 | orchestrator | TASK [osism.commons.resolvconf : Restart systemd-resolved service] ************* 2026-04-24 02:02:15.340217 | orchestrator | Friday 24 April 2026 02:02:13 +0000 (0:00:00.079) 0:00:09.098 ********** 2026-04-24 02:02:15.340228 | orchestrator | changed: [testbed-manager] 2026-04-24 02:02:15.340239 | orchestrator | 2026-04-24 02:02:15.340250 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:02:15.340263 | orchestrator | testbed-manager : ok=10  changed=3  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 02:02:15.340274 | orchestrator | 2026-04-24 02:02:15.340285 | orchestrator | 2026-04-24 02:02:15.340298 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:02:15.340316 | orchestrator | Friday 24 April 2026 02:02:15 +0000 (0:00:01.202) 0:00:10.301 ********** 2026-04-24 02:02:15.340335 | orchestrator | =============================================================================== 2026-04-24 02:02:15.340352 | orchestrator | Gathering Facts --------------------------------------------------------- 4.02s 2026-04-24 02:02:15.340369 | orchestrator | osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf --- 1.22s 2026-04-24 02:02:15.340386 | orchestrator | osism.commons.resolvconf : Restart systemd-resolved service ------------- 1.20s 2026-04-24 02:02:15.340405 | orchestrator | osism.commons.resolvconf : Copy configuration files --------------------- 1.12s 2026-04-24 02:02:15.340425 | orchestrator | osism.commons.resolvconf : Start/enable systemd-resolved service -------- 1.00s 2026-04-24 02:02:15.340444 | orchestrator | osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf --- 0.59s 2026-04-24 02:02:15.340489 | orchestrator | osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf ----- 0.54s 2026-04-24 02:02:15.340508 | orchestrator | osism.commons.resolvconf : Include distribution specific installation tasks --- 0.09s 2026-04-24 02:02:15.340522 | orchestrator | osism.commons.resolvconf : Archive existing file /etc/resolv.conf ------- 0.08s 2026-04-24 02:02:15.340533 | orchestrator | osism.commons.resolvconf : Include distribution specific configuration tasks --- 0.08s 2026-04-24 02:02:15.340544 | orchestrator | osism.commons.resolvconf : Include resolvconf tasks --------------------- 0.08s 2026-04-24 02:02:15.340568 | orchestrator | osism.commons.resolvconf : Check minimum and maximum number of name servers --- 0.07s 2026-04-24 02:02:15.340579 | orchestrator | osism.commons.resolvconf : Install package systemd-resolved ------------- 0.07s 2026-04-24 02:02:15.646364 | orchestrator | + osism apply sshconfig 2026-04-24 02:02:27.751643 | orchestrator | 2026-04-24 02:02:27 | INFO  | Task 3c84e79e-d307-42e9-85c4-7d72fe52c701 (sshconfig) was prepared for execution. 2026-04-24 02:02:27.752561 | orchestrator | 2026-04-24 02:02:27 | INFO  | It takes a moment until task 3c84e79e-d307-42e9-85c4-7d72fe52c701 (sshconfig) has been started and output is visible here. 2026-04-24 02:02:40.035322 | orchestrator | 2026-04-24 02:02:40.036365 | orchestrator | PLAY [Apply role sshconfig] **************************************************** 2026-04-24 02:02:40.036423 | orchestrator | 2026-04-24 02:02:40.036462 | orchestrator | TASK [osism.commons.sshconfig : Get home directory of operator user] *********** 2026-04-24 02:02:40.036478 | orchestrator | Friday 24 April 2026 02:02:31 +0000 (0:00:00.163) 0:00:00.163 ********** 2026-04-24 02:02:40.036493 | orchestrator | ok: [testbed-manager] 2026-04-24 02:02:40.036509 | orchestrator | 2026-04-24 02:02:40.036524 | orchestrator | TASK [osism.commons.sshconfig : Ensure .ssh/config.d exist] ******************** 2026-04-24 02:02:40.036539 | orchestrator | Friday 24 April 2026 02:02:32 +0000 (0:00:00.599) 0:00:00.762 ********** 2026-04-24 02:02:40.036554 | orchestrator | changed: [testbed-manager] 2026-04-24 02:02:40.036570 | orchestrator | 2026-04-24 02:02:40.036585 | orchestrator | TASK [osism.commons.sshconfig : Ensure config for each host exist] ************* 2026-04-24 02:02:40.036599 | orchestrator | Friday 24 April 2026 02:02:33 +0000 (0:00:00.531) 0:00:01.293 ********** 2026-04-24 02:02:40.036615 | orchestrator | changed: [testbed-manager] => (item=testbed-manager) 2026-04-24 02:02:40.036630 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0) 2026-04-24 02:02:40.036741 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1) 2026-04-24 02:02:40.036761 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2) 2026-04-24 02:02:40.036777 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3) 2026-04-24 02:02:40.036794 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4) 2026-04-24 02:02:40.036810 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5) 2026-04-24 02:02:40.036823 | orchestrator | 2026-04-24 02:02:40.036833 | orchestrator | TASK [osism.commons.sshconfig : Add extra config] ****************************** 2026-04-24 02:02:40.036842 | orchestrator | Friday 24 April 2026 02:02:39 +0000 (0:00:06.000) 0:00:07.294 ********** 2026-04-24 02:02:40.036851 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:02:40.036860 | orchestrator | 2026-04-24 02:02:40.036869 | orchestrator | TASK [osism.commons.sshconfig : Assemble ssh config] *************************** 2026-04-24 02:02:40.036878 | orchestrator | Friday 24 April 2026 02:02:39 +0000 (0:00:00.067) 0:00:07.362 ********** 2026-04-24 02:02:40.036887 | orchestrator | changed: [testbed-manager] 2026-04-24 02:02:40.036895 | orchestrator | 2026-04-24 02:02:40.036904 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:02:40.036914 | orchestrator | testbed-manager : ok=4  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:02:40.036924 | orchestrator | 2026-04-24 02:02:40.036933 | orchestrator | 2026-04-24 02:02:40.036942 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:02:40.036951 | orchestrator | Friday 24 April 2026 02:02:39 +0000 (0:00:00.590) 0:00:07.952 ********** 2026-04-24 02:02:40.036960 | orchestrator | =============================================================================== 2026-04-24 02:02:40.036969 | orchestrator | osism.commons.sshconfig : Ensure config for each host exist ------------- 6.00s 2026-04-24 02:02:40.036978 | orchestrator | osism.commons.sshconfig : Get home directory of operator user ----------- 0.60s 2026-04-24 02:02:40.036987 | orchestrator | osism.commons.sshconfig : Assemble ssh config --------------------------- 0.59s 2026-04-24 02:02:40.036996 | orchestrator | osism.commons.sshconfig : Ensure .ssh/config.d exist -------------------- 0.53s 2026-04-24 02:02:40.037069 | orchestrator | osism.commons.sshconfig : Add extra config ------------------------------ 0.07s 2026-04-24 02:02:40.369572 | orchestrator | + osism apply known-hosts 2026-04-24 02:02:52.501389 | orchestrator | 2026-04-24 02:02:52 | INFO  | Task 939281e6-b4b6-40b9-b2b4-ca2ac098c423 (known-hosts) was prepared for execution. 2026-04-24 02:02:52.501540 | orchestrator | 2026-04-24 02:02:52 | INFO  | It takes a moment until task 939281e6-b4b6-40b9-b2b4-ca2ac098c423 (known-hosts) has been started and output is visible here. 2026-04-24 02:03:09.668805 | orchestrator | 2026-04-24 02:03:09.668945 | orchestrator | PLAY [Apply role known_hosts] ************************************************** 2026-04-24 02:03:09.668974 | orchestrator | 2026-04-24 02:03:09.669029 | orchestrator | TASK [osism.commons.known_hosts : Run ssh-keyscan for all hosts with hostname] *** 2026-04-24 02:03:09.669051 | orchestrator | Friday 24 April 2026 02:02:56 +0000 (0:00:00.165) 0:00:00.165 ********** 2026-04-24 02:03:09.669071 | orchestrator | ok: [testbed-manager] => (item=testbed-manager) 2026-04-24 02:03:09.669089 | orchestrator | ok: [testbed-manager] => (item=testbed-node-3) 2026-04-24 02:03:09.669108 | orchestrator | ok: [testbed-manager] => (item=testbed-node-4) 2026-04-24 02:03:09.669125 | orchestrator | ok: [testbed-manager] => (item=testbed-node-5) 2026-04-24 02:03:09.669144 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-24 02:03:09.669162 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-24 02:03:09.669181 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-24 02:03:09.669200 | orchestrator | 2026-04-24 02:03:09.669220 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with hostname] *** 2026-04-24 02:03:09.669241 | orchestrator | Friday 24 April 2026 02:03:02 +0000 (0:00:06.042) 0:00:06.208 ********** 2026-04-24 02:03:09.669262 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-manager) 2026-04-24 02:03:09.669285 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-3) 2026-04-24 02:03:09.669306 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-4) 2026-04-24 02:03:09.669327 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-5) 2026-04-24 02:03:09.669347 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-0) 2026-04-24 02:03:09.669381 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-1) 2026-04-24 02:03:09.669403 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-2) 2026-04-24 02:03:09.669423 | orchestrator | 2026-04-24 02:03:09.669444 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:09.669465 | orchestrator | Friday 24 April 2026 02:03:02 +0000 (0:00:00.175) 0:00:06.383 ********** 2026-04-24 02:03:09.669497 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBm/HAyClxTsO12LYGm+ntxtiXTtYwrwto/DB6RukA6lmlBQ2czHeszLTWagmHXxsvSZ4lFuM8abQY1GF7gCFAM4kUwFRPJF2EspCWG5+FLUm+m7Yj9JcRWVCjss0JhBhmWhbGpmiLQU/E/wTtrxX89TrfZKJS+2gJ3OoYcPBDSQtIXOXQmJZ7JQ3u59wY2wtgZGCg5A/+jrqoUGYSvn+NX7d3P3u0vg8QGAYSJeeQcFMmvK7eJU8ztctmRpGc2u/GGI/0WBjKCBhly1fBfIzsox8RuGWtbVNFBijDGCRgLW7Shb231VznpZKf6VK1UFxudUs1xQGu/wpPBEt1EJgnJTmXScc2gD6m+UCacaaIvqoIUtu7kqeU940iDNtAX9KzvNE1vKX+QrX4IPXl/TWuO/FIOzb8asu0v1pYkjNZEJca0iO448Z8ActInEAoSBrc0A1VQgSqdFSHIiKku+v/kvS120+ATQz9rBaGNHjJEl53bQQFSKddq9AKa3VIJms=) 2026-04-24 02:03:09.669558 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMCZTNjG/7697UZQs30QkSgnMGK/p24JrlFSZMCTinglZxLS2ofnwmBJERaQBhKgsWhUVJytiI1NAZo5IXLrwes=) 2026-04-24 02:03:09.669581 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIxhu5Fi+C+cCYvDVwNerX8zdrJCN/PfSBHdSThMdcsT) 2026-04-24 02:03:09.669603 | orchestrator | 2026-04-24 02:03:09.669623 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:09.669644 | orchestrator | Friday 24 April 2026 02:03:04 +0000 (0:00:01.241) 0:00:07.624 ********** 2026-04-24 02:03:09.669663 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEk6Uq4Eq/Il3GmuAhXS8pKBd9n4ou3H9EExyAYEsCXGWfuuFgPcWZnuR9eUC2tCkDfZRRO+aY97YBs4Q5LpGaU=) 2026-04-24 02:03:09.669723 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc+gy499HqqXTOVjShP2yRYAryzYtkIMDuHNlMTlYD75o2zxl5EHtU8ZEXd59HM5a4Yutc1hn2OFWmiyXLvPsJrbp2d9mziDEVrGIotznMKcgEHbOwlasbNDf3MRLS7hLh1kmJBvq4LyFmIBnRm3DgkGOZr216ygvhBchRHtq7NpxU5e4Z/vLKDEDIvetsoxvrEaHSQjzSMrYqulzwlOP7S5wOwdOR8r9rWWpThSc6otRpbnMllyRQRjQdrupatqsQn36zjA4vXpd0575o8tdAsDwAqfnYL5A1YDqYHJ7YAMw0TOJGB4BIrWe0WX2elngWnzp98rwlilZ7PxscPo/4WOKU2oHckkuoNwVWAOEVUqUb/sIUrYdSn96/vPulv4YWYxjRZvDh/EPpdsjTaDCfWbk2pEBYjrXSr16Lc+WhN7eKpXhf2pLNb1EJNBgsxkwuh9k01btn+zH3q6QZt+bl7qUDQtn1Glb0d4njFSPWl1wxZpesReYgqTJal8MIIx8=) 2026-04-24 02:03:09.669745 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMXrN+DRgyG3tZ5Q02kucKRJMDrUC2U8BgjO2woIg9uj) 2026-04-24 02:03:09.669764 | orchestrator | 2026-04-24 02:03:09.669783 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:09.669802 | orchestrator | Friday 24 April 2026 02:03:05 +0000 (0:00:01.090) 0:00:08.714 ********** 2026-04-24 02:03:09.669819 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDUwCq3k+Ri5SCmgoeaufoR+wAzcMmA3hQH1X/9SIqHm1C5FKKhfwF7zi7aF++vyKLhV5b4FkISRltIE8LBH3pU=) 2026-04-24 02:03:09.669841 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChe26NbkwBk3izpzmtOPrLObsg8FbSc7Zu+m4ecUsqRiTIw/+ifUhOa6qpqj0n/c9pgx6GVZ/7tLALVszRPieb2BcbptbbqOlJvtoymPaWXMSSRep1hU3e4xd1OFnnug4VDzcm71YW1SOH9q81xVoE6jG1NzZeG3ZMYz8lHkCgH7xtU2a/8ouAyex8yr4RJXBtvYyNgCVJRzCJvoWdy/2PeDjivbo8ZxHc4FP+qvu6MOC709fv0nwIWLYAUCo/vQ5yEz1oFKdAjIQkBcsQRTN0EzB7YGtoWmjJGdqSmn0VH53UTcgJVirTeLuK3P3nebva5kehHI6ssA1uRAoBGU16Mih/mI5ED+WJGG67Xyeo1HfVTD23N6ZW3eUPiGuZueYLTz8vsFwxJ1Ua93mELnEfRtvj/k6ziGedZ7wJIwF0l+qz8ciJ+Vwgng0bSd+UscPuBU4S++zkNMXNCLaGRojUrR0ZwZJHWTbTjmXAadiYSLfpEpJeENAME/MYxOM8cOk=) 2026-04-24 02:03:09.669862 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF4jdbRL38aDeLdIHeNFV6H2gmRSJ09eWZ0VKgW4EbiG) 2026-04-24 02:03:09.669879 | orchestrator | 2026-04-24 02:03:09.669898 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:09.669917 | orchestrator | Friday 24 April 2026 02:03:06 +0000 (0:00:01.137) 0:00:09.851 ********** 2026-04-24 02:03:09.669938 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz0jdBiKcYmIeZOA/0H9MOWX5/v5m9R+BGpQAUP/hj+/GzBQPhb10cgG3LqDB6T0xmwGz7fEUme3PrNLljts6aPo5SKywfsyss6mTckQmHi/N6D6AqUKjDLIb9LQviCkcrrrponVa0UhgdrEzTJV5Ows4xF8Y8JhptC2dKhrbE4yHnMxMyU3+RbGUXi/V2bKWcQiR4IgZgMgE4OvA/d2A30FxoDQhpkY6MlOjDZL1NUUAWi/g5lunMf8I3G7Pxbq5QHUIwKlDtyxEatdA/w3GCHknrX4rvt3TmSRjUOvGgIVv2mmSJIsD3ZsjmAvy+4Lo0Ek5aw4yjJqYOZGhrbpxms+uNxEUxzlbuq4Rf+jCshNwhTyGK/BxePP1FtyH4KPFU0lUnnHxzz2xep7l3yZwiuSescVEV24Bbe/Ht92ODI6nQ3jBk+puTQJ+SetcH+OqjD+5xH6WSNe+lyTyv4r42zrpN6548wUa7T12Hq0aBt5ymsoO6nwoy/e8Ov9YXRw0=) 2026-04-24 02:03:09.670132 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMlD4DaNuZTh6ITUG1ERy1ZWwFplpAVlATJxzauFf305Q0ZLGjM6WydLhtaveG5Hm7ICs01wlgNFSJBr8GmdrKY=) 2026-04-24 02:03:09.670161 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE29hy4IazLxzRQlQ/Fh37sqRA1w/sTAPqLkK7CkeDKn) 2026-04-24 02:03:09.670182 | orchestrator | 2026-04-24 02:03:09.670203 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:09.670224 | orchestrator | Friday 24 April 2026 02:03:07 +0000 (0:00:01.073) 0:00:10.925 ********** 2026-04-24 02:03:09.670389 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt6eLbO+S2pICU0OjLsrkJg4sKr4MhINhoOWrt4FcEPJg4ZZrzF/rLmWXTOC9hO82CGm1RpzhgVByguTn59V/s1zT1pmU8dpRpEF7F3tbYaAbOC1wCMx4tbY+h+mgmLmHcMUSX2kTbxizehfilT9v3oUNPEC9oTNgfFE8gyWzl+szg2LVr6TCH3wRWdDi7QgR+BS6GeZfvQt2kLQ3O5ryiB2nAgWZuAYlMchYPEldLFfQr2rzplJs+sib2+nkKIb7xoX74Ayk3fatWctv+lSRCHmtkeGw+d7TgsdQor+X2Mq26wMfkq0ndghSy9fXsuAu2OUMwHeQ6DgCfjKANd5RoR2Xd+VNUfpLZuJPGFgwNHMjfHxcFs9/WtxbBpnG/t1QkQSPvbfkq6hl0jlo3N2sJFohtFqvnJZoa98wnm6RDkEj6IN70+6xaj8KldlO7WavjEgPDoEiG//y1oOfSyDJZbyrqA8p4F9EXTDhyZbOLa6AyiYJ5EpTbVVBlpIimXDs=) 2026-04-24 02:03:09.670417 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKn1nNibRLkihY+IZVDeTLDLaWNJhTXEROBJ65/4Wx5T) 2026-04-24 02:03:09.670435 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdjTAwa6MJI//+YOvCjhiU1LVr+g7hdOJB5C2ALm4n7WM9VUtoLRInyh+IMc9OCCcEiGwB4f2udQFnIYjA6Y7Y=) 2026-04-24 02:03:09.670455 | orchestrator | 2026-04-24 02:03:09.670476 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:09.670497 | orchestrator | Friday 24 April 2026 02:03:08 +0000 (0:00:01.088) 0:00:12.014 ********** 2026-04-24 02:03:09.670537 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCumiWATpMVCU9JKr2oq5cRuBnZY8g3Elxa+p4uXc3f4nvo7CuFv2w/fdNCvX+5qrJVdFz17XeYe5OOfPfHiCU97MLDY8fgEvHtYB5Kb6RSTfBswMahL8NGogTfysqhgLRfW838WA84Lq5Z/1raI3uzjOp5sfdN/8NvUQbnwzd/V07wZ6VxC7n8c+v0z6prUz1u6qckBoa0Y32WKDLZrGxNpJ7OE6dZnMZQih3OoQTmMuOxKEqpMUlRpeDxGiJPhYXv1qbQuIhaorRVagq+lJt8oRbedzS64lENho+/4pw8cb79TOEPJRLlTwAohqSQZZwpQF3O31oDPeKaX1I4+Na0skZCyPWvBhki7U30cWQvgfklfu2wHsNve+jwMmskoeni5sd5u24Cfjv/lz+kP4U7kgWYJ4OVuJIOXri5o0OF9i6gH9YCpHGhcga2cjFfjXhBMaGM9v6DfR2A6POcLpr0BwuQ6EXf8YjEJvnCcftwKkcuDZtDlxSXPpDuzISNBS0=) 2026-04-24 02:03:20.779585 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1k3NglbSkpQJlekbGFSN7MstPqqjkKp6zfWDi3MamKwYtwg7co8Oe+yIzfr22DLJUTNqlwlGiQTzjTPHbJcyI=) 2026-04-24 02:03:20.779718 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB6p8rR7vJ3zwrcVBtVWK/QHLb+p1H3dOs8VMT/yy5DS) 2026-04-24 02:03:20.779737 | orchestrator | 2026-04-24 02:03:20.779749 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:20.779761 | orchestrator | Friday 24 April 2026 02:03:09 +0000 (0:00:01.122) 0:00:13.137 ********** 2026-04-24 02:03:20.779771 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTYB9oRP1Xjm019LDuQdtIyvbGeic0iC2TpffD9U5YgMYSuxLeFqsdIQ1xx7aYncTlYJxj26X8UqibrLHq8nxQ=) 2026-04-24 02:03:20.779782 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEfmUAOHjdLcJea0LhBc5iJMoR5GZ1cWQDX9aRsKCsU8) 2026-04-24 02:03:20.779795 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6fkVKSq+E+W744rXBNCHjWAQGd8ZpOC8Wr2hOgOgaPaMbPYqbpA1PHlW1c7tfeQU9yC7a6MFMr+i1tRMAla/HR3tPk+CBplvtso8hvHZAZoGRlW4HDjMB5Y2qdB2woeYBmgJ5w1g1aHHS5EYFXtOzFMeUxTuWX5vT8j3qPoQ/d51RdvLE6KIaH5hVjM3VmNw5Z7mamiSyMdX8V9FTX2r/OFTDB6wKbCU6NYTkeb8opT1iJsBleNguPy0Aaf5CPlV5mtu//C70BalpN68HBt2hxYv5mJFWqarL/rnJ68ihtBMu945Ds9F8DJ30FcWvJYbyoI0mwjQO9gkcQgwoxlSEI9MuGM4LfHzUg86EGf+CcGLl+6m9UgLGa97IEL/eVLQRfdt38ZS0TVn9wx1N+q6j//GNuVDWEanXvFxdObClhMFi7qZj8CKM2yvkKlvY90s4Y6YmCgo7UPa4sbhDuhWZHyHapksw01Oe1Jo5lar97524Rdk6q0UjxyfSPcOQmcs=) 2026-04-24 02:03:20.779833 | orchestrator | 2026-04-24 02:03:20.779844 | orchestrator | TASK [osism.commons.known_hosts : Run ssh-keyscan for all hosts with ansible_host] *** 2026-04-24 02:03:20.779855 | orchestrator | Friday 24 April 2026 02:03:10 +0000 (0:00:01.107) 0:00:14.245 ********** 2026-04-24 02:03:20.779865 | orchestrator | ok: [testbed-manager] => (item=testbed-manager) 2026-04-24 02:03:20.779876 | orchestrator | ok: [testbed-manager] => (item=testbed-node-3) 2026-04-24 02:03:20.779885 | orchestrator | ok: [testbed-manager] => (item=testbed-node-4) 2026-04-24 02:03:20.779895 | orchestrator | ok: [testbed-manager] => (item=testbed-node-5) 2026-04-24 02:03:20.779904 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-24 02:03:20.779914 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-24 02:03:20.779924 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-24 02:03:20.779933 | orchestrator | 2026-04-24 02:03:20.779943 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with ansible_host] *** 2026-04-24 02:03:20.779958 | orchestrator | Friday 24 April 2026 02:03:16 +0000 (0:00:05.432) 0:00:19.678 ********** 2026-04-24 02:03:20.779975 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-manager) 2026-04-24 02:03:20.779993 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-3) 2026-04-24 02:03:20.780074 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-4) 2026-04-24 02:03:20.780091 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-5) 2026-04-24 02:03:20.780108 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-0) 2026-04-24 02:03:20.780125 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-1) 2026-04-24 02:03:20.780140 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-2) 2026-04-24 02:03:20.780158 | orchestrator | 2026-04-24 02:03:20.780174 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:20.780192 | orchestrator | Friday 24 April 2026 02:03:16 +0000 (0:00:00.181) 0:00:19.860 ********** 2026-04-24 02:03:20.780250 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBm/HAyClxTsO12LYGm+ntxtiXTtYwrwto/DB6RukA6lmlBQ2czHeszLTWagmHXxsvSZ4lFuM8abQY1GF7gCFAM4kUwFRPJF2EspCWG5+FLUm+m7Yj9JcRWVCjss0JhBhmWhbGpmiLQU/E/wTtrxX89TrfZKJS+2gJ3OoYcPBDSQtIXOXQmJZ7JQ3u59wY2wtgZGCg5A/+jrqoUGYSvn+NX7d3P3u0vg8QGAYSJeeQcFMmvK7eJU8ztctmRpGc2u/GGI/0WBjKCBhly1fBfIzsox8RuGWtbVNFBijDGCRgLW7Shb231VznpZKf6VK1UFxudUs1xQGu/wpPBEt1EJgnJTmXScc2gD6m+UCacaaIvqoIUtu7kqeU940iDNtAX9KzvNE1vKX+QrX4IPXl/TWuO/FIOzb8asu0v1pYkjNZEJca0iO448Z8ActInEAoSBrc0A1VQgSqdFSHIiKku+v/kvS120+ATQz9rBaGNHjJEl53bQQFSKddq9AKa3VIJms=) 2026-04-24 02:03:20.780270 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMCZTNjG/7697UZQs30QkSgnMGK/p24JrlFSZMCTinglZxLS2ofnwmBJERaQBhKgsWhUVJytiI1NAZo5IXLrwes=) 2026-04-24 02:03:20.780312 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIxhu5Fi+C+cCYvDVwNerX8zdrJCN/PfSBHdSThMdcsT) 2026-04-24 02:03:20.780330 | orchestrator | 2026-04-24 02:03:20.780348 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:20.780362 | orchestrator | Friday 24 April 2026 02:03:17 +0000 (0:00:01.088) 0:00:20.949 ********** 2026-04-24 02:03:20.780384 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEk6Uq4Eq/Il3GmuAhXS8pKBd9n4ou3H9EExyAYEsCXGWfuuFgPcWZnuR9eUC2tCkDfZRRO+aY97YBs4Q5LpGaU=) 2026-04-24 02:03:20.780402 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc+gy499HqqXTOVjShP2yRYAryzYtkIMDuHNlMTlYD75o2zxl5EHtU8ZEXd59HM5a4Yutc1hn2OFWmiyXLvPsJrbp2d9mziDEVrGIotznMKcgEHbOwlasbNDf3MRLS7hLh1kmJBvq4LyFmIBnRm3DgkGOZr216ygvhBchRHtq7NpxU5e4Z/vLKDEDIvetsoxvrEaHSQjzSMrYqulzwlOP7S5wOwdOR8r9rWWpThSc6otRpbnMllyRQRjQdrupatqsQn36zjA4vXpd0575o8tdAsDwAqfnYL5A1YDqYHJ7YAMw0TOJGB4BIrWe0WX2elngWnzp98rwlilZ7PxscPo/4WOKU2oHckkuoNwVWAOEVUqUb/sIUrYdSn96/vPulv4YWYxjRZvDh/EPpdsjTaDCfWbk2pEBYjrXSr16Lc+WhN7eKpXhf2pLNb1EJNBgsxkwuh9k01btn+zH3q6QZt+bl7qUDQtn1Glb0d4njFSPWl1wxZpesReYgqTJal8MIIx8=) 2026-04-24 02:03:20.780418 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMXrN+DRgyG3tZ5Q02kucKRJMDrUC2U8BgjO2woIg9uj) 2026-04-24 02:03:20.780433 | orchestrator | 2026-04-24 02:03:20.780449 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:20.780466 | orchestrator | Friday 24 April 2026 02:03:18 +0000 (0:00:01.049) 0:00:21.998 ********** 2026-04-24 02:03:20.780484 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChe26NbkwBk3izpzmtOPrLObsg8FbSc7Zu+m4ecUsqRiTIw/+ifUhOa6qpqj0n/c9pgx6GVZ/7tLALVszRPieb2BcbptbbqOlJvtoymPaWXMSSRep1hU3e4xd1OFnnug4VDzcm71YW1SOH9q81xVoE6jG1NzZeG3ZMYz8lHkCgH7xtU2a/8ouAyex8yr4RJXBtvYyNgCVJRzCJvoWdy/2PeDjivbo8ZxHc4FP+qvu6MOC709fv0nwIWLYAUCo/vQ5yEz1oFKdAjIQkBcsQRTN0EzB7YGtoWmjJGdqSmn0VH53UTcgJVirTeLuK3P3nebva5kehHI6ssA1uRAoBGU16Mih/mI5ED+WJGG67Xyeo1HfVTD23N6ZW3eUPiGuZueYLTz8vsFwxJ1Ua93mELnEfRtvj/k6ziGedZ7wJIwF0l+qz8ciJ+Vwgng0bSd+UscPuBU4S++zkNMXNCLaGRojUrR0ZwZJHWTbTjmXAadiYSLfpEpJeENAME/MYxOM8cOk=) 2026-04-24 02:03:20.780501 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDUwCq3k+Ri5SCmgoeaufoR+wAzcMmA3hQH1X/9SIqHm1C5FKKhfwF7zi7aF++vyKLhV5b4FkISRltIE8LBH3pU=) 2026-04-24 02:03:20.780517 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF4jdbRL38aDeLdIHeNFV6H2gmRSJ09eWZ0VKgW4EbiG) 2026-04-24 02:03:20.780533 | orchestrator | 2026-04-24 02:03:20.780550 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:20.780566 | orchestrator | Friday 24 April 2026 02:03:19 +0000 (0:00:01.131) 0:00:23.130 ********** 2026-04-24 02:03:20.780583 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz0jdBiKcYmIeZOA/0H9MOWX5/v5m9R+BGpQAUP/hj+/GzBQPhb10cgG3LqDB6T0xmwGz7fEUme3PrNLljts6aPo5SKywfsyss6mTckQmHi/N6D6AqUKjDLIb9LQviCkcrrrponVa0UhgdrEzTJV5Ows4xF8Y8JhptC2dKhrbE4yHnMxMyU3+RbGUXi/V2bKWcQiR4IgZgMgE4OvA/d2A30FxoDQhpkY6MlOjDZL1NUUAWi/g5lunMf8I3G7Pxbq5QHUIwKlDtyxEatdA/w3GCHknrX4rvt3TmSRjUOvGgIVv2mmSJIsD3ZsjmAvy+4Lo0Ek5aw4yjJqYOZGhrbpxms+uNxEUxzlbuq4Rf+jCshNwhTyGK/BxePP1FtyH4KPFU0lUnnHxzz2xep7l3yZwiuSescVEV24Bbe/Ht92ODI6nQ3jBk+puTQJ+SetcH+OqjD+5xH6WSNe+lyTyv4r42zrpN6548wUa7T12Hq0aBt5ymsoO6nwoy/e8Ov9YXRw0=) 2026-04-24 02:03:20.780602 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMlD4DaNuZTh6ITUG1ERy1ZWwFplpAVlATJxzauFf305Q0ZLGjM6WydLhtaveG5Hm7ICs01wlgNFSJBr8GmdrKY=) 2026-04-24 02:03:20.780624 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE29hy4IazLxzRQlQ/Fh37sqRA1w/sTAPqLkK7CkeDKn) 2026-04-24 02:03:25.438479 | orchestrator | 2026-04-24 02:03:25.438623 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:25.438652 | orchestrator | Friday 24 April 2026 02:03:20 +0000 (0:00:01.119) 0:00:24.249 ********** 2026-04-24 02:03:25.438673 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt6eLbO+S2pICU0OjLsrkJg4sKr4MhINhoOWrt4FcEPJg4ZZrzF/rLmWXTOC9hO82CGm1RpzhgVByguTn59V/s1zT1pmU8dpRpEF7F3tbYaAbOC1wCMx4tbY+h+mgmLmHcMUSX2kTbxizehfilT9v3oUNPEC9oTNgfFE8gyWzl+szg2LVr6TCH3wRWdDi7QgR+BS6GeZfvQt2kLQ3O5ryiB2nAgWZuAYlMchYPEldLFfQr2rzplJs+sib2+nkKIb7xoX74Ayk3fatWctv+lSRCHmtkeGw+d7TgsdQor+X2Mq26wMfkq0ndghSy9fXsuAu2OUMwHeQ6DgCfjKANd5RoR2Xd+VNUfpLZuJPGFgwNHMjfHxcFs9/WtxbBpnG/t1QkQSPvbfkq6hl0jlo3N2sJFohtFqvnJZoa98wnm6RDkEj6IN70+6xaj8KldlO7WavjEgPDoEiG//y1oOfSyDJZbyrqA8p4F9EXTDhyZbOLa6AyiYJ5EpTbVVBlpIimXDs=) 2026-04-24 02:03:25.438698 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdjTAwa6MJI//+YOvCjhiU1LVr+g7hdOJB5C2ALm4n7WM9VUtoLRInyh+IMc9OCCcEiGwB4f2udQFnIYjA6Y7Y=) 2026-04-24 02:03:25.438720 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKn1nNibRLkihY+IZVDeTLDLaWNJhTXEROBJ65/4Wx5T) 2026-04-24 02:03:25.438740 | orchestrator | 2026-04-24 02:03:25.438759 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:25.438779 | orchestrator | Friday 24 April 2026 02:03:21 +0000 (0:00:01.096) 0:00:25.346 ********** 2026-04-24 02:03:25.438799 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCumiWATpMVCU9JKr2oq5cRuBnZY8g3Elxa+p4uXc3f4nvo7CuFv2w/fdNCvX+5qrJVdFz17XeYe5OOfPfHiCU97MLDY8fgEvHtYB5Kb6RSTfBswMahL8NGogTfysqhgLRfW838WA84Lq5Z/1raI3uzjOp5sfdN/8NvUQbnwzd/V07wZ6VxC7n8c+v0z6prUz1u6qckBoa0Y32WKDLZrGxNpJ7OE6dZnMZQih3OoQTmMuOxKEqpMUlRpeDxGiJPhYXv1qbQuIhaorRVagq+lJt8oRbedzS64lENho+/4pw8cb79TOEPJRLlTwAohqSQZZwpQF3O31oDPeKaX1I4+Na0skZCyPWvBhki7U30cWQvgfklfu2wHsNve+jwMmskoeni5sd5u24Cfjv/lz+kP4U7kgWYJ4OVuJIOXri5o0OF9i6gH9YCpHGhcga2cjFfjXhBMaGM9v6DfR2A6POcLpr0BwuQ6EXf8YjEJvnCcftwKkcuDZtDlxSXPpDuzISNBS0=) 2026-04-24 02:03:25.438819 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1k3NglbSkpQJlekbGFSN7MstPqqjkKp6zfWDi3MamKwYtwg7co8Oe+yIzfr22DLJUTNqlwlGiQTzjTPHbJcyI=) 2026-04-24 02:03:25.438833 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB6p8rR7vJ3zwrcVBtVWK/QHLb+p1H3dOs8VMT/yy5DS) 2026-04-24 02:03:25.438844 | orchestrator | 2026-04-24 02:03:25.438855 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-24 02:03:25.438867 | orchestrator | Friday 24 April 2026 02:03:23 +0000 (0:00:01.148) 0:00:26.495 ********** 2026-04-24 02:03:25.438878 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTYB9oRP1Xjm019LDuQdtIyvbGeic0iC2TpffD9U5YgMYSuxLeFqsdIQ1xx7aYncTlYJxj26X8UqibrLHq8nxQ=) 2026-04-24 02:03:25.438910 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6fkVKSq+E+W744rXBNCHjWAQGd8ZpOC8Wr2hOgOgaPaMbPYqbpA1PHlW1c7tfeQU9yC7a6MFMr+i1tRMAla/HR3tPk+CBplvtso8hvHZAZoGRlW4HDjMB5Y2qdB2woeYBmgJ5w1g1aHHS5EYFXtOzFMeUxTuWX5vT8j3qPoQ/d51RdvLE6KIaH5hVjM3VmNw5Z7mamiSyMdX8V9FTX2r/OFTDB6wKbCU6NYTkeb8opT1iJsBleNguPy0Aaf5CPlV5mtu//C70BalpN68HBt2hxYv5mJFWqarL/rnJ68ihtBMu945Ds9F8DJ30FcWvJYbyoI0mwjQO9gkcQgwoxlSEI9MuGM4LfHzUg86EGf+CcGLl+6m9UgLGa97IEL/eVLQRfdt38ZS0TVn9wx1N+q6j//GNuVDWEanXvFxdObClhMFi7qZj8CKM2yvkKlvY90s4Y6YmCgo7UPa4sbhDuhWZHyHapksw01Oe1Jo5lar97524Rdk6q0UjxyfSPcOQmcs=) 2026-04-24 02:03:25.438922 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEfmUAOHjdLcJea0LhBc5iJMoR5GZ1cWQDX9aRsKCsU8) 2026-04-24 02:03:25.438932 | orchestrator | 2026-04-24 02:03:25.438967 | orchestrator | TASK [osism.commons.known_hosts : Write static known_hosts entries] ************ 2026-04-24 02:03:25.438979 | orchestrator | Friday 24 April 2026 02:03:24 +0000 (0:00:01.141) 0:00:27.636 ********** 2026-04-24 02:03:25.438990 | orchestrator | skipping: [testbed-manager] => (item=testbed-manager)  2026-04-24 02:03:25.439051 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-3)  2026-04-24 02:03:25.439064 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-4)  2026-04-24 02:03:25.439074 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-5)  2026-04-24 02:03:25.439085 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-24 02:03:25.439096 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-24 02:03:25.439106 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-24 02:03:25.439117 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:03:25.439128 | orchestrator | 2026-04-24 02:03:25.439160 | orchestrator | TASK [osism.commons.known_hosts : Write extra known_hosts entries] ************* 2026-04-24 02:03:25.439172 | orchestrator | Friday 24 April 2026 02:03:24 +0000 (0:00:00.182) 0:00:27.819 ********** 2026-04-24 02:03:25.439183 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:03:25.439194 | orchestrator | 2026-04-24 02:03:25.439205 | orchestrator | TASK [osism.commons.known_hosts : Delete known_hosts entries] ****************** 2026-04-24 02:03:25.439216 | orchestrator | Friday 24 April 2026 02:03:24 +0000 (0:00:00.065) 0:00:27.884 ********** 2026-04-24 02:03:25.439227 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:03:25.439237 | orchestrator | 2026-04-24 02:03:25.439248 | orchestrator | TASK [osism.commons.known_hosts : Set file permissions] ************************ 2026-04-24 02:03:25.439259 | orchestrator | Friday 24 April 2026 02:03:24 +0000 (0:00:00.071) 0:00:27.956 ********** 2026-04-24 02:03:25.439270 | orchestrator | changed: [testbed-manager] 2026-04-24 02:03:25.439281 | orchestrator | 2026-04-24 02:03:25.439292 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:03:25.439303 | orchestrator | testbed-manager : ok=31  changed=15  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 02:03:25.439315 | orchestrator | 2026-04-24 02:03:25.439326 | orchestrator | 2026-04-24 02:03:25.439337 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:03:25.439356 | orchestrator | Friday 24 April 2026 02:03:25 +0000 (0:00:00.742) 0:00:28.699 ********** 2026-04-24 02:03:25.439367 | orchestrator | =============================================================================== 2026-04-24 02:03:25.439378 | orchestrator | osism.commons.known_hosts : Run ssh-keyscan for all hosts with hostname --- 6.04s 2026-04-24 02:03:25.439389 | orchestrator | osism.commons.known_hosts : Run ssh-keyscan for all hosts with ansible_host --- 5.43s 2026-04-24 02:03:25.439401 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.24s 2026-04-24 02:03:25.439411 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.15s 2026-04-24 02:03:25.439422 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.14s 2026-04-24 02:03:25.439433 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.14s 2026-04-24 02:03:25.439443 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.13s 2026-04-24 02:03:25.439460 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.12s 2026-04-24 02:03:25.439487 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.12s 2026-04-24 02:03:25.439510 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.11s 2026-04-24 02:03:25.439527 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.10s 2026-04-24 02:03:25.439545 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.09s 2026-04-24 02:03:25.439562 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.09s 2026-04-24 02:03:25.439580 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.09s 2026-04-24 02:03:25.439668 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.07s 2026-04-24 02:03:25.439684 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.05s 2026-04-24 02:03:25.439695 | orchestrator | osism.commons.known_hosts : Set file permissions ------------------------ 0.74s 2026-04-24 02:03:25.439706 | orchestrator | osism.commons.known_hosts : Write static known_hosts entries ------------ 0.18s 2026-04-24 02:03:25.439717 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with ansible_host --- 0.18s 2026-04-24 02:03:25.439729 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with hostname --- 0.18s 2026-04-24 02:03:25.740697 | orchestrator | + osism apply squid 2026-04-24 02:03:37.880941 | orchestrator | 2026-04-24 02:03:37 | INFO  | Task 7d2ba6ba-64bc-4241-88e3-638a17a058d6 (squid) was prepared for execution. 2026-04-24 02:03:37.881079 | orchestrator | 2026-04-24 02:03:37 | INFO  | It takes a moment until task 7d2ba6ba-64bc-4241-88e3-638a17a058d6 (squid) has been started and output is visible here. 2026-04-24 02:05:31.283233 | orchestrator | 2026-04-24 02:05:31.283359 | orchestrator | PLAY [Apply role squid] ******************************************************** 2026-04-24 02:05:31.283378 | orchestrator | 2026-04-24 02:05:31.283390 | orchestrator | TASK [osism.services.squid : Include install tasks] **************************** 2026-04-24 02:05:31.283402 | orchestrator | Friday 24 April 2026 02:03:42 +0000 (0:00:00.180) 0:00:00.180 ********** 2026-04-24 02:05:31.283413 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/squid/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 02:05:31.283426 | orchestrator | 2026-04-24 02:05:31.283437 | orchestrator | TASK [osism.services.squid : Install required packages] ************************ 2026-04-24 02:05:31.283448 | orchestrator | Friday 24 April 2026 02:03:42 +0000 (0:00:00.077) 0:00:00.258 ********** 2026-04-24 02:05:31.283459 | orchestrator | ok: [testbed-manager] 2026-04-24 02:05:31.283472 | orchestrator | 2026-04-24 02:05:31.283483 | orchestrator | TASK [osism.services.squid : Create required directories] ********************** 2026-04-24 02:05:31.283494 | orchestrator | Friday 24 April 2026 02:03:43 +0000 (0:00:01.571) 0:00:01.829 ********** 2026-04-24 02:05:31.283506 | orchestrator | changed: [testbed-manager] => (item=/opt/squid/configuration) 2026-04-24 02:05:31.283516 | orchestrator | changed: [testbed-manager] => (item=/opt/squid/configuration/conf.d) 2026-04-24 02:05:31.283527 | orchestrator | ok: [testbed-manager] => (item=/opt/squid) 2026-04-24 02:05:31.283538 | orchestrator | 2026-04-24 02:05:31.283550 | orchestrator | TASK [osism.services.squid : Copy squid configuration files] ******************* 2026-04-24 02:05:31.283560 | orchestrator | Friday 24 April 2026 02:03:44 +0000 (0:00:01.224) 0:00:03.054 ********** 2026-04-24 02:05:31.283571 | orchestrator | changed: [testbed-manager] => (item=osism.conf) 2026-04-24 02:05:31.283583 | orchestrator | 2026-04-24 02:05:31.283594 | orchestrator | TASK [osism.services.squid : Remove osism_allow_list.conf configuration file] *** 2026-04-24 02:05:31.283605 | orchestrator | Friday 24 April 2026 02:03:46 +0000 (0:00:01.137) 0:00:04.191 ********** 2026-04-24 02:05:31.283616 | orchestrator | ok: [testbed-manager] 2026-04-24 02:05:31.283627 | orchestrator | 2026-04-24 02:05:31.283638 | orchestrator | TASK [osism.services.squid : Copy docker-compose.yml file] ********************* 2026-04-24 02:05:31.283650 | orchestrator | Friday 24 April 2026 02:03:46 +0000 (0:00:00.377) 0:00:04.569 ********** 2026-04-24 02:05:31.283661 | orchestrator | changed: [testbed-manager] 2026-04-24 02:05:31.283672 | orchestrator | 2026-04-24 02:05:31.283683 | orchestrator | TASK [osism.services.squid : Manage squid service] ***************************** 2026-04-24 02:05:31.283694 | orchestrator | Friday 24 April 2026 02:03:47 +0000 (0:00:00.961) 0:00:05.530 ********** 2026-04-24 02:05:31.283709 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage squid service (10 retries left). 2026-04-24 02:05:31.283723 | orchestrator | ok: [testbed-manager] 2026-04-24 02:05:31.283736 | orchestrator | 2026-04-24 02:05:31.283749 | orchestrator | RUNNING HANDLER [osism.services.squid : Restart squid service] ***************** 2026-04-24 02:05:31.283807 | orchestrator | Friday 24 April 2026 02:04:18 +0000 (0:00:31.013) 0:00:36.544 ********** 2026-04-24 02:05:31.283819 | orchestrator | changed: [testbed-manager] 2026-04-24 02:05:31.283830 | orchestrator | 2026-04-24 02:05:31.283841 | orchestrator | RUNNING HANDLER [osism.services.squid : Wait for squid service to start] ******* 2026-04-24 02:05:31.283852 | orchestrator | Friday 24 April 2026 02:04:29 +0000 (0:00:11.443) 0:00:47.987 ********** 2026-04-24 02:05:31.283863 | orchestrator | Pausing for 60 seconds 2026-04-24 02:05:31.283875 | orchestrator | changed: [testbed-manager] 2026-04-24 02:05:31.283886 | orchestrator | 2026-04-24 02:05:31.283897 | orchestrator | RUNNING HANDLER [osism.services.squid : Register that squid service was restarted] *** 2026-04-24 02:05:31.283908 | orchestrator | Friday 24 April 2026 02:05:29 +0000 (0:01:00.098) 0:01:48.086 ********** 2026-04-24 02:05:31.283919 | orchestrator | ok: [testbed-manager] 2026-04-24 02:05:31.283929 | orchestrator | 2026-04-24 02:05:31.283940 | orchestrator | RUNNING HANDLER [osism.services.squid : Wait for an healthy squid service] ***** 2026-04-24 02:05:31.283951 | orchestrator | Friday 24 April 2026 02:05:30 +0000 (0:00:00.066) 0:01:48.153 ********** 2026-04-24 02:05:31.283961 | orchestrator | changed: [testbed-manager] 2026-04-24 02:05:31.283972 | orchestrator | 2026-04-24 02:05:31.283983 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:05:31.283994 | orchestrator | testbed-manager : ok=11  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:05:31.284023 | orchestrator | 2026-04-24 02:05:31.284034 | orchestrator | 2026-04-24 02:05:31.284045 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:05:31.284056 | orchestrator | Friday 24 April 2026 02:05:30 +0000 (0:00:00.798) 0:01:48.951 ********** 2026-04-24 02:05:31.284067 | orchestrator | =============================================================================== 2026-04-24 02:05:31.284078 | orchestrator | osism.services.squid : Wait for squid service to start ----------------- 60.10s 2026-04-24 02:05:31.284089 | orchestrator | osism.services.squid : Manage squid service ---------------------------- 31.01s 2026-04-24 02:05:31.284099 | orchestrator | osism.services.squid : Restart squid service --------------------------- 11.44s 2026-04-24 02:05:31.284128 | orchestrator | osism.services.squid : Install required packages ------------------------ 1.57s 2026-04-24 02:05:31.284139 | orchestrator | osism.services.squid : Create required directories ---------------------- 1.22s 2026-04-24 02:05:31.284150 | orchestrator | osism.services.squid : Copy squid configuration files ------------------- 1.14s 2026-04-24 02:05:31.284161 | orchestrator | osism.services.squid : Copy docker-compose.yml file --------------------- 0.96s 2026-04-24 02:05:31.284172 | orchestrator | osism.services.squid : Wait for an healthy squid service ---------------- 0.80s 2026-04-24 02:05:31.284182 | orchestrator | osism.services.squid : Remove osism_allow_list.conf configuration file --- 0.38s 2026-04-24 02:05:31.284193 | orchestrator | osism.services.squid : Include install tasks ---------------------------- 0.08s 2026-04-24 02:05:31.284204 | orchestrator | osism.services.squid : Register that squid service was restarted -------- 0.07s 2026-04-24 02:05:31.628495 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-24 02:05:31.628947 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-24 02:05:31.688151 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-24 02:05:31.688231 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release 2026-04-24 02:05:31.695186 | orchestrator | + set -e 2026-04-24 02:05:31.695259 | orchestrator | + NAMESPACE=kolla/release 2026-04-24 02:05:31.695274 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-24 02:05:31.701230 | orchestrator | ++ semver 9.5.0 9.0.0 2026-04-24 02:05:31.779489 | orchestrator | + [[ 1 -lt 0 ]] 2026-04-24 02:05:31.780639 | orchestrator | + osism apply operator -u ubuntu -l testbed-nodes 2026-04-24 02:05:43.873128 | orchestrator | 2026-04-24 02:05:43 | INFO  | Task 12910075-ffc7-4ff2-874f-424c5fc51dae (operator) was prepared for execution. 2026-04-24 02:05:43.873247 | orchestrator | 2026-04-24 02:05:43 | INFO  | It takes a moment until task 12910075-ffc7-4ff2-874f-424c5fc51dae (operator) has been started and output is visible here. 2026-04-24 02:06:00.253143 | orchestrator | 2026-04-24 02:06:00.253269 | orchestrator | PLAY [Make ssh pipelining working] ********************************************* 2026-04-24 02:06:00.253281 | orchestrator | 2026-04-24 02:06:00.253287 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 02:06:00.253296 | orchestrator | Friday 24 April 2026 02:05:48 +0000 (0:00:00.140) 0:00:00.140 ********** 2026-04-24 02:06:00.253303 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:06:00.253312 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:06:00.253319 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:00.253326 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:06:00.253333 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:00.253340 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:00.253347 | orchestrator | 2026-04-24 02:06:00.253354 | orchestrator | TASK [Do not require tty for all users] **************************************** 2026-04-24 02:06:00.253362 | orchestrator | Friday 24 April 2026 02:05:51 +0000 (0:00:03.385) 0:00:03.526 ********** 2026-04-24 02:06:00.253368 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:00.253375 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:06:00.253381 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:06:00.253388 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:00.253396 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:06:00.253403 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:00.253409 | orchestrator | 2026-04-24 02:06:00.253417 | orchestrator | PLAY [Apply role operator] ***************************************************** 2026-04-24 02:06:00.253424 | orchestrator | 2026-04-24 02:06:00.253431 | orchestrator | TASK [osism.commons.operator : Gather variables for each operating system] ***** 2026-04-24 02:06:00.253438 | orchestrator | Friday 24 April 2026 02:05:52 +0000 (0:00:00.799) 0:00:04.326 ********** 2026-04-24 02:06:00.253445 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:06:00.253452 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:06:00.253459 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:06:00.253465 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:00.253473 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:00.253480 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:00.253487 | orchestrator | 2026-04-24 02:06:00.253494 | orchestrator | TASK [osism.commons.operator : Set operator_groups variable to default value] *** 2026-04-24 02:06:00.253520 | orchestrator | Friday 24 April 2026 02:05:52 +0000 (0:00:00.196) 0:00:04.522 ********** 2026-04-24 02:06:00.253527 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:06:00.253534 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:06:00.253541 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:06:00.253548 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:00.253555 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:00.253562 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:00.253568 | orchestrator | 2026-04-24 02:06:00.253575 | orchestrator | TASK [osism.commons.operator : Create operator group] ************************** 2026-04-24 02:06:00.253583 | orchestrator | Friday 24 April 2026 02:05:52 +0000 (0:00:00.217) 0:00:04.740 ********** 2026-04-24 02:06:00.253590 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:06:00.253598 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:06:00.253605 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:00.253611 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:00.253619 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:00.253626 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:06:00.253633 | orchestrator | 2026-04-24 02:06:00.253640 | orchestrator | TASK [osism.commons.operator : Create user] ************************************ 2026-04-24 02:06:00.253646 | orchestrator | Friday 24 April 2026 02:05:53 +0000 (0:00:00.649) 0:00:05.389 ********** 2026-04-24 02:06:00.253653 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:00.253660 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:06:00.253667 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:06:00.253674 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:00.253681 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:06:00.253689 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:00.253726 | orchestrator | 2026-04-24 02:06:00.253733 | orchestrator | TASK [osism.commons.operator : Add user to additional groups] ****************** 2026-04-24 02:06:00.253740 | orchestrator | Friday 24 April 2026 02:05:54 +0000 (0:00:00.829) 0:00:06.218 ********** 2026-04-24 02:06:00.253747 | orchestrator | changed: [testbed-node-0] => (item=adm) 2026-04-24 02:06:00.253755 | orchestrator | changed: [testbed-node-1] => (item=adm) 2026-04-24 02:06:00.253762 | orchestrator | changed: [testbed-node-2] => (item=adm) 2026-04-24 02:06:00.253769 | orchestrator | changed: [testbed-node-4] => (item=adm) 2026-04-24 02:06:00.253776 | orchestrator | changed: [testbed-node-5] => (item=adm) 2026-04-24 02:06:00.253783 | orchestrator | changed: [testbed-node-3] => (item=adm) 2026-04-24 02:06:00.253790 | orchestrator | changed: [testbed-node-0] => (item=sudo) 2026-04-24 02:06:00.253797 | orchestrator | changed: [testbed-node-1] => (item=sudo) 2026-04-24 02:06:00.253805 | orchestrator | changed: [testbed-node-5] => (item=sudo) 2026-04-24 02:06:00.253812 | orchestrator | changed: [testbed-node-2] => (item=sudo) 2026-04-24 02:06:00.253819 | orchestrator | changed: [testbed-node-4] => (item=sudo) 2026-04-24 02:06:00.253826 | orchestrator | changed: [testbed-node-3] => (item=sudo) 2026-04-24 02:06:00.253833 | orchestrator | 2026-04-24 02:06:00.253840 | orchestrator | TASK [osism.commons.operator : Copy user sudoers file] ************************* 2026-04-24 02:06:00.253847 | orchestrator | Friday 24 April 2026 02:05:55 +0000 (0:00:01.210) 0:00:07.428 ********** 2026-04-24 02:06:00.253854 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:06:00.253861 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:06:00.253868 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:00.253875 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:00.253882 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:06:00.253889 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:00.253896 | orchestrator | 2026-04-24 02:06:00.253903 | orchestrator | TASK [osism.commons.operator : Set language variables in .bashrc configuration file] *** 2026-04-24 02:06:00.253912 | orchestrator | Friday 24 April 2026 02:05:56 +0000 (0:00:01.353) 0:00:08.782 ********** 2026-04-24 02:06:00.253919 | orchestrator | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-24 02:06:00.253926 | orchestrator | with a mode of 0700, this may cause issues when running as another user. To 2026-04-24 02:06:00.253934 | orchestrator | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-24 02:06:00.253941 | orchestrator | changed: [testbed-node-0] => (item=export LANGUAGE=C.UTF-8) 2026-04-24 02:06:00.253968 | orchestrator | changed: [testbed-node-5] => (item=export LANGUAGE=C.UTF-8) 2026-04-24 02:06:00.253976 | orchestrator | changed: [testbed-node-1] => (item=export LANGUAGE=C.UTF-8) 2026-04-24 02:06:00.253984 | orchestrator | changed: [testbed-node-4] => (item=export LANGUAGE=C.UTF-8) 2026-04-24 02:06:00.253988 | orchestrator | changed: [testbed-node-3] => (item=export LANGUAGE=C.UTF-8) 2026-04-24 02:06:00.253992 | orchestrator | changed: [testbed-node-2] => (item=export LANGUAGE=C.UTF-8) 2026-04-24 02:06:00.253996 | orchestrator | changed: [testbed-node-0] => (item=export LANG=C.UTF-8) 2026-04-24 02:06:00.254080 | orchestrator | changed: [testbed-node-5] => (item=export LANG=C.UTF-8) 2026-04-24 02:06:00.254086 | orchestrator | changed: [testbed-node-2] => (item=export LANG=C.UTF-8) 2026-04-24 02:06:00.254090 | orchestrator | changed: [testbed-node-1] => (item=export LANG=C.UTF-8) 2026-04-24 02:06:00.254094 | orchestrator | changed: [testbed-node-4] => (item=export LANG=C.UTF-8) 2026-04-24 02:06:00.254098 | orchestrator | changed: [testbed-node-3] => (item=export LANG=C.UTF-8) 2026-04-24 02:06:00.254102 | orchestrator | changed: [testbed-node-0] => (item=export LC_ALL=C.UTF-8) 2026-04-24 02:06:00.254106 | orchestrator | changed: [testbed-node-1] => (item=export LC_ALL=C.UTF-8) 2026-04-24 02:06:00.254110 | orchestrator | changed: [testbed-node-4] => (item=export LC_ALL=C.UTF-8) 2026-04-24 02:06:00.254114 | orchestrator | changed: [testbed-node-5] => (item=export LC_ALL=C.UTF-8) 2026-04-24 02:06:00.254118 | orchestrator | changed: [testbed-node-2] => (item=export LC_ALL=C.UTF-8) 2026-04-24 02:06:00.254220 | orchestrator | changed: [testbed-node-3] => (item=export LC_ALL=C.UTF-8) 2026-04-24 02:06:00.254226 | orchestrator | 2026-04-24 02:06:00.254230 | orchestrator | TASK [osism.commons.operator : Set custom environment variables in .bashrc configuration file] *** 2026-04-24 02:06:00.254235 | orchestrator | Friday 24 April 2026 02:05:57 +0000 (0:00:01.269) 0:00:10.052 ********** 2026-04-24 02:06:00.254239 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:06:00.254244 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:06:00.254248 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:06:00.254253 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:00.254257 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:00.254261 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:00.254265 | orchestrator | 2026-04-24 02:06:00.254269 | orchestrator | TASK [osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file] *** 2026-04-24 02:06:00.254274 | orchestrator | Friday 24 April 2026 02:05:58 +0000 (0:00:00.191) 0:00:10.243 ********** 2026-04-24 02:06:00.254278 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:06:00.254282 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:06:00.254286 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:06:00.254290 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:00.254294 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:00.254298 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:00.254302 | orchestrator | 2026-04-24 02:06:00.254306 | orchestrator | TASK [osism.commons.operator : Create .ssh directory] ************************** 2026-04-24 02:06:00.254311 | orchestrator | Friday 24 April 2026 02:05:58 +0000 (0:00:00.212) 0:00:10.456 ********** 2026-04-24 02:06:00.254315 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:06:00.254319 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:06:00.254323 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:06:00.254327 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:00.254331 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:00.254335 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:00.254339 | orchestrator | 2026-04-24 02:06:00.254343 | orchestrator | TASK [osism.commons.operator : Check number of SSH authorized keys] ************ 2026-04-24 02:06:00.254347 | orchestrator | Friday 24 April 2026 02:05:58 +0000 (0:00:00.590) 0:00:11.046 ********** 2026-04-24 02:06:00.254351 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:06:00.254355 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:06:00.254360 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:06:00.254364 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:00.254368 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:00.254372 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:00.254376 | orchestrator | 2026-04-24 02:06:00.254380 | orchestrator | TASK [osism.commons.operator : Set ssh authorized keys] ************************ 2026-04-24 02:06:00.254384 | orchestrator | Friday 24 April 2026 02:05:59 +0000 (0:00:00.203) 0:00:11.250 ********** 2026-04-24 02:06:00.254388 | orchestrator | changed: [testbed-node-2] => (item=None) 2026-04-24 02:06:00.254401 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 02:06:00.254406 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-24 02:06:00.254410 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:06:00.254414 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:06:00.254418 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-24 02:06:00.254422 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:00.254426 | orchestrator | changed: [testbed-node-1] => (item=None) 2026-04-24 02:06:00.254430 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:00.254442 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:06:00.254446 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-24 02:06:00.254450 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:00.254454 | orchestrator | 2026-04-24 02:06:00.254458 | orchestrator | TASK [osism.commons.operator : Delete ssh authorized keys] ********************* 2026-04-24 02:06:00.254462 | orchestrator | Friday 24 April 2026 02:05:59 +0000 (0:00:00.718) 0:00:11.969 ********** 2026-04-24 02:06:00.254471 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:06:00.254475 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:06:00.254479 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:06:00.254483 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:00.254487 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:00.254491 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:00.254496 | orchestrator | 2026-04-24 02:06:00.254500 | orchestrator | TASK [osism.commons.operator : Set authorized GitHub accounts] ***************** 2026-04-24 02:06:00.254504 | orchestrator | Friday 24 April 2026 02:06:00 +0000 (0:00:00.178) 0:00:12.147 ********** 2026-04-24 02:06:00.254508 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:06:00.254512 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:06:00.254516 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:06:00.254520 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:00.254531 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:01.621640 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:01.621742 | orchestrator | 2026-04-24 02:06:01.621757 | orchestrator | TASK [osism.commons.operator : Delete authorized GitHub accounts] ************** 2026-04-24 02:06:01.621770 | orchestrator | Friday 24 April 2026 02:06:00 +0000 (0:00:00.172) 0:00:12.320 ********** 2026-04-24 02:06:01.621780 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:06:01.621790 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:06:01.621800 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:06:01.621809 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:01.621819 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:01.621829 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:01.621838 | orchestrator | 2026-04-24 02:06:01.621848 | orchestrator | TASK [osism.commons.operator : Set password] *********************************** 2026-04-24 02:06:01.621858 | orchestrator | Friday 24 April 2026 02:06:00 +0000 (0:00:00.165) 0:00:12.485 ********** 2026-04-24 02:06:01.621868 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:06:01.621877 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:06:01.621887 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:06:01.621896 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:01.621905 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:01.621915 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:01.621924 | orchestrator | 2026-04-24 02:06:01.621934 | orchestrator | TASK [osism.commons.operator : Unset & lock password] ************************** 2026-04-24 02:06:01.621944 | orchestrator | Friday 24 April 2026 02:06:01 +0000 (0:00:00.669) 0:00:13.154 ********** 2026-04-24 02:06:01.621953 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:06:01.621963 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:06:01.621973 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:06:01.621983 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:01.621992 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:01.622115 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:01.622127 | orchestrator | 2026-04-24 02:06:01.622138 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:06:01.622170 | orchestrator | testbed-node-0 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 02:06:01.622184 | orchestrator | testbed-node-1 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 02:06:01.622195 | orchestrator | testbed-node-2 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 02:06:01.622207 | orchestrator | testbed-node-3 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 02:06:01.622219 | orchestrator | testbed-node-4 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 02:06:01.622251 | orchestrator | testbed-node-5 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 02:06:01.622262 | orchestrator | 2026-04-24 02:06:01.622273 | orchestrator | 2026-04-24 02:06:01.622284 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:06:01.622297 | orchestrator | Friday 24 April 2026 02:06:01 +0000 (0:00:00.254) 0:00:13.409 ********** 2026-04-24 02:06:01.622307 | orchestrator | =============================================================================== 2026-04-24 02:06:01.622317 | orchestrator | Gathering Facts --------------------------------------------------------- 3.39s 2026-04-24 02:06:01.622326 | orchestrator | osism.commons.operator : Copy user sudoers file ------------------------- 1.35s 2026-04-24 02:06:01.622336 | orchestrator | osism.commons.operator : Set language variables in .bashrc configuration file --- 1.27s 2026-04-24 02:06:01.622346 | orchestrator | osism.commons.operator : Add user to additional groups ------------------ 1.21s 2026-04-24 02:06:01.622356 | orchestrator | osism.commons.operator : Create user ------------------------------------ 0.83s 2026-04-24 02:06:01.622365 | orchestrator | Do not require tty for all users ---------------------------------------- 0.80s 2026-04-24 02:06:01.622375 | orchestrator | osism.commons.operator : Set ssh authorized keys ------------------------ 0.72s 2026-04-24 02:06:01.622384 | orchestrator | osism.commons.operator : Set password ----------------------------------- 0.67s 2026-04-24 02:06:01.622393 | orchestrator | osism.commons.operator : Create operator group -------------------------- 0.65s 2026-04-24 02:06:01.622403 | orchestrator | osism.commons.operator : Create .ssh directory -------------------------- 0.59s 2026-04-24 02:06:01.622412 | orchestrator | osism.commons.operator : Unset & lock password -------------------------- 0.25s 2026-04-24 02:06:01.622422 | orchestrator | osism.commons.operator : Set operator_groups variable to default value --- 0.22s 2026-04-24 02:06:01.622431 | orchestrator | osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file --- 0.21s 2026-04-24 02:06:01.622441 | orchestrator | osism.commons.operator : Check number of SSH authorized keys ------------ 0.20s 2026-04-24 02:06:01.622451 | orchestrator | osism.commons.operator : Gather variables for each operating system ----- 0.20s 2026-04-24 02:06:01.622460 | orchestrator | osism.commons.operator : Set custom environment variables in .bashrc configuration file --- 0.19s 2026-04-24 02:06:01.622470 | orchestrator | osism.commons.operator : Delete ssh authorized keys --------------------- 0.18s 2026-04-24 02:06:01.622479 | orchestrator | osism.commons.operator : Set authorized GitHub accounts ----------------- 0.17s 2026-04-24 02:06:01.622489 | orchestrator | osism.commons.operator : Delete authorized GitHub accounts -------------- 0.17s 2026-04-24 02:06:01.989510 | orchestrator | + osism apply --environment custom facts 2026-04-24 02:06:03.963812 | orchestrator | 2026-04-24 02:06:03 | INFO  | Trying to run play facts in environment custom 2026-04-24 02:06:14.095916 | orchestrator | 2026-04-24 02:06:14 | INFO  | Task 342ee325-21ec-43d6-b9b2-9e90ab7f6206 (facts) was prepared for execution. 2026-04-24 02:06:14.096083 | orchestrator | 2026-04-24 02:06:14 | INFO  | It takes a moment until task 342ee325-21ec-43d6-b9b2-9e90ab7f6206 (facts) has been started and output is visible here. 2026-04-24 02:06:57.960529 | orchestrator | 2026-04-24 02:06:57.960651 | orchestrator | PLAY [Copy custom network devices fact] **************************************** 2026-04-24 02:06:57.960666 | orchestrator | 2026-04-24 02:06:57.960677 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-24 02:06:57.960688 | orchestrator | Friday 24 April 2026 02:06:18 +0000 (0:00:00.087) 0:00:00.087 ********** 2026-04-24 02:06:57.960698 | orchestrator | ok: [testbed-manager] 2026-04-24 02:06:57.960708 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:57.960719 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:06:57.960728 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:06:57.960738 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:06:57.960748 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:57.960782 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:57.960792 | orchestrator | 2026-04-24 02:06:57.960802 | orchestrator | TASK [Copy fact file] ********************************************************** 2026-04-24 02:06:57.960812 | orchestrator | Friday 24 April 2026 02:06:19 +0000 (0:00:01.425) 0:00:01.513 ********** 2026-04-24 02:06:57.960822 | orchestrator | ok: [testbed-manager] 2026-04-24 02:06:57.960832 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:57.960842 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:57.960851 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:06:57.960861 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:57.960870 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:06:57.960880 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:06:57.960890 | orchestrator | 2026-04-24 02:06:57.960900 | orchestrator | PLAY [Copy custom ceph devices facts] ****************************************** 2026-04-24 02:06:57.960909 | orchestrator | 2026-04-24 02:06:57.960919 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-24 02:06:57.960929 | orchestrator | Friday 24 April 2026 02:06:20 +0000 (0:00:01.248) 0:00:02.761 ********** 2026-04-24 02:06:57.960939 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:57.960948 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:57.960958 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:57.960968 | orchestrator | 2026-04-24 02:06:57.960978 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-24 02:06:57.960988 | orchestrator | Friday 24 April 2026 02:06:21 +0000 (0:00:00.117) 0:00:02.878 ********** 2026-04-24 02:06:57.961154 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:57.961181 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:57.961192 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:57.961204 | orchestrator | 2026-04-24 02:06:57.961217 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-24 02:06:57.961227 | orchestrator | Friday 24 April 2026 02:06:21 +0000 (0:00:00.204) 0:00:03.083 ********** 2026-04-24 02:06:57.961236 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:57.961246 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:57.961255 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:57.961264 | orchestrator | 2026-04-24 02:06:57.961275 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-24 02:06:57.961285 | orchestrator | Friday 24 April 2026 02:06:21 +0000 (0:00:00.242) 0:00:03.325 ********** 2026-04-24 02:06:57.961296 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:06:57.961307 | orchestrator | 2026-04-24 02:06:57.961316 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-24 02:06:57.961326 | orchestrator | Friday 24 April 2026 02:06:21 +0000 (0:00:00.149) 0:00:03.475 ********** 2026-04-24 02:06:57.961336 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:57.961345 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:57.961354 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:57.961364 | orchestrator | 2026-04-24 02:06:57.961373 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-24 02:06:57.961383 | orchestrator | Friday 24 April 2026 02:06:22 +0000 (0:00:00.478) 0:00:03.953 ********** 2026-04-24 02:06:57.961392 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:57.961402 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:57.961411 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:57.961421 | orchestrator | 2026-04-24 02:06:57.961430 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-24 02:06:57.961440 | orchestrator | Friday 24 April 2026 02:06:22 +0000 (0:00:00.144) 0:00:04.098 ********** 2026-04-24 02:06:57.961449 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:57.961474 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:57.961493 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:57.961503 | orchestrator | 2026-04-24 02:06:57.961512 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-24 02:06:57.961535 | orchestrator | Friday 24 April 2026 02:06:23 +0000 (0:00:01.115) 0:00:05.213 ********** 2026-04-24 02:06:57.961545 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:57.961554 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:57.961564 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:57.961573 | orchestrator | 2026-04-24 02:06:57.961583 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-24 02:06:57.961593 | orchestrator | Friday 24 April 2026 02:06:23 +0000 (0:00:00.460) 0:00:05.674 ********** 2026-04-24 02:06:57.961602 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:57.961612 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:57.961621 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:57.961631 | orchestrator | 2026-04-24 02:06:57.961641 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-24 02:06:57.961698 | orchestrator | Friday 24 April 2026 02:06:24 +0000 (0:00:01.062) 0:00:06.737 ********** 2026-04-24 02:06:57.961709 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:57.961719 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:57.961728 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:57.961738 | orchestrator | 2026-04-24 02:06:57.961747 | orchestrator | TASK [Install required packages (RedHat)] ************************************** 2026-04-24 02:06:57.961757 | orchestrator | Friday 24 April 2026 02:06:41 +0000 (0:00:16.322) 0:00:23.059 ********** 2026-04-24 02:06:57.961767 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:06:57.961776 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:06:57.961786 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:06:57.961796 | orchestrator | 2026-04-24 02:06:57.961805 | orchestrator | TASK [Install required packages (Debian)] ************************************** 2026-04-24 02:06:57.961835 | orchestrator | Friday 24 April 2026 02:06:41 +0000 (0:00:00.106) 0:00:23.166 ********** 2026-04-24 02:06:57.961845 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:06:57.961855 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:06:57.961865 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:06:57.961874 | orchestrator | 2026-04-24 02:06:57.961884 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-24 02:06:57.961893 | orchestrator | Friday 24 April 2026 02:06:48 +0000 (0:00:07.646) 0:00:30.812 ********** 2026-04-24 02:06:57.961903 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:57.961912 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:57.961922 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:57.961932 | orchestrator | 2026-04-24 02:06:57.961941 | orchestrator | TASK [Copy fact files] ********************************************************* 2026-04-24 02:06:57.961951 | orchestrator | Friday 24 April 2026 02:06:49 +0000 (0:00:00.465) 0:00:31.278 ********** 2026-04-24 02:06:57.961961 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_devices) 2026-04-24 02:06:57.961971 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_devices) 2026-04-24 02:06:57.961981 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_devices) 2026-04-24 02:06:57.961991 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_devices_all) 2026-04-24 02:06:57.962079 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_devices_all) 2026-04-24 02:06:57.962093 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_devices_all) 2026-04-24 02:06:57.962102 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_osd_devices) 2026-04-24 02:06:57.962112 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_osd_devices) 2026-04-24 02:06:57.962122 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_osd_devices) 2026-04-24 02:06:57.962131 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_osd_devices_all) 2026-04-24 02:06:57.962141 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_osd_devices_all) 2026-04-24 02:06:57.962151 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_osd_devices_all) 2026-04-24 02:06:57.962160 | orchestrator | 2026-04-24 02:06:57.962198 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-24 02:06:57.962208 | orchestrator | Friday 24 April 2026 02:06:52 +0000 (0:00:03.486) 0:00:34.764 ********** 2026-04-24 02:06:57.962218 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:57.962227 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:57.962237 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:57.962246 | orchestrator | 2026-04-24 02:06:57.962256 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-24 02:06:57.962266 | orchestrator | 2026-04-24 02:06:57.962276 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 02:06:57.962285 | orchestrator | Friday 24 April 2026 02:06:54 +0000 (0:00:01.314) 0:00:36.079 ********** 2026-04-24 02:06:57.962295 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:06:57.962304 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:06:57.962314 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:06:57.962324 | orchestrator | ok: [testbed-manager] 2026-04-24 02:06:57.962333 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:06:57.962343 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:06:57.962352 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:06:57.962362 | orchestrator | 2026-04-24 02:06:57.962371 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:06:57.962382 | orchestrator | testbed-manager : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:06:57.962392 | orchestrator | testbed-node-0 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:06:57.962404 | orchestrator | testbed-node-1 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:06:57.962414 | orchestrator | testbed-node-2 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:06:57.962423 | orchestrator | testbed-node-3 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:06:57.962433 | orchestrator | testbed-node-4 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:06:57.962443 | orchestrator | testbed-node-5 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:06:57.962452 | orchestrator | 2026-04-24 02:06:57.962462 | orchestrator | 2026-04-24 02:06:57.962471 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:06:57.962481 | orchestrator | Friday 24 April 2026 02:06:57 +0000 (0:00:03.682) 0:00:39.761 ********** 2026-04-24 02:06:57.962491 | orchestrator | =============================================================================== 2026-04-24 02:06:57.962500 | orchestrator | osism.commons.repository : Update package cache ------------------------ 16.32s 2026-04-24 02:06:57.962510 | orchestrator | Install required packages (Debian) -------------------------------------- 7.65s 2026-04-24 02:06:57.962520 | orchestrator | Gathers facts about hosts ----------------------------------------------- 3.68s 2026-04-24 02:06:57.962529 | orchestrator | Copy fact files --------------------------------------------------------- 3.49s 2026-04-24 02:06:57.962539 | orchestrator | Create custom facts directory ------------------------------------------- 1.43s 2026-04-24 02:06:57.962549 | orchestrator | osism.commons.repository : Force update of package cache ---------------- 1.31s 2026-04-24 02:06:57.962566 | orchestrator | Copy fact file ---------------------------------------------------------- 1.25s 2026-04-24 02:06:58.227421 | orchestrator | osism.commons.repository : Copy 99osism apt configuration --------------- 1.12s 2026-04-24 02:06:58.227518 | orchestrator | osism.commons.repository : Copy ubuntu.sources file --------------------- 1.06s 2026-04-24 02:06:58.227530 | orchestrator | osism.commons.repository : Create /etc/apt/sources.list.d directory ----- 0.48s 2026-04-24 02:06:58.227567 | orchestrator | Create custom facts directory ------------------------------------------- 0.47s 2026-04-24 02:06:58.227577 | orchestrator | osism.commons.repository : Remove sources.list file --------------------- 0.46s 2026-04-24 02:06:58.227585 | orchestrator | osism.commons.repository : Set repositories to default ------------------ 0.24s 2026-04-24 02:06:58.227594 | orchestrator | osism.commons.repository : Set repository_default fact to default value --- 0.20s 2026-04-24 02:06:58.227603 | orchestrator | osism.commons.repository : Include distribution specific repository tasks --- 0.15s 2026-04-24 02:06:58.227613 | orchestrator | osism.commons.repository : Include tasks for Ubuntu < 24.04 ------------- 0.14s 2026-04-24 02:06:58.227621 | orchestrator | osism.commons.repository : Gather variables for each operating system --- 0.12s 2026-04-24 02:06:58.227643 | orchestrator | Install required packages (RedHat) -------------------------------------- 0.11s 2026-04-24 02:06:58.561734 | orchestrator | + osism apply bootstrap 2026-04-24 02:07:10.659819 | orchestrator | 2026-04-24 02:07:10 | INFO  | Task a2045b0a-d0bc-4a9f-8c05-e9b970490de8 (bootstrap) was prepared for execution. 2026-04-24 02:07:10.659933 | orchestrator | 2026-04-24 02:07:10 | INFO  | It takes a moment until task a2045b0a-d0bc-4a9f-8c05-e9b970490de8 (bootstrap) has been started and output is visible here. 2026-04-24 02:07:27.132890 | orchestrator | 2026-04-24 02:07:27.132974 | orchestrator | PLAY [Group hosts based on state bootstrap] ************************************ 2026-04-24 02:07:27.132981 | orchestrator | 2026-04-24 02:07:27.132985 | orchestrator | TASK [Group hosts based on state bootstrap] ************************************ 2026-04-24 02:07:27.132990 | orchestrator | Friday 24 April 2026 02:07:15 +0000 (0:00:00.156) 0:00:00.156 ********** 2026-04-24 02:07:27.133050 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:27.133059 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:27.133065 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:27.133071 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:27.133077 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:27.133084 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:27.133091 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:27.133096 | orchestrator | 2026-04-24 02:07:27.133101 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-24 02:07:27.133105 | orchestrator | 2026-04-24 02:07:27.133109 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 02:07:27.133113 | orchestrator | Friday 24 April 2026 02:07:15 +0000 (0:00:00.270) 0:00:00.426 ********** 2026-04-24 02:07:27.133117 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:27.133121 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:27.133125 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:27.133129 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:27.133132 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:27.133136 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:27.133140 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:27.133143 | orchestrator | 2026-04-24 02:07:27.133147 | orchestrator | PLAY [Gather facts for all hosts (if using --limit)] *************************** 2026-04-24 02:07:27.133151 | orchestrator | 2026-04-24 02:07:27.133155 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 02:07:27.133159 | orchestrator | Friday 24 April 2026 02:07:19 +0000 (0:00:03.860) 0:00:04.287 ********** 2026-04-24 02:07:27.133163 | orchestrator | skipping: [testbed-manager] => (item=testbed-manager)  2026-04-24 02:07:27.133168 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-3)  2026-04-24 02:07:27.133172 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-4)  2026-04-24 02:07:27.133176 | orchestrator | skipping: [testbed-node-3] => (item=testbed-manager)  2026-04-24 02:07:27.133179 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:07:27.133184 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-5)  2026-04-24 02:07:27.133187 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-24 02:07:27.133191 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:07:27.133214 | orchestrator | skipping: [testbed-node-4] => (item=testbed-manager)  2026-04-24 02:07:27.133218 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-24 02:07:27.133222 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-24 02:07:27.133226 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:07:27.133230 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:07:27.133233 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 02:07:27.133238 | orchestrator | skipping: [testbed-node-5] => (item=testbed-manager)  2026-04-24 02:07:27.133242 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 02:07:27.133246 | orchestrator | skipping: [testbed-node-0] => (item=testbed-manager)  2026-04-24 02:07:27.133249 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 02:07:27.133253 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 02:07:27.133257 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 02:07:27.133261 | orchestrator | skipping: [testbed-node-2] => (item=testbed-manager)  2026-04-24 02:07:27.133265 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 02:07:27.133268 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 02:07:27.133272 | orchestrator | skipping: [testbed-node-1] => (item=testbed-manager)  2026-04-24 02:07:27.133276 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 02:07:27.133280 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 02:07:27.133283 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 02:07:27.133287 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 02:07:27.133291 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 02:07:27.133295 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 02:07:27.133299 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 02:07:27.133302 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 02:07:27.133306 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 02:07:27.133310 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:07:27.133314 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 02:07:27.133318 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:07:27.133321 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 02:07:27.133325 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 02:07:27.133329 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 02:07:27.133333 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 02:07:27.133337 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 02:07:27.133341 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 02:07:27.133345 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 02:07:27.133349 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 02:07:27.133352 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 02:07:27.133356 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:07:27.133371 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 02:07:27.133375 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 02:07:27.133379 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 02:07:27.133383 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 02:07:27.133387 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:07:27.133390 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 02:07:27.133394 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:07:27.133398 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 02:07:27.133405 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 02:07:27.133421 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:07:27.133425 | orchestrator | 2026-04-24 02:07:27.133429 | orchestrator | PLAY [Apply bootstrap roles part 1] ******************************************** 2026-04-24 02:07:27.133433 | orchestrator | 2026-04-24 02:07:27.133437 | orchestrator | TASK [osism.commons.hostname : Set hostname] *********************************** 2026-04-24 02:07:27.133441 | orchestrator | Friday 24 April 2026 02:07:19 +0000 (0:00:00.464) 0:00:04.751 ********** 2026-04-24 02:07:27.133444 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:27.133449 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:27.133453 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:27.133457 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:27.133462 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:27.133466 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:27.133470 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:27.133475 | orchestrator | 2026-04-24 02:07:27.133479 | orchestrator | TASK [osism.commons.hostname : Copy /etc/hostname] ***************************** 2026-04-24 02:07:27.133485 | orchestrator | Friday 24 April 2026 02:07:20 +0000 (0:00:01.219) 0:00:05.970 ********** 2026-04-24 02:07:27.133491 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:27.133499 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:27.133504 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:27.133508 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:27.133512 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:27.133517 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:27.133521 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:27.133527 | orchestrator | 2026-04-24 02:07:27.133535 | orchestrator | TASK [osism.commons.hosts : Include type specific tasks] *********************** 2026-04-24 02:07:27.133539 | orchestrator | Friday 24 April 2026 02:07:22 +0000 (0:00:01.259) 0:00:07.230 ********** 2026-04-24 02:07:27.133545 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/hosts/tasks/type-template.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:07:27.133551 | orchestrator | 2026-04-24 02:07:27.133556 | orchestrator | TASK [osism.commons.hosts : Copy /etc/hosts file] ****************************** 2026-04-24 02:07:27.133561 | orchestrator | Friday 24 April 2026 02:07:22 +0000 (0:00:00.302) 0:00:07.533 ********** 2026-04-24 02:07:27.133565 | orchestrator | changed: [testbed-manager] 2026-04-24 02:07:27.133570 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:07:27.133574 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:07:27.133578 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:07:27.133583 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:07:27.133587 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:07:27.133591 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:07:27.133596 | orchestrator | 2026-04-24 02:07:27.133600 | orchestrator | TASK [osism.commons.proxy : Include distribution specific tasks] *************** 2026-04-24 02:07:27.133605 | orchestrator | Friday 24 April 2026 02:07:24 +0000 (0:00:02.006) 0:00:09.539 ********** 2026-04-24 02:07:27.133609 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:07:27.133615 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/proxy/tasks/Debian-family.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:07:27.133621 | orchestrator | 2026-04-24 02:07:27.133625 | orchestrator | TASK [osism.commons.proxy : Configure proxy parameters for apt] **************** 2026-04-24 02:07:27.133630 | orchestrator | Friday 24 April 2026 02:07:24 +0000 (0:00:00.274) 0:00:09.814 ********** 2026-04-24 02:07:27.133634 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:07:27.133639 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:07:27.133643 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:07:27.133647 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:07:27.133652 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:07:27.133660 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:07:27.133664 | orchestrator | 2026-04-24 02:07:27.133669 | orchestrator | TASK [osism.commons.proxy : Set system wide settings in environment file] ****** 2026-04-24 02:07:27.133673 | orchestrator | Friday 24 April 2026 02:07:25 +0000 (0:00:01.136) 0:00:10.950 ********** 2026-04-24 02:07:27.133677 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:07:27.133681 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:07:27.133686 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:07:27.133690 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:07:27.133694 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:07:27.133698 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:07:27.133703 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:07:27.133709 | orchestrator | 2026-04-24 02:07:27.133715 | orchestrator | TASK [osism.commons.proxy : Remove system wide settings in environment file] *** 2026-04-24 02:07:27.133722 | orchestrator | Friday 24 April 2026 02:07:26 +0000 (0:00:00.601) 0:00:11.551 ********** 2026-04-24 02:07:27.133728 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:07:27.133734 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:07:27.133780 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:07:27.133787 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:07:27.133791 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:07:27.133796 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:07:27.133800 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:27.133804 | orchestrator | 2026-04-24 02:07:27.133809 | orchestrator | TASK [osism.commons.resolvconf : Check minimum and maximum number of name servers] *** 2026-04-24 02:07:27.133814 | orchestrator | Friday 24 April 2026 02:07:26 +0000 (0:00:00.431) 0:00:11.983 ********** 2026-04-24 02:07:27.133818 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:07:27.133822 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:07:27.133830 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:07:41.341323 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:07:41.341467 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:07:41.341496 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:07:41.341509 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:07:41.341520 | orchestrator | 2026-04-24 02:07:41.341533 | orchestrator | TASK [osism.commons.resolvconf : Include resolvconf tasks] ********************* 2026-04-24 02:07:41.341546 | orchestrator | Friday 24 April 2026 02:07:27 +0000 (0:00:00.232) 0:00:12.216 ********** 2026-04-24 02:07:41.341559 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-resolv.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:07:41.341583 | orchestrator | 2026-04-24 02:07:41.341594 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific installation tasks] *** 2026-04-24 02:07:41.341606 | orchestrator | Friday 24 April 2026 02:07:27 +0000 (0:00:00.293) 0:00:12.510 ********** 2026-04-24 02:07:41.341618 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:07:41.341628 | orchestrator | 2026-04-24 02:07:41.341640 | orchestrator | TASK [osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf] *** 2026-04-24 02:07:41.341650 | orchestrator | Friday 24 April 2026 02:07:27 +0000 (0:00:00.317) 0:00:12.827 ********** 2026-04-24 02:07:41.341661 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.341673 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.341683 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.341695 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:41.341705 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:41.341716 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:41.341727 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.341737 | orchestrator | 2026-04-24 02:07:41.341748 | orchestrator | TASK [osism.commons.resolvconf : Install package systemd-resolved] ************* 2026-04-24 02:07:41.341778 | orchestrator | Friday 24 April 2026 02:07:29 +0000 (0:00:01.614) 0:00:14.441 ********** 2026-04-24 02:07:41.341790 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:07:41.341801 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:07:41.341812 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:07:41.341823 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:07:41.341833 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:07:41.341844 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:07:41.341854 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:07:41.341865 | orchestrator | 2026-04-24 02:07:41.341876 | orchestrator | TASK [osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf] ***** 2026-04-24 02:07:41.341887 | orchestrator | Friday 24 April 2026 02:07:29 +0000 (0:00:00.342) 0:00:14.784 ********** 2026-04-24 02:07:41.341898 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.341909 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.341919 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.341930 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.341941 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:41.341951 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:41.341962 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:41.341972 | orchestrator | 2026-04-24 02:07:41.341983 | orchestrator | TASK [osism.commons.resolvconf : Archive existing file /etc/resolv.conf] ******* 2026-04-24 02:07:41.342112 | orchestrator | Friday 24 April 2026 02:07:30 +0000 (0:00:00.534) 0:00:15.319 ********** 2026-04-24 02:07:41.342130 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:07:41.342141 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:07:41.342152 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:07:41.342163 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:07:41.342173 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:07:41.342185 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:07:41.342196 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:07:41.342206 | orchestrator | 2026-04-24 02:07:41.342217 | orchestrator | TASK [osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf] *** 2026-04-24 02:07:41.342230 | orchestrator | Friday 24 April 2026 02:07:30 +0000 (0:00:00.246) 0:00:15.565 ********** 2026-04-24 02:07:41.342241 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.342252 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:07:41.342263 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:07:41.342274 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:07:41.342284 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:07:41.342295 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:07:41.342306 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:07:41.342317 | orchestrator | 2026-04-24 02:07:41.342328 | orchestrator | TASK [osism.commons.resolvconf : Copy configuration files] ********************* 2026-04-24 02:07:41.342339 | orchestrator | Friday 24 April 2026 02:07:31 +0000 (0:00:00.560) 0:00:16.126 ********** 2026-04-24 02:07:41.342350 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.342361 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:07:41.342371 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:07:41.342382 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:07:41.342393 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:07:41.342404 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:07:41.342415 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:07:41.342425 | orchestrator | 2026-04-24 02:07:41.342436 | orchestrator | TASK [osism.commons.resolvconf : Start/enable systemd-resolved service] ******** 2026-04-24 02:07:41.342447 | orchestrator | Friday 24 April 2026 02:07:32 +0000 (0:00:01.093) 0:00:17.219 ********** 2026-04-24 02:07:41.342465 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:41.342476 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:41.342487 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.342498 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.342509 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:41.342520 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.342531 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.342550 | orchestrator | 2026-04-24 02:07:41.342561 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific configuration tasks] *** 2026-04-24 02:07:41.342572 | orchestrator | Friday 24 April 2026 02:07:34 +0000 (0:00:01.983) 0:00:19.203 ********** 2026-04-24 02:07:41.342601 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:07:41.342613 | orchestrator | 2026-04-24 02:07:41.342623 | orchestrator | TASK [osism.commons.resolvconf : Restart systemd-resolved service] ************* 2026-04-24 02:07:41.342634 | orchestrator | Friday 24 April 2026 02:07:34 +0000 (0:00:00.342) 0:00:19.546 ********** 2026-04-24 02:07:41.342645 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:07:41.342656 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:07:41.342667 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:07:41.342677 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:07:41.342688 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:07:41.342699 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:07:41.342709 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:07:41.342720 | orchestrator | 2026-04-24 02:07:41.342731 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-24 02:07:41.342742 | orchestrator | Friday 24 April 2026 02:07:36 +0000 (0:00:02.255) 0:00:21.801 ********** 2026-04-24 02:07:41.342753 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.342764 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.342775 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.342785 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.342796 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:41.342807 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:41.342817 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:41.342828 | orchestrator | 2026-04-24 02:07:41.342839 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-24 02:07:41.342850 | orchestrator | Friday 24 April 2026 02:07:37 +0000 (0:00:00.224) 0:00:22.026 ********** 2026-04-24 02:07:41.342861 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.342872 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.342883 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.342893 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.342904 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:41.342914 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:41.342925 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:41.342935 | orchestrator | 2026-04-24 02:07:41.342946 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-24 02:07:41.342957 | orchestrator | Friday 24 April 2026 02:07:37 +0000 (0:00:00.215) 0:00:22.242 ********** 2026-04-24 02:07:41.342968 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.342979 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.342989 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.343027 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.343046 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:41.343065 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:41.343084 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:41.343102 | orchestrator | 2026-04-24 02:07:41.343114 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-24 02:07:41.343126 | orchestrator | Friday 24 April 2026 02:07:37 +0000 (0:00:00.251) 0:00:22.494 ********** 2026-04-24 02:07:41.343137 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:07:41.343150 | orchestrator | 2026-04-24 02:07:41.343160 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-24 02:07:41.343171 | orchestrator | Friday 24 April 2026 02:07:37 +0000 (0:00:00.254) 0:00:22.748 ********** 2026-04-24 02:07:41.343182 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.343200 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.343214 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.343232 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.343250 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:41.343269 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:41.343287 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:41.343299 | orchestrator | 2026-04-24 02:07:41.343310 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-24 02:07:41.343321 | orchestrator | Friday 24 April 2026 02:07:38 +0000 (0:00:00.548) 0:00:23.297 ********** 2026-04-24 02:07:41.343332 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:07:41.343343 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:07:41.343353 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:07:41.343364 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:07:41.343375 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:07:41.343386 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:07:41.343396 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:07:41.343407 | orchestrator | 2026-04-24 02:07:41.343418 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-24 02:07:41.343429 | orchestrator | Friday 24 April 2026 02:07:38 +0000 (0:00:00.246) 0:00:23.543 ********** 2026-04-24 02:07:41.343440 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.343450 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.343461 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.343471 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.343482 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:07:41.343493 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:07:41.343503 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:07:41.343514 | orchestrator | 2026-04-24 02:07:41.343525 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-24 02:07:41.343536 | orchestrator | Friday 24 April 2026 02:07:39 +0000 (0:00:01.074) 0:00:24.617 ********** 2026-04-24 02:07:41.343547 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.343557 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.343569 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.343579 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.343590 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:07:41.343600 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:07:41.343611 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:07:41.343621 | orchestrator | 2026-04-24 02:07:41.343633 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-24 02:07:41.343644 | orchestrator | Friday 24 April 2026 02:07:40 +0000 (0:00:00.557) 0:00:25.175 ********** 2026-04-24 02:07:41.343655 | orchestrator | ok: [testbed-manager] 2026-04-24 02:07:41.343665 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:07:41.343676 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:07:41.343695 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:07:41.343715 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:08:23.451310 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:08:23.452232 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:08:23.452271 | orchestrator | 2026-04-24 02:08:23.452285 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-24 02:08:23.452299 | orchestrator | Friday 24 April 2026 02:07:41 +0000 (0:00:01.148) 0:00:26.323 ********** 2026-04-24 02:08:23.452311 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.452323 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.452334 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.452346 | orchestrator | changed: [testbed-manager] 2026-04-24 02:08:23.452357 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:08:23.452369 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:08:23.452380 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:08:23.452390 | orchestrator | 2026-04-24 02:08:23.452402 | orchestrator | TASK [osism.services.rsyslog : Gather variables for each operating system] ***** 2026-04-24 02:08:23.452413 | orchestrator | Friday 24 April 2026 02:07:57 +0000 (0:00:16.186) 0:00:42.510 ********** 2026-04-24 02:08:23.452451 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.452463 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.452473 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.452484 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.452495 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.452506 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.452516 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.452527 | orchestrator | 2026-04-24 02:08:23.452538 | orchestrator | TASK [osism.services.rsyslog : Set rsyslog_user variable to default value] ***** 2026-04-24 02:08:23.452549 | orchestrator | Friday 24 April 2026 02:07:57 +0000 (0:00:00.240) 0:00:42.751 ********** 2026-04-24 02:08:23.452560 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.452571 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.452581 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.452592 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.452603 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.452613 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.452624 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.452634 | orchestrator | 2026-04-24 02:08:23.452646 | orchestrator | TASK [osism.services.rsyslog : Set rsyslog_workdir variable to default value] *** 2026-04-24 02:08:23.452656 | orchestrator | Friday 24 April 2026 02:07:57 +0000 (0:00:00.222) 0:00:42.974 ********** 2026-04-24 02:08:23.452667 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.452678 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.452689 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.452699 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.452710 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.452721 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.452732 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.452742 | orchestrator | 2026-04-24 02:08:23.452753 | orchestrator | TASK [osism.services.rsyslog : Include distribution specific install tasks] **** 2026-04-24 02:08:23.452764 | orchestrator | Friday 24 April 2026 02:07:58 +0000 (0:00:00.214) 0:00:43.189 ********** 2026-04-24 02:08:23.452777 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:08:23.452791 | orchestrator | 2026-04-24 02:08:23.452802 | orchestrator | TASK [osism.services.rsyslog : Install rsyslog package] ************************ 2026-04-24 02:08:23.452813 | orchestrator | Friday 24 April 2026 02:07:58 +0000 (0:00:00.347) 0:00:43.536 ********** 2026-04-24 02:08:23.452824 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.452835 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.452845 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.452856 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.452866 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.452877 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.452887 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.452898 | orchestrator | 2026-04-24 02:08:23.452909 | orchestrator | TASK [osism.services.rsyslog : Copy rsyslog.conf configuration file] *********** 2026-04-24 02:08:23.452920 | orchestrator | Friday 24 April 2026 02:08:00 +0000 (0:00:01.605) 0:00:45.141 ********** 2026-04-24 02:08:23.452931 | orchestrator | changed: [testbed-manager] 2026-04-24 02:08:23.452942 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:08:23.452952 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:08:23.452963 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:08:23.452974 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:08:23.452985 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:08:23.453023 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:08:23.453036 | orchestrator | 2026-04-24 02:08:23.453048 | orchestrator | TASK [osism.services.rsyslog : Manage rsyslog service] ************************* 2026-04-24 02:08:23.453059 | orchestrator | Friday 24 April 2026 02:08:01 +0000 (0:00:01.042) 0:00:46.183 ********** 2026-04-24 02:08:23.453069 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.453080 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.453099 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.453110 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.453121 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.453131 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.453142 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.453153 | orchestrator | 2026-04-24 02:08:23.453163 | orchestrator | TASK [osism.services.rsyslog : Include fluentd tasks] ************************** 2026-04-24 02:08:23.453174 | orchestrator | Friday 24 April 2026 02:08:02 +0000 (0:00:01.633) 0:00:47.817 ********** 2026-04-24 02:08:23.453200 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/fluentd.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:08:23.453213 | orchestrator | 2026-04-24 02:08:23.453223 | orchestrator | TASK [osism.services.rsyslog : Forward syslog message to local fluentd daemon] *** 2026-04-24 02:08:23.453235 | orchestrator | Friday 24 April 2026 02:08:03 +0000 (0:00:00.323) 0:00:48.140 ********** 2026-04-24 02:08:23.453246 | orchestrator | changed: [testbed-manager] 2026-04-24 02:08:23.453256 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:08:23.453267 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:08:23.453278 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:08:23.453288 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:08:23.453299 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:08:23.453310 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:08:23.453320 | orchestrator | 2026-04-24 02:08:23.453351 | orchestrator | TASK [osism.services.rsyslog : Include additional log server tasks] ************ 2026-04-24 02:08:23.453363 | orchestrator | Friday 24 April 2026 02:08:04 +0000 (0:00:01.032) 0:00:49.173 ********** 2026-04-24 02:08:23.453373 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:08:23.453384 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:08:23.453395 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:08:23.453406 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:08:23.453417 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:08:23.453479 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:08:23.453491 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:08:23.453502 | orchestrator | 2026-04-24 02:08:23.453513 | orchestrator | TASK [osism.services.rsyslog : Include logrotate tasks] ************************ 2026-04-24 02:08:23.453524 | orchestrator | Friday 24 April 2026 02:08:04 +0000 (0:00:00.229) 0:00:49.402 ********** 2026-04-24 02:08:23.453535 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/logrotate.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:08:23.453546 | orchestrator | 2026-04-24 02:08:23.453556 | orchestrator | TASK [osism.services.rsyslog : Ensure logrotate package is installed] ********** 2026-04-24 02:08:23.453567 | orchestrator | Friday 24 April 2026 02:08:04 +0000 (0:00:00.327) 0:00:49.729 ********** 2026-04-24 02:08:23.453578 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.453589 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.453599 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.453624 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.453635 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.453646 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.453656 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.453667 | orchestrator | 2026-04-24 02:08:23.453677 | orchestrator | TASK [osism.services.rsyslog : Configure logrotate for rsyslog] **************** 2026-04-24 02:08:23.453688 | orchestrator | Friday 24 April 2026 02:08:06 +0000 (0:00:01.808) 0:00:51.537 ********** 2026-04-24 02:08:23.453730 | orchestrator | changed: [testbed-manager] 2026-04-24 02:08:23.453742 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:08:23.453753 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:08:23.453764 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:08:23.453775 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:08:23.453786 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:08:23.453805 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:08:23.453816 | orchestrator | 2026-04-24 02:08:23.453827 | orchestrator | TASK [osism.commons.systohc : Install util-linux-extra package] **************** 2026-04-24 02:08:23.453838 | orchestrator | Friday 24 April 2026 02:08:07 +0000 (0:00:01.085) 0:00:52.622 ********** 2026-04-24 02:08:23.453849 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:08:23.453860 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:08:23.453870 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:08:23.453881 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:08:23.453892 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:08:23.453902 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:08:23.453913 | orchestrator | changed: [testbed-manager] 2026-04-24 02:08:23.453924 | orchestrator | 2026-04-24 02:08:23.453934 | orchestrator | TASK [osism.commons.systohc : Sync hardware clock] ***************************** 2026-04-24 02:08:23.453945 | orchestrator | Friday 24 April 2026 02:08:20 +0000 (0:00:13.132) 0:01:05.755 ********** 2026-04-24 02:08:23.453956 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.453967 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.453978 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.453988 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.454110 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.454123 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.454134 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.454145 | orchestrator | 2026-04-24 02:08:23.454156 | orchestrator | TASK [osism.commons.configfs : Start sys-kernel-config mount] ****************** 2026-04-24 02:08:23.454167 | orchestrator | Friday 24 April 2026 02:08:21 +0000 (0:00:00.920) 0:01:06.676 ********** 2026-04-24 02:08:23.454178 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.454189 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.454199 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.454210 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.454221 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.454231 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.454242 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.454252 | orchestrator | 2026-04-24 02:08:23.454263 | orchestrator | TASK [osism.commons.packages : Gather variables for each operating system] ***** 2026-04-24 02:08:23.454274 | orchestrator | Friday 24 April 2026 02:08:22 +0000 (0:00:00.907) 0:01:07.583 ********** 2026-04-24 02:08:23.454285 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.454296 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.454306 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.454317 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.454327 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.454338 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.454348 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.454359 | orchestrator | 2026-04-24 02:08:23.454370 | orchestrator | TASK [osism.commons.packages : Set required_packages_distribution variable to default value] *** 2026-04-24 02:08:23.454381 | orchestrator | Friday 24 April 2026 02:08:22 +0000 (0:00:00.260) 0:01:07.844 ********** 2026-04-24 02:08:23.454392 | orchestrator | ok: [testbed-manager] 2026-04-24 02:08:23.454403 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:08:23.454413 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:08:23.454424 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:08:23.454434 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:08:23.454445 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:08:23.454455 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:08:23.454466 | orchestrator | 2026-04-24 02:08:23.454483 | orchestrator | TASK [osism.commons.packages : Include distribution specific package tasks] **** 2026-04-24 02:08:23.454495 | orchestrator | Friday 24 April 2026 02:08:23 +0000 (0:00:00.262) 0:01:08.107 ********** 2026-04-24 02:08:23.454506 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/packages/tasks/package-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:08:23.454518 | orchestrator | 2026-04-24 02:08:23.454539 | orchestrator | TASK [osism.commons.packages : Install needrestart package] ******************** 2026-04-24 02:10:41.457064 | orchestrator | Friday 24 April 2026 02:08:23 +0000 (0:00:00.333) 0:01:08.441 ********** 2026-04-24 02:10:41.457187 | orchestrator | ok: [testbed-manager] 2026-04-24 02:10:41.457207 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:10:41.457223 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:10:41.457239 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:10:41.457254 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:10:41.457269 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:10:41.457283 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:10:41.457298 | orchestrator | 2026-04-24 02:10:41.457328 | orchestrator | TASK [osism.commons.packages : Set needrestart mode] *************************** 2026-04-24 02:10:41.457353 | orchestrator | Friday 24 April 2026 02:08:24 +0000 (0:00:01.553) 0:01:09.994 ********** 2026-04-24 02:10:41.457367 | orchestrator | changed: [testbed-manager] 2026-04-24 02:10:41.457381 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:10:41.457395 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:10:41.457408 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:10:41.457422 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:10:41.457435 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:10:41.457449 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:10:41.457463 | orchestrator | 2026-04-24 02:10:41.457476 | orchestrator | TASK [osism.commons.packages : Set apt_cache_valid_time variable to default value] *** 2026-04-24 02:10:41.457490 | orchestrator | Friday 24 April 2026 02:08:25 +0000 (0:00:00.533) 0:01:10.528 ********** 2026-04-24 02:10:41.457504 | orchestrator | ok: [testbed-manager] 2026-04-24 02:10:41.457517 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:10:41.457530 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:10:41.457543 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:10:41.457557 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:10:41.457570 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:10:41.457584 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:10:41.457599 | orchestrator | 2026-04-24 02:10:41.457614 | orchestrator | TASK [osism.commons.packages : Update package cache] *************************** 2026-04-24 02:10:41.457629 | orchestrator | Friday 24 April 2026 02:08:25 +0000 (0:00:00.244) 0:01:10.772 ********** 2026-04-24 02:10:41.457645 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:10:41.457661 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:10:41.457677 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:10:41.457691 | orchestrator | ok: [testbed-manager] 2026-04-24 02:10:41.457704 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:10:41.457717 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:10:41.457731 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:10:41.457744 | orchestrator | 2026-04-24 02:10:41.457757 | orchestrator | TASK [osism.commons.packages : Download upgrade packages] ********************** 2026-04-24 02:10:41.457770 | orchestrator | Friday 24 April 2026 02:08:26 +0000 (0:00:00.970) 0:01:11.742 ********** 2026-04-24 02:10:41.457784 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:10:41.457797 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:10:41.457811 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:10:41.457825 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:10:41.457840 | orchestrator | changed: [testbed-manager] 2026-04-24 02:10:41.457854 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:10:41.457868 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:10:41.457886 | orchestrator | 2026-04-24 02:10:41.457900 | orchestrator | TASK [osism.commons.packages : Upgrade packages] ******************************* 2026-04-24 02:10:41.457915 | orchestrator | Friday 24 April 2026 02:08:28 +0000 (0:00:01.487) 0:01:13.229 ********** 2026-04-24 02:10:41.457930 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:10:41.457943 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:10:41.457957 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:10:41.457970 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:10:41.457983 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:10:41.457996 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:10:41.458117 | orchestrator | ok: [testbed-manager] 2026-04-24 02:10:41.458162 | orchestrator | 2026-04-24 02:10:41.458177 | orchestrator | TASK [osism.commons.packages : Download required packages] ********************* 2026-04-24 02:10:41.458306 | orchestrator | Friday 24 April 2026 02:08:30 +0000 (0:00:01.967) 0:01:15.197 ********** 2026-04-24 02:10:41.458321 | orchestrator | ok: [testbed-manager] 2026-04-24 02:10:41.458334 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:10:41.458347 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:10:41.458360 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:10:41.458372 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:10:41.458384 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:10:41.458397 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:10:41.458410 | orchestrator | 2026-04-24 02:10:41.458422 | orchestrator | TASK [osism.commons.packages : Install required packages] ********************** 2026-04-24 02:10:41.458435 | orchestrator | Friday 24 April 2026 02:09:08 +0000 (0:00:38.526) 0:01:53.724 ********** 2026-04-24 02:10:41.458448 | orchestrator | changed: [testbed-manager] 2026-04-24 02:10:41.458461 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:10:41.458473 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:10:41.458486 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:10:41.458499 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:10:41.458511 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:10:41.458524 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:10:41.458537 | orchestrator | 2026-04-24 02:10:41.458549 | orchestrator | TASK [osism.commons.packages : Remove useless packages from the cache] ********* 2026-04-24 02:10:41.458562 | orchestrator | Friday 24 April 2026 02:10:25 +0000 (0:01:16.740) 0:03:10.464 ********** 2026-04-24 02:10:41.458575 | orchestrator | ok: [testbed-manager] 2026-04-24 02:10:41.458588 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:10:41.458601 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:10:41.458613 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:10:41.458625 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:10:41.458638 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:10:41.458651 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:10:41.458664 | orchestrator | 2026-04-24 02:10:41.458677 | orchestrator | TASK [osism.commons.packages : Remove dependencies that are no longer required] *** 2026-04-24 02:10:41.458690 | orchestrator | Friday 24 April 2026 02:10:27 +0000 (0:00:01.596) 0:03:12.061 ********** 2026-04-24 02:10:41.458703 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:10:41.458716 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:10:41.458729 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:10:41.458741 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:10:41.458753 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:10:41.458766 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:10:41.458779 | orchestrator | changed: [testbed-manager] 2026-04-24 02:10:41.458791 | orchestrator | 2026-04-24 02:10:41.458804 | orchestrator | TASK [osism.commons.sysctl : Include sysctl tasks] ***************************** 2026-04-24 02:10:41.458817 | orchestrator | Friday 24 April 2026 02:10:40 +0000 (0:00:13.144) 0:03:25.206 ********** 2026-04-24 02:10:41.458921 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'elasticsearch', 'value': [{'name': 'vm.max_map_count', 'value': 262144}]}) 2026-04-24 02:10:41.458961 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'rabbitmq', 'value': [{'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}, {'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}, {'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}, {'name': 'net.core.wmem_max', 'value': 16777216}, {'name': 'net.core.rmem_max', 'value': 16777216}, {'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}, {'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}, {'name': 'net.core.somaxconn', 'value': 4096}, {'name': 'net.ipv4.tcp_syncookies', 'value': 0}, {'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}]}) 2026-04-24 02:10:41.458991 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'generic', 'value': [{'name': 'vm.swappiness', 'value': 1}]}) 2026-04-24 02:10:41.459070 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'compute', 'value': [{'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}]}) 2026-04-24 02:10:41.459084 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'network', 'value': [{'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}]}) 2026-04-24 02:10:41.459098 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'k3s_node', 'value': [{'name': 'fs.inotify.max_user_instances', 'value': 1024}]}) 2026-04-24 02:10:41.459111 | orchestrator | 2026-04-24 02:10:41.459125 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on elasticsearch] *********** 2026-04-24 02:10:41.459138 | orchestrator | Friday 24 April 2026 02:10:40 +0000 (0:00:00.404) 0:03:25.610 ********** 2026-04-24 02:10:41.459151 | orchestrator | skipping: [testbed-manager] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-24 02:10:41.459164 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:10:41.459178 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-24 02:10:41.459191 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:10:41.459204 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-24 02:10:41.459217 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-24 02:10:41.459229 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:10:41.459242 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:10:41.459255 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 02:10:41.459268 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 02:10:41.459280 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 02:10:41.459293 | orchestrator | 2026-04-24 02:10:41.459306 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on rabbitmq] **************** 2026-04-24 02:10:41.459319 | orchestrator | Friday 24 April 2026 02:10:41 +0000 (0:00:00.768) 0:03:26.378 ********** 2026-04-24 02:10:41.459337 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-24 02:10:41.459352 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-24 02:10:41.459365 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-24 02:10:41.459378 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-24 02:10:41.459391 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-24 02:10:41.459414 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-24 02:10:47.216110 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-24 02:10:47.216190 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-24 02:10:47.216214 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-24 02:10:47.216219 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-24 02:10:47.216223 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-24 02:10:47.216227 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-24 02:10:47.216231 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-24 02:10:47.216235 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-24 02:10:47.216239 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-24 02:10:47.216243 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-24 02:10:47.216247 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-24 02:10:47.216251 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-24 02:10:47.216255 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-24 02:10:47.216259 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-24 02:10:47.216263 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-24 02:10:47.216267 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-24 02:10:47.216270 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-24 02:10:47.216274 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-24 02:10:47.216278 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:10:47.216283 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-24 02:10:47.216287 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-24 02:10:47.216291 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-24 02:10:47.216294 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-24 02:10:47.216298 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-24 02:10:47.216302 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-24 02:10:47.216305 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-24 02:10:47.216309 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-24 02:10:47.216313 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:10:47.216317 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-24 02:10:47.216321 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-24 02:10:47.216324 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-24 02:10:47.216328 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-24 02:10:47.216332 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-24 02:10:47.216336 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-24 02:10:47.216340 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-24 02:10:47.216347 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-24 02:10:47.216351 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:10:47.216355 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:10:47.216369 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-24 02:10:47.216373 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-24 02:10:47.216377 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-24 02:10:47.216380 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-24 02:10:47.216384 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-24 02:10:47.216398 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-24 02:10:47.216402 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-24 02:10:47.216406 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-24 02:10:47.216409 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-24 02:10:47.216413 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-24 02:10:47.216417 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-24 02:10:47.216420 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-24 02:10:47.216424 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-24 02:10:47.216428 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-24 02:10:47.216432 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-24 02:10:47.216435 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-24 02:10:47.216439 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-24 02:10:47.216443 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-24 02:10:47.216447 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-24 02:10:47.216450 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-24 02:10:47.216454 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-24 02:10:47.216458 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-24 02:10:47.216462 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-24 02:10:47.216465 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-24 02:10:47.216469 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-24 02:10:47.216473 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-24 02:10:47.216476 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-24 02:10:47.216480 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-24 02:10:47.216485 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-24 02:10:47.216489 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-24 02:10:47.216495 | orchestrator | 2026-04-24 02:10:47.216500 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on generic] ***************** 2026-04-24 02:10:47.216504 | orchestrator | Friday 24 April 2026 02:10:45 +0000 (0:00:03.811) 0:03:30.189 ********** 2026-04-24 02:10:47.216508 | orchestrator | changed: [testbed-manager] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-24 02:10:47.216511 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-24 02:10:47.216515 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-24 02:10:47.216519 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-24 02:10:47.216523 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-24 02:10:47.216526 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-24 02:10:47.216530 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-24 02:10:47.216534 | orchestrator | 2026-04-24 02:10:47.216537 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on compute] ***************** 2026-04-24 02:10:47.216541 | orchestrator | Friday 24 April 2026 02:10:46 +0000 (0:00:01.526) 0:03:31.716 ********** 2026-04-24 02:10:47.216545 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-24 02:10:47.216549 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:10:47.216553 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-24 02:10:47.216560 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:10:47.216563 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-24 02:10:47.216567 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:10:47.216571 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-24 02:10:47.216575 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:10:47.216578 | orchestrator | changed: [testbed-node-3] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-24 02:10:47.216582 | orchestrator | changed: [testbed-node-4] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-24 02:10:47.216589 | orchestrator | changed: [testbed-node-5] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-24 02:11:00.359351 | orchestrator | 2026-04-24 02:11:00.359490 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on network] ***************** 2026-04-24 02:11:00.359510 | orchestrator | Friday 24 April 2026 02:10:47 +0000 (0:00:00.494) 0:03:32.211 ********** 2026-04-24 02:11:00.359523 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-24 02:11:00.359536 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:11:00.359557 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-24 02:11:00.359569 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:11:00.359581 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-24 02:11:00.359593 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-24 02:11:00.359604 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:11:00.359615 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:11:00.359626 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-24 02:11:00.359637 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-24 02:11:00.359648 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-24 02:11:00.359659 | orchestrator | 2026-04-24 02:11:00.359698 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on k3s_node] **************** 2026-04-24 02:11:00.359710 | orchestrator | Friday 24 April 2026 02:10:47 +0000 (0:00:00.589) 0:03:32.800 ********** 2026-04-24 02:11:00.359721 | orchestrator | skipping: [testbed-manager] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-24 02:11:00.359732 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:11:00.359743 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-24 02:11:00.359754 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:11:00.359765 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-24 02:11:00.359776 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:11:00.359787 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-24 02:11:00.359798 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:11:00.359809 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-24 02:11:00.359820 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-24 02:11:00.359831 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-24 02:11:00.359842 | orchestrator | 2026-04-24 02:11:00.359853 | orchestrator | TASK [osism.commons.limits : Include limits tasks] ***************************** 2026-04-24 02:11:00.359863 | orchestrator | Friday 24 April 2026 02:10:48 +0000 (0:00:00.549) 0:03:33.350 ********** 2026-04-24 02:11:00.359874 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:11:00.359885 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:11:00.359913 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:11:00.359935 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:11:00.359946 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:11:00.359957 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:11:00.359968 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:11:00.359978 | orchestrator | 2026-04-24 02:11:00.359990 | orchestrator | TASK [osism.commons.services : Populate service facts] ************************* 2026-04-24 02:11:00.360001 | orchestrator | Friday 24 April 2026 02:10:48 +0000 (0:00:00.315) 0:03:33.665 ********** 2026-04-24 02:11:00.360079 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:11:00.360094 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:11:00.360105 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:11:00.360116 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:11:00.360126 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:11:00.360138 | orchestrator | ok: [testbed-manager] 2026-04-24 02:11:00.360149 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:11:00.360159 | orchestrator | 2026-04-24 02:11:00.360171 | orchestrator | TASK [osism.commons.services : Check services] ********************************* 2026-04-24 02:11:00.360181 | orchestrator | Friday 24 April 2026 02:10:54 +0000 (0:00:05.741) 0:03:39.407 ********** 2026-04-24 02:11:00.360193 | orchestrator | skipping: [testbed-manager] => (item=nscd)  2026-04-24 02:11:00.360204 | orchestrator | skipping: [testbed-node-3] => (item=nscd)  2026-04-24 02:11:00.360215 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:11:00.360226 | orchestrator | skipping: [testbed-node-4] => (item=nscd)  2026-04-24 02:11:00.360237 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:11:00.360248 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:11:00.360259 | orchestrator | skipping: [testbed-node-5] => (item=nscd)  2026-04-24 02:11:00.360270 | orchestrator | skipping: [testbed-node-0] => (item=nscd)  2026-04-24 02:11:00.360281 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:11:00.360292 | orchestrator | skipping: [testbed-node-1] => (item=nscd)  2026-04-24 02:11:00.360322 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:11:00.360334 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:11:00.360344 | orchestrator | skipping: [testbed-node-2] => (item=nscd)  2026-04-24 02:11:00.360355 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:11:00.360376 | orchestrator | 2026-04-24 02:11:00.360387 | orchestrator | TASK [osism.commons.services : Start/enable required services] ***************** 2026-04-24 02:11:00.360398 | orchestrator | Friday 24 April 2026 02:10:54 +0000 (0:00:00.326) 0:03:39.733 ********** 2026-04-24 02:11:00.360409 | orchestrator | ok: [testbed-manager] => (item=cron) 2026-04-24 02:11:00.360420 | orchestrator | ok: [testbed-node-3] => (item=cron) 2026-04-24 02:11:00.360431 | orchestrator | ok: [testbed-node-4] => (item=cron) 2026-04-24 02:11:00.360461 | orchestrator | ok: [testbed-node-5] => (item=cron) 2026-04-24 02:11:00.360473 | orchestrator | ok: [testbed-node-0] => (item=cron) 2026-04-24 02:11:00.360484 | orchestrator | ok: [testbed-node-1] => (item=cron) 2026-04-24 02:11:00.360495 | orchestrator | ok: [testbed-node-2] => (item=cron) 2026-04-24 02:11:00.360506 | orchestrator | 2026-04-24 02:11:00.360516 | orchestrator | TASK [osism.commons.motd : Include distribution specific configure tasks] ****** 2026-04-24 02:11:00.360527 | orchestrator | Friday 24 April 2026 02:10:55 +0000 (0:00:01.144) 0:03:40.878 ********** 2026-04-24 02:11:00.360540 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/motd/tasks/configure-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:11:00.360553 | orchestrator | 2026-04-24 02:11:00.360564 | orchestrator | TASK [osism.commons.motd : Remove update-motd package] ************************* 2026-04-24 02:11:00.360575 | orchestrator | Friday 24 April 2026 02:10:56 +0000 (0:00:00.425) 0:03:41.304 ********** 2026-04-24 02:11:00.360586 | orchestrator | ok: [testbed-manager] 2026-04-24 02:11:00.360597 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:11:00.360608 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:11:00.360619 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:11:00.360629 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:11:00.360640 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:11:00.360650 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:11:00.360661 | orchestrator | 2026-04-24 02:11:00.360672 | orchestrator | TASK [osism.commons.motd : Check if /etc/default/motd-news exists] ************* 2026-04-24 02:11:00.360683 | orchestrator | Friday 24 April 2026 02:10:57 +0000 (0:00:01.229) 0:03:42.533 ********** 2026-04-24 02:11:00.360693 | orchestrator | ok: [testbed-manager] 2026-04-24 02:11:00.360704 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:11:00.360715 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:11:00.360725 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:11:00.360736 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:11:00.360746 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:11:00.360757 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:11:00.360767 | orchestrator | 2026-04-24 02:11:00.360778 | orchestrator | TASK [osism.commons.motd : Disable the dynamic motd-news service] ************** 2026-04-24 02:11:00.360789 | orchestrator | Friday 24 April 2026 02:10:58 +0000 (0:00:00.616) 0:03:43.150 ********** 2026-04-24 02:11:00.360800 | orchestrator | changed: [testbed-manager] 2026-04-24 02:11:00.360811 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:11:00.360821 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:11:00.360832 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:11:00.360843 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:11:00.360854 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:11:00.360864 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:11:00.360875 | orchestrator | 2026-04-24 02:11:00.360886 | orchestrator | TASK [osism.commons.motd : Get all configuration files in /etc/pam.d] ********** 2026-04-24 02:11:00.360897 | orchestrator | Friday 24 April 2026 02:10:58 +0000 (0:00:00.636) 0:03:43.787 ********** 2026-04-24 02:11:00.360908 | orchestrator | ok: [testbed-manager] 2026-04-24 02:11:00.360919 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:11:00.360930 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:11:00.360941 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:11:00.360951 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:11:00.360962 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:11:00.360973 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:11:00.360990 | orchestrator | 2026-04-24 02:11:00.361002 | orchestrator | TASK [osism.commons.motd : Remove pam_motd.so rule] **************************** 2026-04-24 02:11:00.361034 | orchestrator | Friday 24 April 2026 02:10:59 +0000 (0:00:00.601) 0:03:44.388 ********** 2026-04-24 02:11:00.361050 | orchestrator | changed: [testbed-manager] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1776994997.424, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:00.361065 | orchestrator | changed: [testbed-node-0] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1776995069.6712458, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:00.361083 | orchestrator | changed: [testbed-node-5] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1776995071.844372, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:00.361118 | orchestrator | changed: [testbed-node-3] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1776995067.2611878, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.395686 | orchestrator | changed: [testbed-node-1] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1776995065.4083066, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.395846 | orchestrator | changed: [testbed-node-4] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1776995076.9591343, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.395878 | orchestrator | changed: [testbed-node-2] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1776995064.1926608, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.396800 | orchestrator | changed: [testbed-manager] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.396834 | orchestrator | changed: [testbed-node-5] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.396873 | orchestrator | changed: [testbed-node-0] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.396895 | orchestrator | changed: [testbed-node-4] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.396945 | orchestrator | changed: [testbed-node-3] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.396968 | orchestrator | changed: [testbed-node-2] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.396982 | orchestrator | changed: [testbed-node-1] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 02:11:05.397076 | orchestrator | 2026-04-24 02:11:05.397094 | orchestrator | TASK [osism.commons.motd : Copy motd file] ************************************* 2026-04-24 02:11:05.397107 | orchestrator | Friday 24 April 2026 02:11:00 +0000 (0:00:00.959) 0:03:45.347 ********** 2026-04-24 02:11:05.397118 | orchestrator | changed: [testbed-manager] 2026-04-24 02:11:05.397131 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:11:05.397142 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:11:05.397154 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:11:05.397165 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:11:05.397176 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:11:05.397186 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:11:05.397197 | orchestrator | 2026-04-24 02:11:05.397208 | orchestrator | TASK [osism.commons.motd : Copy issue file] ************************************ 2026-04-24 02:11:05.397219 | orchestrator | Friday 24 April 2026 02:11:01 +0000 (0:00:01.168) 0:03:46.516 ********** 2026-04-24 02:11:05.397230 | orchestrator | changed: [testbed-manager] 2026-04-24 02:11:05.397241 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:11:05.397251 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:11:05.397262 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:11:05.397273 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:11:05.397283 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:11:05.397294 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:11:05.397305 | orchestrator | 2026-04-24 02:11:05.397316 | orchestrator | TASK [osism.commons.motd : Copy issue.net file] ******************************** 2026-04-24 02:11:05.397327 | orchestrator | Friday 24 April 2026 02:11:02 +0000 (0:00:01.134) 0:03:47.651 ********** 2026-04-24 02:11:05.397337 | orchestrator | changed: [testbed-manager] 2026-04-24 02:11:05.397348 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:11:05.397359 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:11:05.397369 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:11:05.397380 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:11:05.397391 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:11:05.397401 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:11:05.397412 | orchestrator | 2026-04-24 02:11:05.397423 | orchestrator | TASK [osism.commons.motd : Configure SSH to print the motd] ******************** 2026-04-24 02:11:05.397434 | orchestrator | Friday 24 April 2026 02:11:03 +0000 (0:00:01.134) 0:03:48.786 ********** 2026-04-24 02:11:05.397445 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:11:05.397456 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:11:05.397473 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:11:05.397484 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:11:05.397495 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:11:05.397505 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:11:05.397516 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:11:05.397527 | orchestrator | 2026-04-24 02:11:05.397538 | orchestrator | TASK [osism.commons.motd : Configure SSH to not print the motd] **************** 2026-04-24 02:11:05.397549 | orchestrator | Friday 24 April 2026 02:11:04 +0000 (0:00:00.317) 0:03:49.103 ********** 2026-04-24 02:11:05.397560 | orchestrator | ok: [testbed-manager] 2026-04-24 02:11:05.397571 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:11:05.397582 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:11:05.397593 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:11:05.397604 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:11:05.397614 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:11:05.397625 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:11:05.397636 | orchestrator | 2026-04-24 02:11:05.397647 | orchestrator | TASK [osism.services.rng : Include distribution specific install tasks] ******** 2026-04-24 02:11:05.397658 | orchestrator | Friday 24 April 2026 02:11:04 +0000 (0:00:00.807) 0:03:49.911 ********** 2026-04-24 02:11:05.397671 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rng/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:11:05.397691 | orchestrator | 2026-04-24 02:11:05.397702 | orchestrator | TASK [osism.services.rng : Install rng package] ******************************** 2026-04-24 02:11:05.397724 | orchestrator | Friday 24 April 2026 02:11:05 +0000 (0:00:00.475) 0:03:50.386 ********** 2026-04-24 02:12:23.240681 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:23.240798 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:12:23.240815 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:12:23.240827 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:12:23.240838 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:12:23.240850 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:12:23.240861 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:12:23.240873 | orchestrator | 2026-04-24 02:12:23.240886 | orchestrator | TASK [osism.services.rng : Remove haveged package] ***************************** 2026-04-24 02:12:23.240899 | orchestrator | Friday 24 April 2026 02:11:13 +0000 (0:00:07.995) 0:03:58.382 ********** 2026-04-24 02:12:23.240910 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:23.240921 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:23.240933 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:23.240943 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:23.240954 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:23.240965 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:23.240976 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:23.240988 | orchestrator | 2026-04-24 02:12:23.240999 | orchestrator | TASK [osism.services.rng : Manage rng service] ********************************* 2026-04-24 02:12:23.241010 | orchestrator | Friday 24 April 2026 02:11:14 +0000 (0:00:01.230) 0:03:59.612 ********** 2026-04-24 02:12:23.241022 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:23.241033 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:23.241070 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:23.241081 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:23.241092 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:23.241102 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:23.241113 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:23.241124 | orchestrator | 2026-04-24 02:12:23.241135 | orchestrator | TASK [osism.commons.cleanup : Gather variables for each operating system] ****** 2026-04-24 02:12:23.241161 | orchestrator | Friday 24 April 2026 02:11:15 +0000 (0:00:01.096) 0:04:00.708 ********** 2026-04-24 02:12:23.241184 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:23.241195 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:23.241206 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:23.241219 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:23.241229 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:23.241240 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:23.241251 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:23.241262 | orchestrator | 2026-04-24 02:12:23.241274 | orchestrator | TASK [osism.commons.cleanup : Set cleanup_packages_distribution variable to default value] *** 2026-04-24 02:12:23.241286 | orchestrator | Friday 24 April 2026 02:11:15 +0000 (0:00:00.285) 0:04:00.994 ********** 2026-04-24 02:12:23.241297 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:23.241308 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:23.241318 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:23.241329 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:23.241340 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:23.241351 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:23.241362 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:23.241372 | orchestrator | 2026-04-24 02:12:23.241383 | orchestrator | TASK [osism.commons.cleanup : Set cleanup_services_distribution variable to default value] *** 2026-04-24 02:12:23.241395 | orchestrator | Friday 24 April 2026 02:11:16 +0000 (0:00:00.315) 0:04:01.310 ********** 2026-04-24 02:12:23.241406 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:23.241417 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:23.241427 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:23.241466 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:23.241477 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:23.241488 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:23.241499 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:23.241510 | orchestrator | 2026-04-24 02:12:23.241521 | orchestrator | TASK [osism.commons.cleanup : Populate service facts] ************************** 2026-04-24 02:12:23.241532 | orchestrator | Friday 24 April 2026 02:11:16 +0000 (0:00:00.340) 0:04:01.650 ********** 2026-04-24 02:12:23.241543 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:23.241554 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:23.241565 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:23.241576 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:23.241586 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:23.241597 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:23.241608 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:23.241619 | orchestrator | 2026-04-24 02:12:23.241630 | orchestrator | TASK [osism.commons.cleanup : Include distribution specific timer tasks] ******* 2026-04-24 02:12:23.241641 | orchestrator | Friday 24 April 2026 02:11:22 +0000 (0:00:05.596) 0:04:07.247 ********** 2026-04-24 02:12:23.241654 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/timers-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:12:23.241668 | orchestrator | 2026-04-24 02:12:23.241679 | orchestrator | TASK [osism.commons.cleanup : Disable apt-daily timers] ************************ 2026-04-24 02:12:23.241690 | orchestrator | Friday 24 April 2026 02:11:22 +0000 (0:00:00.419) 0:04:07.666 ********** 2026-04-24 02:12:23.241701 | orchestrator | skipping: [testbed-manager] => (item=apt-daily-upgrade)  2026-04-24 02:12:23.241713 | orchestrator | skipping: [testbed-manager] => (item=apt-daily)  2026-04-24 02:12:23.241724 | orchestrator | skipping: [testbed-node-3] => (item=apt-daily-upgrade)  2026-04-24 02:12:23.241735 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:12:23.241746 | orchestrator | skipping: [testbed-node-3] => (item=apt-daily)  2026-04-24 02:12:23.241774 | orchestrator | skipping: [testbed-node-4] => (item=apt-daily-upgrade)  2026-04-24 02:12:23.241786 | orchestrator | skipping: [testbed-node-4] => (item=apt-daily)  2026-04-24 02:12:23.241797 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:12:23.241808 | orchestrator | skipping: [testbed-node-5] => (item=apt-daily-upgrade)  2026-04-24 02:12:23.241819 | orchestrator | skipping: [testbed-node-5] => (item=apt-daily)  2026-04-24 02:12:23.241830 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:12:23.241841 | orchestrator | skipping: [testbed-node-0] => (item=apt-daily-upgrade)  2026-04-24 02:12:23.241852 | orchestrator | skipping: [testbed-node-0] => (item=apt-daily)  2026-04-24 02:12:23.241863 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:12:23.241874 | orchestrator | skipping: [testbed-node-1] => (item=apt-daily-upgrade)  2026-04-24 02:12:23.241885 | orchestrator | skipping: [testbed-node-1] => (item=apt-daily)  2026-04-24 02:12:23.241913 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:12:23.241925 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:12:23.241936 | orchestrator | skipping: [testbed-node-2] => (item=apt-daily-upgrade)  2026-04-24 02:12:23.241946 | orchestrator | skipping: [testbed-node-2] => (item=apt-daily)  2026-04-24 02:12:23.241957 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:12:23.241968 | orchestrator | 2026-04-24 02:12:23.241978 | orchestrator | TASK [osism.commons.cleanup : Include service tasks] *************************** 2026-04-24 02:12:23.241989 | orchestrator | Friday 24 April 2026 02:11:23 +0000 (0:00:00.373) 0:04:08.039 ********** 2026-04-24 02:12:23.242000 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/services-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:12:23.242011 | orchestrator | 2026-04-24 02:12:23.242148 | orchestrator | TASK [osism.commons.cleanup : Cleanup services] ******************************** 2026-04-24 02:12:23.242171 | orchestrator | Friday 24 April 2026 02:11:23 +0000 (0:00:00.428) 0:04:08.467 ********** 2026-04-24 02:12:23.242182 | orchestrator | skipping: [testbed-manager] => (item=ModemManager.service)  2026-04-24 02:12:23.242193 | orchestrator | skipping: [testbed-node-3] => (item=ModemManager.service)  2026-04-24 02:12:23.242203 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:12:23.242214 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:12:23.242225 | orchestrator | skipping: [testbed-node-4] => (item=ModemManager.service)  2026-04-24 02:12:23.242236 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:12:23.242247 | orchestrator | skipping: [testbed-node-5] => (item=ModemManager.service)  2026-04-24 02:12:23.242258 | orchestrator | skipping: [testbed-node-0] => (item=ModemManager.service)  2026-04-24 02:12:23.242268 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:12:23.242279 | orchestrator | skipping: [testbed-node-1] => (item=ModemManager.service)  2026-04-24 02:12:23.242290 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:12:23.242301 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:12:23.242312 | orchestrator | skipping: [testbed-node-2] => (item=ModemManager.service)  2026-04-24 02:12:23.242323 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:12:23.242334 | orchestrator | 2026-04-24 02:12:23.242345 | orchestrator | TASK [osism.commons.cleanup : Include packages tasks] ************************** 2026-04-24 02:12:23.242362 | orchestrator | Friday 24 April 2026 02:11:23 +0000 (0:00:00.339) 0:04:08.807 ********** 2026-04-24 02:12:23.242381 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/packages-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:12:23.242401 | orchestrator | 2026-04-24 02:12:23.242420 | orchestrator | TASK [osism.commons.cleanup : Cleanup installed packages] ********************** 2026-04-24 02:12:23.242439 | orchestrator | Friday 24 April 2026 02:11:24 +0000 (0:00:00.434) 0:04:09.241 ********** 2026-04-24 02:12:23.242458 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:12:23.242479 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:12:23.242498 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:12:23.242517 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:12:23.242536 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:12:23.242556 | orchestrator | changed: [testbed-manager] 2026-04-24 02:12:23.242576 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:12:23.242595 | orchestrator | 2026-04-24 02:12:23.242616 | orchestrator | TASK [osism.commons.cleanup : Remove cloudinit package] ************************ 2026-04-24 02:12:23.242635 | orchestrator | Friday 24 April 2026 02:11:59 +0000 (0:00:35.169) 0:04:44.411 ********** 2026-04-24 02:12:23.242655 | orchestrator | changed: [testbed-manager] 2026-04-24 02:12:23.242675 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:12:23.242696 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:12:23.242717 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:12:23.242736 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:12:23.242757 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:12:23.242777 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:12:23.242797 | orchestrator | 2026-04-24 02:12:23.242816 | orchestrator | TASK [osism.commons.cleanup : Uninstall unattended-upgrades package] *********** 2026-04-24 02:12:23.242845 | orchestrator | Friday 24 April 2026 02:12:07 +0000 (0:00:08.082) 0:04:52.494 ********** 2026-04-24 02:12:23.242862 | orchestrator | changed: [testbed-manager] 2026-04-24 02:12:23.242873 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:12:23.242883 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:12:23.242894 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:12:23.242904 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:12:23.242915 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:12:23.242926 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:12:23.242936 | orchestrator | 2026-04-24 02:12:23.242947 | orchestrator | TASK [osism.commons.cleanup : Remove useless packages from the cache] ********** 2026-04-24 02:12:23.242967 | orchestrator | Friday 24 April 2026 02:12:15 +0000 (0:00:07.770) 0:05:00.265 ********** 2026-04-24 02:12:23.242978 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:23.242989 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:23.242999 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:23.243010 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:23.243021 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:23.243031 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:23.243084 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:23.243095 | orchestrator | 2026-04-24 02:12:23.243106 | orchestrator | TASK [osism.commons.cleanup : Remove dependencies that are no longer required] *** 2026-04-24 02:12:23.243117 | orchestrator | Friday 24 April 2026 02:12:16 +0000 (0:00:01.726) 0:05:01.991 ********** 2026-04-24 02:12:23.243128 | orchestrator | changed: [testbed-manager] 2026-04-24 02:12:23.243139 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:12:23.243150 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:12:23.243160 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:12:23.243171 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:12:23.243182 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:12:23.243193 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:12:23.243203 | orchestrator | 2026-04-24 02:12:23.243227 | orchestrator | TASK [osism.commons.cleanup : Include cloudinit tasks] ************************* 2026-04-24 02:12:34.862246 | orchestrator | Friday 24 April 2026 02:12:23 +0000 (0:00:06.224) 0:05:08.216 ********** 2026-04-24 02:12:34.862363 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/cloudinit.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:12:34.862383 | orchestrator | 2026-04-24 02:12:34.862397 | orchestrator | TASK [osism.commons.cleanup : Remove cloud-init configuration directory] ******* 2026-04-24 02:12:34.862409 | orchestrator | Friday 24 April 2026 02:12:23 +0000 (0:00:00.429) 0:05:08.646 ********** 2026-04-24 02:12:34.862420 | orchestrator | changed: [testbed-manager] 2026-04-24 02:12:34.862433 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:12:34.862444 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:12:34.862455 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:12:34.862466 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:12:34.862476 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:12:34.862487 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:12:34.862498 | orchestrator | 2026-04-24 02:12:34.862509 | orchestrator | TASK [osism.commons.timezone : Install tzdata package] ************************* 2026-04-24 02:12:34.862519 | orchestrator | Friday 24 April 2026 02:12:24 +0000 (0:00:00.735) 0:05:09.381 ********** 2026-04-24 02:12:34.862530 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:34.862542 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:34.862552 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:34.862563 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:34.862574 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:34.862584 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:34.862595 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:34.862605 | orchestrator | 2026-04-24 02:12:34.862618 | orchestrator | TASK [osism.commons.timezone : Set timezone to UTC] **************************** 2026-04-24 02:12:34.862631 | orchestrator | Friday 24 April 2026 02:12:26 +0000 (0:00:01.843) 0:05:11.225 ********** 2026-04-24 02:12:34.862643 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:12:34.862656 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:12:34.862669 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:12:34.862682 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:12:34.862695 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:12:34.862708 | orchestrator | changed: [testbed-manager] 2026-04-24 02:12:34.862722 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:12:34.862735 | orchestrator | 2026-04-24 02:12:34.862747 | orchestrator | TASK [osism.commons.timezone : Create /etc/adjtime file] *********************** 2026-04-24 02:12:34.862760 | orchestrator | Friday 24 April 2026 02:12:27 +0000 (0:00:00.809) 0:05:12.034 ********** 2026-04-24 02:12:34.862799 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:12:34.862813 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:12:34.862825 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:12:34.862836 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:12:34.862846 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:12:34.862857 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:12:34.862868 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:12:34.862878 | orchestrator | 2026-04-24 02:12:34.862889 | orchestrator | TASK [osism.commons.timezone : Ensure UTC in /etc/adjtime] ********************* 2026-04-24 02:12:34.862900 | orchestrator | Friday 24 April 2026 02:12:27 +0000 (0:00:00.296) 0:05:12.330 ********** 2026-04-24 02:12:34.862911 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:12:34.862921 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:12:34.862932 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:12:34.862943 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:12:34.862953 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:12:34.862963 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:12:34.862974 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:12:34.862984 | orchestrator | 2026-04-24 02:12:34.862995 | orchestrator | TASK [osism.services.docker : Gather variables for each operating system] ****** 2026-04-24 02:12:34.863006 | orchestrator | Friday 24 April 2026 02:12:27 +0000 (0:00:00.375) 0:05:12.706 ********** 2026-04-24 02:12:34.863017 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:34.863027 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:34.863058 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:34.863069 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:34.863080 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:34.863091 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:34.863101 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:34.863112 | orchestrator | 2026-04-24 02:12:34.863123 | orchestrator | TASK [osism.services.docker : Set docker_version variable to default value] **** 2026-04-24 02:12:34.863149 | orchestrator | Friday 24 April 2026 02:12:28 +0000 (0:00:00.326) 0:05:13.032 ********** 2026-04-24 02:12:34.863160 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:12:34.863171 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:12:34.863182 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:12:34.863192 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:12:34.863203 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:12:34.863213 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:12:34.863224 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:12:34.863234 | orchestrator | 2026-04-24 02:12:34.863245 | orchestrator | TASK [osism.services.docker : Set docker_cli_version variable to default value] *** 2026-04-24 02:12:34.863256 | orchestrator | Friday 24 April 2026 02:12:28 +0000 (0:00:00.300) 0:05:13.332 ********** 2026-04-24 02:12:34.863267 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:34.863278 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:34.863288 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:34.863299 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:34.863309 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:34.863320 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:34.863331 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:34.863341 | orchestrator | 2026-04-24 02:12:34.863352 | orchestrator | TASK [osism.services.docker : Print used docker version] *********************** 2026-04-24 02:12:34.863363 | orchestrator | Friday 24 April 2026 02:12:28 +0000 (0:00:00.321) 0:05:13.654 ********** 2026-04-24 02:12:34.863374 | orchestrator | ok: [testbed-manager] =>  2026-04-24 02:12:34.863384 | orchestrator |  docker_version: 5:27.5.1 2026-04-24 02:12:34.863395 | orchestrator | ok: [testbed-node-3] =>  2026-04-24 02:12:34.863406 | orchestrator |  docker_version: 5:27.5.1 2026-04-24 02:12:34.863416 | orchestrator | ok: [testbed-node-4] =>  2026-04-24 02:12:34.863427 | orchestrator |  docker_version: 5:27.5.1 2026-04-24 02:12:34.863438 | orchestrator | ok: [testbed-node-5] =>  2026-04-24 02:12:34.863448 | orchestrator |  docker_version: 5:27.5.1 2026-04-24 02:12:34.863486 | orchestrator | ok: [testbed-node-0] =>  2026-04-24 02:12:34.863498 | orchestrator |  docker_version: 5:27.5.1 2026-04-24 02:12:34.863508 | orchestrator | ok: [testbed-node-1] =>  2026-04-24 02:12:34.863519 | orchestrator |  docker_version: 5:27.5.1 2026-04-24 02:12:34.863529 | orchestrator | ok: [testbed-node-2] =>  2026-04-24 02:12:34.863540 | orchestrator |  docker_version: 5:27.5.1 2026-04-24 02:12:34.863550 | orchestrator | 2026-04-24 02:12:34.863561 | orchestrator | TASK [osism.services.docker : Print used docker cli version] ******************* 2026-04-24 02:12:34.863572 | orchestrator | Friday 24 April 2026 02:12:28 +0000 (0:00:00.304) 0:05:13.958 ********** 2026-04-24 02:12:34.863582 | orchestrator | ok: [testbed-manager] =>  2026-04-24 02:12:34.863593 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-24 02:12:34.863603 | orchestrator | ok: [testbed-node-3] =>  2026-04-24 02:12:34.863614 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-24 02:12:34.863624 | orchestrator | ok: [testbed-node-4] =>  2026-04-24 02:12:34.863725 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-24 02:12:34.863737 | orchestrator | ok: [testbed-node-5] =>  2026-04-24 02:12:34.863748 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-24 02:12:34.863762 | orchestrator | ok: [testbed-node-0] =>  2026-04-24 02:12:34.863779 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-24 02:12:34.863798 | orchestrator | ok: [testbed-node-1] =>  2026-04-24 02:12:34.863825 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-24 02:12:34.863845 | orchestrator | ok: [testbed-node-2] =>  2026-04-24 02:12:34.863862 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-24 02:12:34.863878 | orchestrator | 2026-04-24 02:12:34.863896 | orchestrator | TASK [osism.services.docker : Include block storage tasks] ********************* 2026-04-24 02:12:34.863913 | orchestrator | Friday 24 April 2026 02:12:29 +0000 (0:00:00.337) 0:05:14.295 ********** 2026-04-24 02:12:34.863931 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:12:34.863948 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:12:34.863966 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:12:34.863984 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:12:34.864002 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:12:34.864020 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:12:34.864037 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:12:34.864082 | orchestrator | 2026-04-24 02:12:34.864101 | orchestrator | TASK [osism.services.docker : Include zram storage tasks] ********************** 2026-04-24 02:12:34.864118 | orchestrator | Friday 24 April 2026 02:12:29 +0000 (0:00:00.300) 0:05:14.596 ********** 2026-04-24 02:12:34.864137 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:12:34.864155 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:12:34.864173 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:12:34.864184 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:12:34.864195 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:12:34.864205 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:12:34.864216 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:12:34.864226 | orchestrator | 2026-04-24 02:12:34.864237 | orchestrator | TASK [osism.services.docker : Include docker install tasks] ******************** 2026-04-24 02:12:34.864248 | orchestrator | Friday 24 April 2026 02:12:29 +0000 (0:00:00.349) 0:05:14.945 ********** 2026-04-24 02:12:34.864261 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/install-docker-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:12:34.864274 | orchestrator | 2026-04-24 02:12:34.864285 | orchestrator | TASK [osism.services.docker : Remove old architecture-dependent repository] **** 2026-04-24 02:12:34.864296 | orchestrator | Friday 24 April 2026 02:12:30 +0000 (0:00:00.437) 0:05:15.383 ********** 2026-04-24 02:12:34.864306 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:34.864318 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:34.864328 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:34.864339 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:34.864363 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:34.864374 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:34.864384 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:34.864395 | orchestrator | 2026-04-24 02:12:34.864406 | orchestrator | TASK [osism.services.docker : Gather package facts] **************************** 2026-04-24 02:12:34.864417 | orchestrator | Friday 24 April 2026 02:12:31 +0000 (0:00:01.045) 0:05:16.428 ********** 2026-04-24 02:12:34.864428 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:12:34.864438 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:12:34.864449 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:12:34.864459 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:12:34.864479 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:12:34.864489 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:12:34.864500 | orchestrator | ok: [testbed-manager] 2026-04-24 02:12:34.864511 | orchestrator | 2026-04-24 02:12:34.864521 | orchestrator | TASK [osism.services.docker : Check whether packages are installed that should not be installed] *** 2026-04-24 02:12:34.864533 | orchestrator | Friday 24 April 2026 02:12:34 +0000 (0:00:02.995) 0:05:19.424 ********** 2026-04-24 02:12:34.864544 | orchestrator | skipping: [testbed-manager] => (item=containerd)  2026-04-24 02:12:34.864555 | orchestrator | skipping: [testbed-manager] => (item=docker.io)  2026-04-24 02:12:34.864566 | orchestrator | skipping: [testbed-manager] => (item=docker-engine)  2026-04-24 02:12:34.864577 | orchestrator | skipping: [testbed-node-3] => (item=containerd)  2026-04-24 02:12:34.864588 | orchestrator | skipping: [testbed-node-3] => (item=docker.io)  2026-04-24 02:12:34.864599 | orchestrator | skipping: [testbed-node-3] => (item=docker-engine)  2026-04-24 02:12:34.864609 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:12:34.864620 | orchestrator | skipping: [testbed-node-4] => (item=containerd)  2026-04-24 02:12:34.864631 | orchestrator | skipping: [testbed-node-4] => (item=docker.io)  2026-04-24 02:12:34.864641 | orchestrator | skipping: [testbed-node-4] => (item=docker-engine)  2026-04-24 02:12:34.864652 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:12:34.864662 | orchestrator | skipping: [testbed-node-5] => (item=containerd)  2026-04-24 02:12:34.864673 | orchestrator | skipping: [testbed-node-5] => (item=docker.io)  2026-04-24 02:12:34.864684 | orchestrator | skipping: [testbed-node-5] => (item=docker-engine)  2026-04-24 02:12:34.864694 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:12:34.864705 | orchestrator | skipping: [testbed-node-0] => (item=containerd)  2026-04-24 02:12:34.864730 | orchestrator | skipping: [testbed-node-0] => (item=docker.io)  2026-04-24 02:13:34.257274 | orchestrator | skipping: [testbed-node-0] => (item=docker-engine)  2026-04-24 02:13:34.257430 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:13:34.257449 | orchestrator | skipping: [testbed-node-1] => (item=containerd)  2026-04-24 02:13:34.257461 | orchestrator | skipping: [testbed-node-1] => (item=docker.io)  2026-04-24 02:13:34.257472 | orchestrator | skipping: [testbed-node-1] => (item=docker-engine)  2026-04-24 02:13:34.257483 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:13:34.257494 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:13:34.257505 | orchestrator | skipping: [testbed-node-2] => (item=containerd)  2026-04-24 02:13:34.257516 | orchestrator | skipping: [testbed-node-2] => (item=docker.io)  2026-04-24 02:13:34.257527 | orchestrator | skipping: [testbed-node-2] => (item=docker-engine)  2026-04-24 02:13:34.257538 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:13:34.257549 | orchestrator | 2026-04-24 02:13:34.257562 | orchestrator | TASK [osism.services.docker : Install apt-transport-https package] ************* 2026-04-24 02:13:34.257574 | orchestrator | Friday 24 April 2026 02:12:35 +0000 (0:00:00.663) 0:05:20.088 ********** 2026-04-24 02:13:34.257585 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.257596 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.257607 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.257619 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.257630 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.257641 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.257707 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.257741 | orchestrator | 2026-04-24 02:13:34.257759 | orchestrator | TASK [osism.services.docker : Add repository gpg key] ************************** 2026-04-24 02:13:34.257778 | orchestrator | Friday 24 April 2026 02:12:41 +0000 (0:00:05.938) 0:05:26.027 ********** 2026-04-24 02:13:34.257796 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.257816 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.257835 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.257854 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.257872 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.257890 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.257908 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.257928 | orchestrator | 2026-04-24 02:13:34.257949 | orchestrator | TASK [osism.services.docker : Add repository] ********************************** 2026-04-24 02:13:34.257968 | orchestrator | Friday 24 April 2026 02:12:42 +0000 (0:00:01.010) 0:05:27.037 ********** 2026-04-24 02:13:34.257988 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.258001 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.258014 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.258153 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.258167 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.258178 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.258189 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.258200 | orchestrator | 2026-04-24 02:13:34.258211 | orchestrator | TASK [osism.services.docker : Update package cache] **************************** 2026-04-24 02:13:34.258222 | orchestrator | Friday 24 April 2026 02:12:50 +0000 (0:00:08.417) 0:05:35.455 ********** 2026-04-24 02:13:34.258233 | orchestrator | changed: [testbed-manager] 2026-04-24 02:13:34.258244 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.258255 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.258266 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.258276 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.258287 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.258298 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.258309 | orchestrator | 2026-04-24 02:13:34.258320 | orchestrator | TASK [osism.services.docker : Pin docker package version] ********************** 2026-04-24 02:13:34.258359 | orchestrator | Friday 24 April 2026 02:12:53 +0000 (0:00:03.288) 0:05:38.743 ********** 2026-04-24 02:13:34.258370 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.258381 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.258392 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.258402 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.258413 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.258424 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.258435 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.258445 | orchestrator | 2026-04-24 02:13:34.258456 | orchestrator | TASK [osism.services.docker : Pin docker-cli package version] ****************** 2026-04-24 02:13:34.258467 | orchestrator | Friday 24 April 2026 02:12:55 +0000 (0:00:01.289) 0:05:40.033 ********** 2026-04-24 02:13:34.258478 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.258489 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.258500 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.258511 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.258522 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.258533 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.258544 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.258555 | orchestrator | 2026-04-24 02:13:34.258566 | orchestrator | TASK [osism.services.docker : Unlock containerd package] *********************** 2026-04-24 02:13:34.258577 | orchestrator | Friday 24 April 2026 02:12:56 +0000 (0:00:01.520) 0:05:41.554 ********** 2026-04-24 02:13:34.258587 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:13:34.258598 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:13:34.258608 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:13:34.258632 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:13:34.258643 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:13:34.258654 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:13:34.258665 | orchestrator | changed: [testbed-manager] 2026-04-24 02:13:34.258676 | orchestrator | 2026-04-24 02:13:34.258687 | orchestrator | TASK [osism.services.docker : Install containerd package] ********************** 2026-04-24 02:13:34.258698 | orchestrator | Friday 24 April 2026 02:12:57 +0000 (0:00:00.611) 0:05:42.166 ********** 2026-04-24 02:13:34.258709 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.258720 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.258730 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.258741 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.258752 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.258763 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.258773 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.258784 | orchestrator | 2026-04-24 02:13:34.258795 | orchestrator | TASK [osism.services.docker : Lock containerd package] ************************* 2026-04-24 02:13:34.258829 | orchestrator | Friday 24 April 2026 02:13:06 +0000 (0:00:09.493) 0:05:51.659 ********** 2026-04-24 02:13:34.258840 | orchestrator | changed: [testbed-manager] 2026-04-24 02:13:34.258851 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.258862 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.258872 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.258883 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.258894 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.258904 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.258917 | orchestrator | 2026-04-24 02:13:34.258936 | orchestrator | TASK [osism.services.docker : Install docker-cli package] ********************** 2026-04-24 02:13:34.258954 | orchestrator | Friday 24 April 2026 02:13:07 +0000 (0:00:00.925) 0:05:52.585 ********** 2026-04-24 02:13:34.258972 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.258992 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.259011 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.259029 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.259047 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.259086 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.259098 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.259108 | orchestrator | 2026-04-24 02:13:34.259119 | orchestrator | TASK [osism.services.docker : Install docker package] ************************** 2026-04-24 02:13:34.259135 | orchestrator | Friday 24 April 2026 02:13:16 +0000 (0:00:09.176) 0:06:01.761 ********** 2026-04-24 02:13:34.259160 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.259184 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.259202 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.259219 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.259236 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.259252 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.259267 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.259284 | orchestrator | 2026-04-24 02:13:34.259300 | orchestrator | TASK [osism.services.docker : Unblock installation of python docker packages] *** 2026-04-24 02:13:34.259318 | orchestrator | Friday 24 April 2026 02:13:27 +0000 (0:00:10.490) 0:06:12.251 ********** 2026-04-24 02:13:34.259337 | orchestrator | ok: [testbed-manager] => (item=python3-docker) 2026-04-24 02:13:34.259355 | orchestrator | ok: [testbed-node-3] => (item=python3-docker) 2026-04-24 02:13:34.259374 | orchestrator | ok: [testbed-node-4] => (item=python3-docker) 2026-04-24 02:13:34.259393 | orchestrator | ok: [testbed-node-5] => (item=python3-docker) 2026-04-24 02:13:34.259411 | orchestrator | ok: [testbed-manager] => (item=python-docker) 2026-04-24 02:13:34.259429 | orchestrator | ok: [testbed-node-0] => (item=python3-docker) 2026-04-24 02:13:34.259441 | orchestrator | ok: [testbed-node-4] => (item=python-docker) 2026-04-24 02:13:34.259452 | orchestrator | ok: [testbed-node-3] => (item=python-docker) 2026-04-24 02:13:34.259463 | orchestrator | ok: [testbed-node-1] => (item=python3-docker) 2026-04-24 02:13:34.259489 | orchestrator | ok: [testbed-node-2] => (item=python3-docker) 2026-04-24 02:13:34.259500 | orchestrator | ok: [testbed-node-5] => (item=python-docker) 2026-04-24 02:13:34.259560 | orchestrator | ok: [testbed-node-0] => (item=python-docker) 2026-04-24 02:13:34.259573 | orchestrator | ok: [testbed-node-1] => (item=python-docker) 2026-04-24 02:13:34.259584 | orchestrator | ok: [testbed-node-2] => (item=python-docker) 2026-04-24 02:13:34.259595 | orchestrator | 2026-04-24 02:13:34.259606 | orchestrator | TASK [osism.services.docker : Install python3 docker package] ****************** 2026-04-24 02:13:34.259617 | orchestrator | Friday 24 April 2026 02:13:28 +0000 (0:00:01.330) 0:06:13.582 ********** 2026-04-24 02:13:34.259635 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:13:34.259653 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:13:34.259671 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:13:34.259689 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:13:34.259707 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:13:34.259726 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:13:34.259744 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:13:34.259761 | orchestrator | 2026-04-24 02:13:34.259791 | orchestrator | TASK [osism.services.docker : Install python3 docker package from Debian Sid] *** 2026-04-24 02:13:34.259823 | orchestrator | Friday 24 April 2026 02:13:29 +0000 (0:00:00.614) 0:06:14.196 ********** 2026-04-24 02:13:34.259842 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:34.259861 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:34.259881 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:34.259899 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:34.259917 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:34.259933 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:34.259951 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:34.259962 | orchestrator | 2026-04-24 02:13:34.259973 | orchestrator | TASK [osism.services.docker : Remove python docker packages (install python bindings from pip)] *** 2026-04-24 02:13:34.259985 | orchestrator | Friday 24 April 2026 02:13:33 +0000 (0:00:03.901) 0:06:18.098 ********** 2026-04-24 02:13:34.259996 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:13:34.260007 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:13:34.260018 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:13:34.260028 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:13:34.260039 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:13:34.260050 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:13:34.260090 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:13:34.260101 | orchestrator | 2026-04-24 02:13:34.260116 | orchestrator | TASK [osism.services.docker : Block installation of python docker packages (install python bindings from pip)] *** 2026-04-24 02:13:34.260137 | orchestrator | Friday 24 April 2026 02:13:33 +0000 (0:00:00.643) 0:06:18.741 ********** 2026-04-24 02:13:34.260155 | orchestrator | skipping: [testbed-manager] => (item=python3-docker)  2026-04-24 02:13:34.260172 | orchestrator | skipping: [testbed-manager] => (item=python-docker)  2026-04-24 02:13:34.260191 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:13:34.260211 | orchestrator | skipping: [testbed-node-3] => (item=python3-docker)  2026-04-24 02:13:34.260229 | orchestrator | skipping: [testbed-node-3] => (item=python-docker)  2026-04-24 02:13:34.260248 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:13:34.260259 | orchestrator | skipping: [testbed-node-4] => (item=python3-docker)  2026-04-24 02:13:34.260270 | orchestrator | skipping: [testbed-node-4] => (item=python-docker)  2026-04-24 02:13:34.260281 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:13:34.260305 | orchestrator | skipping: [testbed-node-5] => (item=python3-docker)  2026-04-24 02:13:54.566718 | orchestrator | skipping: [testbed-node-5] => (item=python-docker)  2026-04-24 02:13:54.566835 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:13:54.566853 | orchestrator | skipping: [testbed-node-0] => (item=python3-docker)  2026-04-24 02:13:54.566866 | orchestrator | skipping: [testbed-node-0] => (item=python-docker)  2026-04-24 02:13:54.566905 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:13:54.566918 | orchestrator | skipping: [testbed-node-1] => (item=python3-docker)  2026-04-24 02:13:54.566930 | orchestrator | skipping: [testbed-node-1] => (item=python-docker)  2026-04-24 02:13:54.566941 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:13:54.566952 | orchestrator | skipping: [testbed-node-2] => (item=python3-docker)  2026-04-24 02:13:54.566962 | orchestrator | skipping: [testbed-node-2] => (item=python-docker)  2026-04-24 02:13:54.566973 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:13:54.566984 | orchestrator | 2026-04-24 02:13:54.566998 | orchestrator | TASK [osism.services.docker : Install python3-pip package (install python bindings from pip)] *** 2026-04-24 02:13:54.567009 | orchestrator | Friday 24 April 2026 02:13:34 +0000 (0:00:00.797) 0:06:19.539 ********** 2026-04-24 02:13:54.567021 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:13:54.567032 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:13:54.567042 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:13:54.567053 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:13:54.567146 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:13:54.567159 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:13:54.567170 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:13:54.567181 | orchestrator | 2026-04-24 02:13:54.567192 | orchestrator | TASK [osism.services.docker : Install docker packages (install python bindings from pip)] *** 2026-04-24 02:13:54.567204 | orchestrator | Friday 24 April 2026 02:13:35 +0000 (0:00:00.516) 0:06:20.055 ********** 2026-04-24 02:13:54.567215 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:13:54.567226 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:13:54.567236 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:13:54.567247 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:13:54.567258 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:13:54.567269 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:13:54.567280 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:13:54.567290 | orchestrator | 2026-04-24 02:13:54.567301 | orchestrator | TASK [osism.services.docker : Install packages required by docker login] ******* 2026-04-24 02:13:54.567312 | orchestrator | Friday 24 April 2026 02:13:35 +0000 (0:00:00.533) 0:06:20.588 ********** 2026-04-24 02:13:54.567323 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:13:54.567334 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:13:54.567345 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:13:54.567355 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:13:54.567366 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:13:54.567377 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:13:54.567388 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:13:54.567398 | orchestrator | 2026-04-24 02:13:54.567409 | orchestrator | TASK [osism.services.docker : Ensure that some packages are not installed] ***** 2026-04-24 02:13:54.567420 | orchestrator | Friday 24 April 2026 02:13:36 +0000 (0:00:00.518) 0:06:21.107 ********** 2026-04-24 02:13:54.567431 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.567442 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:13:54.567453 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:13:54.567464 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:13:54.567475 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:13:54.567485 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:13:54.567496 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:13:54.567506 | orchestrator | 2026-04-24 02:13:54.567517 | orchestrator | TASK [osism.services.docker : Include config tasks] **************************** 2026-04-24 02:13:54.567528 | orchestrator | Friday 24 April 2026 02:13:38 +0000 (0:00:01.912) 0:06:23.019 ********** 2026-04-24 02:13:54.567540 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/config.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:13:54.567553 | orchestrator | 2026-04-24 02:13:54.567565 | orchestrator | TASK [osism.services.docker : Create plugins directory] ************************ 2026-04-24 02:13:54.567651 | orchestrator | Friday 24 April 2026 02:13:38 +0000 (0:00:00.880) 0:06:23.899 ********** 2026-04-24 02:13:54.567665 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.567676 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:54.567687 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:54.567698 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:54.567709 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:54.567720 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:54.567730 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:54.567741 | orchestrator | 2026-04-24 02:13:54.567752 | orchestrator | TASK [osism.services.docker : Create systemd overlay directory] **************** 2026-04-24 02:13:54.567763 | orchestrator | Friday 24 April 2026 02:13:39 +0000 (0:00:00.855) 0:06:24.755 ********** 2026-04-24 02:13:54.567774 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.567784 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:54.567795 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:54.567806 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:54.567816 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:54.567827 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:54.567838 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:54.567849 | orchestrator | 2026-04-24 02:13:54.567860 | orchestrator | TASK [osism.services.docker : Copy systemd overlay file] *********************** 2026-04-24 02:13:54.567870 | orchestrator | Friday 24 April 2026 02:13:40 +0000 (0:00:00.876) 0:06:25.631 ********** 2026-04-24 02:13:54.567881 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.567892 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:54.567903 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:54.567914 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:54.567924 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:54.567935 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:54.567946 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:54.567957 | orchestrator | 2026-04-24 02:13:54.567968 | orchestrator | TASK [osism.services.docker : Reload systemd daemon if systemd overlay file is changed] *** 2026-04-24 02:13:54.567997 | orchestrator | Friday 24 April 2026 02:13:42 +0000 (0:00:01.590) 0:06:27.222 ********** 2026-04-24 02:13:54.568009 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:13:54.568021 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:13:54.568031 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:13:54.568042 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:13:54.568053 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:13:54.568086 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:13:54.568097 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:13:54.568108 | orchestrator | 2026-04-24 02:13:54.568119 | orchestrator | TASK [osism.services.docker : Copy limits configuration file] ****************** 2026-04-24 02:13:54.568130 | orchestrator | Friday 24 April 2026 02:13:43 +0000 (0:00:01.375) 0:06:28.597 ********** 2026-04-24 02:13:54.568141 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.568152 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:54.568163 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:54.568174 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:54.568184 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:54.568195 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:54.568205 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:54.568216 | orchestrator | 2026-04-24 02:13:54.568227 | orchestrator | TASK [osism.services.docker : Copy daemon.json configuration file] ************* 2026-04-24 02:13:54.568238 | orchestrator | Friday 24 April 2026 02:13:44 +0000 (0:00:01.357) 0:06:29.954 ********** 2026-04-24 02:13:54.568249 | orchestrator | changed: [testbed-manager] 2026-04-24 02:13:54.568260 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:13:54.568270 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:13:54.568281 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:13:54.568292 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:13:54.568302 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:13:54.568313 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:13:54.568332 | orchestrator | 2026-04-24 02:13:54.568343 | orchestrator | TASK [osism.services.docker : Include service tasks] *************************** 2026-04-24 02:13:54.568354 | orchestrator | Friday 24 April 2026 02:13:46 +0000 (0:00:01.406) 0:06:31.361 ********** 2026-04-24 02:13:54.568365 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/service.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:13:54.568377 | orchestrator | 2026-04-24 02:13:54.568388 | orchestrator | TASK [osism.services.docker : Reload systemd daemon] *************************** 2026-04-24 02:13:54.568398 | orchestrator | Friday 24 April 2026 02:13:47 +0000 (0:00:01.104) 0:06:32.466 ********** 2026-04-24 02:13:54.568409 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.568420 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:13:54.568431 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:13:54.568441 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:13:54.568452 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:13:54.568463 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:13:54.568473 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:13:54.568484 | orchestrator | 2026-04-24 02:13:54.568495 | orchestrator | TASK [osism.services.docker : Manage service] ********************************** 2026-04-24 02:13:54.568506 | orchestrator | Friday 24 April 2026 02:13:48 +0000 (0:00:01.368) 0:06:33.834 ********** 2026-04-24 02:13:54.568516 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.568527 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:13:54.568538 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:13:54.568548 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:13:54.568559 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:13:54.568570 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:13:54.568580 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:13:54.568591 | orchestrator | 2026-04-24 02:13:54.568602 | orchestrator | TASK [osism.services.docker : Manage docker socket service] ******************** 2026-04-24 02:13:54.568613 | orchestrator | Friday 24 April 2026 02:13:49 +0000 (0:00:01.134) 0:06:34.968 ********** 2026-04-24 02:13:54.568624 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.568635 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:13:54.568645 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:13:54.568656 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:13:54.568667 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:13:54.568677 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:13:54.568688 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:13:54.568706 | orchestrator | 2026-04-24 02:13:54.568725 | orchestrator | TASK [osism.services.docker : Manage containerd service] *********************** 2026-04-24 02:13:54.568745 | orchestrator | Friday 24 April 2026 02:13:51 +0000 (0:00:02.024) 0:06:36.992 ********** 2026-04-24 02:13:54.568783 | orchestrator | ok: [testbed-manager] 2026-04-24 02:13:54.568801 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:13:54.568819 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:13:54.568837 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:13:54.568856 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:13:54.568875 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:13:54.568924 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:13:54.568936 | orchestrator | 2026-04-24 02:13:54.568947 | orchestrator | TASK [osism.services.docker : Include bootstrap tasks] ************************* 2026-04-24 02:13:54.568958 | orchestrator | Friday 24 April 2026 02:13:53 +0000 (0:00:01.331) 0:06:38.324 ********** 2026-04-24 02:13:54.568969 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/bootstrap.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:13:54.568980 | orchestrator | 2026-04-24 02:13:54.568991 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-24 02:13:54.569002 | orchestrator | Friday 24 April 2026 02:13:54 +0000 (0:00:00.933) 0:06:39.257 ********** 2026-04-24 02:13:54.569012 | orchestrator | 2026-04-24 02:13:54.569023 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-24 02:13:54.569043 | orchestrator | Friday 24 April 2026 02:13:54 +0000 (0:00:00.041) 0:06:39.298 ********** 2026-04-24 02:13:54.569054 | orchestrator | 2026-04-24 02:13:54.569080 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-24 02:13:54.569091 | orchestrator | Friday 24 April 2026 02:13:54 +0000 (0:00:00.046) 0:06:39.345 ********** 2026-04-24 02:13:54.569102 | orchestrator | 2026-04-24 02:13:54.569113 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-24 02:13:54.569133 | orchestrator | Friday 24 April 2026 02:13:54 +0000 (0:00:00.040) 0:06:39.386 ********** 2026-04-24 02:14:20.653131 | orchestrator | 2026-04-24 02:14:20.653284 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-24 02:14:20.653316 | orchestrator | Friday 24 April 2026 02:13:54 +0000 (0:00:00.039) 0:06:39.425 ********** 2026-04-24 02:14:20.653372 | orchestrator | 2026-04-24 02:14:20.653394 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-24 02:14:20.653412 | orchestrator | Friday 24 April 2026 02:13:54 +0000 (0:00:00.047) 0:06:39.472 ********** 2026-04-24 02:14:20.653430 | orchestrator | 2026-04-24 02:14:20.653449 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-24 02:14:20.653467 | orchestrator | Friday 24 April 2026 02:13:54 +0000 (0:00:00.040) 0:06:39.512 ********** 2026-04-24 02:14:20.653487 | orchestrator | 2026-04-24 02:14:20.653507 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-24 02:14:20.653525 | orchestrator | Friday 24 April 2026 02:13:54 +0000 (0:00:00.040) 0:06:39.553 ********** 2026-04-24 02:14:20.653545 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:20.653565 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:20.653584 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:20.653604 | orchestrator | 2026-04-24 02:14:20.653624 | orchestrator | RUNNING HANDLER [osism.services.rsyslog : Restart rsyslog service] ************* 2026-04-24 02:14:20.653644 | orchestrator | Friday 24 April 2026 02:13:55 +0000 (0:00:01.250) 0:06:40.803 ********** 2026-04-24 02:14:20.653664 | orchestrator | changed: [testbed-manager] 2026-04-24 02:14:20.653686 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:20.653705 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:20.653723 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:20.653742 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:20.653760 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:20.653779 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:20.653797 | orchestrator | 2026-04-24 02:14:20.653815 | orchestrator | RUNNING HANDLER [osism.services.rsyslog : Restart logrotate service] *********** 2026-04-24 02:14:20.653833 | orchestrator | Friday 24 April 2026 02:13:57 +0000 (0:00:01.476) 0:06:42.279 ********** 2026-04-24 02:14:20.653851 | orchestrator | changed: [testbed-manager] 2026-04-24 02:14:20.653870 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:20.653889 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:20.653908 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:20.653926 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:20.653944 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:20.653961 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:20.653980 | orchestrator | 2026-04-24 02:14:20.653999 | orchestrator | RUNNING HANDLER [osism.services.docker : Restart docker service] *************** 2026-04-24 02:14:20.654204 | orchestrator | Friday 24 April 2026 02:13:58 +0000 (0:00:01.177) 0:06:43.457 ********** 2026-04-24 02:14:20.654235 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:14:20.654255 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:20.654274 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:20.654296 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:20.654315 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:20.654332 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:20.654351 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:20.654370 | orchestrator | 2026-04-24 02:14:20.654388 | orchestrator | RUNNING HANDLER [osism.services.docker : Wait after docker service restart] **** 2026-04-24 02:14:20.654445 | orchestrator | Friday 24 April 2026 02:14:00 +0000 (0:00:02.367) 0:06:45.824 ********** 2026-04-24 02:14:20.654466 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:14:20.654487 | orchestrator | 2026-04-24 02:14:20.654507 | orchestrator | TASK [osism.services.docker : Add user to docker group] ************************ 2026-04-24 02:14:20.654526 | orchestrator | Friday 24 April 2026 02:14:00 +0000 (0:00:00.124) 0:06:45.949 ********** 2026-04-24 02:14:20.654547 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:20.654566 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:20.654584 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:20.654603 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:20.654624 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:20.654645 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:20.654665 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:20.654686 | orchestrator | 2026-04-24 02:14:20.654706 | orchestrator | TASK [osism.services.docker : Log into private registry and force re-authorization] *** 2026-04-24 02:14:20.654726 | orchestrator | Friday 24 April 2026 02:14:01 +0000 (0:00:01.048) 0:06:46.998 ********** 2026-04-24 02:14:20.654765 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:14:20.654785 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:14:20.654803 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:14:20.654821 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:14:20.654840 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:14:20.654860 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:14:20.654879 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:14:20.654898 | orchestrator | 2026-04-24 02:14:20.654918 | orchestrator | TASK [osism.services.docker : Include facts tasks] ***************************** 2026-04-24 02:14:20.654936 | orchestrator | Friday 24 April 2026 02:14:02 +0000 (0:00:00.535) 0:06:47.533 ********** 2026-04-24 02:14:20.654956 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/facts.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:14:20.654979 | orchestrator | 2026-04-24 02:14:20.655000 | orchestrator | TASK [osism.services.docker : Create facts directory] ************************** 2026-04-24 02:14:20.655019 | orchestrator | Friday 24 April 2026 02:14:03 +0000 (0:00:01.109) 0:06:48.642 ********** 2026-04-24 02:14:20.655037 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:20.655055 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:20.655102 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:20.655123 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:20.655143 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:20.655163 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:20.655183 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:20.655203 | orchestrator | 2026-04-24 02:14:20.655224 | orchestrator | TASK [osism.services.docker : Copy docker fact files] ************************** 2026-04-24 02:14:20.655243 | orchestrator | Friday 24 April 2026 02:14:04 +0000 (0:00:00.843) 0:06:49.486 ********** 2026-04-24 02:14:20.655262 | orchestrator | ok: [testbed-manager] => (item=docker_containers) 2026-04-24 02:14:20.655312 | orchestrator | changed: [testbed-node-3] => (item=docker_containers) 2026-04-24 02:14:20.655336 | orchestrator | changed: [testbed-node-4] => (item=docker_containers) 2026-04-24 02:14:20.655357 | orchestrator | changed: [testbed-node-5] => (item=docker_containers) 2026-04-24 02:14:20.655378 | orchestrator | changed: [testbed-node-0] => (item=docker_containers) 2026-04-24 02:14:20.655399 | orchestrator | changed: [testbed-node-1] => (item=docker_containers) 2026-04-24 02:14:20.655419 | orchestrator | changed: [testbed-node-2] => (item=docker_containers) 2026-04-24 02:14:20.655438 | orchestrator | ok: [testbed-manager] => (item=docker_images) 2026-04-24 02:14:20.655456 | orchestrator | changed: [testbed-node-4] => (item=docker_images) 2026-04-24 02:14:20.655475 | orchestrator | changed: [testbed-node-3] => (item=docker_images) 2026-04-24 02:14:20.655494 | orchestrator | changed: [testbed-node-5] => (item=docker_images) 2026-04-24 02:14:20.655515 | orchestrator | changed: [testbed-node-0] => (item=docker_images) 2026-04-24 02:14:20.655600 | orchestrator | changed: [testbed-node-1] => (item=docker_images) 2026-04-24 02:14:20.655622 | orchestrator | changed: [testbed-node-2] => (item=docker_images) 2026-04-24 02:14:20.655643 | orchestrator | 2026-04-24 02:14:20.655662 | orchestrator | TASK [osism.commons.docker_compose : This install type is not supported] ******* 2026-04-24 02:14:20.655681 | orchestrator | Friday 24 April 2026 02:14:07 +0000 (0:00:02.734) 0:06:52.220 ********** 2026-04-24 02:14:20.655700 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:14:20.655718 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:14:20.655738 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:14:20.655759 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:14:20.655779 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:14:20.655797 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:14:20.655817 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:14:20.655837 | orchestrator | 2026-04-24 02:14:20.655858 | orchestrator | TASK [osism.commons.docker_compose : Include distribution specific install tasks] *** 2026-04-24 02:14:20.655879 | orchestrator | Friday 24 April 2026 02:14:07 +0000 (0:00:00.518) 0:06:52.739 ********** 2026-04-24 02:14:20.655921 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/docker_compose/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:14:20.655944 | orchestrator | 2026-04-24 02:14:20.655963 | orchestrator | TASK [osism.commons.docker_compose : Remove docker-compose apt preferences file] *** 2026-04-24 02:14:20.655982 | orchestrator | Friday 24 April 2026 02:14:08 +0000 (0:00:00.903) 0:06:53.642 ********** 2026-04-24 02:14:20.656000 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:20.656018 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:20.656036 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:20.656054 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:20.656151 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:20.656173 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:20.656193 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:20.656210 | orchestrator | 2026-04-24 02:14:20.656228 | orchestrator | TASK [osism.commons.docker_compose : Get checksum of docker-compose file] ****** 2026-04-24 02:14:20.656248 | orchestrator | Friday 24 April 2026 02:14:09 +0000 (0:00:00.820) 0:06:54.462 ********** 2026-04-24 02:14:20.656269 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:20.656289 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:20.656308 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:20.656325 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:20.656343 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:20.656363 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:20.656384 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:20.656403 | orchestrator | 2026-04-24 02:14:20.656421 | orchestrator | TASK [osism.commons.docker_compose : Remove docker-compose binary] ************* 2026-04-24 02:14:20.656439 | orchestrator | Friday 24 April 2026 02:14:10 +0000 (0:00:00.999) 0:06:55.461 ********** 2026-04-24 02:14:20.656459 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:14:20.656480 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:14:20.656501 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:14:20.656520 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:14:20.656537 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:14:20.656556 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:14:20.656577 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:14:20.656597 | orchestrator | 2026-04-24 02:14:20.656617 | orchestrator | TASK [osism.commons.docker_compose : Uninstall docker-compose package] ********* 2026-04-24 02:14:20.656636 | orchestrator | Friday 24 April 2026 02:14:11 +0000 (0:00:00.590) 0:06:56.052 ********** 2026-04-24 02:14:20.656654 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:20.656672 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:20.656691 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:20.656707 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:20.656735 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:20.656754 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:20.656772 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:20.656790 | orchestrator | 2026-04-24 02:14:20.656808 | orchestrator | TASK [osism.commons.docker_compose : Copy docker-compose script] *************** 2026-04-24 02:14:20.656825 | orchestrator | Friday 24 April 2026 02:14:12 +0000 (0:00:01.324) 0:06:57.377 ********** 2026-04-24 02:14:20.656843 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:14:20.656862 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:14:20.656880 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:14:20.656898 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:14:20.656916 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:14:20.656933 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:14:20.656950 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:14:20.656967 | orchestrator | 2026-04-24 02:14:20.656986 | orchestrator | TASK [osism.commons.docker_compose : Install docker-compose-plugin package] **** 2026-04-24 02:14:20.657003 | orchestrator | Friday 24 April 2026 02:14:12 +0000 (0:00:00.534) 0:06:57.911 ********** 2026-04-24 02:14:20.657019 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:20.657035 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:20.657051 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:20.657088 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:20.657107 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:20.657123 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:20.657154 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:52.909879 | orchestrator | 2026-04-24 02:14:52.909958 | orchestrator | TASK [osism.commons.docker_compose : Copy osism.target systemd file] *********** 2026-04-24 02:14:52.909966 | orchestrator | Friday 24 April 2026 02:14:20 +0000 (0:00:07.724) 0:07:05.635 ********** 2026-04-24 02:14:52.909970 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.909976 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:52.909981 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:52.909985 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:52.909989 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:52.909993 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:52.909997 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:52.910001 | orchestrator | 2026-04-24 02:14:52.910005 | orchestrator | TASK [osism.commons.docker_compose : Enable osism.target] ********************** 2026-04-24 02:14:52.910009 | orchestrator | Friday 24 April 2026 02:14:22 +0000 (0:00:01.635) 0:07:07.271 ********** 2026-04-24 02:14:52.910012 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910095 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:52.910099 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:52.910103 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:52.910107 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:52.910111 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:52.910114 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:52.910118 | orchestrator | 2026-04-24 02:14:52.910122 | orchestrator | TASK [osism.commons.docker_compose : Copy docker-compose systemd unit file] **** 2026-04-24 02:14:52.910126 | orchestrator | Friday 24 April 2026 02:14:23 +0000 (0:00:01.716) 0:07:08.987 ********** 2026-04-24 02:14:52.910130 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910134 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:52.910138 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:52.910142 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:52.910145 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:52.910149 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:52.910153 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:52.910157 | orchestrator | 2026-04-24 02:14:52.910161 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-24 02:14:52.910164 | orchestrator | Friday 24 April 2026 02:14:25 +0000 (0:00:01.720) 0:07:10.708 ********** 2026-04-24 02:14:52.910168 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910172 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:52.910195 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:52.910199 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:52.910203 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:52.910206 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:52.910210 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:52.910214 | orchestrator | 2026-04-24 02:14:52.910217 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-24 02:14:52.910221 | orchestrator | Friday 24 April 2026 02:14:26 +0000 (0:00:00.913) 0:07:11.622 ********** 2026-04-24 02:14:52.910225 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:14:52.910229 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:14:52.910233 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:14:52.910237 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:14:52.910240 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:14:52.910244 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:14:52.910248 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:14:52.910251 | orchestrator | 2026-04-24 02:14:52.910255 | orchestrator | TASK [osism.services.chrony : Check minimum and maximum number of servers] ***** 2026-04-24 02:14:52.910259 | orchestrator | Friday 24 April 2026 02:14:27 +0000 (0:00:01.040) 0:07:12.663 ********** 2026-04-24 02:14:52.910263 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:14:52.910266 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:14:52.910270 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:14:52.910274 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:14:52.910277 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:14:52.910281 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:14:52.910285 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:14:52.910288 | orchestrator | 2026-04-24 02:14:52.910292 | orchestrator | TASK [osism.services.chrony : Gather variables for each operating system] ****** 2026-04-24 02:14:52.910296 | orchestrator | Friday 24 April 2026 02:14:28 +0000 (0:00:00.539) 0:07:13.202 ********** 2026-04-24 02:14:52.910300 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910315 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:52.910319 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:52.910323 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:52.910326 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:52.910333 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:52.910337 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:52.910340 | orchestrator | 2026-04-24 02:14:52.910344 | orchestrator | TASK [osism.services.chrony : Set chrony_conf_file variable to default value] *** 2026-04-24 02:14:52.910348 | orchestrator | Friday 24 April 2026 02:14:28 +0000 (0:00:00.519) 0:07:13.722 ********** 2026-04-24 02:14:52.910352 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910356 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:52.910360 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:52.910364 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:52.910367 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:52.910371 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:52.910375 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:52.910378 | orchestrator | 2026-04-24 02:14:52.910382 | orchestrator | TASK [osism.services.chrony : Set chrony_key_file variable to default value] *** 2026-04-24 02:14:52.910386 | orchestrator | Friday 24 April 2026 02:14:29 +0000 (0:00:00.738) 0:07:14.461 ********** 2026-04-24 02:14:52.910390 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910393 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:52.910397 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:52.910401 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:52.910404 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:52.910408 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:52.910412 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:52.910415 | orchestrator | 2026-04-24 02:14:52.910419 | orchestrator | TASK [osism.services.chrony : Populate service facts] ************************** 2026-04-24 02:14:52.910423 | orchestrator | Friday 24 April 2026 02:14:29 +0000 (0:00:00.534) 0:07:14.995 ********** 2026-04-24 02:14:52.910427 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910434 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:52.910438 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:52.910441 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:52.910445 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:52.910449 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:52.910452 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:52.910456 | orchestrator | 2026-04-24 02:14:52.910471 | orchestrator | TASK [osism.services.chrony : Manage timesyncd service] ************************ 2026-04-24 02:14:52.910475 | orchestrator | Friday 24 April 2026 02:14:35 +0000 (0:00:05.570) 0:07:20.565 ********** 2026-04-24 02:14:52.910479 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:14:52.910482 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:14:52.910486 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:14:52.910490 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:14:52.910494 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:14:52.910498 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:14:52.910501 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:14:52.910505 | orchestrator | 2026-04-24 02:14:52.910509 | orchestrator | TASK [osism.services.chrony : Include distribution specific install tasks] ***** 2026-04-24 02:14:52.910513 | orchestrator | Friday 24 April 2026 02:14:36 +0000 (0:00:00.579) 0:07:21.145 ********** 2026-04-24 02:14:52.910518 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:14:52.910524 | orchestrator | 2026-04-24 02:14:52.910528 | orchestrator | TASK [osism.services.chrony : Install package] ********************************* 2026-04-24 02:14:52.910532 | orchestrator | Friday 24 April 2026 02:14:37 +0000 (0:00:01.024) 0:07:22.170 ********** 2026-04-24 02:14:52.910535 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910539 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:52.910543 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:52.910546 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:52.910550 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:52.910554 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:52.910558 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:52.910561 | orchestrator | 2026-04-24 02:14:52.910565 | orchestrator | TASK [osism.services.chrony : Manage chrony service] *************************** 2026-04-24 02:14:52.910569 | orchestrator | Friday 24 April 2026 02:14:39 +0000 (0:00:01.886) 0:07:24.056 ********** 2026-04-24 02:14:52.910573 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910577 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:52.910580 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:52.910584 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:52.910588 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:52.910591 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:52.910595 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:52.910599 | orchestrator | 2026-04-24 02:14:52.910602 | orchestrator | TASK [osism.services.chrony : Check if configuration file exists] ************** 2026-04-24 02:14:52.910606 | orchestrator | Friday 24 April 2026 02:14:40 +0000 (0:00:01.121) 0:07:25.178 ********** 2026-04-24 02:14:52.910610 | orchestrator | ok: [testbed-manager] 2026-04-24 02:14:52.910614 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:14:52.910617 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:14:52.910621 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:14:52.910625 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:14:52.910628 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:14:52.910632 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:14:52.910636 | orchestrator | 2026-04-24 02:14:52.910640 | orchestrator | TASK [osism.services.chrony : Copy configuration file] ************************* 2026-04-24 02:14:52.910643 | orchestrator | Friday 24 April 2026 02:14:40 +0000 (0:00:00.821) 0:07:25.999 ********** 2026-04-24 02:14:52.910647 | orchestrator | changed: [testbed-manager] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-24 02:14:52.910653 | orchestrator | changed: [testbed-node-3] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-24 02:14:52.910660 | orchestrator | changed: [testbed-node-4] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-24 02:14:52.910664 | orchestrator | changed: [testbed-node-5] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-24 02:14:52.910671 | orchestrator | changed: [testbed-node-0] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-24 02:14:52.910674 | orchestrator | changed: [testbed-node-1] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-24 02:14:52.910678 | orchestrator | changed: [testbed-node-2] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-24 02:14:52.910682 | orchestrator | 2026-04-24 02:14:52.910686 | orchestrator | TASK [osism.services.lldpd : Include distribution specific install tasks] ****** 2026-04-24 02:14:52.910690 | orchestrator | Friday 24 April 2026 02:14:42 +0000 (0:00:01.863) 0:07:27.863 ********** 2026-04-24 02:14:52.910694 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/lldpd/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:14:52.910697 | orchestrator | 2026-04-24 02:14:52.910701 | orchestrator | TASK [osism.services.lldpd : Install lldpd package] **************************** 2026-04-24 02:14:52.910705 | orchestrator | Friday 24 April 2026 02:14:43 +0000 (0:00:00.849) 0:07:28.713 ********** 2026-04-24 02:14:52.910709 | orchestrator | changed: [testbed-manager] 2026-04-24 02:14:52.910713 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:14:52.910716 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:14:52.910720 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:14:52.910724 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:14:52.910728 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:14:52.910732 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:14:52.910735 | orchestrator | 2026-04-24 02:14:52.910741 | orchestrator | TASK [osism.services.lldpd : Manage lldpd service] ***************************** 2026-04-24 02:15:23.841631 | orchestrator | Friday 24 April 2026 02:14:52 +0000 (0:00:09.180) 0:07:37.893 ********** 2026-04-24 02:15:23.841749 | orchestrator | ok: [testbed-manager] 2026-04-24 02:15:23.841769 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:15:23.841782 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:15:23.841793 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:15:23.841804 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:15:23.841815 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:15:23.841826 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:15:23.841838 | orchestrator | 2026-04-24 02:15:23.841850 | orchestrator | RUNNING HANDLER [osism.commons.docker_compose : Reload systemd daemon] ********* 2026-04-24 02:15:23.841861 | orchestrator | Friday 24 April 2026 02:14:54 +0000 (0:00:01.990) 0:07:39.884 ********** 2026-04-24 02:15:23.841872 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:15:23.841892 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:15:23.841903 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:15:23.841914 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:15:23.841925 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:15:23.841936 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:15:23.841947 | orchestrator | 2026-04-24 02:15:23.841958 | orchestrator | RUNNING HANDLER [osism.services.chrony : Restart chrony service] *************** 2026-04-24 02:15:23.841969 | orchestrator | Friday 24 April 2026 02:14:56 +0000 (0:00:01.296) 0:07:41.181 ********** 2026-04-24 02:15:23.841980 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.841993 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.842004 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.842063 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.842174 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.842191 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.842204 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.842217 | orchestrator | 2026-04-24 02:15:23.842229 | orchestrator | PLAY [Apply bootstrap role part 2] ********************************************* 2026-04-24 02:15:23.842243 | orchestrator | 2026-04-24 02:15:23.842256 | orchestrator | TASK [Include hardening role] ************************************************** 2026-04-24 02:15:23.842268 | orchestrator | Friday 24 April 2026 02:14:57 +0000 (0:00:01.218) 0:07:42.399 ********** 2026-04-24 02:15:23.842280 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:15:23.842293 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:15:23.842305 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:15:23.842317 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:15:23.842329 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:15:23.842341 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:15:23.842353 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:15:23.842365 | orchestrator | 2026-04-24 02:15:23.842377 | orchestrator | PLAY [Apply bootstrap roles part 3] ******************************************** 2026-04-24 02:15:23.842390 | orchestrator | 2026-04-24 02:15:23.842403 | orchestrator | TASK [osism.services.journald : Copy configuration file] *********************** 2026-04-24 02:15:23.842416 | orchestrator | Friday 24 April 2026 02:14:58 +0000 (0:00:00.720) 0:07:43.120 ********** 2026-04-24 02:15:23.842429 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.842441 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.842453 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.842466 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.842478 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.842488 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.842499 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.842509 | orchestrator | 2026-04-24 02:15:23.842520 | orchestrator | TASK [osism.services.journald : Manage journald service] *********************** 2026-04-24 02:15:23.842531 | orchestrator | Friday 24 April 2026 02:14:59 +0000 (0:00:01.334) 0:07:44.454 ********** 2026-04-24 02:15:23.842542 | orchestrator | ok: [testbed-manager] 2026-04-24 02:15:23.842553 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:15:23.842564 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:15:23.842574 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:15:23.842585 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:15:23.842596 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:15:23.842606 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:15:23.842617 | orchestrator | 2026-04-24 02:15:23.842628 | orchestrator | TASK [Include auditd role] ***************************************************** 2026-04-24 02:15:23.842639 | orchestrator | Friday 24 April 2026 02:15:00 +0000 (0:00:01.445) 0:07:45.899 ********** 2026-04-24 02:15:23.842650 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:15:23.842660 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:15:23.842671 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:15:23.842682 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:15:23.842706 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:15:23.842718 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:15:23.842728 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:15:23.842739 | orchestrator | 2026-04-24 02:15:23.842750 | orchestrator | TASK [Include smartd role] ***************************************************** 2026-04-24 02:15:23.842762 | orchestrator | Friday 24 April 2026 02:15:01 +0000 (0:00:00.579) 0:07:46.479 ********** 2026-04-24 02:15:23.842774 | orchestrator | included: osism.services.smartd for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:15:23.842786 | orchestrator | 2026-04-24 02:15:23.842797 | orchestrator | TASK [osism.services.smartd : Include distribution specific install tasks] ***** 2026-04-24 02:15:23.842808 | orchestrator | Friday 24 April 2026 02:15:02 +0000 (0:00:01.057) 0:07:47.536 ********** 2026-04-24 02:15:23.842821 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/smartd/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:15:23.842842 | orchestrator | 2026-04-24 02:15:23.842853 | orchestrator | TASK [osism.services.smartd : Install smartmontools package] ******************* 2026-04-24 02:15:23.842863 | orchestrator | Friday 24 April 2026 02:15:03 +0000 (0:00:00.845) 0:07:48.381 ********** 2026-04-24 02:15:23.842874 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.842885 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.842896 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.842906 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.842917 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.842929 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.842948 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.842966 | orchestrator | 2026-04-24 02:15:23.843019 | orchestrator | TASK [osism.services.smartd : Create /var/log/smartd directory] **************** 2026-04-24 02:15:23.843039 | orchestrator | Friday 24 April 2026 02:15:12 +0000 (0:00:08.651) 0:07:57.033 ********** 2026-04-24 02:15:23.843058 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.843075 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.843163 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.843183 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.843201 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.843219 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.843236 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.843256 | orchestrator | 2026-04-24 02:15:23.843273 | orchestrator | TASK [osism.services.smartd : Copy smartmontools configuration file] *********** 2026-04-24 02:15:23.843292 | orchestrator | Friday 24 April 2026 02:15:12 +0000 (0:00:00.884) 0:07:57.917 ********** 2026-04-24 02:15:23.843303 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.843314 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.843325 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.843335 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.843346 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.843357 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.843367 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.843378 | orchestrator | 2026-04-24 02:15:23.843389 | orchestrator | TASK [osism.services.smartd : Manage smartd service] *************************** 2026-04-24 02:15:23.843399 | orchestrator | Friday 24 April 2026 02:15:14 +0000 (0:00:01.352) 0:07:59.270 ********** 2026-04-24 02:15:23.843410 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.843421 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.843431 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.843442 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.843466 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.843478 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.843488 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.843499 | orchestrator | 2026-04-24 02:15:23.843521 | orchestrator | RUNNING HANDLER [osism.services.journald : Restart journald service] *********** 2026-04-24 02:15:23.843532 | orchestrator | Friday 24 April 2026 02:15:16 +0000 (0:00:01.945) 0:08:01.215 ********** 2026-04-24 02:15:23.843543 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.843553 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.843564 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.843575 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.843586 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.843596 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.843607 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.843618 | orchestrator | 2026-04-24 02:15:23.843629 | orchestrator | RUNNING HANDLER [osism.services.smartd : Restart smartd service] *************** 2026-04-24 02:15:23.843640 | orchestrator | Friday 24 April 2026 02:15:17 +0000 (0:00:01.265) 0:08:02.481 ********** 2026-04-24 02:15:23.843650 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.843661 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.843683 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.843693 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.843704 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.843715 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.843725 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.843736 | orchestrator | 2026-04-24 02:15:23.843747 | orchestrator | PLAY [Set state bootstrap] ***************************************************** 2026-04-24 02:15:23.843758 | orchestrator | 2026-04-24 02:15:23.843769 | orchestrator | TASK [Set osism.bootstrap.status fact] ***************************************** 2026-04-24 02:15:23.843779 | orchestrator | Friday 24 April 2026 02:15:18 +0000 (0:00:01.149) 0:08:03.631 ********** 2026-04-24 02:15:23.843790 | orchestrator | included: osism.commons.state for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:15:23.843801 | orchestrator | 2026-04-24 02:15:23.843812 | orchestrator | TASK [osism.commons.state : Create custom facts directory] ********************* 2026-04-24 02:15:23.843823 | orchestrator | Friday 24 April 2026 02:15:19 +0000 (0:00:00.826) 0:08:04.458 ********** 2026-04-24 02:15:23.843833 | orchestrator | ok: [testbed-manager] 2026-04-24 02:15:23.843844 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:15:23.843855 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:15:23.843866 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:15:23.843876 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:15:23.843895 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:15:23.843907 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:15:23.843917 | orchestrator | 2026-04-24 02:15:23.843928 | orchestrator | TASK [osism.commons.state : Write state into file] ***************************** 2026-04-24 02:15:23.843939 | orchestrator | Friday 24 April 2026 02:15:20 +0000 (0:00:01.064) 0:08:05.522 ********** 2026-04-24 02:15:23.843950 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:23.843961 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:23.843972 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:23.843983 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:23.843993 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:23.844004 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:23.844015 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:23.844025 | orchestrator | 2026-04-24 02:15:23.844036 | orchestrator | TASK [Set osism.bootstrap.timestamp fact] ************************************** 2026-04-24 02:15:23.844047 | orchestrator | Friday 24 April 2026 02:15:21 +0000 (0:00:01.206) 0:08:06.728 ********** 2026-04-24 02:15:23.844058 | orchestrator | included: osism.commons.state for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:15:23.844069 | orchestrator | 2026-04-24 02:15:23.844079 | orchestrator | TASK [osism.commons.state : Create custom facts directory] ********************* 2026-04-24 02:15:23.844115 | orchestrator | Friday 24 April 2026 02:15:22 +0000 (0:00:01.258) 0:08:07.986 ********** 2026-04-24 02:15:23.844127 | orchestrator | ok: [testbed-manager] 2026-04-24 02:15:23.844137 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:15:23.844148 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:15:23.844159 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:15:23.844170 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:15:23.844180 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:15:23.844191 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:15:23.844202 | orchestrator | 2026-04-24 02:15:23.844232 | orchestrator | TASK [osism.commons.state : Write state into file] ***************************** 2026-04-24 02:15:25.485679 | orchestrator | Friday 24 April 2026 02:15:23 +0000 (0:00:00.838) 0:08:08.824 ********** 2026-04-24 02:15:25.485761 | orchestrator | changed: [testbed-manager] 2026-04-24 02:15:25.485770 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:15:25.485774 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:15:25.485778 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:15:25.485782 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:15:25.485786 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:15:25.485811 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:15:25.485815 | orchestrator | 2026-04-24 02:15:25.485819 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:15:25.485825 | orchestrator | testbed-manager : ok=168  changed=40  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-24 02:15:25.485830 | orchestrator | testbed-node-0 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-24 02:15:25.485834 | orchestrator | testbed-node-1 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-24 02:15:25.485838 | orchestrator | testbed-node-2 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-24 02:15:25.485842 | orchestrator | testbed-node-3 : ok=175  changed=65  unreachable=0 failed=0 skipped=38  rescued=0 ignored=0 2026-04-24 02:15:25.485846 | orchestrator | testbed-node-4 : ok=175  changed=65  unreachable=0 failed=0 skipped=37  rescued=0 ignored=0 2026-04-24 02:15:25.485849 | orchestrator | testbed-node-5 : ok=175  changed=65  unreachable=0 failed=0 skipped=37  rescued=0 ignored=0 2026-04-24 02:15:25.485853 | orchestrator | 2026-04-24 02:15:25.485857 | orchestrator | 2026-04-24 02:15:25.485860 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:15:25.485864 | orchestrator | Friday 24 April 2026 02:15:24 +0000 (0:00:01.148) 0:08:09.973 ********** 2026-04-24 02:15:25.485868 | orchestrator | =============================================================================== 2026-04-24 02:15:25.485872 | orchestrator | osism.commons.packages : Install required packages --------------------- 76.74s 2026-04-24 02:15:25.485876 | orchestrator | osism.commons.packages : Download required packages -------------------- 38.53s 2026-04-24 02:15:25.485880 | orchestrator | osism.commons.cleanup : Cleanup installed packages --------------------- 35.17s 2026-04-24 02:15:25.485883 | orchestrator | osism.commons.repository : Update package cache ------------------------ 16.19s 2026-04-24 02:15:25.485887 | orchestrator | osism.commons.packages : Remove dependencies that are no longer required -- 13.14s 2026-04-24 02:15:25.485891 | orchestrator | osism.commons.systohc : Install util-linux-extra package --------------- 13.13s 2026-04-24 02:15:25.485895 | orchestrator | osism.services.docker : Install docker package ------------------------- 10.49s 2026-04-24 02:15:25.485899 | orchestrator | osism.services.docker : Install containerd package ---------------------- 9.49s 2026-04-24 02:15:25.485903 | orchestrator | osism.services.lldpd : Install lldpd package ---------------------------- 9.18s 2026-04-24 02:15:25.485907 | orchestrator | osism.services.docker : Install docker-cli package ---------------------- 9.18s 2026-04-24 02:15:25.485910 | orchestrator | osism.services.smartd : Install smartmontools package ------------------- 8.65s 2026-04-24 02:15:25.485914 | orchestrator | osism.services.docker : Add repository ---------------------------------- 8.42s 2026-04-24 02:15:25.485927 | orchestrator | osism.commons.cleanup : Remove cloudinit package ------------------------ 8.08s 2026-04-24 02:15:25.485931 | orchestrator | osism.services.rng : Install rng package -------------------------------- 8.00s 2026-04-24 02:15:25.485934 | orchestrator | osism.commons.cleanup : Uninstall unattended-upgrades package ----------- 7.77s 2026-04-24 02:15:25.485938 | orchestrator | osism.commons.docker_compose : Install docker-compose-plugin package ---- 7.72s 2026-04-24 02:15:25.485942 | orchestrator | osism.commons.cleanup : Remove dependencies that are no longer required --- 6.22s 2026-04-24 02:15:25.485945 | orchestrator | osism.services.docker : Install apt-transport-https package ------------- 5.94s 2026-04-24 02:15:25.485949 | orchestrator | osism.commons.services : Populate service facts ------------------------- 5.74s 2026-04-24 02:15:25.485953 | orchestrator | osism.commons.cleanup : Populate service facts -------------------------- 5.60s 2026-04-24 02:15:25.837285 | orchestrator | + osism apply fail2ban 2026-04-24 02:15:38.864972 | orchestrator | 2026-04-24 02:15:38 | INFO  | Task 15d0e3f5-736e-420e-ad6c-36189374583c (fail2ban) was prepared for execution. 2026-04-24 02:15:38.865059 | orchestrator | 2026-04-24 02:15:38 | INFO  | It takes a moment until task 15d0e3f5-736e-420e-ad6c-36189374583c (fail2ban) has been started and output is visible here. 2026-04-24 02:16:00.658351 | orchestrator | 2026-04-24 02:16:00.658457 | orchestrator | PLAY [Apply role fail2ban] ***************************************************** 2026-04-24 02:16:00.658472 | orchestrator | 2026-04-24 02:16:00.658483 | orchestrator | TASK [osism.services.fail2ban : Include distribution specific install tasks] *** 2026-04-24 02:16:00.658493 | orchestrator | Friday 24 April 2026 02:15:43 +0000 (0:00:00.284) 0:00:00.284 ********** 2026-04-24 02:16:00.658505 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/fail2ban/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:16:00.658517 | orchestrator | 2026-04-24 02:16:00.658527 | orchestrator | TASK [osism.services.fail2ban : Install fail2ban package] ********************** 2026-04-24 02:16:00.658537 | orchestrator | Friday 24 April 2026 02:15:44 +0000 (0:00:01.203) 0:00:01.488 ********** 2026-04-24 02:16:00.658547 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:16:00.658558 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:16:00.658567 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:16:00.658580 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:16:00.658597 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:16:00.658614 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:16:00.658631 | orchestrator | changed: [testbed-manager] 2026-04-24 02:16:00.658648 | orchestrator | 2026-04-24 02:16:00.658663 | orchestrator | TASK [osism.services.fail2ban : Copy configuration files] ********************** 2026-04-24 02:16:00.658678 | orchestrator | Friday 24 April 2026 02:15:55 +0000 (0:00:10.817) 0:00:12.306 ********** 2026-04-24 02:16:00.658694 | orchestrator | changed: [testbed-manager] 2026-04-24 02:16:00.658708 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:16:00.658724 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:16:00.658738 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:16:00.658754 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:16:00.658769 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:16:00.658784 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:16:00.658800 | orchestrator | 2026-04-24 02:16:00.658816 | orchestrator | TASK [osism.services.fail2ban : Manage fail2ban service] *********************** 2026-04-24 02:16:00.658832 | orchestrator | Friday 24 April 2026 02:15:57 +0000 (0:00:01.483) 0:00:13.789 ********** 2026-04-24 02:16:00.658849 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:00.658867 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:16:00.658882 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:16:00.658897 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:16:00.658923 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:16:00.658940 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:16:00.658957 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:16:00.658973 | orchestrator | 2026-04-24 02:16:00.658990 | orchestrator | TASK [osism.services.fail2ban : Reload fail2ban configuration] ***************** 2026-04-24 02:16:00.659008 | orchestrator | Friday 24 April 2026 02:15:58 +0000 (0:00:01.470) 0:00:15.260 ********** 2026-04-24 02:16:00.659027 | orchestrator | changed: [testbed-manager] 2026-04-24 02:16:00.659044 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:16:00.659063 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:16:00.659075 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:16:00.659086 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:16:00.659123 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:16:00.659135 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:16:00.659147 | orchestrator | 2026-04-24 02:16:00.659159 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:16:00.659171 | orchestrator | testbed-manager : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:16:00.659285 | orchestrator | testbed-node-0 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:16:00.659299 | orchestrator | testbed-node-1 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:16:00.659311 | orchestrator | testbed-node-2 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:16:00.659322 | orchestrator | testbed-node-3 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:16:00.659331 | orchestrator | testbed-node-4 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:16:00.659342 | orchestrator | testbed-node-5 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:16:00.659351 | orchestrator | 2026-04-24 02:16:00.659361 | orchestrator | 2026-04-24 02:16:00.659371 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:16:00.659381 | orchestrator | Friday 24 April 2026 02:16:00 +0000 (0:00:01.669) 0:00:16.929 ********** 2026-04-24 02:16:00.659390 | orchestrator | =============================================================================== 2026-04-24 02:16:00.659400 | orchestrator | osism.services.fail2ban : Install fail2ban package --------------------- 10.82s 2026-04-24 02:16:00.659410 | orchestrator | osism.services.fail2ban : Reload fail2ban configuration ----------------- 1.67s 2026-04-24 02:16:00.659419 | orchestrator | osism.services.fail2ban : Copy configuration files ---------------------- 1.48s 2026-04-24 02:16:00.659429 | orchestrator | osism.services.fail2ban : Manage fail2ban service ----------------------- 1.47s 2026-04-24 02:16:00.659438 | orchestrator | osism.services.fail2ban : Include distribution specific install tasks --- 1.20s 2026-04-24 02:16:00.989993 | orchestrator | + osism apply network 2026-04-24 02:16:13.082686 | orchestrator | 2026-04-24 02:16:13 | INFO  | Task 39655d49-40e2-45aa-917b-8e7398f80fa2 (network) was prepared for execution. 2026-04-24 02:16:13.082803 | orchestrator | 2026-04-24 02:16:13 | INFO  | It takes a moment until task 39655d49-40e2-45aa-917b-8e7398f80fa2 (network) has been started and output is visible here. 2026-04-24 02:16:41.926469 | orchestrator | 2026-04-24 02:16:41.926566 | orchestrator | PLAY [Apply role network] ****************************************************** 2026-04-24 02:16:41.926584 | orchestrator | 2026-04-24 02:16:41.926597 | orchestrator | TASK [osism.commons.network : Gather variables for each operating system] ****** 2026-04-24 02:16:41.926610 | orchestrator | Friday 24 April 2026 02:16:17 +0000 (0:00:00.290) 0:00:00.290 ********** 2026-04-24 02:16:41.926622 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:41.926634 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:16:41.926645 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:16:41.926656 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:16:41.926668 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:16:41.926679 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:16:41.926690 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:16:41.926701 | orchestrator | 2026-04-24 02:16:41.926713 | orchestrator | TASK [osism.commons.network : Include type specific tasks] ********************* 2026-04-24 02:16:41.926725 | orchestrator | Friday 24 April 2026 02:16:18 +0000 (0:00:00.709) 0:00:00.999 ********** 2026-04-24 02:16:41.926738 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/netplan-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:16:41.926752 | orchestrator | 2026-04-24 02:16:41.926763 | orchestrator | TASK [osism.commons.network : Install required packages] *********************** 2026-04-24 02:16:41.926798 | orchestrator | Friday 24 April 2026 02:16:19 +0000 (0:00:01.254) 0:00:02.253 ********** 2026-04-24 02:16:41.926809 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:41.926821 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:16:41.926831 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:16:41.926842 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:16:41.926852 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:16:41.926863 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:16:41.926873 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:16:41.926884 | orchestrator | 2026-04-24 02:16:41.926895 | orchestrator | TASK [osism.commons.network : Remove ifupdown package] ************************* 2026-04-24 02:16:41.926906 | orchestrator | Friday 24 April 2026 02:16:21 +0000 (0:00:02.071) 0:00:04.325 ********** 2026-04-24 02:16:41.926917 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:41.926927 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:16:41.926939 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:16:41.926950 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:16:41.926960 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:16:41.926971 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:16:41.926981 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:16:41.926992 | orchestrator | 2026-04-24 02:16:41.927003 | orchestrator | TASK [osism.commons.network : Create required directories] ********************* 2026-04-24 02:16:41.927014 | orchestrator | Friday 24 April 2026 02:16:23 +0000 (0:00:01.789) 0:00:06.114 ********** 2026-04-24 02:16:41.927027 | orchestrator | ok: [testbed-manager] => (item=/etc/netplan) 2026-04-24 02:16:41.927039 | orchestrator | ok: [testbed-node-0] => (item=/etc/netplan) 2026-04-24 02:16:41.927052 | orchestrator | ok: [testbed-node-1] => (item=/etc/netplan) 2026-04-24 02:16:41.927064 | orchestrator | ok: [testbed-node-2] => (item=/etc/netplan) 2026-04-24 02:16:41.927077 | orchestrator | ok: [testbed-node-3] => (item=/etc/netplan) 2026-04-24 02:16:41.927090 | orchestrator | ok: [testbed-node-4] => (item=/etc/netplan) 2026-04-24 02:16:41.927129 | orchestrator | ok: [testbed-node-5] => (item=/etc/netplan) 2026-04-24 02:16:41.927143 | orchestrator | 2026-04-24 02:16:41.927171 | orchestrator | TASK [osism.commons.network : Prepare netplan configuration template] ********** 2026-04-24 02:16:41.927184 | orchestrator | Friday 24 April 2026 02:16:24 +0000 (0:00:00.982) 0:00:07.097 ********** 2026-04-24 02:16:41.927197 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 02:16:41.927210 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 02:16:41.927222 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 02:16:41.927235 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 02:16:41.927246 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 02:16:41.927258 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 02:16:41.927271 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 02:16:41.927283 | orchestrator | 2026-04-24 02:16:41.927298 | orchestrator | TASK [osism.commons.network : Copy netplan configuration] ********************** 2026-04-24 02:16:41.927318 | orchestrator | Friday 24 April 2026 02:16:27 +0000 (0:00:03.435) 0:00:10.532 ********** 2026-04-24 02:16:41.927338 | orchestrator | changed: [testbed-manager] 2026-04-24 02:16:41.927360 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:16:41.927379 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:16:41.927396 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:16:41.927443 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:16:41.927456 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:16:41.927467 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:16:41.927478 | orchestrator | 2026-04-24 02:16:41.927489 | orchestrator | TASK [osism.commons.network : Remove netplan configuration template] *********** 2026-04-24 02:16:41.927499 | orchestrator | Friday 24 April 2026 02:16:29 +0000 (0:00:01.629) 0:00:12.162 ********** 2026-04-24 02:16:41.927510 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 02:16:41.927521 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 02:16:41.927532 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 02:16:41.927543 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 02:16:41.927553 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 02:16:41.927586 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 02:16:41.927598 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 02:16:41.927609 | orchestrator | 2026-04-24 02:16:41.927620 | orchestrator | TASK [osism.commons.network : Check if path for interface file exists] ********* 2026-04-24 02:16:41.927631 | orchestrator | Friday 24 April 2026 02:16:31 +0000 (0:00:01.855) 0:00:14.017 ********** 2026-04-24 02:16:41.927641 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:41.927652 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:16:41.927663 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:16:41.927674 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:16:41.927685 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:16:41.927696 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:16:41.927706 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:16:41.927717 | orchestrator | 2026-04-24 02:16:41.927728 | orchestrator | TASK [osism.commons.network : Copy interfaces file] **************************** 2026-04-24 02:16:41.927756 | orchestrator | Friday 24 April 2026 02:16:32 +0000 (0:00:01.236) 0:00:15.253 ********** 2026-04-24 02:16:41.927767 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:16:41.927778 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:16:41.927789 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:16:41.927800 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:16:41.927810 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:16:41.927821 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:16:41.927832 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:16:41.927843 | orchestrator | 2026-04-24 02:16:41.927854 | orchestrator | TASK [osism.commons.network : Install package networkd-dispatcher] ************* 2026-04-24 02:16:41.927865 | orchestrator | Friday 24 April 2026 02:16:33 +0000 (0:00:00.672) 0:00:15.926 ********** 2026-04-24 02:16:41.927876 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:41.927887 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:16:41.927898 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:16:41.927908 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:16:41.927919 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:16:41.927930 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:16:41.927941 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:16:41.927951 | orchestrator | 2026-04-24 02:16:41.927962 | orchestrator | TASK [osism.commons.network : Copy dispatcher scripts] ************************* 2026-04-24 02:16:41.927973 | orchestrator | Friday 24 April 2026 02:16:35 +0000 (0:00:02.199) 0:00:18.126 ********** 2026-04-24 02:16:41.927984 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:16:41.927995 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:16:41.928006 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:16:41.928017 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:16:41.928027 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:16:41.928038 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:16:41.928050 | orchestrator | changed: [testbed-manager] => (item={'dest': 'routable.d/iptables.sh', 'src': '/opt/configuration/network/iptables.sh'}) 2026-04-24 02:16:41.928062 | orchestrator | 2026-04-24 02:16:41.928073 | orchestrator | TASK [osism.commons.network : Manage service networkd-dispatcher] ************** 2026-04-24 02:16:41.928084 | orchestrator | Friday 24 April 2026 02:16:36 +0000 (0:00:00.960) 0:00:19.087 ********** 2026-04-24 02:16:41.928095 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:41.928135 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:16:41.928147 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:16:41.928158 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:16:41.928169 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:16:41.928180 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:16:41.928190 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:16:41.928201 | orchestrator | 2026-04-24 02:16:41.928213 | orchestrator | TASK [osism.commons.network : Include cleanup tasks] *************************** 2026-04-24 02:16:41.928224 | orchestrator | Friday 24 April 2026 02:16:37 +0000 (0:00:01.676) 0:00:20.764 ********** 2026-04-24 02:16:41.928235 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/cleanup-netplan.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:16:41.928255 | orchestrator | 2026-04-24 02:16:41.928266 | orchestrator | TASK [osism.commons.network : List existing configuration files] *************** 2026-04-24 02:16:41.928278 | orchestrator | Friday 24 April 2026 02:16:39 +0000 (0:00:01.243) 0:00:22.007 ********** 2026-04-24 02:16:41.928289 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:41.928300 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:16:41.928311 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:16:41.928321 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:16:41.928332 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:16:41.928343 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:16:41.928354 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:16:41.928365 | orchestrator | 2026-04-24 02:16:41.928376 | orchestrator | TASK [osism.commons.network : Set network_configured_files fact] *************** 2026-04-24 02:16:41.928387 | orchestrator | Friday 24 April 2026 02:16:40 +0000 (0:00:00.986) 0:00:22.994 ********** 2026-04-24 02:16:41.928398 | orchestrator | ok: [testbed-manager] 2026-04-24 02:16:41.928409 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:16:41.928419 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:16:41.928430 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:16:41.928441 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:16:41.928452 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:16:41.928462 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:16:41.928473 | orchestrator | 2026-04-24 02:16:41.928484 | orchestrator | TASK [osism.commons.network : Remove unused configuration files] *************** 2026-04-24 02:16:41.928496 | orchestrator | Friday 24 April 2026 02:16:40 +0000 (0:00:00.644) 0:00:23.638 ********** 2026-04-24 02:16:41.928512 | orchestrator | skipping: [testbed-manager] => (item=/etc/netplan/01-osism.yaml)  2026-04-24 02:16:41.928524 | orchestrator | skipping: [testbed-node-0] => (item=/etc/netplan/01-osism.yaml)  2026-04-24 02:16:41.928535 | orchestrator | skipping: [testbed-node-1] => (item=/etc/netplan/01-osism.yaml)  2026-04-24 02:16:41.928546 | orchestrator | skipping: [testbed-node-2] => (item=/etc/netplan/01-osism.yaml)  2026-04-24 02:16:41.928557 | orchestrator | changed: [testbed-manager] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-24 02:16:41.928567 | orchestrator | skipping: [testbed-node-3] => (item=/etc/netplan/01-osism.yaml)  2026-04-24 02:16:41.928578 | orchestrator | changed: [testbed-node-0] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-24 02:16:41.928589 | orchestrator | skipping: [testbed-node-4] => (item=/etc/netplan/01-osism.yaml)  2026-04-24 02:16:41.928600 | orchestrator | changed: [testbed-node-1] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-24 02:16:41.928611 | orchestrator | changed: [testbed-node-2] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-24 02:16:41.928622 | orchestrator | changed: [testbed-node-3] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-24 02:16:41.928633 | orchestrator | skipping: [testbed-node-5] => (item=/etc/netplan/01-osism.yaml)  2026-04-24 02:16:41.928643 | orchestrator | changed: [testbed-node-4] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-24 02:16:41.928654 | orchestrator | changed: [testbed-node-5] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-24 02:16:41.928665 | orchestrator | 2026-04-24 02:16:41.928684 | orchestrator | TASK [osism.commons.network : Include dummy interfaces] ************************ 2026-04-24 02:16:58.685434 | orchestrator | Friday 24 April 2026 02:16:41 +0000 (0:00:01.109) 0:00:24.748 ********** 2026-04-24 02:16:58.685541 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:16:58.685555 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:16:58.685565 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:16:58.685575 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:16:58.685584 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:16:58.685593 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:16:58.685603 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:16:58.685613 | orchestrator | 2026-04-24 02:16:58.685623 | orchestrator | TASK [osism.commons.network : Include vxlan interfaces] ************************ 2026-04-24 02:16:58.685700 | orchestrator | Friday 24 April 2026 02:16:42 +0000 (0:00:00.561) 0:00:25.310 ********** 2026-04-24 02:16:58.685712 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/vxlan-interfaces.yml for testbed-manager, testbed-node-3, testbed-node-1, testbed-node-2, testbed-node-0, testbed-node-5, testbed-node-4 2026-04-24 02:16:58.685724 | orchestrator | 2026-04-24 02:16:58.685733 | orchestrator | TASK [osism.commons.network : Create systemd networkd netdev files] ************ 2026-04-24 02:16:58.685743 | orchestrator | Friday 24 April 2026 02:16:46 +0000 (0:00:04.126) 0:00:29.436 ********** 2026-04-24 02:16:58.685753 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan0', 'value': {'addresses': ['192.168.112.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685765 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685774 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.685783 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685793 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685802 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685812 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685852 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685864 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.13/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.685879 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.10/20'], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.685889 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.11/20'], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.685915 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.12/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.685932 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.14/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.685941 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.15/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.685950 | orchestrator | 2026-04-24 02:16:58.685960 | orchestrator | TASK [osism.commons.network : Create systemd networkd network files] *********** 2026-04-24 02:16:58.685969 | orchestrator | Friday 24 April 2026 02:16:52 +0000 (0:00:06.102) 0:00:35.539 ********** 2026-04-24 02:16:58.685978 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan0', 'value': {'addresses': ['192.168.112.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685988 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.685998 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.686008 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.686100 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.686165 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.686175 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.686185 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 42}}) 2026-04-24 02:16:58.686200 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.11/20'], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.686211 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.13/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.686220 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.15/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.686265 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.10/20'], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:16:58.686286 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.14/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:17:05.166415 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.12/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 23}}) 2026-04-24 02:17:05.166527 | orchestrator | 2026-04-24 02:17:05.166544 | orchestrator | TASK [osism.commons.network : Include networkd cleanup tasks] ****************** 2026-04-24 02:17:05.166557 | orchestrator | Friday 24 April 2026 02:16:58 +0000 (0:00:05.961) 0:00:41.501 ********** 2026-04-24 02:17:05.166570 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/cleanup-networkd.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:17:05.166582 | orchestrator | 2026-04-24 02:17:05.166593 | orchestrator | TASK [osism.commons.network : List existing configuration files] *************** 2026-04-24 02:17:05.166605 | orchestrator | Friday 24 April 2026 02:17:00 +0000 (0:00:01.341) 0:00:42.843 ********** 2026-04-24 02:17:05.166616 | orchestrator | ok: [testbed-manager] 2026-04-24 02:17:05.166628 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:17:05.166639 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:17:05.166650 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:17:05.166661 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:17:05.166672 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:17:05.166682 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:17:05.166693 | orchestrator | 2026-04-24 02:17:05.166704 | orchestrator | TASK [osism.commons.network : Remove unused configuration files] *************** 2026-04-24 02:17:05.166716 | orchestrator | Friday 24 April 2026 02:17:01 +0000 (0:00:01.215) 0:00:44.058 ********** 2026-04-24 02:17:05.166727 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-24 02:17:05.166739 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-24 02:17:05.166750 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-24 02:17:05.166761 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-24 02:17:05.166772 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-24 02:17:05.166783 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-24 02:17:05.166794 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-24 02:17:05.166805 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-24 02:17:05.166816 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:17:05.166827 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-24 02:17:05.166838 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-24 02:17:05.166849 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-24 02:17:05.166860 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-24 02:17:05.166871 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:17:05.166906 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-24 02:17:05.166918 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-24 02:17:05.166931 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-24 02:17:05.166945 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:17:05.166957 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-24 02:17:05.166985 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-24 02:17:05.166999 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-24 02:17:05.167011 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-24 02:17:05.167024 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-24 02:17:05.167037 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:17:05.167050 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-24 02:17:05.167061 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-24 02:17:05.167072 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-24 02:17:05.167083 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-24 02:17:05.167094 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:17:05.167149 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:17:05.167171 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-24 02:17:05.167192 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-24 02:17:05.167209 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-24 02:17:05.167230 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-24 02:17:05.167241 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:17:05.167252 | orchestrator | 2026-04-24 02:17:05.167263 | orchestrator | RUNNING HANDLER [osism.commons.network : Reload systemd-networkd] ************** 2026-04-24 02:17:05.167294 | orchestrator | Friday 24 April 2026 02:17:03 +0000 (0:00:02.120) 0:00:46.179 ********** 2026-04-24 02:17:05.167305 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:17:05.167316 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:17:05.167327 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:17:05.167338 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:17:05.167349 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:17:05.167360 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:17:05.167371 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:17:05.167381 | orchestrator | 2026-04-24 02:17:05.167393 | orchestrator | RUNNING HANDLER [osism.commons.network : Netplan configuration changed] ******** 2026-04-24 02:17:05.167404 | orchestrator | Friday 24 April 2026 02:17:03 +0000 (0:00:00.648) 0:00:46.828 ********** 2026-04-24 02:17:05.167415 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:17:05.167425 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:17:05.167436 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:17:05.167448 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:17:05.167459 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:17:05.167469 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:17:05.167480 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:17:05.167490 | orchestrator | 2026-04-24 02:17:05.167501 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:17:05.167514 | orchestrator | testbed-manager : ok=21  changed=5  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 02:17:05.167527 | orchestrator | testbed-node-0 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 02:17:05.167549 | orchestrator | testbed-node-1 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 02:17:05.167560 | orchestrator | testbed-node-2 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 02:17:05.167571 | orchestrator | testbed-node-3 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 02:17:05.167582 | orchestrator | testbed-node-4 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 02:17:05.167593 | orchestrator | testbed-node-5 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 02:17:05.167603 | orchestrator | 2026-04-24 02:17:05.167614 | orchestrator | 2026-04-24 02:17:05.167625 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:17:05.167636 | orchestrator | Friday 24 April 2026 02:17:04 +0000 (0:00:00.747) 0:00:47.575 ********** 2026-04-24 02:17:05.167647 | orchestrator | =============================================================================== 2026-04-24 02:17:05.167658 | orchestrator | osism.commons.network : Create systemd networkd netdev files ------------ 6.10s 2026-04-24 02:17:05.167668 | orchestrator | osism.commons.network : Create systemd networkd network files ----------- 5.96s 2026-04-24 02:17:05.167679 | orchestrator | osism.commons.network : Include vxlan interfaces ------------------------ 4.13s 2026-04-24 02:17:05.167690 | orchestrator | osism.commons.network : Prepare netplan configuration template ---------- 3.44s 2026-04-24 02:17:05.167701 | orchestrator | osism.commons.network : Install package networkd-dispatcher ------------- 2.20s 2026-04-24 02:17:05.167711 | orchestrator | osism.commons.network : Remove unused configuration files --------------- 2.12s 2026-04-24 02:17:05.167722 | orchestrator | osism.commons.network : Install required packages ----------------------- 2.07s 2026-04-24 02:17:05.167739 | orchestrator | osism.commons.network : Remove netplan configuration template ----------- 1.86s 2026-04-24 02:17:05.167750 | orchestrator | osism.commons.network : Remove ifupdown package ------------------------- 1.79s 2026-04-24 02:17:05.167761 | orchestrator | osism.commons.network : Manage service networkd-dispatcher -------------- 1.68s 2026-04-24 02:17:05.167771 | orchestrator | osism.commons.network : Copy netplan configuration ---------------------- 1.63s 2026-04-24 02:17:05.167782 | orchestrator | osism.commons.network : Include networkd cleanup tasks ------------------ 1.34s 2026-04-24 02:17:05.167793 | orchestrator | osism.commons.network : Include type specific tasks --------------------- 1.25s 2026-04-24 02:17:05.167804 | orchestrator | osism.commons.network : Include cleanup tasks --------------------------- 1.24s 2026-04-24 02:17:05.167814 | orchestrator | osism.commons.network : Check if path for interface file exists --------- 1.24s 2026-04-24 02:17:05.167825 | orchestrator | osism.commons.network : List existing configuration files --------------- 1.22s 2026-04-24 02:17:05.167836 | orchestrator | osism.commons.network : Remove unused configuration files --------------- 1.11s 2026-04-24 02:17:05.167846 | orchestrator | osism.commons.network : List existing configuration files --------------- 0.99s 2026-04-24 02:17:05.167857 | orchestrator | osism.commons.network : Create required directories --------------------- 0.98s 2026-04-24 02:17:05.167868 | orchestrator | osism.commons.network : Copy dispatcher scripts ------------------------- 0.96s 2026-04-24 02:17:05.495267 | orchestrator | + osism apply wireguard 2026-04-24 02:17:17.620489 | orchestrator | 2026-04-24 02:17:17 | INFO  | Task bbc8d8da-1cbf-43ec-8d30-881af416a386 (wireguard) was prepared for execution. 2026-04-24 02:17:17.620630 | orchestrator | 2026-04-24 02:17:17 | INFO  | It takes a moment until task bbc8d8da-1cbf-43ec-8d30-881af416a386 (wireguard) has been started and output is visible here. 2026-04-24 02:17:38.330254 | orchestrator | 2026-04-24 02:17:38.330351 | orchestrator | PLAY [Apply role wireguard] **************************************************** 2026-04-24 02:17:38.330386 | orchestrator | 2026-04-24 02:17:38.330394 | orchestrator | TASK [osism.services.wireguard : Install iptables package] ********************* 2026-04-24 02:17:38.330402 | orchestrator | Friday 24 April 2026 02:17:21 +0000 (0:00:00.227) 0:00:00.227 ********** 2026-04-24 02:17:38.330410 | orchestrator | ok: [testbed-manager] 2026-04-24 02:17:38.330418 | orchestrator | 2026-04-24 02:17:38.330426 | orchestrator | TASK [osism.services.wireguard : Install wireguard package] ******************** 2026-04-24 02:17:38.330433 | orchestrator | Friday 24 April 2026 02:17:23 +0000 (0:00:01.583) 0:00:01.811 ********** 2026-04-24 02:17:38.330441 | orchestrator | changed: [testbed-manager] 2026-04-24 02:17:38.330453 | orchestrator | 2026-04-24 02:17:38.330461 | orchestrator | TASK [osism.services.wireguard : Create public and private key - server] ******* 2026-04-24 02:17:38.330468 | orchestrator | Friday 24 April 2026 02:17:30 +0000 (0:00:06.912) 0:00:08.723 ********** 2026-04-24 02:17:38.330476 | orchestrator | changed: [testbed-manager] 2026-04-24 02:17:38.330483 | orchestrator | 2026-04-24 02:17:38.330490 | orchestrator | TASK [osism.services.wireguard : Create preshared key] ************************* 2026-04-24 02:17:38.330498 | orchestrator | Friday 24 April 2026 02:17:31 +0000 (0:00:00.612) 0:00:09.336 ********** 2026-04-24 02:17:38.330505 | orchestrator | changed: [testbed-manager] 2026-04-24 02:17:38.330512 | orchestrator | 2026-04-24 02:17:38.330520 | orchestrator | TASK [osism.services.wireguard : Get preshared key] **************************** 2026-04-24 02:17:38.330527 | orchestrator | Friday 24 April 2026 02:17:31 +0000 (0:00:00.452) 0:00:09.788 ********** 2026-04-24 02:17:38.330534 | orchestrator | ok: [testbed-manager] 2026-04-24 02:17:38.330541 | orchestrator | 2026-04-24 02:17:38.330549 | orchestrator | TASK [osism.services.wireguard : Get public key - server] ********************** 2026-04-24 02:17:38.330556 | orchestrator | Friday 24 April 2026 02:17:32 +0000 (0:00:00.697) 0:00:10.486 ********** 2026-04-24 02:17:38.330563 | orchestrator | ok: [testbed-manager] 2026-04-24 02:17:38.330571 | orchestrator | 2026-04-24 02:17:38.330578 | orchestrator | TASK [osism.services.wireguard : Get private key - server] ********************* 2026-04-24 02:17:38.330585 | orchestrator | Friday 24 April 2026 02:17:32 +0000 (0:00:00.430) 0:00:10.916 ********** 2026-04-24 02:17:38.330593 | orchestrator | ok: [testbed-manager] 2026-04-24 02:17:38.330600 | orchestrator | 2026-04-24 02:17:38.330607 | orchestrator | TASK [osism.services.wireguard : Copy wg0.conf configuration file] ************* 2026-04-24 02:17:38.330614 | orchestrator | Friday 24 April 2026 02:17:33 +0000 (0:00:00.441) 0:00:11.358 ********** 2026-04-24 02:17:38.330622 | orchestrator | changed: [testbed-manager] 2026-04-24 02:17:38.330629 | orchestrator | 2026-04-24 02:17:38.330636 | orchestrator | TASK [osism.services.wireguard : Copy client configuration files] ************** 2026-04-24 02:17:38.330644 | orchestrator | Friday 24 April 2026 02:17:34 +0000 (0:00:01.265) 0:00:12.624 ********** 2026-04-24 02:17:38.330651 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-24 02:17:38.330658 | orchestrator | changed: [testbed-manager] 2026-04-24 02:17:38.330666 | orchestrator | 2026-04-24 02:17:38.330673 | orchestrator | TASK [osism.services.wireguard : Manage wg-quick@wg0.service service] ********** 2026-04-24 02:17:38.330680 | orchestrator | Friday 24 April 2026 02:17:35 +0000 (0:00:00.952) 0:00:13.576 ********** 2026-04-24 02:17:38.330688 | orchestrator | changed: [testbed-manager] 2026-04-24 02:17:38.330695 | orchestrator | 2026-04-24 02:17:38.330703 | orchestrator | RUNNING HANDLER [osism.services.wireguard : Restart wg0 service] *************** 2026-04-24 02:17:38.330710 | orchestrator | Friday 24 April 2026 02:17:36 +0000 (0:00:01.681) 0:00:15.258 ********** 2026-04-24 02:17:38.330717 | orchestrator | changed: [testbed-manager] 2026-04-24 02:17:38.330725 | orchestrator | 2026-04-24 02:17:38.330732 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:17:38.330740 | orchestrator | testbed-manager : ok=11  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:17:38.330749 | orchestrator | 2026-04-24 02:17:38.330756 | orchestrator | 2026-04-24 02:17:38.330764 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:17:38.330777 | orchestrator | Friday 24 April 2026 02:17:37 +0000 (0:00:00.966) 0:00:16.224 ********** 2026-04-24 02:17:38.330784 | orchestrator | =============================================================================== 2026-04-24 02:17:38.330792 | orchestrator | osism.services.wireguard : Install wireguard package -------------------- 6.91s 2026-04-24 02:17:38.330799 | orchestrator | osism.services.wireguard : Manage wg-quick@wg0.service service ---------- 1.68s 2026-04-24 02:17:38.330808 | orchestrator | osism.services.wireguard : Install iptables package --------------------- 1.58s 2026-04-24 02:17:38.330817 | orchestrator | osism.services.wireguard : Copy wg0.conf configuration file ------------- 1.27s 2026-04-24 02:17:38.330825 | orchestrator | osism.services.wireguard : Restart wg0 service -------------------------- 0.97s 2026-04-24 02:17:38.330833 | orchestrator | osism.services.wireguard : Copy client configuration files -------------- 0.95s 2026-04-24 02:17:38.330841 | orchestrator | osism.services.wireguard : Get preshared key ---------------------------- 0.70s 2026-04-24 02:17:38.330850 | orchestrator | osism.services.wireguard : Create public and private key - server ------- 0.61s 2026-04-24 02:17:38.330858 | orchestrator | osism.services.wireguard : Create preshared key ------------------------- 0.45s 2026-04-24 02:17:38.330866 | orchestrator | osism.services.wireguard : Get private key - server --------------------- 0.44s 2026-04-24 02:17:38.330875 | orchestrator | osism.services.wireguard : Get public key - server ---------------------- 0.43s 2026-04-24 02:17:38.638764 | orchestrator | + sh -c /opt/configuration/scripts/prepare-wireguard-configuration.sh 2026-04-24 02:17:38.667698 | orchestrator | % Total % Received % Xferd Average Speed Time Time Time Current 2026-04-24 02:17:38.667794 | orchestrator | Dload Upload Total Spent Left Speed 2026-04-24 02:17:38.753290 | orchestrator | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 15 100 15 0 0 175 0 --:--:-- --:--:-- --:--:-- 176 2026-04-24 02:17:38.770998 | orchestrator | + osism apply --environment custom workarounds 2026-04-24 02:17:40.725031 | orchestrator | 2026-04-24 02:17:40 | INFO  | Trying to run play workarounds in environment custom 2026-04-24 02:17:50.949944 | orchestrator | 2026-04-24 02:17:50 | INFO  | Task 00deaedd-9e02-4768-89fb-4691b886e76a (workarounds) was prepared for execution. 2026-04-24 02:17:50.950213 | orchestrator | 2026-04-24 02:17:50 | INFO  | It takes a moment until task 00deaedd-9e02-4768-89fb-4691b886e76a (workarounds) has been started and output is visible here. 2026-04-24 02:18:16.942421 | orchestrator | 2026-04-24 02:18:16.942555 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:18:16.942583 | orchestrator | 2026-04-24 02:18:16.942604 | orchestrator | TASK [Group hosts based on virtualization_role] ******************************** 2026-04-24 02:18:16.942624 | orchestrator | Friday 24 April 2026 02:17:55 +0000 (0:00:00.131) 0:00:00.131 ********** 2026-04-24 02:18:16.942644 | orchestrator | changed: [testbed-node-0] => (item=virtualization_role_guest) 2026-04-24 02:18:16.942656 | orchestrator | changed: [testbed-node-1] => (item=virtualization_role_guest) 2026-04-24 02:18:16.942668 | orchestrator | changed: [testbed-node-2] => (item=virtualization_role_guest) 2026-04-24 02:18:16.942679 | orchestrator | changed: [testbed-node-3] => (item=virtualization_role_guest) 2026-04-24 02:18:16.942690 | orchestrator | changed: [testbed-node-4] => (item=virtualization_role_guest) 2026-04-24 02:18:16.942701 | orchestrator | changed: [testbed-node-5] => (item=virtualization_role_guest) 2026-04-24 02:18:16.942712 | orchestrator | changed: [testbed-manager] => (item=virtualization_role_guest) 2026-04-24 02:18:16.942722 | orchestrator | 2026-04-24 02:18:16.942733 | orchestrator | PLAY [Apply netplan configuration on the manager node] ************************* 2026-04-24 02:18:16.942744 | orchestrator | 2026-04-24 02:18:16.942755 | orchestrator | TASK [Apply netplan configuration] ********************************************* 2026-04-24 02:18:16.942765 | orchestrator | Friday 24 April 2026 02:17:56 +0000 (0:00:00.824) 0:00:00.956 ********** 2026-04-24 02:18:16.942776 | orchestrator | ok: [testbed-manager] 2026-04-24 02:18:16.942811 | orchestrator | 2026-04-24 02:18:16.942823 | orchestrator | PLAY [Apply netplan configuration on all other nodes] ************************** 2026-04-24 02:18:16.942840 | orchestrator | 2026-04-24 02:18:16.942866 | orchestrator | TASK [Apply netplan configuration] ********************************************* 2026-04-24 02:18:16.942889 | orchestrator | Friday 24 April 2026 02:17:58 +0000 (0:00:02.472) 0:00:03.428 ********** 2026-04-24 02:18:16.942906 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:18:16.942924 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:18:16.942941 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:18:16.942958 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:18:16.942974 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:18:16.942991 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:18:16.943007 | orchestrator | 2026-04-24 02:18:16.943025 | orchestrator | PLAY [Add custom CA certificates to non-manager nodes] ************************* 2026-04-24 02:18:16.943043 | orchestrator | 2026-04-24 02:18:16.943062 | orchestrator | TASK [Copy custom CA certificates] ********************************************* 2026-04-24 02:18:16.943082 | orchestrator | Friday 24 April 2026 02:18:00 +0000 (0:00:01.876) 0:00:05.305 ********** 2026-04-24 02:18:16.943104 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-24 02:18:16.943153 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-24 02:18:16.943175 | orchestrator | changed: [testbed-node-4] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-24 02:18:16.943194 | orchestrator | changed: [testbed-node-3] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-24 02:18:16.943212 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-24 02:18:16.943245 | orchestrator | changed: [testbed-node-5] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-24 02:18:16.943266 | orchestrator | 2026-04-24 02:18:16.943284 | orchestrator | TASK [Run update-ca-certificates] ********************************************** 2026-04-24 02:18:16.943303 | orchestrator | Friday 24 April 2026 02:18:01 +0000 (0:00:01.520) 0:00:06.825 ********** 2026-04-24 02:18:16.943322 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:18:16.943341 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:18:16.943360 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:18:16.943371 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:18:16.943382 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:18:16.943393 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:18:16.943403 | orchestrator | 2026-04-24 02:18:16.943414 | orchestrator | TASK [Run update-ca-trust] ***************************************************** 2026-04-24 02:18:16.943425 | orchestrator | Friday 24 April 2026 02:18:05 +0000 (0:00:03.941) 0:00:10.766 ********** 2026-04-24 02:18:16.943436 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:18:16.943448 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:18:16.943458 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:18:16.943469 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:18:16.943480 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:18:16.943490 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:18:16.943501 | orchestrator | 2026-04-24 02:18:16.943512 | orchestrator | PLAY [Add a workaround service] ************************************************ 2026-04-24 02:18:16.943523 | orchestrator | 2026-04-24 02:18:16.943535 | orchestrator | TASK [Copy workarounds.sh scripts] ********************************************* 2026-04-24 02:18:16.943554 | orchestrator | Friday 24 April 2026 02:18:06 +0000 (0:00:00.699) 0:00:11.466 ********** 2026-04-24 02:18:16.943571 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:18:16.943587 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:18:16.943605 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:18:16.943626 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:18:16.943640 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:18:16.943651 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:18:16.943677 | orchestrator | changed: [testbed-manager] 2026-04-24 02:18:16.943688 | orchestrator | 2026-04-24 02:18:16.943699 | orchestrator | TASK [Copy workarounds systemd unit file] ************************************** 2026-04-24 02:18:16.943710 | orchestrator | Friday 24 April 2026 02:18:08 +0000 (0:00:01.649) 0:00:13.117 ********** 2026-04-24 02:18:16.943720 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:18:16.943731 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:18:16.943742 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:18:16.943752 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:18:16.943763 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:18:16.943774 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:18:16.943807 | orchestrator | changed: [testbed-manager] 2026-04-24 02:18:16.943819 | orchestrator | 2026-04-24 02:18:16.943829 | orchestrator | TASK [Reload systemd daemon] *************************************************** 2026-04-24 02:18:16.943841 | orchestrator | Friday 24 April 2026 02:18:09 +0000 (0:00:01.647) 0:00:14.764 ********** 2026-04-24 02:18:16.943852 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:18:16.943863 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:18:16.943874 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:18:16.943885 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:18:16.943896 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:18:16.943906 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:18:16.943917 | orchestrator | ok: [testbed-manager] 2026-04-24 02:18:16.943928 | orchestrator | 2026-04-24 02:18:16.943939 | orchestrator | TASK [Enable workarounds.service (Debian)] ************************************* 2026-04-24 02:18:16.943950 | orchestrator | Friday 24 April 2026 02:18:11 +0000 (0:00:01.605) 0:00:16.369 ********** 2026-04-24 02:18:16.943961 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:18:16.943972 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:18:16.943983 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:18:16.943994 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:18:16.944005 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:18:16.944016 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:18:16.944027 | orchestrator | changed: [testbed-manager] 2026-04-24 02:18:16.944037 | orchestrator | 2026-04-24 02:18:16.944049 | orchestrator | TASK [Enable and start workarounds.service (RedHat)] *************************** 2026-04-24 02:18:16.944060 | orchestrator | Friday 24 April 2026 02:18:13 +0000 (0:00:01.931) 0:00:18.301 ********** 2026-04-24 02:18:16.944070 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:18:16.944081 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:18:16.944092 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:18:16.944103 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:18:16.944114 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:18:16.944153 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:18:16.944165 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:18:16.944176 | orchestrator | 2026-04-24 02:18:16.944187 | orchestrator | PLAY [On Ubuntu 24.04 install python3-docker from Debian Sid] ****************** 2026-04-24 02:18:16.944198 | orchestrator | 2026-04-24 02:18:16.944209 | orchestrator | TASK [Install python3-docker] ************************************************** 2026-04-24 02:18:16.944220 | orchestrator | Friday 24 April 2026 02:18:14 +0000 (0:00:00.671) 0:00:18.972 ********** 2026-04-24 02:18:16.944231 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:18:16.944242 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:18:16.944252 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:18:16.944263 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:18:16.944289 | orchestrator | ok: [testbed-manager] 2026-04-24 02:18:16.944300 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:18:16.944311 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:18:16.944333 | orchestrator | 2026-04-24 02:18:16.944345 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:18:16.944357 | orchestrator | testbed-manager : ok=7  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:18:16.944369 | orchestrator | testbed-node-0 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:16.944388 | orchestrator | testbed-node-1 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:16.944450 | orchestrator | testbed-node-2 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:16.944463 | orchestrator | testbed-node-3 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:16.944474 | orchestrator | testbed-node-4 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:16.944485 | orchestrator | testbed-node-5 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:16.944496 | orchestrator | 2026-04-24 02:18:16.944507 | orchestrator | 2026-04-24 02:18:16.944518 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:18:16.944529 | orchestrator | Friday 24 April 2026 02:18:16 +0000 (0:00:02.834) 0:00:21.807 ********** 2026-04-24 02:18:16.944540 | orchestrator | =============================================================================== 2026-04-24 02:18:16.944551 | orchestrator | Run update-ca-certificates ---------------------------------------------- 3.94s 2026-04-24 02:18:16.944562 | orchestrator | Install python3-docker -------------------------------------------------- 2.83s 2026-04-24 02:18:16.944573 | orchestrator | Apply netplan configuration --------------------------------------------- 2.47s 2026-04-24 02:18:16.944585 | orchestrator | Enable workarounds.service (Debian) ------------------------------------- 1.93s 2026-04-24 02:18:16.944603 | orchestrator | Apply netplan configuration --------------------------------------------- 1.88s 2026-04-24 02:18:16.944622 | orchestrator | Copy workarounds.sh scripts --------------------------------------------- 1.65s 2026-04-24 02:18:16.944642 | orchestrator | Copy workarounds systemd unit file -------------------------------------- 1.65s 2026-04-24 02:18:16.944662 | orchestrator | Reload systemd daemon --------------------------------------------------- 1.61s 2026-04-24 02:18:16.944674 | orchestrator | Copy custom CA certificates --------------------------------------------- 1.52s 2026-04-24 02:18:16.944685 | orchestrator | Group hosts based on virtualization_role -------------------------------- 0.82s 2026-04-24 02:18:16.944696 | orchestrator | Run update-ca-trust ----------------------------------------------------- 0.70s 2026-04-24 02:18:16.944716 | orchestrator | Enable and start workarounds.service (RedHat) --------------------------- 0.67s 2026-04-24 02:18:17.613021 | orchestrator | + osism apply reboot -l testbed-nodes -e ireallymeanit=yes 2026-04-24 02:18:29.725709 | orchestrator | 2026-04-24 02:18:29 | INFO  | Task 2f534803-12b6-4f27-8e6e-721b5c5a5855 (reboot) was prepared for execution. 2026-04-24 02:18:29.725803 | orchestrator | 2026-04-24 02:18:29 | INFO  | It takes a moment until task 2f534803-12b6-4f27-8e6e-721b5c5a5855 (reboot) has been started and output is visible here. 2026-04-24 02:18:40.261639 | orchestrator | 2026-04-24 02:18:40.261750 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-24 02:18:40.261766 | orchestrator | 2026-04-24 02:18:40.261776 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-24 02:18:40.261787 | orchestrator | Friday 24 April 2026 02:18:34 +0000 (0:00:00.216) 0:00:00.216 ********** 2026-04-24 02:18:40.261797 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:18:40.261807 | orchestrator | 2026-04-24 02:18:40.261817 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-24 02:18:40.261827 | orchestrator | Friday 24 April 2026 02:18:34 +0000 (0:00:00.113) 0:00:00.330 ********** 2026-04-24 02:18:40.261837 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:18:40.261846 | orchestrator | 2026-04-24 02:18:40.261857 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-24 02:18:40.261938 | orchestrator | Friday 24 April 2026 02:18:35 +0000 (0:00:00.956) 0:00:01.287 ********** 2026-04-24 02:18:40.261950 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:18:40.261959 | orchestrator | 2026-04-24 02:18:40.261969 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-24 02:18:40.261979 | orchestrator | 2026-04-24 02:18:40.261988 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-24 02:18:40.261998 | orchestrator | Friday 24 April 2026 02:18:35 +0000 (0:00:00.133) 0:00:01.420 ********** 2026-04-24 02:18:40.262007 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:18:40.262071 | orchestrator | 2026-04-24 02:18:40.262083 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-24 02:18:40.262093 | orchestrator | Friday 24 April 2026 02:18:35 +0000 (0:00:00.108) 0:00:01.528 ********** 2026-04-24 02:18:40.262102 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:18:40.262112 | orchestrator | 2026-04-24 02:18:40.262122 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-24 02:18:40.262177 | orchestrator | Friday 24 April 2026 02:18:36 +0000 (0:00:00.680) 0:00:02.209 ********** 2026-04-24 02:18:40.262189 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:18:40.262200 | orchestrator | 2026-04-24 02:18:40.262211 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-24 02:18:40.262223 | orchestrator | 2026-04-24 02:18:40.262234 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-24 02:18:40.262245 | orchestrator | Friday 24 April 2026 02:18:36 +0000 (0:00:00.125) 0:00:02.335 ********** 2026-04-24 02:18:40.262256 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:18:40.262267 | orchestrator | 2026-04-24 02:18:40.262279 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-24 02:18:40.262290 | orchestrator | Friday 24 April 2026 02:18:36 +0000 (0:00:00.202) 0:00:02.538 ********** 2026-04-24 02:18:40.262301 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:18:40.262312 | orchestrator | 2026-04-24 02:18:40.262337 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-24 02:18:40.262348 | orchestrator | Friday 24 April 2026 02:18:37 +0000 (0:00:00.678) 0:00:03.216 ********** 2026-04-24 02:18:40.262359 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:18:40.262368 | orchestrator | 2026-04-24 02:18:40.262378 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-24 02:18:40.262387 | orchestrator | 2026-04-24 02:18:40.262397 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-24 02:18:40.262406 | orchestrator | Friday 24 April 2026 02:18:37 +0000 (0:00:00.133) 0:00:03.350 ********** 2026-04-24 02:18:40.262416 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:18:40.262425 | orchestrator | 2026-04-24 02:18:40.262435 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-24 02:18:40.262444 | orchestrator | Friday 24 April 2026 02:18:37 +0000 (0:00:00.119) 0:00:03.469 ********** 2026-04-24 02:18:40.262454 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:18:40.262464 | orchestrator | 2026-04-24 02:18:40.262473 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-24 02:18:40.262483 | orchestrator | Friday 24 April 2026 02:18:38 +0000 (0:00:00.700) 0:00:04.169 ********** 2026-04-24 02:18:40.262492 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:18:40.262502 | orchestrator | 2026-04-24 02:18:40.262511 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-24 02:18:40.262521 | orchestrator | 2026-04-24 02:18:40.262530 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-24 02:18:40.262540 | orchestrator | Friday 24 April 2026 02:18:38 +0000 (0:00:00.118) 0:00:04.288 ********** 2026-04-24 02:18:40.262549 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:18:40.262559 | orchestrator | 2026-04-24 02:18:40.262568 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-24 02:18:40.262588 | orchestrator | Friday 24 April 2026 02:18:38 +0000 (0:00:00.108) 0:00:04.396 ********** 2026-04-24 02:18:40.262598 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:18:40.262608 | orchestrator | 2026-04-24 02:18:40.262617 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-24 02:18:40.262627 | orchestrator | Friday 24 April 2026 02:18:38 +0000 (0:00:00.686) 0:00:05.082 ********** 2026-04-24 02:18:40.262636 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:18:40.262647 | orchestrator | 2026-04-24 02:18:40.262656 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-24 02:18:40.262665 | orchestrator | 2026-04-24 02:18:40.262675 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-24 02:18:40.262685 | orchestrator | Friday 24 April 2026 02:18:39 +0000 (0:00:00.123) 0:00:05.205 ********** 2026-04-24 02:18:40.262694 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:18:40.262704 | orchestrator | 2026-04-24 02:18:40.262713 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-24 02:18:40.262723 | orchestrator | Friday 24 April 2026 02:18:39 +0000 (0:00:00.114) 0:00:05.320 ********** 2026-04-24 02:18:40.262732 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:18:40.262742 | orchestrator | 2026-04-24 02:18:40.262752 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-24 02:18:40.262761 | orchestrator | Friday 24 April 2026 02:18:39 +0000 (0:00:00.678) 0:00:05.998 ********** 2026-04-24 02:18:40.262788 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:18:40.262798 | orchestrator | 2026-04-24 02:18:40.262808 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:18:40.262820 | orchestrator | testbed-node-0 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:40.262831 | orchestrator | testbed-node-1 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:40.262840 | orchestrator | testbed-node-2 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:40.262850 | orchestrator | testbed-node-3 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:40.262860 | orchestrator | testbed-node-4 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:40.262869 | orchestrator | testbed-node-5 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:18:40.262878 | orchestrator | 2026-04-24 02:18:40.262888 | orchestrator | 2026-04-24 02:18:40.262898 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:18:40.262907 | orchestrator | Friday 24 April 2026 02:18:39 +0000 (0:00:00.039) 0:00:06.037 ********** 2026-04-24 02:18:40.262917 | orchestrator | =============================================================================== 2026-04-24 02:18:40.262926 | orchestrator | Reboot system - do not wait for the reboot to complete ------------------ 4.38s 2026-04-24 02:18:40.262936 | orchestrator | Exit playbook, if user did not mean to reboot systems ------------------- 0.77s 2026-04-24 02:18:40.262946 | orchestrator | Reboot system - wait for the reboot to complete ------------------------- 0.67s 2026-04-24 02:18:40.577733 | orchestrator | + osism apply wait-for-connection -l testbed-nodes -e ireallymeanit=yes 2026-04-24 02:18:52.635094 | orchestrator | 2026-04-24 02:18:52 | INFO  | Task 1519c466-2c88-48f6-9419-ee4b3eb79c04 (wait-for-connection) was prepared for execution. 2026-04-24 02:18:52.635277 | orchestrator | 2026-04-24 02:18:52 | INFO  | It takes a moment until task 1519c466-2c88-48f6-9419-ee4b3eb79c04 (wait-for-connection) has been started and output is visible here. 2026-04-24 02:19:08.810986 | orchestrator | 2026-04-24 02:19:08.811104 | orchestrator | PLAY [Wait until remote systems are reachable] ********************************* 2026-04-24 02:19:08.811124 | orchestrator | 2026-04-24 02:19:08.811184 | orchestrator | TASK [Wait until remote system is reachable] *********************************** 2026-04-24 02:19:08.811199 | orchestrator | Friday 24 April 2026 02:18:56 +0000 (0:00:00.232) 0:00:00.232 ********** 2026-04-24 02:19:08.811211 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:19:08.811222 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:19:08.811233 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:19:08.811244 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:19:08.811255 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:19:08.811265 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:19:08.811276 | orchestrator | 2026-04-24 02:19:08.811287 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:19:08.811299 | orchestrator | testbed-node-0 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:19:08.811312 | orchestrator | testbed-node-1 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:19:08.811323 | orchestrator | testbed-node-2 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:19:08.811334 | orchestrator | testbed-node-3 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:19:08.811345 | orchestrator | testbed-node-4 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:19:08.811356 | orchestrator | testbed-node-5 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:19:08.811368 | orchestrator | 2026-04-24 02:19:08.811379 | orchestrator | 2026-04-24 02:19:08.811390 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:19:08.811401 | orchestrator | Friday 24 April 2026 02:19:08 +0000 (0:00:11.541) 0:00:11.773 ********** 2026-04-24 02:19:08.811412 | orchestrator | =============================================================================== 2026-04-24 02:19:08.811423 | orchestrator | Wait until remote system is reachable ---------------------------------- 11.54s 2026-04-24 02:19:09.147683 | orchestrator | + osism apply hddtemp 2026-04-24 02:19:21.237944 | orchestrator | 2026-04-24 02:19:21 | INFO  | Task 6f2989f2-35ae-4e68-87d8-7c47bc9dd16f (hddtemp) was prepared for execution. 2026-04-24 02:19:21.238132 | orchestrator | 2026-04-24 02:19:21 | INFO  | It takes a moment until task 6f2989f2-35ae-4e68-87d8-7c47bc9dd16f (hddtemp) has been started and output is visible here. 2026-04-24 02:19:49.998235 | orchestrator | 2026-04-24 02:19:49.998369 | orchestrator | PLAY [Apply role hddtemp] ****************************************************** 2026-04-24 02:19:49.998387 | orchestrator | 2026-04-24 02:19:49.998399 | orchestrator | TASK [osism.services.hddtemp : Gather variables for each operating system] ***** 2026-04-24 02:19:49.998411 | orchestrator | Friday 24 April 2026 02:19:25 +0000 (0:00:00.262) 0:00:00.262 ********** 2026-04-24 02:19:49.998423 | orchestrator | ok: [testbed-manager] 2026-04-24 02:19:49.998435 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:19:49.998446 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:19:49.998457 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:19:49.998468 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:19:49.998478 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:19:49.998489 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:19:49.998500 | orchestrator | 2026-04-24 02:19:49.998511 | orchestrator | TASK [osism.services.hddtemp : Include distribution specific install tasks] **** 2026-04-24 02:19:49.998522 | orchestrator | Friday 24 April 2026 02:19:26 +0000 (0:00:00.722) 0:00:00.985 ********** 2026-04-24 02:19:49.998536 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/hddtemp/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:19:49.998615 | orchestrator | 2026-04-24 02:19:49.998628 | orchestrator | TASK [osism.services.hddtemp : Remove hddtemp package] ************************* 2026-04-24 02:19:49.998640 | orchestrator | Friday 24 April 2026 02:19:27 +0000 (0:00:01.255) 0:00:02.240 ********** 2026-04-24 02:19:49.998652 | orchestrator | ok: [testbed-manager] 2026-04-24 02:19:49.998665 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:19:49.998677 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:19:49.998689 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:19:49.998702 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:19:49.998715 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:19:49.998727 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:19:49.998738 | orchestrator | 2026-04-24 02:19:49.998751 | orchestrator | TASK [osism.services.hddtemp : Enable Kernel Module drivetemp] ***************** 2026-04-24 02:19:49.998762 | orchestrator | Friday 24 April 2026 02:19:29 +0000 (0:00:01.922) 0:00:04.162 ********** 2026-04-24 02:19:49.998775 | orchestrator | changed: [testbed-manager] 2026-04-24 02:19:49.998788 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:19:49.998799 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:19:49.998810 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:19:49.998821 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:19:49.998831 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:19:49.998842 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:19:49.998852 | orchestrator | 2026-04-24 02:19:49.998863 | orchestrator | TASK [osism.services.hddtemp : Check if drivetemp module is available] ********* 2026-04-24 02:19:49.998874 | orchestrator | Friday 24 April 2026 02:19:30 +0000 (0:00:01.177) 0:00:05.340 ********** 2026-04-24 02:19:49.998884 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:19:49.998895 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:19:49.998905 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:19:49.998916 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:19:49.998927 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:19:49.998953 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:19:49.998964 | orchestrator | ok: [testbed-manager] 2026-04-24 02:19:49.998975 | orchestrator | 2026-04-24 02:19:49.998985 | orchestrator | TASK [osism.services.hddtemp : Load Kernel Module drivetemp] ******************* 2026-04-24 02:19:49.998996 | orchestrator | Friday 24 April 2026 02:19:31 +0000 (0:00:01.184) 0:00:06.525 ********** 2026-04-24 02:19:49.999007 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:19:49.999018 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:19:49.999029 | orchestrator | changed: [testbed-manager] 2026-04-24 02:19:49.999039 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:19:49.999050 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:19:49.999060 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:19:49.999071 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:19:49.999082 | orchestrator | 2026-04-24 02:19:49.999092 | orchestrator | TASK [osism.services.hddtemp : Install lm-sensors] ***************************** 2026-04-24 02:19:49.999103 | orchestrator | Friday 24 April 2026 02:19:32 +0000 (0:00:00.897) 0:00:07.422 ********** 2026-04-24 02:19:49.999114 | orchestrator | changed: [testbed-manager] 2026-04-24 02:19:49.999124 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:19:49.999135 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:19:49.999168 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:19:49.999182 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:19:49.999192 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:19:49.999203 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:19:49.999214 | orchestrator | 2026-04-24 02:19:49.999225 | orchestrator | TASK [osism.services.hddtemp : Include distribution specific service tasks] **** 2026-04-24 02:19:49.999236 | orchestrator | Friday 24 April 2026 02:19:45 +0000 (0:00:12.950) 0:00:20.373 ********** 2026-04-24 02:19:49.999247 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/hddtemp/tasks/service-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:19:49.999274 | orchestrator | 2026-04-24 02:19:49.999294 | orchestrator | TASK [osism.services.hddtemp : Manage lm-sensors service] ********************** 2026-04-24 02:19:49.999312 | orchestrator | Friday 24 April 2026 02:19:46 +0000 (0:00:01.250) 0:00:21.624 ********** 2026-04-24 02:19:49.999330 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:19:49.999348 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:19:49.999366 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:19:49.999384 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:19:49.999403 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:19:49.999422 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:19:49.999441 | orchestrator | changed: [testbed-manager] 2026-04-24 02:19:49.999459 | orchestrator | 2026-04-24 02:19:49.999478 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:19:49.999498 | orchestrator | testbed-manager : ok=9  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:19:49.999544 | orchestrator | testbed-node-0 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:19:49.999558 | orchestrator | testbed-node-1 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:19:49.999569 | orchestrator | testbed-node-2 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:19:49.999580 | orchestrator | testbed-node-3 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:19:49.999591 | orchestrator | testbed-node-4 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:19:49.999601 | orchestrator | testbed-node-5 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:19:49.999612 | orchestrator | 2026-04-24 02:19:49.999623 | orchestrator | 2026-04-24 02:19:49.999634 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:19:49.999645 | orchestrator | Friday 24 April 2026 02:19:49 +0000 (0:00:02.626) 0:00:24.250 ********** 2026-04-24 02:19:49.999655 | orchestrator | =============================================================================== 2026-04-24 02:19:49.999666 | orchestrator | osism.services.hddtemp : Install lm-sensors ---------------------------- 12.95s 2026-04-24 02:19:49.999677 | orchestrator | osism.services.hddtemp : Manage lm-sensors service ---------------------- 2.63s 2026-04-24 02:19:49.999688 | orchestrator | osism.services.hddtemp : Remove hddtemp package ------------------------- 1.92s 2026-04-24 02:19:49.999699 | orchestrator | osism.services.hddtemp : Include distribution specific install tasks ---- 1.26s 2026-04-24 02:19:49.999709 | orchestrator | osism.services.hddtemp : Include distribution specific service tasks ---- 1.25s 2026-04-24 02:19:49.999720 | orchestrator | osism.services.hddtemp : Check if drivetemp module is available --------- 1.18s 2026-04-24 02:19:49.999730 | orchestrator | osism.services.hddtemp : Enable Kernel Module drivetemp ----------------- 1.18s 2026-04-24 02:19:49.999741 | orchestrator | osism.services.hddtemp : Load Kernel Module drivetemp ------------------- 0.90s 2026-04-24 02:19:49.999752 | orchestrator | osism.services.hddtemp : Gather variables for each operating system ----- 0.72s 2026-04-24 02:19:50.329913 | orchestrator | ++ semver 9.5.0 7.1.1 2026-04-24 02:19:50.383270 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 02:19:50.383366 | orchestrator | + sudo systemctl restart manager.service 2026-04-24 02:20:08.479012 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-24 02:20:08.479232 | orchestrator | + wait_for_container_healthy 60 ceph-ansible 2026-04-24 02:20:08.479272 | orchestrator | + local max_attempts=60 2026-04-24 02:20:08.479286 | orchestrator | + local name=ceph-ansible 2026-04-24 02:20:08.479298 | orchestrator | + local attempt_num=1 2026-04-24 02:20:08.479309 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:08.514411 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:08.514485 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:08.514495 | orchestrator | + sleep 5 2026-04-24 02:20:13.519357 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:13.547513 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:13.547618 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:13.547645 | orchestrator | + sleep 5 2026-04-24 02:20:18.550712 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:18.582399 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:18.582491 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:18.582506 | orchestrator | + sleep 5 2026-04-24 02:20:23.585966 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:23.619238 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:23.619346 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:23.619362 | orchestrator | + sleep 5 2026-04-24 02:20:28.624774 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:28.667693 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:28.667793 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:28.667809 | orchestrator | + sleep 5 2026-04-24 02:20:33.673121 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:33.716622 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:33.716729 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:33.716744 | orchestrator | + sleep 5 2026-04-24 02:20:38.721855 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:38.758782 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:38.758887 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:38.758906 | orchestrator | + sleep 5 2026-04-24 02:20:43.764070 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:43.850392 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:43.850500 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:43.850518 | orchestrator | + sleep 5 2026-04-24 02:20:48.876122 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:48.908061 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:48.908208 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:48.908227 | orchestrator | + sleep 5 2026-04-24 02:20:53.911798 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:53.948732 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:53.948839 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:53.948854 | orchestrator | + sleep 5 2026-04-24 02:20:58.953981 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:20:58.990933 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-24 02:20:58.991049 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:20:58.991074 | orchestrator | + sleep 5 2026-04-24 02:21:03.996452 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:21:04.042776 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-24 02:21:04.042870 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:21:04.042896 | orchestrator | + sleep 5 2026-04-24 02:21:09.048406 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:21:09.090227 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-24 02:21:09.090296 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-24 02:21:09.090302 | orchestrator | + sleep 5 2026-04-24 02:21:14.094981 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-24 02:21:14.139503 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:21:14.139610 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-24 02:21:14.139627 | orchestrator | + local max_attempts=60 2026-04-24 02:21:14.139641 | orchestrator | + local name=kolla-ansible 2026-04-24 02:21:14.139652 | orchestrator | + local attempt_num=1 2026-04-24 02:21:14.139664 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-24 02:21:14.178796 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:21:14.178885 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-24 02:21:14.178930 | orchestrator | + local max_attempts=60 2026-04-24 02:21:14.178943 | orchestrator | + local name=osism-ansible 2026-04-24 02:21:14.179208 | orchestrator | + local attempt_num=1 2026-04-24 02:21:14.179473 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-24 02:21:14.219246 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-24 02:21:14.219362 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-24 02:21:14.219386 | orchestrator | + sh -c /opt/configuration/scripts/disable-ara.sh 2026-04-24 02:21:14.404271 | orchestrator | ARA in ceph-ansible already disabled. 2026-04-24 02:21:14.578268 | orchestrator | ARA in kolla-ansible already disabled. 2026-04-24 02:21:14.740711 | orchestrator | ARA in osism-ansible already disabled. 2026-04-24 02:21:14.917898 | orchestrator | ARA in osism-kubernetes already disabled. 2026-04-24 02:21:14.918531 | orchestrator | + osism apply gather-facts 2026-04-24 02:21:27.209496 | orchestrator | 2026-04-24 02:21:27 | INFO  | Task d0b179d5-d63b-4d79-8cc2-7307abd3b8de (gather-facts) was prepared for execution. 2026-04-24 02:21:27.209609 | orchestrator | 2026-04-24 02:21:27 | INFO  | It takes a moment until task d0b179d5-d63b-4d79-8cc2-7307abd3b8de (gather-facts) has been started and output is visible here. 2026-04-24 02:21:41.026911 | orchestrator | 2026-04-24 02:21:41.027007 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-24 02:21:41.027018 | orchestrator | 2026-04-24 02:21:41.027026 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 02:21:41.027034 | orchestrator | Friday 24 April 2026 02:21:31 +0000 (0:00:00.222) 0:00:00.222 ********** 2026-04-24 02:21:41.027042 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:21:41.027050 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:21:41.027057 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:21:41.027064 | orchestrator | ok: [testbed-manager] 2026-04-24 02:21:41.027071 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:21:41.027078 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:21:41.027085 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:21:41.027091 | orchestrator | 2026-04-24 02:21:41.027098 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-24 02:21:41.027105 | orchestrator | 2026-04-24 02:21:41.027112 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-24 02:21:41.027119 | orchestrator | Friday 24 April 2026 02:21:40 +0000 (0:00:08.540) 0:00:08.763 ********** 2026-04-24 02:21:41.027126 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:21:41.027133 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:21:41.027140 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:21:41.027147 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:21:41.027154 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:21:41.027160 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:21:41.027168 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:21:41.027263 | orchestrator | 2026-04-24 02:21:41.027276 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:21:41.027284 | orchestrator | testbed-manager : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:21:41.027292 | orchestrator | testbed-node-0 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:21:41.027299 | orchestrator | testbed-node-1 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:21:41.027306 | orchestrator | testbed-node-2 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:21:41.027313 | orchestrator | testbed-node-3 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:21:41.027320 | orchestrator | testbed-node-4 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:21:41.027327 | orchestrator | testbed-node-5 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 02:21:41.027366 | orchestrator | 2026-04-24 02:21:41.027382 | orchestrator | 2026-04-24 02:21:41.027389 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:21:41.027396 | orchestrator | Friday 24 April 2026 02:21:40 +0000 (0:00:00.560) 0:00:09.324 ********** 2026-04-24 02:21:41.027402 | orchestrator | =============================================================================== 2026-04-24 02:21:41.027409 | orchestrator | Gathers facts about hosts ----------------------------------------------- 8.54s 2026-04-24 02:21:41.027416 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.56s 2026-04-24 02:21:41.378650 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/001-helpers.sh /usr/local/bin/deploy-helper 2026-04-24 02:21:41.396229 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/100-ceph-with-ansible.sh /usr/local/bin/deploy-ceph-with-ansible 2026-04-24 02:21:41.415032 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/100-ceph-with-rook.sh /usr/local/bin/deploy-ceph-with-rook 2026-04-24 02:21:41.431709 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/200-infrastructure.sh /usr/local/bin/deploy-infrastructure 2026-04-24 02:21:41.452767 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/300-openstack.sh /usr/local/bin/deploy-openstack 2026-04-24 02:21:41.470240 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/320-openstack-minimal.sh /usr/local/bin/deploy-openstack-minimal 2026-04-24 02:21:41.490647 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/400-monitoring.sh /usr/local/bin/deploy-monitoring 2026-04-24 02:21:41.508427 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/500-kubernetes.sh /usr/local/bin/deploy-kubernetes 2026-04-24 02:21:41.529837 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/510-clusterapi.sh /usr/local/bin/deploy-kubernetes-clusterapi 2026-04-24 02:21:41.548001 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade-manager.sh /usr/local/bin/upgrade-manager 2026-04-24 02:21:41.573266 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/100-ceph-with-ansible.sh /usr/local/bin/upgrade-ceph-with-ansible 2026-04-24 02:21:41.594331 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/100-ceph-with-rook.sh /usr/local/bin/upgrade-ceph-with-rook 2026-04-24 02:21:41.615724 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/200-infrastructure.sh /usr/local/bin/upgrade-infrastructure 2026-04-24 02:21:41.632569 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/300-openstack.sh /usr/local/bin/upgrade-openstack 2026-04-24 02:21:41.646910 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/320-openstack-minimal.sh /usr/local/bin/upgrade-openstack-minimal 2026-04-24 02:21:41.664834 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/400-monitoring.sh /usr/local/bin/upgrade-monitoring 2026-04-24 02:21:41.676165 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/500-kubernetes.sh /usr/local/bin/upgrade-kubernetes 2026-04-24 02:21:41.687266 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/510-clusterapi.sh /usr/local/bin/upgrade-kubernetes-clusterapi 2026-04-24 02:21:41.698479 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/300-openstack.sh /usr/local/bin/bootstrap-openstack 2026-04-24 02:21:41.719764 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/301-openstack-octavia-amphora-image.sh /usr/local/bin/bootstrap-octavia 2026-04-24 02:21:41.741354 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/302-openstack-k8s-clusterapi-images.sh /usr/local/bin/bootstrap-clusterapi 2026-04-24 02:21:41.762623 | orchestrator | + sudo ln -sf /opt/configuration/scripts/disable-local-registry.sh /usr/local/bin/disable-local-registry 2026-04-24 02:21:41.779550 | orchestrator | + sudo ln -sf /opt/configuration/scripts/pull-images.sh /usr/local/bin/pull-images 2026-04-24 02:21:41.796855 | orchestrator | + [[ false == \t\r\u\e ]] 2026-04-24 02:21:42.124677 | orchestrator | ok: Runtime: 0:24:36.534960 2026-04-24 02:21:42.240886 | 2026-04-24 02:21:42.241037 | TASK [Deploy services] 2026-04-24 02:21:42.944931 | orchestrator | 2026-04-24 02:21:42.945104 | orchestrator | # DEPLOY SERVICES 2026-04-24 02:21:42.945128 | orchestrator | 2026-04-24 02:21:42.945147 | orchestrator | + set -e 2026-04-24 02:21:42.945165 | orchestrator | + echo 2026-04-24 02:21:42.945250 | orchestrator | + echo '# DEPLOY SERVICES' 2026-04-24 02:21:42.945276 | orchestrator | + echo 2026-04-24 02:21:42.945338 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 02:21:42.945373 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 02:21:42.945398 | orchestrator | ++ INTERACTIVE=false 2026-04-24 02:21:42.945419 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 02:21:42.945453 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 02:21:42.945466 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 02:21:42.945481 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 02:21:42.945493 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 02:21:42.945510 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 02:21:42.945521 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 02:21:42.945536 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 02:21:42.945548 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 02:21:42.945562 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 02:21:42.945573 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 02:21:42.945583 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 02:21:42.945595 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 02:21:42.945606 | orchestrator | ++ export ARA=false 2026-04-24 02:21:42.945617 | orchestrator | ++ ARA=false 2026-04-24 02:21:42.945627 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 02:21:42.945638 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 02:21:42.945648 | orchestrator | ++ export TEMPEST=false 2026-04-24 02:21:42.945659 | orchestrator | ++ TEMPEST=false 2026-04-24 02:21:42.945669 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 02:21:42.945680 | orchestrator | ++ IS_ZUUL=true 2026-04-24 02:21:42.945691 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 02:21:42.945702 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 02:21:42.945713 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 02:21:42.945724 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 02:21:42.945734 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 02:21:42.945745 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 02:21:42.945755 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 02:21:42.945766 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 02:21:42.945777 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 02:21:42.945795 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 02:21:42.945806 | orchestrator | + sh -c /opt/configuration/scripts/pull-images.sh 2026-04-24 02:21:42.956459 | orchestrator | + set -e 2026-04-24 02:21:42.956525 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 02:21:42.956533 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 02:21:42.958138 | orchestrator | 2026-04-24 02:21:42.958153 | orchestrator | # PULL IMAGES 2026-04-24 02:21:42.958159 | orchestrator | 2026-04-24 02:21:42.958164 | orchestrator | ++ INTERACTIVE=false 2026-04-24 02:21:42.958168 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 02:21:42.958172 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 02:21:42.958189 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 02:21:42.958193 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 02:21:42.958197 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 02:21:42.958201 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 02:21:42.958205 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 02:21:42.958209 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 02:21:42.958213 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 02:21:42.958216 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 02:21:42.958220 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 02:21:42.958224 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 02:21:42.958228 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 02:21:42.958232 | orchestrator | ++ export ARA=false 2026-04-24 02:21:42.958236 | orchestrator | ++ ARA=false 2026-04-24 02:21:42.958242 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 02:21:42.958246 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 02:21:42.958250 | orchestrator | ++ export TEMPEST=false 2026-04-24 02:21:42.958254 | orchestrator | ++ TEMPEST=false 2026-04-24 02:21:42.958258 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 02:21:42.958261 | orchestrator | ++ IS_ZUUL=true 2026-04-24 02:21:42.958265 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 02:21:42.958269 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 02:21:42.958273 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 02:21:42.958276 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 02:21:42.958280 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 02:21:42.958284 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 02:21:42.958305 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 02:21:42.958309 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 02:21:42.958313 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 02:21:42.958317 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 02:21:42.958321 | orchestrator | + echo 2026-04-24 02:21:42.958324 | orchestrator | + echo '# PULL IMAGES' 2026-04-24 02:21:42.958328 | orchestrator | + echo 2026-04-24 02:21:42.958784 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-24 02:21:43.022606 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 02:21:43.022691 | orchestrator | + osism apply --no-wait -r 2 -e custom pull-images 2026-04-24 02:21:44.940837 | orchestrator | 2026-04-24 02:21:44 | INFO  | Trying to run play pull-images in environment custom 2026-04-24 02:21:55.083947 | orchestrator | 2026-04-24 02:21:55 | INFO  | Task ed9ce1a1-b291-4353-bff1-e7ea772fcf31 (pull-images) was prepared for execution. 2026-04-24 02:21:55.084104 | orchestrator | 2026-04-24 02:21:55 | INFO  | Task ed9ce1a1-b291-4353-bff1-e7ea772fcf31 is running in background. No more output. Check ARA for logs. 2026-04-24 02:21:55.418836 | orchestrator | + sh -c /opt/configuration/scripts/deploy/001-helpers.sh 2026-04-24 02:22:07.510471 | orchestrator | 2026-04-24 02:22:07 | INFO  | Task 644e50d3-8e9d-4c7c-b6f2-670410f9dfa1 (cgit) was prepared for execution. 2026-04-24 02:22:07.510604 | orchestrator | 2026-04-24 02:22:07 | INFO  | Task 644e50d3-8e9d-4c7c-b6f2-670410f9dfa1 is running in background. No more output. Check ARA for logs. 2026-04-24 02:22:20.112128 | orchestrator | 2026-04-24 02:22:20 | INFO  | Task 1f274312-a583-49a6-8880-ba404c35cf88 (dotfiles) was prepared for execution. 2026-04-24 02:22:20.112348 | orchestrator | 2026-04-24 02:22:20 | INFO  | Task 1f274312-a583-49a6-8880-ba404c35cf88 is running in background. No more output. Check ARA for logs. 2026-04-24 02:22:32.770300 | orchestrator | 2026-04-24 02:22:32 | INFO  | Task b16a4101-7742-4990-9e6f-00902828dd6e (homer) was prepared for execution. 2026-04-24 02:22:32.770384 | orchestrator | 2026-04-24 02:22:32 | INFO  | Task b16a4101-7742-4990-9e6f-00902828dd6e is running in background. No more output. Check ARA for logs. 2026-04-24 02:22:45.309364 | orchestrator | 2026-04-24 02:22:45 | INFO  | Task 6cbcb53d-85a0-4122-bd52-da9054edd832 (phpmyadmin) was prepared for execution. 2026-04-24 02:22:45.309480 | orchestrator | 2026-04-24 02:22:45 | INFO  | Task 6cbcb53d-85a0-4122-bd52-da9054edd832 is running in background. No more output. Check ARA for logs. 2026-04-24 02:22:57.644953 | orchestrator | 2026-04-24 02:22:57 | INFO  | Task b86e85d5-9f86-4e9f-852c-95a8f8260082 (sosreport) was prepared for execution. 2026-04-24 02:22:57.645079 | orchestrator | 2026-04-24 02:22:57 | INFO  | Task b86e85d5-9f86-4e9f-852c-95a8f8260082 is running in background. No more output. Check ARA for logs. 2026-04-24 02:22:57.959851 | orchestrator | + sh -c /opt/configuration/scripts/deploy/500-kubernetes.sh 2026-04-24 02:22:57.971912 | orchestrator | + set -e 2026-04-24 02:22:57.972055 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 02:22:57.972081 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 02:22:57.972101 | orchestrator | ++ INTERACTIVE=false 2026-04-24 02:22:57.972122 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 02:22:57.972142 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 02:22:57.972162 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 02:22:57.972180 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 02:22:57.972226 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 02:22:57.972245 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 02:22:57.972264 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 02:22:57.972284 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 02:22:57.972303 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 02:22:57.972321 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 02:22:57.972333 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 02:22:57.972344 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 02:22:57.972355 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 02:22:57.972366 | orchestrator | ++ export ARA=false 2026-04-24 02:22:57.972377 | orchestrator | ++ ARA=false 2026-04-24 02:22:57.972388 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 02:22:57.972428 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 02:22:57.972439 | orchestrator | ++ export TEMPEST=false 2026-04-24 02:22:57.972450 | orchestrator | ++ TEMPEST=false 2026-04-24 02:22:57.972461 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 02:22:57.972471 | orchestrator | ++ IS_ZUUL=true 2026-04-24 02:22:57.972496 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 02:22:57.972516 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 02:22:57.972528 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 02:22:57.972541 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 02:22:57.972553 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 02:22:57.972565 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 02:22:57.972577 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 02:22:57.972589 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 02:22:57.972601 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 02:22:57.972613 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 02:22:57.973298 | orchestrator | ++ semver 9.5.0 8.0.3 2026-04-24 02:22:58.049781 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 02:22:58.049897 | orchestrator | + osism apply frr 2026-04-24 02:23:10.332250 | orchestrator | 2026-04-24 02:23:10 | INFO  | Task 8cf46cd2-a0fa-4f0d-9704-5c6ff30e75c0 (frr) was prepared for execution. 2026-04-24 02:23:10.332351 | orchestrator | 2026-04-24 02:23:10 | INFO  | It takes a moment until task 8cf46cd2-a0fa-4f0d-9704-5c6ff30e75c0 (frr) has been started and output is visible here. 2026-04-24 02:23:46.526837 | orchestrator | 2026-04-24 02:23:46.526980 | orchestrator | PLAY [Apply role frr] ********************************************************** 2026-04-24 02:23:46.527006 | orchestrator | 2026-04-24 02:23:46.527025 | orchestrator | TASK [osism.services.frr : Include distribution specific install tasks] ******** 2026-04-24 02:23:46.527053 | orchestrator | Friday 24 April 2026 02:23:18 +0000 (0:00:00.270) 0:00:00.270 ********** 2026-04-24 02:23:46.527071 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/frr/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 02:23:46.527091 | orchestrator | 2026-04-24 02:23:46.527109 | orchestrator | TASK [osism.services.frr : Pin frr package version] **************************** 2026-04-24 02:23:46.527127 | orchestrator | Friday 24 April 2026 02:23:18 +0000 (0:00:00.384) 0:00:00.654 ********** 2026-04-24 02:23:46.527144 | orchestrator | changed: [testbed-manager] 2026-04-24 02:23:46.527163 | orchestrator | 2026-04-24 02:23:46.527181 | orchestrator | TASK [osism.services.frr : Install frr package] ******************************** 2026-04-24 02:23:46.527202 | orchestrator | Friday 24 April 2026 02:23:20 +0000 (0:00:02.234) 0:00:02.889 ********** 2026-04-24 02:23:46.527338 | orchestrator | changed: [testbed-manager] 2026-04-24 02:23:46.527358 | orchestrator | 2026-04-24 02:23:46.527375 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/vtysh.conf] ********************* 2026-04-24 02:23:46.527395 | orchestrator | Friday 24 April 2026 02:23:32 +0000 (0:00:12.007) 0:00:14.897 ********** 2026-04-24 02:23:46.527414 | orchestrator | ok: [testbed-manager] 2026-04-24 02:23:46.527433 | orchestrator | 2026-04-24 02:23:46.527453 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/daemons] ************************ 2026-04-24 02:23:46.527472 | orchestrator | Friday 24 April 2026 02:23:34 +0000 (0:00:01.541) 0:00:16.438 ********** 2026-04-24 02:23:46.527491 | orchestrator | changed: [testbed-manager] 2026-04-24 02:23:46.527510 | orchestrator | 2026-04-24 02:23:46.527529 | orchestrator | TASK [osism.services.frr : Set _frr_uplinks fact] ****************************** 2026-04-24 02:23:46.527549 | orchestrator | Friday 24 April 2026 02:23:35 +0000 (0:00:01.426) 0:00:17.865 ********** 2026-04-24 02:23:46.527568 | orchestrator | ok: [testbed-manager] 2026-04-24 02:23:46.527588 | orchestrator | 2026-04-24 02:23:46.527607 | orchestrator | TASK [osism.services.frr : Check for frr.conf file in the configuration repository] *** 2026-04-24 02:23:46.527628 | orchestrator | Friday 24 April 2026 02:23:37 +0000 (0:00:01.449) 0:00:19.314 ********** 2026-04-24 02:23:46.527645 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:23:46.527664 | orchestrator | 2026-04-24 02:23:46.527683 | orchestrator | TASK [osism.services.frr : Copy frr.conf file from the configuration repository] *** 2026-04-24 02:23:46.527702 | orchestrator | Friday 24 April 2026 02:23:37 +0000 (0:00:00.297) 0:00:19.612 ********** 2026-04-24 02:23:46.527753 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:23:46.527774 | orchestrator | 2026-04-24 02:23:46.527792 | orchestrator | TASK [osism.services.frr : Copy default frr.conf file of type k3s_cilium] ****** 2026-04-24 02:23:46.527810 | orchestrator | Friday 24 April 2026 02:23:37 +0000 (0:00:00.177) 0:00:19.789 ********** 2026-04-24 02:23:46.527828 | orchestrator | changed: [testbed-manager] 2026-04-24 02:23:46.527847 | orchestrator | 2026-04-24 02:23:46.527863 | orchestrator | TASK [osism.services.frr : Set sysctl parameters] ****************************** 2026-04-24 02:23:46.527881 | orchestrator | Friday 24 April 2026 02:23:38 +0000 (0:00:01.085) 0:00:20.875 ********** 2026-04-24 02:23:46.527898 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-04-24 02:23:46.527916 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.send_redirects', 'value': 0}) 2026-04-24 02:23:46.527937 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.accept_redirects', 'value': 0}) 2026-04-24 02:23:46.527954 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.fib_multipath_hash_policy', 'value': 1}) 2026-04-24 02:23:46.527972 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.default.ignore_routes_with_linkdown', 'value': 1}) 2026-04-24 02:23:46.527991 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 2}) 2026-04-24 02:23:46.528009 | orchestrator | 2026-04-24 02:23:46.528027 | orchestrator | TASK [osism.services.frr : Manage frr service] ********************************* 2026-04-24 02:23:46.528046 | orchestrator | Friday 24 April 2026 02:23:42 +0000 (0:00:03.985) 0:00:24.860 ********** 2026-04-24 02:23:46.528064 | orchestrator | ok: [testbed-manager] 2026-04-24 02:23:46.528081 | orchestrator | 2026-04-24 02:23:46.528100 | orchestrator | RUNNING HANDLER [osism.services.frr : Restart frr service] ********************* 2026-04-24 02:23:46.528119 | orchestrator | Friday 24 April 2026 02:23:44 +0000 (0:00:01.818) 0:00:26.679 ********** 2026-04-24 02:23:46.528136 | orchestrator | changed: [testbed-manager] 2026-04-24 02:23:46.528154 | orchestrator | 2026-04-24 02:23:46.528173 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:23:46.528192 | orchestrator | testbed-manager : ok=10  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:23:46.528238 | orchestrator | 2026-04-24 02:23:46.528257 | orchestrator | 2026-04-24 02:23:46.528290 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:23:46.528310 | orchestrator | Friday 24 April 2026 02:23:46 +0000 (0:00:01.447) 0:00:28.127 ********** 2026-04-24 02:23:46.528323 | orchestrator | =============================================================================== 2026-04-24 02:23:46.528333 | orchestrator | osism.services.frr : Install frr package ------------------------------- 12.01s 2026-04-24 02:23:46.528342 | orchestrator | osism.services.frr : Set sysctl parameters ------------------------------ 3.99s 2026-04-24 02:23:46.528352 | orchestrator | osism.services.frr : Pin frr package version ---------------------------- 2.23s 2026-04-24 02:23:46.528364 | orchestrator | osism.services.frr : Manage frr service --------------------------------- 1.82s 2026-04-24 02:23:46.528380 | orchestrator | osism.services.frr : Copy file: /etc/frr/vtysh.conf --------------------- 1.54s 2026-04-24 02:23:46.528424 | orchestrator | osism.services.frr : Set _frr_uplinks fact ------------------------------ 1.45s 2026-04-24 02:23:46.528442 | orchestrator | osism.services.frr : Restart frr service -------------------------------- 1.45s 2026-04-24 02:23:46.528458 | orchestrator | osism.services.frr : Copy file: /etc/frr/daemons ------------------------ 1.43s 2026-04-24 02:23:46.528474 | orchestrator | osism.services.frr : Copy default frr.conf file of type k3s_cilium ------ 1.09s 2026-04-24 02:23:46.528490 | orchestrator | osism.services.frr : Include distribution specific install tasks -------- 0.38s 2026-04-24 02:23:46.528508 | orchestrator | osism.services.frr : Check for frr.conf file in the configuration repository --- 0.30s 2026-04-24 02:23:46.528524 | orchestrator | osism.services.frr : Copy frr.conf file from the configuration repository --- 0.18s 2026-04-24 02:23:46.847510 | orchestrator | + osism apply kubernetes 2026-04-24 02:23:48.895804 | orchestrator | 2026-04-24 02:23:48 | INFO  | Task d3b7a23a-5fed-4cf4-b08d-2ae681241c25 (kubernetes) was prepared for execution. 2026-04-24 02:23:48.895897 | orchestrator | 2026-04-24 02:23:48 | INFO  | It takes a moment until task d3b7a23a-5fed-4cf4-b08d-2ae681241c25 (kubernetes) has been started and output is visible here. 2026-04-24 02:24:13.287108 | orchestrator | 2026-04-24 02:24:13.287265 | orchestrator | PLAY [Prepare all k3s nodes] *************************************************** 2026-04-24 02:24:13.287284 | orchestrator | 2026-04-24 02:24:13.287297 | orchestrator | TASK [k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites] *** 2026-04-24 02:24:13.287309 | orchestrator | Friday 24 April 2026 02:23:53 +0000 (0:00:00.160) 0:00:00.160 ********** 2026-04-24 02:24:13.287320 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:24:13.287332 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:24:13.287344 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:24:13.287355 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:24:13.287366 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:24:13.287377 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:24:13.287388 | orchestrator | 2026-04-24 02:24:13.287399 | orchestrator | TASK [k3s_prereq : Set same timezone on every Server] ************************** 2026-04-24 02:24:13.287410 | orchestrator | Friday 24 April 2026 02:23:54 +0000 (0:00:00.675) 0:00:00.836 ********** 2026-04-24 02:24:13.287421 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.287432 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.287443 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.287454 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.287465 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.287475 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.287486 | orchestrator | 2026-04-24 02:24:13.287497 | orchestrator | TASK [k3s_prereq : Set SELinux to disabled state] ****************************** 2026-04-24 02:24:13.287510 | orchestrator | Friday 24 April 2026 02:23:54 +0000 (0:00:00.612) 0:00:01.449 ********** 2026-04-24 02:24:13.287520 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.287531 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.287542 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.287552 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.287563 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.287573 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.287584 | orchestrator | 2026-04-24 02:24:13.287595 | orchestrator | TASK [k3s_prereq : Enable IPv4 forwarding] ************************************* 2026-04-24 02:24:13.287606 | orchestrator | Friday 24 April 2026 02:23:55 +0000 (0:00:00.906) 0:00:02.355 ********** 2026-04-24 02:24:13.287616 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:24:13.287627 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:24:13.287638 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:24:13.287653 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:24:13.287664 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:24:13.287675 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:24:13.287685 | orchestrator | 2026-04-24 02:24:13.287696 | orchestrator | TASK [k3s_prereq : Enable IPv6 forwarding] ************************************* 2026-04-24 02:24:13.287708 | orchestrator | Friday 24 April 2026 02:23:57 +0000 (0:00:01.855) 0:00:04.211 ********** 2026-04-24 02:24:13.287718 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:24:13.287729 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:24:13.287740 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:24:13.287750 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:24:13.287761 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:24:13.287771 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:24:13.287782 | orchestrator | 2026-04-24 02:24:13.287793 | orchestrator | TASK [k3s_prereq : Enable IPv6 router advertisements] ************************** 2026-04-24 02:24:13.287804 | orchestrator | Friday 24 April 2026 02:23:58 +0000 (0:00:01.263) 0:00:05.474 ********** 2026-04-24 02:24:13.287814 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:24:13.287848 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:24:13.287860 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:24:13.287870 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:24:13.287881 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:24:13.287891 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:24:13.287902 | orchestrator | 2026-04-24 02:24:13.287921 | orchestrator | TASK [k3s_prereq : Add br_netfilter to /etc/modules-load.d/] ******************* 2026-04-24 02:24:13.287932 | orchestrator | Friday 24 April 2026 02:23:59 +0000 (0:00:01.072) 0:00:06.547 ********** 2026-04-24 02:24:13.287943 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.287954 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.287964 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.287975 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.287985 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.287996 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.288007 | orchestrator | 2026-04-24 02:24:13.288017 | orchestrator | TASK [k3s_prereq : Load br_netfilter] ****************************************** 2026-04-24 02:24:13.288028 | orchestrator | Friday 24 April 2026 02:24:00 +0000 (0:00:00.653) 0:00:07.200 ********** 2026-04-24 02:24:13.288039 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.288049 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.288060 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.288070 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.288081 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.288092 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.288102 | orchestrator | 2026-04-24 02:24:13.288113 | orchestrator | TASK [k3s_prereq : Set bridge-nf-call-iptables (just to be sure)] ************** 2026-04-24 02:24:13.288124 | orchestrator | Friday 24 April 2026 02:24:01 +0000 (0:00:00.851) 0:00:08.052 ********** 2026-04-24 02:24:13.288134 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 02:24:13.288145 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 02:24:13.288156 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.288166 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 02:24:13.288177 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 02:24:13.288188 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.288198 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 02:24:13.288209 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 02:24:13.288242 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.288253 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 02:24:13.288281 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 02:24:13.288293 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.288304 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 02:24:13.288314 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 02:24:13.288325 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.288336 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 02:24:13.288346 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 02:24:13.288357 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.288368 | orchestrator | 2026-04-24 02:24:13.288379 | orchestrator | TASK [k3s_prereq : Add /usr/local/bin to sudo secure_path] ********************* 2026-04-24 02:24:13.288389 | orchestrator | Friday 24 April 2026 02:24:01 +0000 (0:00:00.582) 0:00:08.634 ********** 2026-04-24 02:24:13.288400 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.288411 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.288421 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.288440 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.288452 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.288462 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.288473 | orchestrator | 2026-04-24 02:24:13.288483 | orchestrator | TASK [k3s_download : Validating arguments against arg spec 'main' - Manage the downloading of K3S binaries] *** 2026-04-24 02:24:13.288496 | orchestrator | Friday 24 April 2026 02:24:03 +0000 (0:00:01.162) 0:00:09.797 ********** 2026-04-24 02:24:13.288507 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:24:13.288517 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:24:13.288528 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:24:13.288538 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:24:13.288549 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:24:13.288560 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:24:13.288570 | orchestrator | 2026-04-24 02:24:13.288581 | orchestrator | TASK [k3s_download : Download k3s binary x64] ********************************** 2026-04-24 02:24:13.288592 | orchestrator | Friday 24 April 2026 02:24:04 +0000 (0:00:00.957) 0:00:10.754 ********** 2026-04-24 02:24:13.288602 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:24:13.288613 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:24:13.288624 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:24:13.288634 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:24:13.288645 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:24:13.288655 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:24:13.288666 | orchestrator | 2026-04-24 02:24:13.288677 | orchestrator | TASK [k3s_download : Download k3s binary arm64] ******************************** 2026-04-24 02:24:13.288687 | orchestrator | Friday 24 April 2026 02:24:09 +0000 (0:00:05.568) 0:00:16.323 ********** 2026-04-24 02:24:13.288698 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.288714 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.288725 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.288736 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.288747 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.288757 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.288768 | orchestrator | 2026-04-24 02:24:13.288779 | orchestrator | TASK [k3s_download : Download k3s binary armhf] ******************************** 2026-04-24 02:24:13.288789 | orchestrator | Friday 24 April 2026 02:24:10 +0000 (0:00:00.976) 0:00:17.300 ********** 2026-04-24 02:24:13.288800 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.288811 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.288821 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.288832 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.288842 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.288853 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.288863 | orchestrator | 2026-04-24 02:24:13.288874 | orchestrator | TASK [k3s_custom_registries : Validating arguments against arg spec 'main' - Configure the use of a custom container registry] *** 2026-04-24 02:24:13.288886 | orchestrator | Friday 24 April 2026 02:24:11 +0000 (0:00:01.256) 0:00:18.556 ********** 2026-04-24 02:24:13.288897 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.288908 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.288919 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.288929 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.288940 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.288950 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.288961 | orchestrator | 2026-04-24 02:24:13.288971 | orchestrator | TASK [k3s_custom_registries : Create directory /etc/rancher/k3s] *************** 2026-04-24 02:24:13.288982 | orchestrator | Friday 24 April 2026 02:24:12 +0000 (0:00:00.585) 0:00:19.142 ********** 2026-04-24 02:24:13.288993 | orchestrator | skipping: [testbed-node-3] => (item=rancher)  2026-04-24 02:24:13.289011 | orchestrator | skipping: [testbed-node-3] => (item=rancher/k3s)  2026-04-24 02:24:13.289022 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:24:13.289033 | orchestrator | skipping: [testbed-node-4] => (item=rancher)  2026-04-24 02:24:13.289051 | orchestrator | skipping: [testbed-node-4] => (item=rancher/k3s)  2026-04-24 02:24:13.289062 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:24:13.289072 | orchestrator | skipping: [testbed-node-5] => (item=rancher)  2026-04-24 02:24:13.289083 | orchestrator | skipping: [testbed-node-5] => (item=rancher/k3s)  2026-04-24 02:24:13.289094 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:24:13.289104 | orchestrator | skipping: [testbed-node-0] => (item=rancher)  2026-04-24 02:24:13.289115 | orchestrator | skipping: [testbed-node-0] => (item=rancher/k3s)  2026-04-24 02:24:13.289125 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:24:13.289136 | orchestrator | skipping: [testbed-node-1] => (item=rancher)  2026-04-24 02:24:13.289146 | orchestrator | skipping: [testbed-node-1] => (item=rancher/k3s)  2026-04-24 02:24:13.289157 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:24:13.289168 | orchestrator | skipping: [testbed-node-2] => (item=rancher)  2026-04-24 02:24:13.289178 | orchestrator | skipping: [testbed-node-2] => (item=rancher/k3s)  2026-04-24 02:24:13.289189 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:24:13.289200 | orchestrator | 2026-04-24 02:24:13.289210 | orchestrator | TASK [k3s_custom_registries : Insert registries into /etc/rancher/k3s/registries.yaml] *** 2026-04-24 02:24:13.289279 | orchestrator | Friday 24 April 2026 02:24:13 +0000 (0:00:00.803) 0:00:19.945 ********** 2026-04-24 02:25:28.360977 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:25:28.361089 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:25:28.361103 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:25:28.361115 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:25:28.361126 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.361137 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.361149 | orchestrator | 2026-04-24 02:25:28.361162 | orchestrator | TASK [k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured] *** 2026-04-24 02:25:28.361174 | orchestrator | Friday 24 April 2026 02:24:13 +0000 (0:00:00.592) 0:00:20.537 ********** 2026-04-24 02:25:28.361185 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:25:28.361196 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:25:28.361207 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:25:28.361217 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:25:28.361258 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.361271 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.361282 | orchestrator | 2026-04-24 02:25:28.361293 | orchestrator | PLAY [Deploy k3s master nodes] ************************************************* 2026-04-24 02:25:28.361304 | orchestrator | 2026-04-24 02:25:28.361315 | orchestrator | TASK [k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers] *** 2026-04-24 02:25:28.361327 | orchestrator | Friday 24 April 2026 02:24:15 +0000 (0:00:01.147) 0:00:21.685 ********** 2026-04-24 02:25:28.361337 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:25:28.361349 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:25:28.361360 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:25:28.361371 | orchestrator | 2026-04-24 02:25:28.361382 | orchestrator | TASK [k3s_server : Stop k3s-init] ********************************************** 2026-04-24 02:25:28.361392 | orchestrator | Friday 24 April 2026 02:24:16 +0000 (0:00:01.415) 0:00:23.101 ********** 2026-04-24 02:25:28.361403 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:25:28.361414 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:25:28.361432 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:25:28.361450 | orchestrator | 2026-04-24 02:25:28.361469 | orchestrator | TASK [k3s_server : Stop k3s] *************************************************** 2026-04-24 02:25:28.361488 | orchestrator | Friday 24 April 2026 02:24:17 +0000 (0:00:01.258) 0:00:24.360 ********** 2026-04-24 02:25:28.361506 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:25:28.361525 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:25:28.361543 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:25:28.361562 | orchestrator | 2026-04-24 02:25:28.361582 | orchestrator | TASK [k3s_server : Clean previous runs of k3s-init] **************************** 2026-04-24 02:25:28.361692 | orchestrator | Friday 24 April 2026 02:24:18 +0000 (0:00:00.886) 0:00:25.246 ********** 2026-04-24 02:25:28.361717 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:25:28.361740 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:25:28.361761 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:25:28.361775 | orchestrator | 2026-04-24 02:25:28.361788 | orchestrator | TASK [k3s_server : Deploy K3s http_proxy conf] ********************************* 2026-04-24 02:25:28.361801 | orchestrator | Friday 24 April 2026 02:24:20 +0000 (0:00:01.805) 0:00:27.051 ********** 2026-04-24 02:25:28.361813 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:25:28.361825 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.361838 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.361850 | orchestrator | 2026-04-24 02:25:28.361862 | orchestrator | TASK [k3s_server : Create /etc/rancher/k3s directory] ************************** 2026-04-24 02:25:28.361890 | orchestrator | Friday 24 April 2026 02:24:20 +0000 (0:00:00.395) 0:00:27.447 ********** 2026-04-24 02:25:28.361902 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:25:28.361912 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:25:28.361923 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:25:28.361934 | orchestrator | 2026-04-24 02:25:28.361944 | orchestrator | TASK [k3s_server : Create custom resolv.conf for k3s] ************************** 2026-04-24 02:25:28.361955 | orchestrator | Friday 24 April 2026 02:24:21 +0000 (0:00:01.126) 0:00:28.573 ********** 2026-04-24 02:25:28.361965 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:25:28.361976 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:25:28.361986 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:25:28.361997 | orchestrator | 2026-04-24 02:25:28.362007 | orchestrator | TASK [k3s_server : Deploy vip manifest] **************************************** 2026-04-24 02:25:28.362080 | orchestrator | Friday 24 April 2026 02:24:23 +0000 (0:00:01.441) 0:00:30.014 ********** 2026-04-24 02:25:28.362093 | orchestrator | included: /ansible/roles/k3s_server/tasks/vip.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:25:28.362105 | orchestrator | 2026-04-24 02:25:28.362116 | orchestrator | TASK [k3s_server : Set _kube_vip_bgp_peers fact] ******************************* 2026-04-24 02:25:28.362127 | orchestrator | Friday 24 April 2026 02:24:23 +0000 (0:00:00.496) 0:00:30.511 ********** 2026-04-24 02:25:28.362137 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:25:28.362148 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:25:28.362158 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:25:28.362169 | orchestrator | 2026-04-24 02:25:28.362180 | orchestrator | TASK [k3s_server : Create manifests directory on first master] ***************** 2026-04-24 02:25:28.362191 | orchestrator | Friday 24 April 2026 02:24:25 +0000 (0:00:01.470) 0:00:31.981 ********** 2026-04-24 02:25:28.362201 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.362212 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.362223 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:25:28.362281 | orchestrator | 2026-04-24 02:25:28.362293 | orchestrator | TASK [k3s_server : Download vip rbac manifest to first master] ***************** 2026-04-24 02:25:28.362303 | orchestrator | Friday 24 April 2026 02:24:25 +0000 (0:00:00.504) 0:00:32.485 ********** 2026-04-24 02:25:28.362314 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.362325 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.362335 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:25:28.362346 | orchestrator | 2026-04-24 02:25:28.362356 | orchestrator | TASK [k3s_server : Copy vip manifest to first master] ************************** 2026-04-24 02:25:28.362367 | orchestrator | Friday 24 April 2026 02:24:26 +0000 (0:00:00.923) 0:00:33.409 ********** 2026-04-24 02:25:28.362378 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.362388 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.362399 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:25:28.362410 | orchestrator | 2026-04-24 02:25:28.362420 | orchestrator | TASK [k3s_server : Deploy metallb manifest] ************************************ 2026-04-24 02:25:28.362453 | orchestrator | Friday 24 April 2026 02:24:27 +0000 (0:00:01.159) 0:00:34.568 ********** 2026-04-24 02:25:28.362465 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:25:28.362491 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.362501 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.362512 | orchestrator | 2026-04-24 02:25:28.362523 | orchestrator | TASK [k3s_server : Deploy kube-vip manifest] *********************************** 2026-04-24 02:25:28.362534 | orchestrator | Friday 24 April 2026 02:24:28 +0000 (0:00:00.299) 0:00:34.868 ********** 2026-04-24 02:25:28.362544 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:25:28.362555 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.362565 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.362576 | orchestrator | 2026-04-24 02:25:28.362587 | orchestrator | TASK [k3s_server : Init cluster inside the transient k3s-init service] ********* 2026-04-24 02:25:28.362597 | orchestrator | Friday 24 April 2026 02:24:28 +0000 (0:00:00.533) 0:00:35.401 ********** 2026-04-24 02:25:28.362608 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:25:28.362619 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:25:28.362629 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:25:28.362640 | orchestrator | 2026-04-24 02:25:28.362658 | orchestrator | TASK [k3s_server : Detect Kubernetes version for label compatibility] ********** 2026-04-24 02:25:28.362669 | orchestrator | Friday 24 April 2026 02:24:29 +0000 (0:00:01.113) 0:00:36.515 ********** 2026-04-24 02:25:28.362695 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:25:28.362706 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:25:28.362717 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:25:28.362728 | orchestrator | 2026-04-24 02:25:28.362739 | orchestrator | TASK [k3s_server : Set node role label selector based on Kubernetes version] *** 2026-04-24 02:25:28.362750 | orchestrator | Friday 24 April 2026 02:24:32 +0000 (0:00:03.075) 0:00:39.591 ********** 2026-04-24 02:25:28.362760 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:25:28.362771 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:25:28.362782 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:25:28.362797 | orchestrator | 2026-04-24 02:25:28.362808 | orchestrator | TASK [k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails)] *** 2026-04-24 02:25:28.362820 | orchestrator | Friday 24 April 2026 02:24:33 +0000 (0:00:00.368) 0:00:39.960 ********** 2026-04-24 02:25:28.362831 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-24 02:25:28.362844 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-24 02:25:28.362854 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-24 02:25:28.362865 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-24 02:25:28.362876 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-24 02:25:28.362887 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-24 02:25:28.362897 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-24 02:25:28.362908 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-24 02:25:28.362919 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-24 02:25:28.362930 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-24 02:25:28.362940 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-24 02:25:28.362958 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-24 02:25:28.362969 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-24 02:25:28.362980 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-24 02:25:28.362990 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-24 02:25:28.363001 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:25:28.363012 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:25:28.363023 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:25:28.363033 | orchestrator | 2026-04-24 02:25:28.363050 | orchestrator | TASK [k3s_server : Save logs of k3s-init.service] ****************************** 2026-04-24 02:25:28.363061 | orchestrator | Friday 24 April 2026 02:25:27 +0000 (0:00:53.772) 0:01:33.732 ********** 2026-04-24 02:25:28.363072 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:25:28.363082 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:25:28.363093 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:25:28.363104 | orchestrator | 2026-04-24 02:25:28.363114 | orchestrator | TASK [k3s_server : Kill the temporary service used for initialization] ********* 2026-04-24 02:25:28.363125 | orchestrator | Friday 24 April 2026 02:25:27 +0000 (0:00:00.345) 0:01:34.078 ********** 2026-04-24 02:25:28.363143 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:26:09.402524 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:26:09.402647 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:26:09.402663 | orchestrator | 2026-04-24 02:26:09.402677 | orchestrator | TASK [k3s_server : Copy K3s service file] ************************************** 2026-04-24 02:26:09.402689 | orchestrator | Friday 24 April 2026 02:25:28 +0000 (0:00:00.954) 0:01:35.032 ********** 2026-04-24 02:26:09.402700 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:26:09.402711 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:26:09.402722 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:26:09.402733 | orchestrator | 2026-04-24 02:26:09.402745 | orchestrator | TASK [k3s_server : Enable and check K3s service] ******************************* 2026-04-24 02:26:09.402755 | orchestrator | Friday 24 April 2026 02:25:29 +0000 (0:00:01.194) 0:01:36.226 ********** 2026-04-24 02:26:09.402766 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:26:09.402777 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:26:09.402788 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:26:09.402798 | orchestrator | 2026-04-24 02:26:09.402809 | orchestrator | TASK [k3s_server : Wait for node-token] **************************************** 2026-04-24 02:26:09.402820 | orchestrator | Friday 24 April 2026 02:25:55 +0000 (0:00:25.471) 0:02:01.698 ********** 2026-04-24 02:26:09.402831 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:26:09.402842 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:26:09.402853 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:26:09.402864 | orchestrator | 2026-04-24 02:26:09.402875 | orchestrator | TASK [k3s_server : Register node-token file access mode] *********************** 2026-04-24 02:26:09.402885 | orchestrator | Friday 24 April 2026 02:25:55 +0000 (0:00:00.679) 0:02:02.378 ********** 2026-04-24 02:26:09.402896 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:26:09.402907 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:26:09.402918 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:26:09.402928 | orchestrator | 2026-04-24 02:26:09.402939 | orchestrator | TASK [k3s_server : Change file access node-token] ****************************** 2026-04-24 02:26:09.402950 | orchestrator | Friday 24 April 2026 02:25:56 +0000 (0:00:00.665) 0:02:03.044 ********** 2026-04-24 02:26:09.402961 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:26:09.402972 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:26:09.402982 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:26:09.402993 | orchestrator | 2026-04-24 02:26:09.403004 | orchestrator | TASK [k3s_server : Read node-token from master] ******************************** 2026-04-24 02:26:09.403042 | orchestrator | Friday 24 April 2026 02:25:56 +0000 (0:00:00.630) 0:02:03.674 ********** 2026-04-24 02:26:09.403056 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:26:09.403069 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:26:09.403081 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:26:09.403094 | orchestrator | 2026-04-24 02:26:09.403107 | orchestrator | TASK [k3s_server : Store Master node-token] ************************************ 2026-04-24 02:26:09.403120 | orchestrator | Friday 24 April 2026 02:25:57 +0000 (0:00:00.831) 0:02:04.506 ********** 2026-04-24 02:26:09.403132 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:26:09.403144 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:26:09.403158 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:26:09.403171 | orchestrator | 2026-04-24 02:26:09.403183 | orchestrator | TASK [k3s_server : Restore node-token file access] ***************************** 2026-04-24 02:26:09.403194 | orchestrator | Friday 24 April 2026 02:25:58 +0000 (0:00:00.309) 0:02:04.816 ********** 2026-04-24 02:26:09.403205 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:26:09.403216 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:26:09.403227 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:26:09.403262 | orchestrator | 2026-04-24 02:26:09.403274 | orchestrator | TASK [k3s_server : Create directory .kube] ************************************* 2026-04-24 02:26:09.403284 | orchestrator | Friday 24 April 2026 02:25:58 +0000 (0:00:00.613) 0:02:05.430 ********** 2026-04-24 02:26:09.403295 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:26:09.403306 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:26:09.403317 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:26:09.403328 | orchestrator | 2026-04-24 02:26:09.403339 | orchestrator | TASK [k3s_server : Copy config file to user home directory] ******************** 2026-04-24 02:26:09.403349 | orchestrator | Friday 24 April 2026 02:25:59 +0000 (0:00:00.605) 0:02:06.035 ********** 2026-04-24 02:26:09.403360 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:26:09.403371 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:26:09.403381 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:26:09.403392 | orchestrator | 2026-04-24 02:26:09.403403 | orchestrator | TASK [k3s_server : Configure kubectl cluster to https://192.168.16.8:6443] ***** 2026-04-24 02:26:09.403414 | orchestrator | Friday 24 April 2026 02:26:00 +0000 (0:00:00.866) 0:02:06.901 ********** 2026-04-24 02:26:09.403427 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:26:09.403438 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:26:09.403449 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:26:09.403459 | orchestrator | 2026-04-24 02:26:09.403470 | orchestrator | TASK [k3s_server : Create kubectl symlink] ************************************* 2026-04-24 02:26:09.403481 | orchestrator | Friday 24 April 2026 02:26:01 +0000 (0:00:01.049) 0:02:07.951 ********** 2026-04-24 02:26:09.403492 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:26:09.403502 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:26:09.403513 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:26:09.403523 | orchestrator | 2026-04-24 02:26:09.403534 | orchestrator | TASK [k3s_server : Create crictl symlink] ************************************** 2026-04-24 02:26:09.403545 | orchestrator | Friday 24 April 2026 02:26:01 +0000 (0:00:00.299) 0:02:08.250 ********** 2026-04-24 02:26:09.403556 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:26:09.403566 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:26:09.403577 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:26:09.403587 | orchestrator | 2026-04-24 02:26:09.403598 | orchestrator | TASK [k3s_server : Get contents of manifests folder] *************************** 2026-04-24 02:26:09.403609 | orchestrator | Friday 24 April 2026 02:26:01 +0000 (0:00:00.312) 0:02:08.563 ********** 2026-04-24 02:26:09.403619 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:26:09.403630 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:26:09.403641 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:26:09.403651 | orchestrator | 2026-04-24 02:26:09.403662 | orchestrator | TASK [k3s_server : Get sub dirs of manifests folder] *************************** 2026-04-24 02:26:09.403673 | orchestrator | Friday 24 April 2026 02:26:02 +0000 (0:00:00.617) 0:02:09.180 ********** 2026-04-24 02:26:09.403692 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:26:09.403703 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:26:09.403732 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:26:09.403743 | orchestrator | 2026-04-24 02:26:09.403755 | orchestrator | TASK [k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start] *** 2026-04-24 02:26:09.403767 | orchestrator | Friday 24 April 2026 02:26:03 +0000 (0:00:00.873) 0:02:10.053 ********** 2026-04-24 02:26:09.403778 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-24 02:26:09.403789 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-24 02:26:09.403800 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-24 02:26:09.403810 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-24 02:26:09.403821 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-24 02:26:09.403832 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-24 02:26:09.403842 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-24 02:26:09.403854 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-24 02:26:09.403865 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-24 02:26:09.403876 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip.yaml) 2026-04-24 02:26:09.403886 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-24 02:26:09.403897 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-24 02:26:09.403908 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip-rbac.yaml) 2026-04-24 02:26:09.403918 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-24 02:26:09.403929 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-24 02:26:09.403940 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-24 02:26:09.403950 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-24 02:26:09.403961 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-24 02:26:09.403972 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-24 02:26:09.403983 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-24 02:26:09.403993 | orchestrator | 2026-04-24 02:26:09.404004 | orchestrator | PLAY [Deploy k3s worker nodes] ************************************************* 2026-04-24 02:26:09.404015 | orchestrator | 2026-04-24 02:26:09.404025 | orchestrator | TASK [k3s_agent : Validating arguments against arg spec 'main' - Setup k3s agents] *** 2026-04-24 02:26:09.404036 | orchestrator | Friday 24 April 2026 02:26:06 +0000 (0:00:03.010) 0:02:13.063 ********** 2026-04-24 02:26:09.404047 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:26:09.404057 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:26:09.404068 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:26:09.404079 | orchestrator | 2026-04-24 02:26:09.404106 | orchestrator | TASK [k3s_agent : Check if system is PXE-booted] ******************************* 2026-04-24 02:26:09.404117 | orchestrator | Friday 24 April 2026 02:26:06 +0000 (0:00:00.323) 0:02:13.387 ********** 2026-04-24 02:26:09.404128 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:26:09.404139 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:26:09.404149 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:26:09.404167 | orchestrator | 2026-04-24 02:26:09.404178 | orchestrator | TASK [k3s_agent : Set fact for PXE-booted system] ****************************** 2026-04-24 02:26:09.404188 | orchestrator | Friday 24 April 2026 02:26:07 +0000 (0:00:00.832) 0:02:14.220 ********** 2026-04-24 02:26:09.404199 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:26:09.404210 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:26:09.404220 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:26:09.404231 | orchestrator | 2026-04-24 02:26:09.404287 | orchestrator | TASK [k3s_agent : Include http_proxy configuration tasks] ********************** 2026-04-24 02:26:09.404298 | orchestrator | Friday 24 April 2026 02:26:07 +0000 (0:00:00.325) 0:02:14.546 ********** 2026-04-24 02:26:09.404308 | orchestrator | included: /ansible/roles/k3s_agent/tasks/http_proxy.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:26:09.404319 | orchestrator | 2026-04-24 02:26:09.404330 | orchestrator | TASK [k3s_agent : Create k3s-node.service.d directory] ************************* 2026-04-24 02:26:09.404341 | orchestrator | Friday 24 April 2026 02:26:08 +0000 (0:00:00.480) 0:02:15.026 ********** 2026-04-24 02:26:09.404352 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:26:09.404362 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:26:09.404373 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:26:09.404384 | orchestrator | 2026-04-24 02:26:09.404394 | orchestrator | TASK [k3s_agent : Copy K3s http_proxy conf file] ******************************* 2026-04-24 02:26:09.404405 | orchestrator | Friday 24 April 2026 02:26:08 +0000 (0:00:00.522) 0:02:15.548 ********** 2026-04-24 02:26:09.404416 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:26:09.404426 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:26:09.404437 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:26:09.404448 | orchestrator | 2026-04-24 02:26:09.404458 | orchestrator | TASK [k3s_agent : Deploy K3s http_proxy conf] ********************************** 2026-04-24 02:26:09.404469 | orchestrator | Friday 24 April 2026 02:26:09 +0000 (0:00:00.345) 0:02:15.894 ********** 2026-04-24 02:26:09.404487 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:28:02.566973 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:28:02.567093 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:28:02.567109 | orchestrator | 2026-04-24 02:28:02.567123 | orchestrator | TASK [k3s_agent : Create /etc/rancher/k3s directory] *************************** 2026-04-24 02:28:02.567136 | orchestrator | Friday 24 April 2026 02:26:09 +0000 (0:00:00.320) 0:02:16.214 ********** 2026-04-24 02:28:02.567147 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:28:02.567158 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:28:02.567169 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:28:02.567180 | orchestrator | 2026-04-24 02:28:02.567192 | orchestrator | TASK [k3s_agent : Create custom resolv.conf for k3s] *************************** 2026-04-24 02:28:02.567203 | orchestrator | Friday 24 April 2026 02:26:10 +0000 (0:00:00.635) 0:02:16.850 ********** 2026-04-24 02:28:02.567213 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:28:02.567224 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:28:02.567235 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:28:02.567246 | orchestrator | 2026-04-24 02:28:02.567297 | orchestrator | TASK [k3s_agent : Configure the k3s service] *********************************** 2026-04-24 02:28:02.567309 | orchestrator | Friday 24 April 2026 02:26:11 +0000 (0:00:01.376) 0:02:18.226 ********** 2026-04-24 02:28:02.567320 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:28:02.567331 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:28:02.567342 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:28:02.567352 | orchestrator | 2026-04-24 02:28:02.567363 | orchestrator | TASK [k3s_agent : Manage k3s service] ****************************************** 2026-04-24 02:28:02.567374 | orchestrator | Friday 24 April 2026 02:26:12 +0000 (0:00:01.217) 0:02:19.444 ********** 2026-04-24 02:28:02.567385 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:28:02.567396 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:28:02.567407 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:28:02.567417 | orchestrator | 2026-04-24 02:28:02.567428 | orchestrator | PLAY [Prepare kubeconfig file] ************************************************* 2026-04-24 02:28:02.567464 | orchestrator | 2026-04-24 02:28:02.567476 | orchestrator | TASK [Get home directory of operator user] ************************************* 2026-04-24 02:28:02.567487 | orchestrator | Friday 24 April 2026 02:26:22 +0000 (0:00:10.234) 0:02:29.679 ********** 2026-04-24 02:28:02.567503 | orchestrator | ok: [testbed-manager] 2026-04-24 02:28:02.567529 | orchestrator | 2026-04-24 02:28:02.567553 | orchestrator | TASK [Create .kube directory] ************************************************** 2026-04-24 02:28:02.567571 | orchestrator | Friday 24 April 2026 02:26:23 +0000 (0:00:00.787) 0:02:30.466 ********** 2026-04-24 02:28:02.567589 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:02.567608 | orchestrator | 2026-04-24 02:28:02.567626 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-24 02:28:02.567645 | orchestrator | Friday 24 April 2026 02:26:24 +0000 (0:00:00.662) 0:02:31.128 ********** 2026-04-24 02:28:02.567664 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-24 02:28:02.567682 | orchestrator | 2026-04-24 02:28:02.567700 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-24 02:28:02.567719 | orchestrator | Friday 24 April 2026 02:26:24 +0000 (0:00:00.545) 0:02:31.674 ********** 2026-04-24 02:28:02.567738 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:02.567758 | orchestrator | 2026-04-24 02:28:02.567779 | orchestrator | TASK [Change server address in the kubeconfig] ********************************* 2026-04-24 02:28:02.567799 | orchestrator | Friday 24 April 2026 02:26:25 +0000 (0:00:00.923) 0:02:32.597 ********** 2026-04-24 02:28:02.567815 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:02.567828 | orchestrator | 2026-04-24 02:28:02.567840 | orchestrator | TASK [Make kubeconfig available for use inside the manager service] ************ 2026-04-24 02:28:02.567853 | orchestrator | Friday 24 April 2026 02:26:26 +0000 (0:00:00.610) 0:02:33.208 ********** 2026-04-24 02:28:02.567866 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-24 02:28:02.567876 | orchestrator | 2026-04-24 02:28:02.567887 | orchestrator | TASK [Change server address in the kubeconfig inside the manager service] ****** 2026-04-24 02:28:02.567898 | orchestrator | Friday 24 April 2026 02:26:28 +0000 (0:00:01.625) 0:02:34.833 ********** 2026-04-24 02:28:02.567909 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-24 02:28:02.567920 | orchestrator | 2026-04-24 02:28:02.567955 | orchestrator | TASK [Set KUBECONFIG environment variable] ************************************* 2026-04-24 02:28:02.567967 | orchestrator | Friday 24 April 2026 02:26:29 +0000 (0:00:00.870) 0:02:35.704 ********** 2026-04-24 02:28:02.567977 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:02.567988 | orchestrator | 2026-04-24 02:28:02.567999 | orchestrator | TASK [Enable kubectl command line completion] ********************************** 2026-04-24 02:28:02.568009 | orchestrator | Friday 24 April 2026 02:26:29 +0000 (0:00:00.467) 0:02:36.172 ********** 2026-04-24 02:28:02.568020 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:02.568030 | orchestrator | 2026-04-24 02:28:02.568041 | orchestrator | PLAY [Apply role kubectl] ****************************************************** 2026-04-24 02:28:02.568051 | orchestrator | 2026-04-24 02:28:02.568062 | orchestrator | TASK [kubectl : Gather variables for each operating system] ******************** 2026-04-24 02:28:02.568074 | orchestrator | Friday 24 April 2026 02:26:29 +0000 (0:00:00.465) 0:02:36.638 ********** 2026-04-24 02:28:02.568084 | orchestrator | ok: [testbed-manager] 2026-04-24 02:28:02.568095 | orchestrator | 2026-04-24 02:28:02.568106 | orchestrator | TASK [kubectl : Include distribution specific install tasks] ******************* 2026-04-24 02:28:02.568116 | orchestrator | Friday 24 April 2026 02:26:30 +0000 (0:00:00.164) 0:02:36.802 ********** 2026-04-24 02:28:02.568127 | orchestrator | included: /ansible/roles/kubectl/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 02:28:02.568138 | orchestrator | 2026-04-24 02:28:02.568149 | orchestrator | TASK [kubectl : Remove old architecture-dependent repository] ****************** 2026-04-24 02:28:02.568159 | orchestrator | Friday 24 April 2026 02:26:30 +0000 (0:00:00.437) 0:02:37.239 ********** 2026-04-24 02:28:02.568170 | orchestrator | ok: [testbed-manager] 2026-04-24 02:28:02.568181 | orchestrator | 2026-04-24 02:28:02.568203 | orchestrator | TASK [kubectl : Install apt-transport-https package] *************************** 2026-04-24 02:28:02.568214 | orchestrator | Friday 24 April 2026 02:26:31 +0000 (0:00:00.826) 0:02:38.065 ********** 2026-04-24 02:28:02.568224 | orchestrator | ok: [testbed-manager] 2026-04-24 02:28:02.568235 | orchestrator | 2026-04-24 02:28:02.568288 | orchestrator | TASK [kubectl : Add repository gpg key] **************************************** 2026-04-24 02:28:02.568301 | orchestrator | Friday 24 April 2026 02:26:33 +0000 (0:00:01.641) 0:02:39.707 ********** 2026-04-24 02:28:02.568312 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:02.568322 | orchestrator | 2026-04-24 02:28:02.568333 | orchestrator | TASK [kubectl : Set permissions of gpg key] ************************************ 2026-04-24 02:28:02.568344 | orchestrator | Friday 24 April 2026 02:26:33 +0000 (0:00:00.824) 0:02:40.532 ********** 2026-04-24 02:28:02.568355 | orchestrator | ok: [testbed-manager] 2026-04-24 02:28:02.568365 | orchestrator | 2026-04-24 02:28:02.568376 | orchestrator | TASK [kubectl : Add repository Debian] ***************************************** 2026-04-24 02:28:02.568387 | orchestrator | Friday 24 April 2026 02:26:34 +0000 (0:00:00.470) 0:02:41.002 ********** 2026-04-24 02:28:02.568397 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:02.568408 | orchestrator | 2026-04-24 02:28:02.568418 | orchestrator | TASK [kubectl : Install required packages] ************************************* 2026-04-24 02:28:02.568429 | orchestrator | Friday 24 April 2026 02:26:42 +0000 (0:00:07.918) 0:02:48.920 ********** 2026-04-24 02:28:02.568439 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:02.568450 | orchestrator | 2026-04-24 02:28:02.568461 | orchestrator | TASK [kubectl : Remove kubectl symlink] **************************************** 2026-04-24 02:28:02.568471 | orchestrator | Friday 24 April 2026 02:26:54 +0000 (0:00:12.669) 0:03:01.590 ********** 2026-04-24 02:28:02.568482 | orchestrator | ok: [testbed-manager] 2026-04-24 02:28:02.568493 | orchestrator | 2026-04-24 02:28:02.568503 | orchestrator | PLAY [Run post actions on master nodes] **************************************** 2026-04-24 02:28:02.568514 | orchestrator | 2026-04-24 02:28:02.568525 | orchestrator | TASK [k3s_server_post : Validating arguments against arg spec 'main' - Configure k3s cluster] *** 2026-04-24 02:28:02.568535 | orchestrator | Friday 24 April 2026 02:26:55 +0000 (0:00:00.734) 0:03:02.324 ********** 2026-04-24 02:28:02.568546 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:28:02.568557 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:28:02.568567 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:28:02.568578 | orchestrator | 2026-04-24 02:28:02.568589 | orchestrator | TASK [k3s_server_post : Deploy calico] ***************************************** 2026-04-24 02:28:02.568599 | orchestrator | Friday 24 April 2026 02:26:55 +0000 (0:00:00.305) 0:03:02.629 ********** 2026-04-24 02:28:02.568610 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:02.568621 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:28:02.568631 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:28:02.568642 | orchestrator | 2026-04-24 02:28:02.568652 | orchestrator | TASK [k3s_server_post : Deploy cilium] ***************************************** 2026-04-24 02:28:02.568663 | orchestrator | Friday 24 April 2026 02:26:56 +0000 (0:00:00.299) 0:03:02.929 ********** 2026-04-24 02:28:02.568674 | orchestrator | included: /ansible/roles/k3s_server_post/tasks/cilium.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:28:02.568685 | orchestrator | 2026-04-24 02:28:02.568696 | orchestrator | TASK [k3s_server_post : Create tmp directory on first master] ****************** 2026-04-24 02:28:02.568706 | orchestrator | Friday 24 April 2026 02:26:56 +0000 (0:00:00.692) 0:03:03.621 ********** 2026-04-24 02:28:02.568717 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-24 02:28:02.568728 | orchestrator | 2026-04-24 02:28:02.568738 | orchestrator | TASK [k3s_server_post : Wait for connectivity to kube VIP] ********************* 2026-04-24 02:28:02.568749 | orchestrator | Friday 24 April 2026 02:26:57 +0000 (0:00:00.844) 0:03:04.466 ********** 2026-04-24 02:28:02.568760 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 02:28:02.568770 | orchestrator | 2026-04-24 02:28:02.568781 | orchestrator | TASK [k3s_server_post : Fail if kube VIP not reachable] ************************ 2026-04-24 02:28:02.568799 | orchestrator | Friday 24 April 2026 02:26:58 +0000 (0:00:00.852) 0:03:05.318 ********** 2026-04-24 02:28:02.568810 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:02.568821 | orchestrator | 2026-04-24 02:28:02.568831 | orchestrator | TASK [k3s_server_post : Test for existing Cilium install] ********************** 2026-04-24 02:28:02.568842 | orchestrator | Friday 24 April 2026 02:26:58 +0000 (0:00:00.129) 0:03:05.448 ********** 2026-04-24 02:28:02.568853 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 02:28:02.568863 | orchestrator | 2026-04-24 02:28:02.568874 | orchestrator | TASK [k3s_server_post : Check Cilium version] ********************************** 2026-04-24 02:28:02.568884 | orchestrator | Friday 24 April 2026 02:26:59 +0000 (0:00:00.979) 0:03:06.427 ********** 2026-04-24 02:28:02.568895 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:02.568906 | orchestrator | 2026-04-24 02:28:02.568916 | orchestrator | TASK [k3s_server_post : Parse installed Cilium version] ************************ 2026-04-24 02:28:02.568927 | orchestrator | Friday 24 April 2026 02:26:59 +0000 (0:00:00.151) 0:03:06.579 ********** 2026-04-24 02:28:02.568938 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:02.568948 | orchestrator | 2026-04-24 02:28:02.568959 | orchestrator | TASK [k3s_server_post : Determine if Cilium needs update] ********************** 2026-04-24 02:28:02.568970 | orchestrator | Friday 24 April 2026 02:27:00 +0000 (0:00:00.130) 0:03:06.710 ********** 2026-04-24 02:28:02.568980 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:02.568991 | orchestrator | 2026-04-24 02:28:02.569001 | orchestrator | TASK [k3s_server_post : Log result] ******************************************** 2026-04-24 02:28:02.569018 | orchestrator | Friday 24 April 2026 02:27:00 +0000 (0:00:00.122) 0:03:06.832 ********** 2026-04-24 02:28:02.569029 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:02.569040 | orchestrator | 2026-04-24 02:28:02.569051 | orchestrator | TASK [k3s_server_post : Install Cilium] **************************************** 2026-04-24 02:28:02.569061 | orchestrator | Friday 24 April 2026 02:27:00 +0000 (0:00:00.129) 0:03:06.962 ********** 2026-04-24 02:28:02.569072 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-24 02:28:02.569083 | orchestrator | 2026-04-24 02:28:02.569093 | orchestrator | TASK [k3s_server_post : Wait for Cilium resources] ***************************** 2026-04-24 02:28:02.569104 | orchestrator | Friday 24 April 2026 02:27:06 +0000 (0:00:05.836) 0:03:12.799 ********** 2026-04-24 02:28:02.569115 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/cilium-operator) 2026-04-24 02:28:02.569125 | orchestrator | FAILED - RETRYING: [testbed-node-0 -> localhost]: Wait for Cilium resources (30 retries left). 2026-04-24 02:28:02.569143 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=daemonset/cilium) 2026-04-24 02:28:25.815894 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-relay) 2026-04-24 02:28:25.816077 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-ui) 2026-04-24 02:28:25.816095 | orchestrator | 2026-04-24 02:28:25.816107 | orchestrator | TASK [k3s_server_post : Set _cilium_bgp_neighbors fact] ************************ 2026-04-24 02:28:25.816119 | orchestrator | Friday 24 April 2026 02:28:02 +0000 (0:00:56.425) 0:04:09.224 ********** 2026-04-24 02:28:25.816130 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 02:28:25.816142 | orchestrator | 2026-04-24 02:28:25.816153 | orchestrator | TASK [k3s_server_post : Copy BGP manifests to first master] ******************** 2026-04-24 02:28:25.816164 | orchestrator | Friday 24 April 2026 02:28:03 +0000 (0:00:01.310) 0:04:10.535 ********** 2026-04-24 02:28:25.816175 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-24 02:28:25.816186 | orchestrator | 2026-04-24 02:28:25.816197 | orchestrator | TASK [k3s_server_post : Apply BGP manifests] *********************************** 2026-04-24 02:28:25.816207 | orchestrator | Friday 24 April 2026 02:28:05 +0000 (0:00:01.573) 0:04:12.108 ********** 2026-04-24 02:28:25.816218 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-24 02:28:25.816229 | orchestrator | 2026-04-24 02:28:25.816240 | orchestrator | TASK [k3s_server_post : Print error message if BGP manifests application fails] *** 2026-04-24 02:28:25.816251 | orchestrator | Friday 24 April 2026 02:28:06 +0000 (0:00:01.317) 0:04:13.426 ********** 2026-04-24 02:28:25.816321 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:25.816333 | orchestrator | 2026-04-24 02:28:25.816344 | orchestrator | TASK [k3s_server_post : Test for BGP config resources] ************************* 2026-04-24 02:28:25.816355 | orchestrator | Friday 24 April 2026 02:28:06 +0000 (0:00:00.134) 0:04:13.560 ********** 2026-04-24 02:28:25.816366 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumBGPPeeringPolicy.cilium.io) 2026-04-24 02:28:25.816378 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumLoadBalancerIPPool.cilium.io) 2026-04-24 02:28:25.816389 | orchestrator | 2026-04-24 02:28:25.816401 | orchestrator | TASK [k3s_server_post : Deploy metallb pool] *********************************** 2026-04-24 02:28:25.816413 | orchestrator | Friday 24 April 2026 02:28:08 +0000 (0:00:01.837) 0:04:15.398 ********** 2026-04-24 02:28:25.816425 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:25.816437 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:28:25.816450 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:28:25.816462 | orchestrator | 2026-04-24 02:28:25.816473 | orchestrator | TASK [k3s_server_post : Remove tmp directory used for manifests] *************** 2026-04-24 02:28:25.816485 | orchestrator | Friday 24 April 2026 02:28:09 +0000 (0:00:00.293) 0:04:15.692 ********** 2026-04-24 02:28:25.816498 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:28:25.816511 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:28:25.816522 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:28:25.816533 | orchestrator | 2026-04-24 02:28:25.816544 | orchestrator | PLAY [Apply role k9s] ********************************************************** 2026-04-24 02:28:25.816555 | orchestrator | 2026-04-24 02:28:25.816565 | orchestrator | TASK [k9s : Gather variables for each operating system] ************************ 2026-04-24 02:28:25.816576 | orchestrator | Friday 24 April 2026 02:28:09 +0000 (0:00:00.846) 0:04:16.538 ********** 2026-04-24 02:28:25.816587 | orchestrator | ok: [testbed-manager] 2026-04-24 02:28:25.816597 | orchestrator | 2026-04-24 02:28:25.816609 | orchestrator | TASK [k9s : Include distribution specific install tasks] *********************** 2026-04-24 02:28:25.816620 | orchestrator | Friday 24 April 2026 02:28:10 +0000 (0:00:00.372) 0:04:16.911 ********** 2026-04-24 02:28:25.816630 | orchestrator | included: /ansible/roles/k9s/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 02:28:25.816641 | orchestrator | 2026-04-24 02:28:25.816652 | orchestrator | TASK [k9s : Install k9s packages] ********************************************** 2026-04-24 02:28:25.816663 | orchestrator | Friday 24 April 2026 02:28:10 +0000 (0:00:00.244) 0:04:17.156 ********** 2026-04-24 02:28:25.816673 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:25.816684 | orchestrator | 2026-04-24 02:28:25.816695 | orchestrator | PLAY [Manage labels, annotations, and taints on all k3s nodes] ***************** 2026-04-24 02:28:25.816705 | orchestrator | 2026-04-24 02:28:25.816716 | orchestrator | TASK [Merge labels, annotations, and taints] *********************************** 2026-04-24 02:28:25.816750 | orchestrator | Friday 24 April 2026 02:28:16 +0000 (0:00:05.872) 0:04:23.028 ********** 2026-04-24 02:28:25.816762 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:28:25.816784 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:28:25.816806 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:28:25.816817 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:28:25.816839 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:28:25.816850 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:28:25.816872 | orchestrator | 2026-04-24 02:28:25.816883 | orchestrator | TASK [Manage labels] *********************************************************** 2026-04-24 02:28:25.816894 | orchestrator | Friday 24 April 2026 02:28:16 +0000 (0:00:00.579) 0:04:23.607 ********** 2026-04-24 02:28:25.816905 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-24 02:28:25.816916 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-24 02:28:25.816927 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-24 02:28:25.816937 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-24 02:28:25.816956 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-24 02:28:25.816967 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-24 02:28:25.816978 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-24 02:28:25.816988 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-24 02:28:25.816999 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-24 02:28:25.817028 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-24 02:28:25.817039 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-24 02:28:25.817052 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-24 02:28:25.817063 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-24 02:28:25.817073 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-24 02:28:25.817084 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-24 02:28:25.817113 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-24 02:28:25.817125 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-24 02:28:25.817136 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-24 02:28:25.817146 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-24 02:28:25.817160 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-24 02:28:25.817179 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-24 02:28:25.817198 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-24 02:28:25.817215 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-24 02:28:25.817232 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-24 02:28:25.817250 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-24 02:28:25.817297 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-24 02:28:25.817314 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-24 02:28:25.817329 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-24 02:28:25.817345 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-24 02:28:25.817364 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-24 02:28:25.817382 | orchestrator | 2026-04-24 02:28:25.817400 | orchestrator | TASK [Manage annotations] ****************************************************** 2026-04-24 02:28:25.817419 | orchestrator | Friday 24 April 2026 02:28:24 +0000 (0:00:07.727) 0:04:31.335 ********** 2026-04-24 02:28:25.817439 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:28:25.817457 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:28:25.817476 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:28:25.817487 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:25.817498 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:28:25.817508 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:28:25.817519 | orchestrator | 2026-04-24 02:28:25.817530 | orchestrator | TASK [Manage taints] *********************************************************** 2026-04-24 02:28:25.817540 | orchestrator | Friday 24 April 2026 02:28:25 +0000 (0:00:00.512) 0:04:31.847 ********** 2026-04-24 02:28:25.817551 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:28:25.817572 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:28:25.817583 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:28:25.817593 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:28:25.817604 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:28:25.817614 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:28:25.817625 | orchestrator | 2026-04-24 02:28:25.817635 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:28:25.817646 | orchestrator | testbed-manager : ok=21  changed=11  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:28:25.817660 | orchestrator | testbed-node-0 : ok=50  changed=23  unreachable=0 failed=0 skipped=28  rescued=0 ignored=0 2026-04-24 02:28:25.817671 | orchestrator | testbed-node-1 : ok=38  changed=16  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-24 02:28:25.817682 | orchestrator | testbed-node-2 : ok=38  changed=16  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-24 02:28:25.817692 | orchestrator | testbed-node-3 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 02:28:25.817703 | orchestrator | testbed-node-4 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 02:28:25.817714 | orchestrator | testbed-node-5 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 02:28:25.817724 | orchestrator | 2026-04-24 02:28:25.817735 | orchestrator | 2026-04-24 02:28:25.817746 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:28:25.817756 | orchestrator | Friday 24 April 2026 02:28:25 +0000 (0:00:00.628) 0:04:32.476 ********** 2026-04-24 02:28:25.817778 | orchestrator | =============================================================================== 2026-04-24 02:28:26.188349 | orchestrator | k3s_server_post : Wait for Cilium resources ---------------------------- 56.43s 2026-04-24 02:28:26.188427 | orchestrator | k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails) -- 53.77s 2026-04-24 02:28:26.188437 | orchestrator | k3s_server : Enable and check K3s service ------------------------------ 25.47s 2026-04-24 02:28:26.188444 | orchestrator | kubectl : Install required packages ------------------------------------ 12.67s 2026-04-24 02:28:26.188450 | orchestrator | k3s_agent : Manage k3s service ----------------------------------------- 10.23s 2026-04-24 02:28:26.188456 | orchestrator | kubectl : Add repository Debian ----------------------------------------- 7.92s 2026-04-24 02:28:26.188462 | orchestrator | Manage labels ----------------------------------------------------------- 7.73s 2026-04-24 02:28:26.188467 | orchestrator | k9s : Install k9s packages ---------------------------------------------- 5.87s 2026-04-24 02:28:26.188473 | orchestrator | k3s_server_post : Install Cilium ---------------------------------------- 5.84s 2026-04-24 02:28:26.188479 | orchestrator | k3s_download : Download k3s binary x64 ---------------------------------- 5.57s 2026-04-24 02:28:26.188484 | orchestrator | k3s_server : Detect Kubernetes version for label compatibility ---------- 3.08s 2026-04-24 02:28:26.188490 | orchestrator | k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start --- 3.01s 2026-04-24 02:28:26.188497 | orchestrator | k3s_prereq : Enable IPv4 forwarding ------------------------------------- 1.86s 2026-04-24 02:28:26.188503 | orchestrator | k3s_server_post : Test for BGP config resources ------------------------- 1.84s 2026-04-24 02:28:26.188508 | orchestrator | k3s_server : Clean previous runs of k3s-init ---------------------------- 1.81s 2026-04-24 02:28:26.188514 | orchestrator | kubectl : Install apt-transport-https package --------------------------- 1.64s 2026-04-24 02:28:26.188519 | orchestrator | Make kubeconfig available for use inside the manager service ------------ 1.63s 2026-04-24 02:28:26.188545 | orchestrator | k3s_server_post : Copy BGP manifests to first master -------------------- 1.57s 2026-04-24 02:28:26.188551 | orchestrator | k3s_server : Set _kube_vip_bgp_peers fact ------------------------------- 1.47s 2026-04-24 02:28:26.188557 | orchestrator | k3s_server : Create custom resolv.conf for k3s -------------------------- 1.44s 2026-04-24 02:28:26.524858 | orchestrator | + osism apply copy-kubeconfig 2026-04-24 02:28:38.607911 | orchestrator | 2026-04-24 02:28:38 | INFO  | Task abc4a58c-0210-4239-a720-75dfede013eb (copy-kubeconfig) was prepared for execution. 2026-04-24 02:28:38.608053 | orchestrator | 2026-04-24 02:28:38 | INFO  | It takes a moment until task abc4a58c-0210-4239-a720-75dfede013eb (copy-kubeconfig) has been started and output is visible here. 2026-04-24 02:28:45.597225 | orchestrator | 2026-04-24 02:28:45.597396 | orchestrator | PLAY [Copy kubeconfig to the configuration repository] ************************* 2026-04-24 02:28:45.597414 | orchestrator | 2026-04-24 02:28:45.597427 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-24 02:28:45.597439 | orchestrator | Friday 24 April 2026 02:28:42 +0000 (0:00:00.153) 0:00:00.153 ********** 2026-04-24 02:28:45.597451 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-24 02:28:45.597462 | orchestrator | 2026-04-24 02:28:45.597474 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-24 02:28:45.597484 | orchestrator | Friday 24 April 2026 02:28:43 +0000 (0:00:00.715) 0:00:00.869 ********** 2026-04-24 02:28:45.597517 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:45.597529 | orchestrator | 2026-04-24 02:28:45.597541 | orchestrator | TASK [Change server address in the kubeconfig file] **************************** 2026-04-24 02:28:45.597552 | orchestrator | Friday 24 April 2026 02:28:44 +0000 (0:00:01.203) 0:00:02.072 ********** 2026-04-24 02:28:45.597568 | orchestrator | changed: [testbed-manager] 2026-04-24 02:28:45.597580 | orchestrator | 2026-04-24 02:28:45.597595 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:28:45.597607 | orchestrator | testbed-manager : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:28:45.597619 | orchestrator | 2026-04-24 02:28:45.597630 | orchestrator | 2026-04-24 02:28:45.597641 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:28:45.597652 | orchestrator | Friday 24 April 2026 02:28:45 +0000 (0:00:00.476) 0:00:02.549 ********** 2026-04-24 02:28:45.597662 | orchestrator | =============================================================================== 2026-04-24 02:28:45.597673 | orchestrator | Write kubeconfig file --------------------------------------------------- 1.20s 2026-04-24 02:28:45.597684 | orchestrator | Get kubeconfig file ----------------------------------------------------- 0.72s 2026-04-24 02:28:45.597694 | orchestrator | Change server address in the kubeconfig file ---------------------------- 0.48s 2026-04-24 02:28:45.908030 | orchestrator | + sh -c /opt/configuration/scripts/deploy/200-infrastructure.sh 2026-04-24 02:28:57.997443 | orchestrator | 2026-04-24 02:28:57 | INFO  | Task 069929ab-52bd-4d95-a4e4-596bdb1065ef (openstackclient) was prepared for execution. 2026-04-24 02:28:57.997555 | orchestrator | 2026-04-24 02:28:57 | INFO  | It takes a moment until task 069929ab-52bd-4d95-a4e4-596bdb1065ef (openstackclient) has been started and output is visible here. 2026-04-24 02:29:44.980453 | orchestrator | 2026-04-24 02:29:44.980572 | orchestrator | PLAY [Apply role openstackclient] ********************************************** 2026-04-24 02:29:44.980589 | orchestrator | 2026-04-24 02:29:44.980601 | orchestrator | TASK [osism.services.openstackclient : Include tasks] ************************** 2026-04-24 02:29:44.980613 | orchestrator | Friday 24 April 2026 02:29:02 +0000 (0:00:00.229) 0:00:00.229 ********** 2026-04-24 02:29:44.980625 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/openstackclient/tasks/container-Debian-family.yml for testbed-manager 2026-04-24 02:29:44.980638 | orchestrator | 2026-04-24 02:29:44.980676 | orchestrator | TASK [osism.services.openstackclient : Create required directories] ************ 2026-04-24 02:29:44.980688 | orchestrator | Friday 24 April 2026 02:29:02 +0000 (0:00:00.223) 0:00:00.452 ********** 2026-04-24 02:29:44.980699 | orchestrator | changed: [testbed-manager] => (item=/opt/configuration/environments/openstack) 2026-04-24 02:29:44.980712 | orchestrator | changed: [testbed-manager] => (item=/opt/openstackclient/data) 2026-04-24 02:29:44.980723 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient) 2026-04-24 02:29:44.980734 | orchestrator | 2026-04-24 02:29:44.980745 | orchestrator | TASK [osism.services.openstackclient : Copy docker-compose.yml file] *********** 2026-04-24 02:29:44.980756 | orchestrator | Friday 24 April 2026 02:29:03 +0000 (0:00:01.279) 0:00:01.732 ********** 2026-04-24 02:29:44.980767 | orchestrator | changed: [testbed-manager] 2026-04-24 02:29:44.980778 | orchestrator | 2026-04-24 02:29:44.980789 | orchestrator | TASK [osism.services.openstackclient : Manage openstackclient service] ********* 2026-04-24 02:29:44.980799 | orchestrator | Friday 24 April 2026 02:29:05 +0000 (0:00:01.461) 0:00:03.194 ********** 2026-04-24 02:29:44.980814 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage openstackclient service (10 retries left). 2026-04-24 02:29:44.980834 | orchestrator | ok: [testbed-manager] 2026-04-24 02:29:44.980854 | orchestrator | 2026-04-24 02:29:44.980879 | orchestrator | TASK [osism.services.openstackclient : Copy openstack wrapper script] ********** 2026-04-24 02:29:44.980902 | orchestrator | Friday 24 April 2026 02:29:39 +0000 (0:00:34.307) 0:00:37.501 ********** 2026-04-24 02:29:44.980921 | orchestrator | changed: [testbed-manager] 2026-04-24 02:29:44.980939 | orchestrator | 2026-04-24 02:29:44.980959 | orchestrator | TASK [osism.services.openstackclient : Remove ospurge wrapper script] ********** 2026-04-24 02:29:44.980976 | orchestrator | Friday 24 April 2026 02:29:40 +0000 (0:00:00.969) 0:00:38.470 ********** 2026-04-24 02:29:44.980994 | orchestrator | ok: [testbed-manager] 2026-04-24 02:29:44.981015 | orchestrator | 2026-04-24 02:29:44.981034 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Restart openstackclient service] *** 2026-04-24 02:29:44.981055 | orchestrator | Friday 24 April 2026 02:29:41 +0000 (0:00:00.677) 0:00:39.148 ********** 2026-04-24 02:29:44.981075 | orchestrator | changed: [testbed-manager] 2026-04-24 02:29:44.981089 | orchestrator | 2026-04-24 02:29:44.981101 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Ensure that all containers are up] *** 2026-04-24 02:29:44.981114 | orchestrator | Friday 24 April 2026 02:29:42 +0000 (0:00:01.540) 0:00:40.688 ********** 2026-04-24 02:29:44.981127 | orchestrator | changed: [testbed-manager] 2026-04-24 02:29:44.981139 | orchestrator | 2026-04-24 02:29:44.981152 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Wait for an healthy service] *** 2026-04-24 02:29:44.981164 | orchestrator | Friday 24 April 2026 02:29:43 +0000 (0:00:00.736) 0:00:41.425 ********** 2026-04-24 02:29:44.981177 | orchestrator | changed: [testbed-manager] 2026-04-24 02:29:44.981189 | orchestrator | 2026-04-24 02:29:44.981201 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Copy bash completion script] *** 2026-04-24 02:29:44.981212 | orchestrator | Friday 24 April 2026 02:29:44 +0000 (0:00:00.610) 0:00:42.035 ********** 2026-04-24 02:29:44.981224 | orchestrator | ok: [testbed-manager] 2026-04-24 02:29:44.981236 | orchestrator | 2026-04-24 02:29:44.981249 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:29:44.981261 | orchestrator | testbed-manager : ok=10  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:29:44.981299 | orchestrator | 2026-04-24 02:29:44.981311 | orchestrator | 2026-04-24 02:29:44.981323 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:29:44.981335 | orchestrator | Friday 24 April 2026 02:29:44 +0000 (0:00:00.443) 0:00:42.479 ********** 2026-04-24 02:29:44.981347 | orchestrator | =============================================================================== 2026-04-24 02:29:44.981358 | orchestrator | osism.services.openstackclient : Manage openstackclient service -------- 34.31s 2026-04-24 02:29:44.981369 | orchestrator | osism.services.openstackclient : Restart openstackclient service -------- 1.54s 2026-04-24 02:29:44.981392 | orchestrator | osism.services.openstackclient : Copy docker-compose.yml file ----------- 1.46s 2026-04-24 02:29:44.981403 | orchestrator | osism.services.openstackclient : Create required directories ------------ 1.28s 2026-04-24 02:29:44.981413 | orchestrator | osism.services.openstackclient : Copy openstack wrapper script ---------- 0.97s 2026-04-24 02:29:44.981424 | orchestrator | osism.services.openstackclient : Ensure that all containers are up ------ 0.74s 2026-04-24 02:29:44.981435 | orchestrator | osism.services.openstackclient : Remove ospurge wrapper script ---------- 0.68s 2026-04-24 02:29:44.981445 | orchestrator | osism.services.openstackclient : Wait for an healthy service ------------ 0.61s 2026-04-24 02:29:44.981456 | orchestrator | osism.services.openstackclient : Copy bash completion script ------------ 0.44s 2026-04-24 02:29:44.981466 | orchestrator | osism.services.openstackclient : Include tasks -------------------------- 0.22s 2026-04-24 02:29:47.310559 | orchestrator | 2026-04-24 02:29:47 | INFO  | Task 1348b512-0ea4-41ce-9b9d-4ac1dc77f1ee (common) was prepared for execution. 2026-04-24 02:29:47.310667 | orchestrator | 2026-04-24 02:29:47 | INFO  | It takes a moment until task 1348b512-0ea4-41ce-9b9d-4ac1dc77f1ee (common) has been started and output is visible here. 2026-04-24 02:29:59.546863 | orchestrator | 2026-04-24 02:29:59.546994 | orchestrator | PLAY [Apply role common] ******************************************************* 2026-04-24 02:29:59.547024 | orchestrator | 2026-04-24 02:29:59.547046 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-24 02:29:59.547064 | orchestrator | Friday 24 April 2026 02:29:51 +0000 (0:00:00.286) 0:00:00.286 ********** 2026-04-24 02:29:59.547085 | orchestrator | included: /ansible/roles/common/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:29:59.547107 | orchestrator | 2026-04-24 02:29:59.547126 | orchestrator | TASK [common : Ensuring config directories exist] ****************************** 2026-04-24 02:29:59.547146 | orchestrator | Friday 24 April 2026 02:29:52 +0000 (0:00:01.308) 0:00:01.595 ********** 2026-04-24 02:29:59.547166 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 02:29:59.547187 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 02:29:59.547208 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 02:29:59.547229 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 02:29:59.547249 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 02:29:59.547268 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 02:29:59.547321 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 02:29:59.547333 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 02:29:59.547344 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 02:29:59.547375 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 02:29:59.547389 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 02:29:59.547403 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 02:29:59.547422 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 02:29:59.547450 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 02:29:59.547473 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 02:29:59.547493 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 02:29:59.547511 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 02:29:59.547563 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 02:29:59.547582 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 02:29:59.547603 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 02:29:59.547623 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 02:29:59.547641 | orchestrator | 2026-04-24 02:29:59.547659 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-24 02:29:59.547672 | orchestrator | Friday 24 April 2026 02:29:55 +0000 (0:00:02.602) 0:00:04.197 ********** 2026-04-24 02:29:59.547685 | orchestrator | included: /ansible/roles/common/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:29:59.547699 | orchestrator | 2026-04-24 02:29:59.547711 | orchestrator | TASK [service-cert-copy : common | Copying over extra CA certificates] ********* 2026-04-24 02:29:59.547732 | orchestrator | Friday 24 April 2026 02:29:56 +0000 (0:00:01.324) 0:00:05.522 ********** 2026-04-24 02:29:59.547749 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:29:59.547765 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:29:59.547805 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:29:59.547819 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:29:59.547830 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:29:59.547842 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:29:59.547862 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:29:59.547874 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:29:59.547885 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:29:59.547913 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620437 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620543 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620595 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620618 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620634 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620662 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620675 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620713 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620726 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620737 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620757 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:00.620770 | orchestrator | 2026-04-24 02:30:00.620789 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS certificate] *** 2026-04-24 02:30:00.620808 | orchestrator | Friday 24 April 2026 02:30:00 +0000 (0:00:03.473) 0:00:08.995 ********** 2026-04-24 02:30:00.620830 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:00.620850 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:00.620870 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:00.620882 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:30:00.620896 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:00.620923 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209479 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209622 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:30:01.209709 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:01.209738 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209758 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209770 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:30:01.209782 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:01.209807 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209819 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209830 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:30:01.209864 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:01.209887 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209898 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209909 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:30:01.209921 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:01.209932 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209944 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:01.209955 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:30:01.209967 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:01.209986 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104354 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104464 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:30:02.104490 | orchestrator | 2026-04-24 02:30:02.104510 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS key] ****** 2026-04-24 02:30:02.104530 | orchestrator | Friday 24 April 2026 02:30:01 +0000 (0:00:00.908) 0:00:09.904 ********** 2026-04-24 02:30:02.104554 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:02.104579 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104598 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104609 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:30:02.104640 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:02.104658 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104697 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104709 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:30:02.104749 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:02.104762 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104774 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104785 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:30:02.104797 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:02.104808 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104824 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:02.104843 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:30:02.104855 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:02.104886 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:07.133934 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:07.134111 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:30:07.134132 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:07.134145 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:07.134156 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:07.134167 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:30:07.134177 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 02:30:07.134212 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:07.134223 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:07.134233 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:30:07.134243 | orchestrator | 2026-04-24 02:30:07.134254 | orchestrator | TASK [common : Copying over /run subdirectories conf] ************************** 2026-04-24 02:30:07.134265 | orchestrator | Friday 24 April 2026 02:30:03 +0000 (0:00:01.817) 0:00:11.721 ********** 2026-04-24 02:30:07.134315 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:30:07.134326 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:30:07.134336 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:30:07.134346 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:30:07.134372 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:30:07.134383 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:30:07.134393 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:30:07.134402 | orchestrator | 2026-04-24 02:30:07.134412 | orchestrator | TASK [common : Restart systemd-tmpfiles] *************************************** 2026-04-24 02:30:07.134422 | orchestrator | Friday 24 April 2026 02:30:03 +0000 (0:00:00.697) 0:00:12.419 ********** 2026-04-24 02:30:07.134434 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:30:07.134445 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:30:07.134457 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:30:07.134468 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:30:07.134480 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:30:07.134492 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:30:07.134503 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:30:07.134514 | orchestrator | 2026-04-24 02:30:07.134525 | orchestrator | TASK [common : Copying over config.json files for services] ******************** 2026-04-24 02:30:07.134535 | orchestrator | Friday 24 April 2026 02:30:04 +0000 (0:00:00.897) 0:00:13.316 ********** 2026-04-24 02:30:07.134545 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:07.134572 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:07.134590 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:07.134605 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:07.134616 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:07.134626 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:07.134650 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:10.197416 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197502 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197534 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197552 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197560 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197568 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197592 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197602 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197612 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197631 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197642 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197653 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197662 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197671 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:10.197682 | orchestrator | 2026-04-24 02:30:10.197692 | orchestrator | TASK [common : Find custom fluentd input config files] ************************* 2026-04-24 02:30:10.197703 | orchestrator | Friday 24 April 2026 02:30:08 +0000 (0:00:03.477) 0:00:16.794 ********** 2026-04-24 02:30:10.197713 | orchestrator | [WARNING]: Skipped 2026-04-24 02:30:10.197725 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' path due 2026-04-24 02:30:10.197737 | orchestrator | to this access issue: 2026-04-24 02:30:10.197748 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' is not a 2026-04-24 02:30:10.197759 | orchestrator | directory 2026-04-24 02:30:10.197770 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 02:30:10.197782 | orchestrator | 2026-04-24 02:30:10.197794 | orchestrator | TASK [common : Find custom fluentd filter config files] ************************ 2026-04-24 02:30:10.197805 | orchestrator | Friday 24 April 2026 02:30:09 +0000 (0:00:01.049) 0:00:17.844 ********** 2026-04-24 02:30:10.197827 | orchestrator | [WARNING]: Skipped 2026-04-24 02:30:10.197841 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' path due 2026-04-24 02:30:19.713590 | orchestrator | to this access issue: 2026-04-24 02:30:19.713690 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' is not a 2026-04-24 02:30:19.713701 | orchestrator | directory 2026-04-24 02:30:19.713709 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 02:30:19.713719 | orchestrator | 2026-04-24 02:30:19.713732 | orchestrator | TASK [common : Find custom fluentd format config files] ************************ 2026-04-24 02:30:19.713745 | orchestrator | Friday 24 April 2026 02:30:10 +0000 (0:00:01.338) 0:00:19.183 ********** 2026-04-24 02:30:19.713778 | orchestrator | [WARNING]: Skipped 2026-04-24 02:30:19.713790 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' path due 2026-04-24 02:30:19.713801 | orchestrator | to this access issue: 2026-04-24 02:30:19.713811 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' is not a 2026-04-24 02:30:19.713821 | orchestrator | directory 2026-04-24 02:30:19.713832 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 02:30:19.713843 | orchestrator | 2026-04-24 02:30:19.713855 | orchestrator | TASK [common : Find custom fluentd output config files] ************************ 2026-04-24 02:30:19.713867 | orchestrator | Friday 24 April 2026 02:30:11 +0000 (0:00:00.730) 0:00:19.913 ********** 2026-04-24 02:30:19.713879 | orchestrator | [WARNING]: Skipped 2026-04-24 02:30:19.713891 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' path due 2026-04-24 02:30:19.713903 | orchestrator | to this access issue: 2026-04-24 02:30:19.713910 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' is not a 2026-04-24 02:30:19.713917 | orchestrator | directory 2026-04-24 02:30:19.713924 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 02:30:19.713930 | orchestrator | 2026-04-24 02:30:19.713937 | orchestrator | TASK [common : Copying over fluentd.conf] ************************************** 2026-04-24 02:30:19.713944 | orchestrator | Friday 24 April 2026 02:30:11 +0000 (0:00:00.743) 0:00:20.657 ********** 2026-04-24 02:30:19.713950 | orchestrator | changed: [testbed-manager] 2026-04-24 02:30:19.713957 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:30:19.713964 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:30:19.713970 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:30:19.713977 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:30:19.713983 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:30:19.714006 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:30:19.714013 | orchestrator | 2026-04-24 02:30:19.714084 | orchestrator | TASK [common : Copying over cron logrotate config file] ************************ 2026-04-24 02:30:19.714096 | orchestrator | Friday 24 April 2026 02:30:14 +0000 (0:00:02.334) 0:00:22.991 ********** 2026-04-24 02:30:19.714105 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 02:30:19.714117 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 02:30:19.714128 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 02:30:19.714140 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 02:30:19.714152 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 02:30:19.714166 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 02:30:19.714185 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 02:30:19.714194 | orchestrator | 2026-04-24 02:30:19.714202 | orchestrator | TASK [common : Ensure RabbitMQ Erlang cookie exists] *************************** 2026-04-24 02:30:19.714213 | orchestrator | Friday 24 April 2026 02:30:16 +0000 (0:00:02.232) 0:00:25.224 ********** 2026-04-24 02:30:19.714245 | orchestrator | changed: [testbed-manager] 2026-04-24 02:30:19.714257 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:30:19.714268 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:30:19.714280 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:30:19.714292 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:30:19.714303 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:30:19.714315 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:30:19.714326 | orchestrator | 2026-04-24 02:30:19.714338 | orchestrator | TASK [common : Ensuring config directories have correct owner and permission] *** 2026-04-24 02:30:19.714355 | orchestrator | Friday 24 April 2026 02:30:18 +0000 (0:00:01.890) 0:00:27.114 ********** 2026-04-24 02:30:19.714365 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:19.714393 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:19.714402 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:19.714409 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:19.714416 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:19.714428 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:19.714435 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:19.714447 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:19.714459 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:25.760443 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:25.760593 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:25.760614 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:25.760627 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:25.760651 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:25.760688 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:25.760700 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:25.760731 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:30:25.760744 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:25.760755 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:25.760767 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:25.760779 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:25.760791 | orchestrator | 2026-04-24 02:30:25.760804 | orchestrator | TASK [common : Copy rabbitmq-env.conf to kolla toolbox] ************************ 2026-04-24 02:30:25.760817 | orchestrator | Friday 24 April 2026 02:30:19 +0000 (0:00:01.561) 0:00:28.676 ********** 2026-04-24 02:30:25.760827 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 02:30:25.760839 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 02:30:25.760857 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 02:30:25.760868 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 02:30:25.760879 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 02:30:25.760890 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 02:30:25.760901 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 02:30:25.760911 | orchestrator | 2026-04-24 02:30:25.760923 | orchestrator | TASK [common : Copy rabbitmq erl_inetrc to kolla toolbox] ********************** 2026-04-24 02:30:25.760933 | orchestrator | Friday 24 April 2026 02:30:21 +0000 (0:00:01.964) 0:00:30.640 ********** 2026-04-24 02:30:25.760944 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 02:30:25.760957 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 02:30:25.760969 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 02:30:25.760991 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 02:30:25.761005 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 02:30:25.761017 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 02:30:25.761029 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 02:30:25.761041 | orchestrator | 2026-04-24 02:30:25.761054 | orchestrator | TASK [common : Check common containers] **************************************** 2026-04-24 02:30:25.761067 | orchestrator | Friday 24 April 2026 02:30:23 +0000 (0:00:01.782) 0:00:32.422 ********** 2026-04-24 02:30:25.761093 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:26.356075 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:26.356178 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:26.356220 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:26.356261 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:26.356285 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:26.356297 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 02:30:26.356309 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:26.356340 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:26.356353 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:26.356364 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:26.356390 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:26.356402 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:26.356413 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:26.356425 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:30:26.356447 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:31:55.001187 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:31:55.001307 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:31:55.001359 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:31:55.001379 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:31:55.001414 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:31:55.001434 | orchestrator | 2026-04-24 02:31:55.001455 | orchestrator | TASK [common : Creating log volume] ******************************************** 2026-04-24 02:31:55.001474 | orchestrator | Friday 24 April 2026 02:30:26 +0000 (0:00:02.627) 0:00:35.049 ********** 2026-04-24 02:31:55.001492 | orchestrator | changed: [testbed-manager] 2026-04-24 02:31:55.001511 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:31:55.001526 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:31:55.001545 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:31:55.001563 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:31:55.001583 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:31:55.001604 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:31:55.001623 | orchestrator | 2026-04-24 02:31:55.001641 | orchestrator | TASK [common : Link kolla_logs volume to /var/log/kolla] *********************** 2026-04-24 02:31:55.001652 | orchestrator | Friday 24 April 2026 02:30:27 +0000 (0:00:01.338) 0:00:36.388 ********** 2026-04-24 02:31:55.001663 | orchestrator | changed: [testbed-manager] 2026-04-24 02:31:55.001674 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:31:55.001684 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:31:55.001695 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:31:55.001706 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:31:55.001719 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:31:55.001731 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:31:55.001743 | orchestrator | 2026-04-24 02:31:55.001756 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 02:31:55.001768 | orchestrator | Friday 24 April 2026 02:30:28 +0000 (0:00:01.154) 0:00:37.543 ********** 2026-04-24 02:31:55.001780 | orchestrator | 2026-04-24 02:31:55.001792 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 02:31:55.001805 | orchestrator | Friday 24 April 2026 02:30:28 +0000 (0:00:00.064) 0:00:37.607 ********** 2026-04-24 02:31:55.001817 | orchestrator | 2026-04-24 02:31:55.001860 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 02:31:55.001874 | orchestrator | Friday 24 April 2026 02:30:28 +0000 (0:00:00.063) 0:00:37.671 ********** 2026-04-24 02:31:55.001886 | orchestrator | 2026-04-24 02:31:55.001899 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 02:31:55.001911 | orchestrator | Friday 24 April 2026 02:30:29 +0000 (0:00:00.065) 0:00:37.736 ********** 2026-04-24 02:31:55.001924 | orchestrator | 2026-04-24 02:31:55.001936 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 02:31:55.001962 | orchestrator | Friday 24 April 2026 02:30:29 +0000 (0:00:00.231) 0:00:37.968 ********** 2026-04-24 02:31:55.001974 | orchestrator | 2026-04-24 02:31:55.001991 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 02:31:55.002009 | orchestrator | Friday 24 April 2026 02:30:29 +0000 (0:00:00.063) 0:00:38.032 ********** 2026-04-24 02:31:55.002220 | orchestrator | 2026-04-24 02:31:55.002241 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 02:31:55.002283 | orchestrator | Friday 24 April 2026 02:30:29 +0000 (0:00:00.060) 0:00:38.092 ********** 2026-04-24 02:31:55.002301 | orchestrator | 2026-04-24 02:31:55.002319 | orchestrator | RUNNING HANDLER [common : Restart fluentd container] *************************** 2026-04-24 02:31:55.002336 | orchestrator | Friday 24 April 2026 02:30:29 +0000 (0:00:00.089) 0:00:38.182 ********** 2026-04-24 02:31:55.002353 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:31:55.002371 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:31:55.002390 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:31:55.002409 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:31:55.002428 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:31:55.002446 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:31:55.002465 | orchestrator | changed: [testbed-manager] 2026-04-24 02:31:55.002481 | orchestrator | 2026-04-24 02:31:55.002500 | orchestrator | RUNNING HANDLER [common : Restart kolla-toolbox container] ********************* 2026-04-24 02:31:55.002520 | orchestrator | Friday 24 April 2026 02:31:05 +0000 (0:00:36.099) 0:01:14.281 ********** 2026-04-24 02:31:55.002541 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:31:55.002560 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:31:55.002575 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:31:55.002588 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:31:55.002606 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:31:55.002623 | orchestrator | changed: [testbed-manager] 2026-04-24 02:31:55.002641 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:31:55.002660 | orchestrator | 2026-04-24 02:31:55.002679 | orchestrator | RUNNING HANDLER [common : Initializing toolbox container using normal user] **** 2026-04-24 02:31:55.002698 | orchestrator | Friday 24 April 2026 02:31:44 +0000 (0:00:38.926) 0:01:53.208 ********** 2026-04-24 02:31:55.002709 | orchestrator | ok: [testbed-manager] 2026-04-24 02:31:55.002721 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:31:55.002732 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:31:55.002743 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:31:55.002754 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:31:55.002764 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:31:55.002774 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:31:55.002785 | orchestrator | 2026-04-24 02:31:55.002796 | orchestrator | RUNNING HANDLER [common : Restart cron container] ****************************** 2026-04-24 02:31:55.002807 | orchestrator | Friday 24 April 2026 02:31:46 +0000 (0:00:01.821) 0:01:55.029 ********** 2026-04-24 02:31:55.002818 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:31:55.002856 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:31:55.002868 | orchestrator | changed: [testbed-manager] 2026-04-24 02:31:55.002879 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:31:55.002889 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:31:55.002900 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:31:55.002911 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:31:55.002921 | orchestrator | 2026-04-24 02:31:55.002932 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:31:55.002945 | orchestrator | testbed-manager : ok=22  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 02:31:55.002958 | orchestrator | testbed-node-0 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 02:31:55.002983 | orchestrator | testbed-node-1 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 02:31:55.003008 | orchestrator | testbed-node-2 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 02:31:55.003020 | orchestrator | testbed-node-3 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 02:31:55.003031 | orchestrator | testbed-node-4 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 02:31:55.003042 | orchestrator | testbed-node-5 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 02:31:55.003052 | orchestrator | 2026-04-24 02:31:55.003063 | orchestrator | 2026-04-24 02:31:55.003074 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:31:55.003085 | orchestrator | Friday 24 April 2026 02:31:54 +0000 (0:00:08.640) 0:02:03.670 ********** 2026-04-24 02:31:55.003096 | orchestrator | =============================================================================== 2026-04-24 02:31:55.003106 | orchestrator | common : Restart kolla-toolbox container ------------------------------- 38.93s 2026-04-24 02:31:55.003117 | orchestrator | common : Restart fluentd container ------------------------------------- 36.10s 2026-04-24 02:31:55.003128 | orchestrator | common : Restart cron container ----------------------------------------- 8.64s 2026-04-24 02:31:55.003138 | orchestrator | common : Copying over config.json files for services -------------------- 3.48s 2026-04-24 02:31:55.003149 | orchestrator | service-cert-copy : common | Copying over extra CA certificates --------- 3.47s 2026-04-24 02:31:55.003160 | orchestrator | common : Check common containers ---------------------------------------- 2.63s 2026-04-24 02:31:55.003170 | orchestrator | common : Ensuring config directories exist ------------------------------ 2.60s 2026-04-24 02:31:55.003181 | orchestrator | common : Copying over fluentd.conf -------------------------------------- 2.33s 2026-04-24 02:31:55.003191 | orchestrator | common : Copying over cron logrotate config file ------------------------ 2.23s 2026-04-24 02:31:55.003202 | orchestrator | common : Copy rabbitmq-env.conf to kolla toolbox ------------------------ 1.96s 2026-04-24 02:31:55.003212 | orchestrator | common : Ensure RabbitMQ Erlang cookie exists --------------------------- 1.89s 2026-04-24 02:31:55.003235 | orchestrator | common : Initializing toolbox container using normal user --------------- 1.82s 2026-04-24 02:31:55.416126 | orchestrator | service-cert-copy : common | Copying over backend internal TLS key ------ 1.82s 2026-04-24 02:31:55.416220 | orchestrator | common : Copy rabbitmq erl_inetrc to kolla toolbox ---------------------- 1.78s 2026-04-24 02:31:55.416232 | orchestrator | common : Ensuring config directories have correct owner and permission --- 1.56s 2026-04-24 02:31:55.416244 | orchestrator | common : Creating log volume -------------------------------------------- 1.34s 2026-04-24 02:31:55.416257 | orchestrator | common : Find custom fluentd filter config files ------------------------ 1.34s 2026-04-24 02:31:55.416271 | orchestrator | common : include_tasks -------------------------------------------------- 1.32s 2026-04-24 02:31:55.416286 | orchestrator | common : include_tasks -------------------------------------------------- 1.31s 2026-04-24 02:31:55.416300 | orchestrator | common : Link kolla_logs volume to /var/log/kolla ----------------------- 1.15s 2026-04-24 02:31:57.784579 | orchestrator | 2026-04-24 02:31:57 | INFO  | Task d49eb991-faef-4864-849d-21c6f9abeddb (loadbalancer) was prepared for execution. 2026-04-24 02:31:57.784690 | orchestrator | 2026-04-24 02:31:57 | INFO  | It takes a moment until task d49eb991-faef-4864-849d-21c6f9abeddb (loadbalancer) has been started and output is visible here. 2026-04-24 02:32:12.724101 | orchestrator | 2026-04-24 02:32:12.724219 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:32:12.724237 | orchestrator | 2026-04-24 02:32:12.724249 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 02:32:12.724261 | orchestrator | Friday 24 April 2026 02:32:02 +0000 (0:00:00.251) 0:00:00.251 ********** 2026-04-24 02:32:12.724298 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:32:12.724312 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:32:12.724323 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:32:12.724334 | orchestrator | 2026-04-24 02:32:12.724345 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 02:32:12.724362 | orchestrator | Friday 24 April 2026 02:32:02 +0000 (0:00:00.304) 0:00:00.556 ********** 2026-04-24 02:32:12.724382 | orchestrator | ok: [testbed-node-0] => (item=enable_loadbalancer_True) 2026-04-24 02:32:12.724401 | orchestrator | ok: [testbed-node-1] => (item=enable_loadbalancer_True) 2026-04-24 02:32:12.724420 | orchestrator | ok: [testbed-node-2] => (item=enable_loadbalancer_True) 2026-04-24 02:32:12.724439 | orchestrator | 2026-04-24 02:32:12.724457 | orchestrator | PLAY [Apply role loadbalancer] ************************************************* 2026-04-24 02:32:12.724476 | orchestrator | 2026-04-24 02:32:12.724494 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-24 02:32:12.724547 | orchestrator | Friday 24 April 2026 02:32:02 +0000 (0:00:00.424) 0:00:00.980 ********** 2026-04-24 02:32:12.724568 | orchestrator | included: /ansible/roles/loadbalancer/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:32:12.724587 | orchestrator | 2026-04-24 02:32:12.724605 | orchestrator | TASK [loadbalancer : Check IPv6 support] *************************************** 2026-04-24 02:32:12.724624 | orchestrator | Friday 24 April 2026 02:32:03 +0000 (0:00:00.527) 0:00:01.507 ********** 2026-04-24 02:32:12.724644 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:32:12.724662 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:32:12.724682 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:32:12.724700 | orchestrator | 2026-04-24 02:32:12.724718 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-24 02:32:12.724737 | orchestrator | Friday 24 April 2026 02:32:03 +0000 (0:00:00.635) 0:00:02.143 ********** 2026-04-24 02:32:12.724754 | orchestrator | included: sysctl for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:32:12.724803 | orchestrator | 2026-04-24 02:32:12.724822 | orchestrator | TASK [sysctl : Check IPv6 support] ********************************************* 2026-04-24 02:32:12.724839 | orchestrator | Friday 24 April 2026 02:32:04 +0000 (0:00:00.690) 0:00:02.833 ********** 2026-04-24 02:32:12.724857 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:32:12.724874 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:32:12.724892 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:32:12.724910 | orchestrator | 2026-04-24 02:32:12.724929 | orchestrator | TASK [sysctl : Setting sysctl values] ****************************************** 2026-04-24 02:32:12.724947 | orchestrator | Friday 24 April 2026 02:32:05 +0000 (0:00:00.615) 0:00:03.449 ********** 2026-04-24 02:32:12.724964 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-24 02:32:12.724982 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-24 02:32:12.724999 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-24 02:32:12.725018 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-24 02:32:12.725037 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-24 02:32:12.725055 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-24 02:32:12.725076 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-24 02:32:12.725094 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-24 02:32:12.725111 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-24 02:32:12.725129 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-24 02:32:12.725163 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-24 02:32:12.725183 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-24 02:32:12.725201 | orchestrator | 2026-04-24 02:32:12.725220 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-24 02:32:12.725238 | orchestrator | Friday 24 April 2026 02:32:08 +0000 (0:00:03.072) 0:00:06.522 ********** 2026-04-24 02:32:12.725255 | orchestrator | changed: [testbed-node-1] => (item=ip_vs) 2026-04-24 02:32:12.725267 | orchestrator | changed: [testbed-node-0] => (item=ip_vs) 2026-04-24 02:32:12.725278 | orchestrator | changed: [testbed-node-2] => (item=ip_vs) 2026-04-24 02:32:12.725288 | orchestrator | 2026-04-24 02:32:12.725299 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-24 02:32:12.725310 | orchestrator | Friday 24 April 2026 02:32:08 +0000 (0:00:00.711) 0:00:07.233 ********** 2026-04-24 02:32:12.725321 | orchestrator | changed: [testbed-node-2] => (item=ip_vs) 2026-04-24 02:32:12.725332 | orchestrator | changed: [testbed-node-1] => (item=ip_vs) 2026-04-24 02:32:12.725342 | orchestrator | changed: [testbed-node-0] => (item=ip_vs) 2026-04-24 02:32:12.725352 | orchestrator | 2026-04-24 02:32:12.725363 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-24 02:32:12.725374 | orchestrator | Friday 24 April 2026 02:32:10 +0000 (0:00:01.240) 0:00:08.473 ********** 2026-04-24 02:32:12.725384 | orchestrator | skipping: [testbed-node-0] => (item=ip_vs)  2026-04-24 02:32:12.725395 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:12.725426 | orchestrator | skipping: [testbed-node-1] => (item=ip_vs)  2026-04-24 02:32:12.725438 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:12.725448 | orchestrator | skipping: [testbed-node-2] => (item=ip_vs)  2026-04-24 02:32:12.725459 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:12.725469 | orchestrator | 2026-04-24 02:32:12.725480 | orchestrator | TASK [loadbalancer : Ensuring config directories exist] ************************ 2026-04-24 02:32:12.725491 | orchestrator | Friday 24 April 2026 02:32:10 +0000 (0:00:00.581) 0:00:09.055 ********** 2026-04-24 02:32:12.725513 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:12.725531 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:12.725543 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:12.725563 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:12.725575 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:12.725596 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:17.952150 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:17.952327 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:17.952356 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:17.952376 | orchestrator | 2026-04-24 02:32:17.952396 | orchestrator | TASK [loadbalancer : Ensuring haproxy service config subdir exists] ************ 2026-04-24 02:32:17.952415 | orchestrator | Friday 24 April 2026 02:32:12 +0000 (0:00:01.905) 0:00:10.961 ********** 2026-04-24 02:32:17.952434 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:32:17.952482 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:32:17.952496 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:32:17.952507 | orchestrator | 2026-04-24 02:32:17.952517 | orchestrator | TASK [loadbalancer : Ensuring proxysql service config subdirectories exist] **** 2026-04-24 02:32:17.952527 | orchestrator | Friday 24 April 2026 02:32:13 +0000 (0:00:00.896) 0:00:11.857 ********** 2026-04-24 02:32:17.952537 | orchestrator | changed: [testbed-node-0] => (item=users) 2026-04-24 02:32:17.952547 | orchestrator | changed: [testbed-node-1] => (item=users) 2026-04-24 02:32:17.952557 | orchestrator | changed: [testbed-node-2] => (item=users) 2026-04-24 02:32:17.952566 | orchestrator | changed: [testbed-node-0] => (item=rules) 2026-04-24 02:32:17.952576 | orchestrator | changed: [testbed-node-1] => (item=rules) 2026-04-24 02:32:17.952585 | orchestrator | changed: [testbed-node-2] => (item=rules) 2026-04-24 02:32:17.952594 | orchestrator | 2026-04-24 02:32:17.952604 | orchestrator | TASK [loadbalancer : Ensuring keepalived checks subdir exists] ***************** 2026-04-24 02:32:17.952616 | orchestrator | Friday 24 April 2026 02:32:15 +0000 (0:00:01.475) 0:00:13.332 ********** 2026-04-24 02:32:17.952627 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:32:17.952637 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:32:17.952649 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:32:17.952664 | orchestrator | 2026-04-24 02:32:17.952681 | orchestrator | TASK [loadbalancer : Remove mariadb.cfg if proxysql enabled] ******************* 2026-04-24 02:32:17.952698 | orchestrator | Friday 24 April 2026 02:32:16 +0000 (0:00:00.948) 0:00:14.281 ********** 2026-04-24 02:32:17.952716 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:32:17.952732 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:32:17.952808 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:32:17.952821 | orchestrator | 2026-04-24 02:32:17.952832 | orchestrator | TASK [loadbalancer : Removing checks for services which are disabled] ********** 2026-04-24 02:32:17.952845 | orchestrator | Friday 24 April 2026 02:32:17 +0000 (0:00:01.331) 0:00:15.612 ********** 2026-04-24 02:32:17.952857 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:17.952889 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:17.952900 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:17.952912 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 02:32:17.952933 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:17.952944 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:17.952990 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:17.953002 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:17.953012 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 02:32:17.953022 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:17.953040 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:20.678452 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:20.678611 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:20.678643 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 02:32:20.678663 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:20.678683 | orchestrator | 2026-04-24 02:32:20.678702 | orchestrator | TASK [loadbalancer : Copying checks for services which are enabled] ************ 2026-04-24 02:32:20.678722 | orchestrator | Friday 24 April 2026 02:32:17 +0000 (0:00:00.578) 0:00:16.190 ********** 2026-04-24 02:32:20.678839 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:20.678860 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:20.678881 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:20.678965 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:20.678990 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:20.679011 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:20.679032 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 02:32:20.679054 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:20.679076 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 02:32:20.679123 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:28.949798 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:28.949937 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041', '__omit_place_holder__7a00c6d5b8af8cb4c2f4d093dde5f1fcde5ed041'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 02:32:28.949963 | orchestrator | 2026-04-24 02:32:28.949985 | orchestrator | TASK [loadbalancer : Copying over config.json files for services] ************** 2026-04-24 02:32:28.950005 | orchestrator | Friday 24 April 2026 02:32:20 +0000 (0:00:02.719) 0:00:18.910 ********** 2026-04-24 02:32:28.950099 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:28.950123 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:28.950144 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:28.950251 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:28.950305 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:28.950319 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:28.950331 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:28.950343 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:28.950354 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:28.950365 | orchestrator | 2026-04-24 02:32:28.950377 | orchestrator | TASK [loadbalancer : Copying over haproxy.cfg] ********************************* 2026-04-24 02:32:28.950388 | orchestrator | Friday 24 April 2026 02:32:23 +0000 (0:00:03.186) 0:00:22.096 ********** 2026-04-24 02:32:28.950408 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-24 02:32:28.950420 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-24 02:32:28.950431 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-24 02:32:28.950442 | orchestrator | 2026-04-24 02:32:28.950452 | orchestrator | TASK [loadbalancer : Copying over proxysql config] ***************************** 2026-04-24 02:32:28.950463 | orchestrator | Friday 24 April 2026 02:32:25 +0000 (0:00:01.809) 0:00:23.905 ********** 2026-04-24 02:32:28.950474 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-24 02:32:28.950485 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-24 02:32:28.950495 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-24 02:32:28.950506 | orchestrator | 2026-04-24 02:32:28.950517 | orchestrator | TASK [loadbalancer : Copying over haproxy single external frontend config] ***** 2026-04-24 02:32:28.950528 | orchestrator | Friday 24 April 2026 02:32:28 +0000 (0:00:02.751) 0:00:26.657 ********** 2026-04-24 02:32:28.950538 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:28.950551 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:28.950562 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:28.950573 | orchestrator | 2026-04-24 02:32:28.950591 | orchestrator | TASK [loadbalancer : Copying over custom haproxy services configuration] ******* 2026-04-24 02:32:40.522904 | orchestrator | Friday 24 April 2026 02:32:28 +0000 (0:00:00.533) 0:00:27.191 ********** 2026-04-24 02:32:40.523074 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-24 02:32:40.523108 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-24 02:32:40.523120 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-24 02:32:40.523132 | orchestrator | 2026-04-24 02:32:40.523145 | orchestrator | TASK [loadbalancer : Copying over keepalived.conf] ***************************** 2026-04-24 02:32:40.523156 | orchestrator | Friday 24 April 2026 02:32:31 +0000 (0:00:02.059) 0:00:29.250 ********** 2026-04-24 02:32:40.523168 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-24 02:32:40.523180 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-24 02:32:40.523191 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-24 02:32:40.523202 | orchestrator | 2026-04-24 02:32:40.523213 | orchestrator | TASK [loadbalancer : Copying over haproxy.pem] ********************************* 2026-04-24 02:32:40.523224 | orchestrator | Friday 24 April 2026 02:32:33 +0000 (0:00:02.097) 0:00:31.347 ********** 2026-04-24 02:32:40.523235 | orchestrator | changed: [testbed-node-0] => (item=haproxy.pem) 2026-04-24 02:32:40.523247 | orchestrator | changed: [testbed-node-1] => (item=haproxy.pem) 2026-04-24 02:32:40.523291 | orchestrator | changed: [testbed-node-2] => (item=haproxy.pem) 2026-04-24 02:32:40.523305 | orchestrator | 2026-04-24 02:32:40.523330 | orchestrator | TASK [loadbalancer : Copying over haproxy-internal.pem] ************************ 2026-04-24 02:32:40.523341 | orchestrator | Friday 24 April 2026 02:32:34 +0000 (0:00:01.450) 0:00:32.798 ********** 2026-04-24 02:32:40.523353 | orchestrator | changed: [testbed-node-0] => (item=haproxy-internal.pem) 2026-04-24 02:32:40.523364 | orchestrator | changed: [testbed-node-1] => (item=haproxy-internal.pem) 2026-04-24 02:32:40.523375 | orchestrator | changed: [testbed-node-2] => (item=haproxy-internal.pem) 2026-04-24 02:32:40.523404 | orchestrator | 2026-04-24 02:32:40.523476 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-24 02:32:40.523500 | orchestrator | Friday 24 April 2026 02:32:36 +0000 (0:00:01.464) 0:00:34.263 ********** 2026-04-24 02:32:40.523513 | orchestrator | included: /ansible/roles/loadbalancer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:32:40.523566 | orchestrator | 2026-04-24 02:32:40.523581 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over extra CA certificates] *** 2026-04-24 02:32:40.523594 | orchestrator | Friday 24 April 2026 02:32:36 +0000 (0:00:00.512) 0:00:34.775 ********** 2026-04-24 02:32:40.523610 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:40.523628 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:40.523647 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:40.523762 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:40.523778 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:40.523790 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:40.523813 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:40.523825 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:40.523836 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:40.523848 | orchestrator | 2026-04-24 02:32:40.523859 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over backend internal TLS certificate] *** 2026-04-24 02:32:40.523870 | orchestrator | Friday 24 April 2026 02:32:39 +0000 (0:00:03.349) 0:00:38.124 ********** 2026-04-24 02:32:40.523896 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:41.346741 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:41.346842 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:41.346888 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:41.346904 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:41.346914 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:41.346923 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:41.346933 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:41.346944 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:41.346995 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:41.347007 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:41.347026 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:41.347036 | orchestrator | 2026-04-24 02:32:41.347047 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over backend internal TLS key] *** 2026-04-24 02:32:41.347059 | orchestrator | Friday 24 April 2026 02:32:40 +0000 (0:00:00.637) 0:00:38.761 ********** 2026-04-24 02:32:41.347072 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:41.347084 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:41.347095 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:41.347106 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:41.347117 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:41.347143 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:42.319052 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:42.319144 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:42.319157 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:42.319165 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:42.319172 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:42.319179 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:42.319186 | orchestrator | 2026-04-24 02:32:42.319193 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-24 02:32:42.319201 | orchestrator | Friday 24 April 2026 02:32:41 +0000 (0:00:00.816) 0:00:39.578 ********** 2026-04-24 02:32:42.319207 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:42.319214 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:42.319235 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:42.319247 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:42.319254 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:42.319261 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:42.319267 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:42.319274 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:42.319280 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:42.319300 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:42.319312 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:42.319337 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:43.761881 | orchestrator | 2026-04-24 02:32:43.761955 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-24 02:32:43.761965 | orchestrator | Friday 24 April 2026 02:32:42 +0000 (0:00:00.969) 0:00:40.548 ********** 2026-04-24 02:32:43.761973 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:43.761981 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:43.761988 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:43.761994 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:43.762001 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:43.762006 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:43.762089 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:43.762116 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:43.762135 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:43.762140 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:43.762146 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:43.762151 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:43.762157 | orchestrator | 2026-04-24 02:32:43.762162 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-24 02:32:43.762167 | orchestrator | Friday 24 April 2026 02:32:42 +0000 (0:00:00.627) 0:00:41.176 ********** 2026-04-24 02:32:43.762173 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:43.762178 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:43.762196 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:43.762202 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:43.762212 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:44.787037 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:44.787179 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:44.787211 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:44.787235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:44.787253 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:44.787265 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:44.787302 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:44.787315 | orchestrator | 2026-04-24 02:32:44.787327 | orchestrator | TASK [service-cert-copy : proxysql | Copying over extra CA certificates] ******* 2026-04-24 02:32:44.787338 | orchestrator | Friday 24 April 2026 02:32:43 +0000 (0:00:00.824) 0:00:42.000 ********** 2026-04-24 02:32:44.787363 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:44.787399 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:44.787411 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:44.787423 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:44.787434 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:44.787446 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:44.787466 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:44.787477 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:44.787494 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:44.787514 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:46.161805 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:46.161920 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:46.161937 | orchestrator | 2026-04-24 02:32:46.161950 | orchestrator | TASK [service-cert-copy : proxysql | Copying over backend internal TLS certificate] *** 2026-04-24 02:32:46.161963 | orchestrator | Friday 24 April 2026 02:32:44 +0000 (0:00:01.015) 0:00:43.015 ********** 2026-04-24 02:32:46.161976 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:46.161989 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:46.162090 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:46.162105 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:46.162118 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:46.162142 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:46.162175 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:46.162187 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:46.162199 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:46.162211 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:46.162233 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:46.162245 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:46.162257 | orchestrator | 2026-04-24 02:32:46.162271 | orchestrator | TASK [service-cert-copy : proxysql | Copying over backend internal TLS key] **** 2026-04-24 02:32:46.162285 | orchestrator | Friday 24 April 2026 02:32:45 +0000 (0:00:00.595) 0:00:43.611 ********** 2026-04-24 02:32:46.162298 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 02:32:46.162312 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:46.162341 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:52.708762 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:52.708873 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 02:32:52.708893 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:52.708948 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:52.708963 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:52.708976 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 02:32:52.709001 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 02:32:52.709014 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 02:32:52.709025 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:52.709037 | orchestrator | 2026-04-24 02:32:52.709049 | orchestrator | TASK [loadbalancer : Copying over haproxy start script] ************************ 2026-04-24 02:32:52.709061 | orchestrator | Friday 24 April 2026 02:32:46 +0000 (0:00:00.788) 0:00:44.399 ********** 2026-04-24 02:32:52.709072 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-24 02:32:52.709101 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-24 02:32:52.709113 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-24 02:32:52.709123 | orchestrator | 2026-04-24 02:32:52.709134 | orchestrator | TASK [loadbalancer : Copying over proxysql start script] *********************** 2026-04-24 02:32:52.709146 | orchestrator | Friday 24 April 2026 02:32:47 +0000 (0:00:01.668) 0:00:46.068 ********** 2026-04-24 02:32:52.709159 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-24 02:32:52.709170 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-24 02:32:52.709180 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-24 02:32:52.709191 | orchestrator | 2026-04-24 02:32:52.709212 | orchestrator | TASK [loadbalancer : Copying files for haproxy-ssh] **************************** 2026-04-24 02:32:52.709223 | orchestrator | Friday 24 April 2026 02:32:49 +0000 (0:00:01.726) 0:00:47.794 ********** 2026-04-24 02:32:52.709234 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 02:32:52.709245 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 02:32:52.709256 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 02:32:52.709269 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 02:32:52.709281 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:52.709293 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 02:32:52.709306 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:52.709318 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 02:32:52.709330 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:32:52.709342 | orchestrator | 2026-04-24 02:32:52.709355 | orchestrator | TASK [loadbalancer : Check loadbalancer containers] **************************** 2026-04-24 02:32:52.709367 | orchestrator | Friday 24 April 2026 02:32:50 +0000 (0:00:00.809) 0:00:48.604 ********** 2026-04-24 02:32:52.709380 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:52.709393 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:52.709412 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 02:32:52.709434 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:56.911696 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:56.911813 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 02:32:56.911832 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:56.911844 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:56.911856 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 02:32:56.911868 | orchestrator | 2026-04-24 02:32:56.911899 | orchestrator | TASK [include_role : aodh] ***************************************************** 2026-04-24 02:32:56.911912 | orchestrator | Friday 24 April 2026 02:32:52 +0000 (0:00:02.340) 0:00:50.945 ********** 2026-04-24 02:32:56.911925 | orchestrator | included: aodh for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:32:56.911935 | orchestrator | 2026-04-24 02:32:56.911947 | orchestrator | TASK [haproxy-config : Copying over aodh haproxy config] *********************** 2026-04-24 02:32:56.911957 | orchestrator | Friday 24 April 2026 02:32:53 +0000 (0:00:00.826) 0:00:51.771 ********** 2026-04-24 02:32:56.911990 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 02:32:56.912030 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 02:32:56.912044 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:32:56.912056 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 02:32:56.912067 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 02:32:56.912085 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 02:32:56.912097 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:32:56.912126 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 02:32:57.578448 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 02:32:57.578547 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 02:32:57.578563 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:32:57.578590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 02:32:57.578671 | orchestrator | 2026-04-24 02:32:57.578685 | orchestrator | TASK [haproxy-config : Add configuration for aodh when using single external frontend] *** 2026-04-24 02:32:57.578697 | orchestrator | Friday 24 April 2026 02:32:56 +0000 (0:00:03.374) 0:00:55.145 ********** 2026-04-24 02:32:57.578709 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 02:32:57.578759 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 02:32:57.578772 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:32:57.578782 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 02:32:57.578793 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:32:57.578805 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 02:32:57.578822 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 02:32:57.578842 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:32:57.578852 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 02:32:57.578863 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:32:57.578882 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 02:33:06.155425 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 02:33:06.155612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.155647 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.155703 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:06.155726 | orchestrator | 2026-04-24 02:33:06.155747 | orchestrator | TASK [haproxy-config : Configuring firewall for aodh] ************************** 2026-04-24 02:33:06.155768 | orchestrator | Friday 24 April 2026 02:32:57 +0000 (0:00:00.667) 0:00:55.813 ********** 2026-04-24 02:33:06.155788 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-24 02:33:06.155812 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-24 02:33:06.155828 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:06.155858 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-24 02:33:06.155870 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-24 02:33:06.155881 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:06.155892 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-24 02:33:06.155903 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-24 02:33:06.155914 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:06.155925 | orchestrator | 2026-04-24 02:33:06.155939 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL users config] *************** 2026-04-24 02:33:06.155952 | orchestrator | Friday 24 April 2026 02:32:58 +0000 (0:00:01.102) 0:00:56.915 ********** 2026-04-24 02:33:06.155964 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:33:06.155977 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:33:06.155989 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:33:06.156002 | orchestrator | 2026-04-24 02:33:06.156015 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL rules config] *************** 2026-04-24 02:33:06.156028 | orchestrator | Friday 24 April 2026 02:33:00 +0000 (0:00:01.334) 0:00:58.250 ********** 2026-04-24 02:33:06.156041 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:33:06.156053 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:33:06.156066 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:33:06.156078 | orchestrator | 2026-04-24 02:33:06.156091 | orchestrator | TASK [include_role : barbican] ************************************************* 2026-04-24 02:33:06.156104 | orchestrator | Friday 24 April 2026 02:33:01 +0000 (0:00:01.984) 0:01:00.235 ********** 2026-04-24 02:33:06.156117 | orchestrator | included: barbican for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:33:06.156129 | orchestrator | 2026-04-24 02:33:06.156164 | orchestrator | TASK [haproxy-config : Copying over barbican haproxy config] ******************* 2026-04-24 02:33:06.156178 | orchestrator | Friday 24 April 2026 02:33:02 +0000 (0:00:00.627) 0:01:00.863 ********** 2026-04-24 02:33:06.156193 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 02:33:06.156229 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.156245 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.156258 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 02:33:06.156271 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.156294 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.779894 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 02:33:06.780012 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.780034 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.780052 | orchestrator | 2026-04-24 02:33:06.780070 | orchestrator | TASK [haproxy-config : Add configuration for barbican when using single external frontend] *** 2026-04-24 02:33:06.780088 | orchestrator | Friday 24 April 2026 02:33:06 +0000 (0:00:03.526) 0:01:04.389 ********** 2026-04-24 02:33:06.780105 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 02:33:06.780121 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.780167 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.780177 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:06.780195 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 02:33:06.780205 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.780215 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:06.780224 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:06.780234 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 02:33:06.780260 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 02:33:16.551731 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:16.551847 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:16.551866 | orchestrator | 2026-04-24 02:33:16.551880 | orchestrator | TASK [haproxy-config : Configuring firewall for barbican] ********************** 2026-04-24 02:33:16.551893 | orchestrator | Friday 24 April 2026 02:33:06 +0000 (0:00:00.626) 0:01:05.015 ********** 2026-04-24 02:33:16.551921 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-24 02:33:16.551935 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-24 02:33:16.551948 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:16.551960 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-24 02:33:16.551971 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-24 02:33:16.551982 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:16.551993 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-24 02:33:16.552004 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-24 02:33:16.552015 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:16.552026 | orchestrator | 2026-04-24 02:33:16.552037 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL users config] *********** 2026-04-24 02:33:16.552048 | orchestrator | Friday 24 April 2026 02:33:07 +0000 (0:00:00.846) 0:01:05.862 ********** 2026-04-24 02:33:16.552059 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:33:16.552071 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:33:16.552082 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:33:16.552093 | orchestrator | 2026-04-24 02:33:16.552104 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL rules config] *********** 2026-04-24 02:33:16.552115 | orchestrator | Friday 24 April 2026 02:33:09 +0000 (0:00:01.599) 0:01:07.462 ********** 2026-04-24 02:33:16.552152 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:33:16.552164 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:33:16.552175 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:33:16.552187 | orchestrator | 2026-04-24 02:33:16.552200 | orchestrator | TASK [include_role : blazar] *************************************************** 2026-04-24 02:33:16.552213 | orchestrator | Friday 24 April 2026 02:33:11 +0000 (0:00:01.990) 0:01:09.453 ********** 2026-04-24 02:33:16.552225 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:16.552237 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:16.552249 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:16.552262 | orchestrator | 2026-04-24 02:33:16.552274 | orchestrator | TASK [include_role : ceph-rgw] ************************************************* 2026-04-24 02:33:16.552287 | orchestrator | Friday 24 April 2026 02:33:11 +0000 (0:00:00.319) 0:01:09.772 ********** 2026-04-24 02:33:16.552299 | orchestrator | included: ceph-rgw for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:33:16.552311 | orchestrator | 2026-04-24 02:33:16.552324 | orchestrator | TASK [haproxy-config : Copying over ceph-rgw haproxy config] ******************* 2026-04-24 02:33:16.552336 | orchestrator | Friday 24 April 2026 02:33:12 +0000 (0:00:00.672) 0:01:10.445 ********** 2026-04-24 02:33:16.552369 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-24 02:33:16.552391 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-24 02:33:16.552405 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-24 02:33:16.552419 | orchestrator | 2026-04-24 02:33:16.552431 | orchestrator | TASK [haproxy-config : Add configuration for ceph-rgw when using single external frontend] *** 2026-04-24 02:33:16.552444 | orchestrator | Friday 24 April 2026 02:33:15 +0000 (0:00:02.994) 0:01:13.439 ********** 2026-04-24 02:33:16.552466 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-24 02:33:16.552479 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:16.552493 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-24 02:33:16.552506 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:16.552528 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-24 02:33:24.367135 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:24.367244 | orchestrator | 2026-04-24 02:33:24.367263 | orchestrator | TASK [haproxy-config : Configuring firewall for ceph-rgw] ********************** 2026-04-24 02:33:24.367277 | orchestrator | Friday 24 April 2026 02:33:16 +0000 (0:00:01.348) 0:01:14.787 ********** 2026-04-24 02:33:24.367308 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-24 02:33:24.367331 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-24 02:33:24.367362 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:24.367382 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-24 02:33:24.367436 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-24 02:33:24.367456 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:24.367475 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-24 02:33:24.367494 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-24 02:33:24.367505 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:24.367590 | orchestrator | 2026-04-24 02:33:24.367602 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL users config] *********** 2026-04-24 02:33:24.367613 | orchestrator | Friday 24 April 2026 02:33:18 +0000 (0:00:01.655) 0:01:16.442 ********** 2026-04-24 02:33:24.367627 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:24.367646 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:24.367676 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:24.367696 | orchestrator | 2026-04-24 02:33:24.367719 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL rules config] *********** 2026-04-24 02:33:24.367737 | orchestrator | Friday 24 April 2026 02:33:18 +0000 (0:00:00.451) 0:01:16.894 ********** 2026-04-24 02:33:24.367754 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:24.367772 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:24.367791 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:24.367808 | orchestrator | 2026-04-24 02:33:24.367827 | orchestrator | TASK [include_role : cinder] *************************************************** 2026-04-24 02:33:24.367845 | orchestrator | Friday 24 April 2026 02:33:20 +0000 (0:00:01.396) 0:01:18.290 ********** 2026-04-24 02:33:24.367864 | orchestrator | included: cinder for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:33:24.367884 | orchestrator | 2026-04-24 02:33:24.367905 | orchestrator | TASK [haproxy-config : Copying over cinder haproxy config] ********************* 2026-04-24 02:33:24.367924 | orchestrator | Friday 24 April 2026 02:33:20 +0000 (0:00:00.925) 0:01:19.216 ********** 2026-04-24 02:33:24.367989 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 02:33:24.368031 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:33:24.368053 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 02:33:24.368074 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 02:33:24.368094 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 02:33:24.368126 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040063 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040164 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040175 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 02:33:25.040183 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040191 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040216 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040230 | orchestrator | 2026-04-24 02:33:25.040238 | orchestrator | TASK [haproxy-config : Add configuration for cinder when using single external frontend] *** 2026-04-24 02:33:25.040246 | orchestrator | Friday 24 April 2026 02:33:24 +0000 (0:00:03.480) 0:01:22.697 ********** 2026-04-24 02:33:25.040254 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 02:33:25.040261 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040268 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040275 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 02:33:25.040282 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:25.040300 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 02:33:31.567370 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:33:31.567475 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 02:33:31.567550 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 02:33:31.567567 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:31.567582 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 02:33:31.567596 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:33:31.567704 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 02:33:31.567714 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 02:33:31.567722 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:31.567729 | orchestrator | 2026-04-24 02:33:31.567736 | orchestrator | TASK [haproxy-config : Configuring firewall for cinder] ************************ 2026-04-24 02:33:31.567745 | orchestrator | Friday 24 April 2026 02:33:25 +0000 (0:00:00.684) 0:01:23.381 ********** 2026-04-24 02:33:31.567754 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-24 02:33:31.567768 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-24 02:33:31.567782 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:31.567796 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-24 02:33:31.567809 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-24 02:33:31.567822 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:31.567833 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-24 02:33:31.567847 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-24 02:33:31.567860 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:31.567871 | orchestrator | 2026-04-24 02:33:31.567884 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL users config] ************* 2026-04-24 02:33:31.567897 | orchestrator | Friday 24 April 2026 02:33:26 +0000 (0:00:01.163) 0:01:24.545 ********** 2026-04-24 02:33:31.567911 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:33:31.567933 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:33:31.567944 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:33:31.567957 | orchestrator | 2026-04-24 02:33:31.567969 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL rules config] ************* 2026-04-24 02:33:31.567983 | orchestrator | Friday 24 April 2026 02:33:27 +0000 (0:00:01.293) 0:01:25.838 ********** 2026-04-24 02:33:31.567995 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:33:31.568008 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:33:31.568021 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:33:31.568036 | orchestrator | 2026-04-24 02:33:31.568049 | orchestrator | TASK [include_role : cloudkitty] *********************************************** 2026-04-24 02:33:31.568062 | orchestrator | Friday 24 April 2026 02:33:29 +0000 (0:00:02.215) 0:01:28.054 ********** 2026-04-24 02:33:31.568075 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:31.568087 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:31.568101 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:31.568113 | orchestrator | 2026-04-24 02:33:31.568127 | orchestrator | TASK [include_role : cyborg] *************************************************** 2026-04-24 02:33:31.568136 | orchestrator | Friday 24 April 2026 02:33:30 +0000 (0:00:00.341) 0:01:28.395 ********** 2026-04-24 02:33:31.568147 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:31.568160 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:31.568172 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:31.568186 | orchestrator | 2026-04-24 02:33:31.568199 | orchestrator | TASK [include_role : designate] ************************************************ 2026-04-24 02:33:31.568211 | orchestrator | Friday 24 April 2026 02:33:30 +0000 (0:00:00.339) 0:01:28.734 ********** 2026-04-24 02:33:31.568219 | orchestrator | included: designate for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:33:31.568227 | orchestrator | 2026-04-24 02:33:31.568235 | orchestrator | TASK [haproxy-config : Copying over designate haproxy config] ****************** 2026-04-24 02:33:31.568249 | orchestrator | Friday 24 April 2026 02:33:31 +0000 (0:00:01.065) 0:01:29.799 ********** 2026-04-24 02:33:34.869961 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 02:33:34.870107 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 02:33:34.870122 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 02:33:34.870154 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 02:33:34.870162 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 02:33:34.870191 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 02:33:34.870196 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 02:33:34.870200 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:34.870204 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 02:33:34.870213 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 02:33:34.870218 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 02:33:34.870222 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 02:33:34.870234 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.935996 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.936099 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 02:33:35.936936 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 02:33:35.936964 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.936975 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.936998 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.937026 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.937035 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.937054 | orchestrator | 2026-04-24 02:33:35.937065 | orchestrator | TASK [haproxy-config : Add configuration for designate when using single external frontend] *** 2026-04-24 02:33:35.937073 | orchestrator | Friday 24 April 2026 02:33:35 +0000 (0:00:03.752) 0:01:33.552 ********** 2026-04-24 02:33:35.937081 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 02:33:35.937089 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 02:33:35.937097 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.937105 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 02:33:35.937118 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.354818 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.354919 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.354929 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:36.354938 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 02:33:36.354946 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 02:33:36.355318 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.355340 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.355374 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.355398 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.355416 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.355429 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:36.355443 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 02:33:36.355454 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 02:33:36.355465 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 02:33:36.355513 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 02:33:46.710341 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 02:33:46.710587 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:33:46.710612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 02:33:46.710626 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:46.710640 | orchestrator | 2026-04-24 02:33:46.710652 | orchestrator | TASK [haproxy-config : Configuring firewall for designate] ********************* 2026-04-24 02:33:46.710665 | orchestrator | Friday 24 April 2026 02:33:36 +0000 (0:00:01.041) 0:01:34.593 ********** 2026-04-24 02:33:46.710677 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-24 02:33:46.710690 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-24 02:33:46.710702 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:46.710713 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-24 02:33:46.710723 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-24 02:33:46.710734 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:46.710745 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-24 02:33:46.710779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-24 02:33:46.710791 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:46.710801 | orchestrator | 2026-04-24 02:33:46.710812 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL users config] ********** 2026-04-24 02:33:46.710823 | orchestrator | Friday 24 April 2026 02:33:37 +0000 (0:00:01.311) 0:01:35.905 ********** 2026-04-24 02:33:46.710835 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:33:46.710847 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:33:46.710859 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:33:46.710871 | orchestrator | 2026-04-24 02:33:46.710883 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL rules config] ********** 2026-04-24 02:33:46.710896 | orchestrator | Friday 24 April 2026 02:33:39 +0000 (0:00:01.399) 0:01:37.305 ********** 2026-04-24 02:33:46.710908 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:33:46.710920 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:33:46.710932 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:33:46.710944 | orchestrator | 2026-04-24 02:33:46.710956 | orchestrator | TASK [include_role : etcd] ***************************************************** 2026-04-24 02:33:46.710969 | orchestrator | Friday 24 April 2026 02:33:41 +0000 (0:00:02.206) 0:01:39.511 ********** 2026-04-24 02:33:46.711000 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:46.711013 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:46.711026 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:46.711038 | orchestrator | 2026-04-24 02:33:46.711050 | orchestrator | TASK [include_role : glance] *************************************************** 2026-04-24 02:33:46.711062 | orchestrator | Friday 24 April 2026 02:33:41 +0000 (0:00:00.357) 0:01:39.869 ********** 2026-04-24 02:33:46.711075 | orchestrator | included: glance for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:33:46.711086 | orchestrator | 2026-04-24 02:33:46.711099 | orchestrator | TASK [haproxy-config : Copying over glance haproxy config] ********************* 2026-04-24 02:33:46.711111 | orchestrator | Friday 24 April 2026 02:33:42 +0000 (0:00:01.088) 0:01:40.957 ********** 2026-04-24 02:33:46.711131 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 02:33:46.711147 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 02:33:46.711182 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 02:33:49.659928 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 02:33:49.660083 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 02:33:49.660126 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 02:33:49.660153 | orchestrator | 2026-04-24 02:33:49.660167 | orchestrator | TASK [haproxy-config : Add configuration for glance when using single external frontend] *** 2026-04-24 02:33:49.660180 | orchestrator | Friday 24 April 2026 02:33:46 +0000 (0:00:04.104) 0:01:45.062 ********** 2026-04-24 02:33:49.660201 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 02:33:49.660225 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 02:33:53.244970 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 02:33:53.245134 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:33:53.245190 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 02:33:53.245247 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:33:53.245300 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 02:33:53.245334 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 02:33:53.245369 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:33:53.245388 | orchestrator | 2026-04-24 02:33:53.245401 | orchestrator | TASK [haproxy-config : Configuring firewall for glance] ************************ 2026-04-24 02:33:53.245414 | orchestrator | Friday 24 April 2026 02:33:49 +0000 (0:00:02.936) 0:01:47.999 ********** 2026-04-24 02:33:53.245507 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 02:33:53.245535 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 02:34:01.627764 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:01.627887 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 02:34:01.627907 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 02:34:01.627920 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:01.627932 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 02:34:01.627963 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 02:34:01.627976 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:01.627987 | orchestrator | 2026-04-24 02:34:01.627999 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL users config] ************* 2026-04-24 02:34:01.628010 | orchestrator | Friday 24 April 2026 02:33:53 +0000 (0:00:03.483) 0:01:51.483 ********** 2026-04-24 02:34:01.628048 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:01.628060 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:01.628070 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:01.628080 | orchestrator | 2026-04-24 02:34:01.628090 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL rules config] ************* 2026-04-24 02:34:01.628100 | orchestrator | Friday 24 April 2026 02:33:54 +0000 (0:00:01.338) 0:01:52.821 ********** 2026-04-24 02:34:01.628112 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:01.628123 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:01.628133 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:01.628146 | orchestrator | 2026-04-24 02:34:01.628157 | orchestrator | TASK [include_role : gnocchi] ************************************************** 2026-04-24 02:34:01.628168 | orchestrator | Friday 24 April 2026 02:33:56 +0000 (0:00:02.071) 0:01:54.893 ********** 2026-04-24 02:34:01.628179 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:01.628189 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:01.628202 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:01.628214 | orchestrator | 2026-04-24 02:34:01.628225 | orchestrator | TASK [include_role : grafana] ************************************************** 2026-04-24 02:34:01.628235 | orchestrator | Friday 24 April 2026 02:33:56 +0000 (0:00:00.311) 0:01:55.204 ********** 2026-04-24 02:34:01.628241 | orchestrator | included: grafana for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:34:01.628248 | orchestrator | 2026-04-24 02:34:01.628255 | orchestrator | TASK [haproxy-config : Copying over grafana haproxy config] ******************** 2026-04-24 02:34:01.628261 | orchestrator | Friday 24 April 2026 02:33:58 +0000 (0:00:01.102) 0:01:56.306 ********** 2026-04-24 02:34:01.628287 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 02:34:01.628298 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 02:34:01.628305 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 02:34:01.628312 | orchestrator | 2026-04-24 02:34:01.628319 | orchestrator | TASK [haproxy-config : Add configuration for grafana when using single external frontend] *** 2026-04-24 02:34:01.628335 | orchestrator | Friday 24 April 2026 02:34:01 +0000 (0:00:02.942) 0:01:59.249 ********** 2026-04-24 02:34:01.628343 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 02:34:01.628350 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:01.628357 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 02:34:01.628364 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:01.628371 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 02:34:01.628465 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:01.628485 | orchestrator | 2026-04-24 02:34:01.628492 | orchestrator | TASK [haproxy-config : Configuring firewall for grafana] *********************** 2026-04-24 02:34:01.628499 | orchestrator | Friday 24 April 2026 02:34:01 +0000 (0:00:00.414) 0:01:59.663 ********** 2026-04-24 02:34:01.628506 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-24 02:34:01.628523 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-24 02:34:10.214142 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:10.214260 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-24 02:34:10.214278 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-24 02:34:10.214292 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:10.214304 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-24 02:34:10.214315 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-24 02:34:10.214355 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:10.214418 | orchestrator | 2026-04-24 02:34:10.214433 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL users config] ************ 2026-04-24 02:34:10.214446 | orchestrator | Friday 24 April 2026 02:34:02 +0000 (0:00:00.863) 0:02:00.527 ********** 2026-04-24 02:34:10.214456 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:10.214467 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:10.214478 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:10.214488 | orchestrator | 2026-04-24 02:34:10.214499 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL rules config] ************ 2026-04-24 02:34:10.214510 | orchestrator | Friday 24 April 2026 02:34:03 +0000 (0:00:01.318) 0:02:01.845 ********** 2026-04-24 02:34:10.214520 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:10.214531 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:10.214542 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:10.214553 | orchestrator | 2026-04-24 02:34:10.214565 | orchestrator | TASK [include_role : heat] ***************************************************** 2026-04-24 02:34:10.214592 | orchestrator | Friday 24 April 2026 02:34:05 +0000 (0:00:02.019) 0:02:03.865 ********** 2026-04-24 02:34:10.214605 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:10.214617 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:10.214631 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:10.214649 | orchestrator | 2026-04-24 02:34:10.214668 | orchestrator | TASK [include_role : horizon] ************************************************** 2026-04-24 02:34:10.214686 | orchestrator | Friday 24 April 2026 02:34:05 +0000 (0:00:00.327) 0:02:04.193 ********** 2026-04-24 02:34:10.214705 | orchestrator | included: horizon for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:34:10.214723 | orchestrator | 2026-04-24 02:34:10.214740 | orchestrator | TASK [haproxy-config : Copying over horizon haproxy config] ******************** 2026-04-24 02:34:10.214758 | orchestrator | Friday 24 April 2026 02:34:07 +0000 (0:00:01.092) 0:02:05.285 ********** 2026-04-24 02:34:10.214812 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 02:34:10.214903 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 02:34:10.214944 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 02:34:11.812788 | orchestrator | 2026-04-24 02:34:11.812893 | orchestrator | TASK [haproxy-config : Add configuration for horizon when using single external frontend] *** 2026-04-24 02:34:11.812909 | orchestrator | Friday 24 April 2026 02:34:10 +0000 (0:00:03.167) 0:02:08.453 ********** 2026-04-24 02:34:11.812945 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 02:34:11.812962 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:11.812996 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 02:34:11.813039 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:11.813059 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 02:34:11.813072 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:11.813083 | orchestrator | 2026-04-24 02:34:11.813094 | orchestrator | TASK [haproxy-config : Configuring firewall for horizon] *********************** 2026-04-24 02:34:11.813105 | orchestrator | Friday 24 April 2026 02:34:10 +0000 (0:00:00.642) 0:02:09.095 ********** 2026-04-24 02:34:11.813117 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-24 02:34:11.813139 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 02:34:11.813154 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-24 02:34:11.813175 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 02:34:20.400955 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-24 02:34:20.401066 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-24 02:34:20.401113 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:20.401129 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 02:34:20.401162 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-24 02:34:20.401177 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 02:34:20.401190 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-24 02:34:20.401201 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:20.401212 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-24 02:34:20.401224 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 02:34:20.401235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-24 02:34:20.401272 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 02:34:20.401284 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-24 02:34:20.401296 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:20.401307 | orchestrator | 2026-04-24 02:34:20.401319 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL users config] ************ 2026-04-24 02:34:20.401332 | orchestrator | Friday 24 April 2026 02:34:11 +0000 (0:00:00.956) 0:02:10.052 ********** 2026-04-24 02:34:20.401385 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:20.401396 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:20.401407 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:20.401418 | orchestrator | 2026-04-24 02:34:20.401429 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL rules config] ************ 2026-04-24 02:34:20.401440 | orchestrator | Friday 24 April 2026 02:34:13 +0000 (0:00:01.651) 0:02:11.703 ********** 2026-04-24 02:34:20.401452 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:20.401463 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:20.401473 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:20.401485 | orchestrator | 2026-04-24 02:34:20.401498 | orchestrator | TASK [include_role : influxdb] ************************************************* 2026-04-24 02:34:20.401510 | orchestrator | Friday 24 April 2026 02:34:15 +0000 (0:00:02.057) 0:02:13.761 ********** 2026-04-24 02:34:20.401522 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:20.401534 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:20.401564 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:20.401577 | orchestrator | 2026-04-24 02:34:20.401589 | orchestrator | TASK [include_role : ironic] *************************************************** 2026-04-24 02:34:20.401602 | orchestrator | Friday 24 April 2026 02:34:15 +0000 (0:00:00.325) 0:02:14.086 ********** 2026-04-24 02:34:20.401615 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:20.401626 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:20.401639 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:20.401651 | orchestrator | 2026-04-24 02:34:20.401663 | orchestrator | TASK [include_role : keystone] ************************************************* 2026-04-24 02:34:20.401675 | orchestrator | Friday 24 April 2026 02:34:16 +0000 (0:00:00.313) 0:02:14.400 ********** 2026-04-24 02:34:20.401687 | orchestrator | included: keystone for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:34:20.401699 | orchestrator | 2026-04-24 02:34:20.401711 | orchestrator | TASK [haproxy-config : Copying over keystone haproxy config] ******************* 2026-04-24 02:34:20.401723 | orchestrator | Friday 24 April 2026 02:34:17 +0000 (0:00:01.135) 0:02:15.536 ********** 2026-04-24 02:34:20.401746 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 02:34:20.401774 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 02:34:20.401788 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 02:34:20.401803 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 02:34:20.401826 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 02:34:21.021563 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 02:34:21.021656 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 02:34:21.021688 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 02:34:21.021697 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 02:34:21.021707 | orchestrator | 2026-04-24 02:34:21.021717 | orchestrator | TASK [haproxy-config : Add configuration for keystone when using single external frontend] *** 2026-04-24 02:34:21.021726 | orchestrator | Friday 24 April 2026 02:34:20 +0000 (0:00:03.102) 0:02:18.639 ********** 2026-04-24 02:34:21.021750 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 02:34:21.021766 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 02:34:21.021775 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 02:34:21.021788 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:21.021799 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 02:34:21.021807 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 02:34:21.021816 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 02:34:21.021824 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:21.021842 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 02:34:30.213407 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 02:34:30.213518 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 02:34:30.213536 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:30.213550 | orchestrator | 2026-04-24 02:34:30.213563 | orchestrator | TASK [haproxy-config : Configuring firewall for keystone] ********************** 2026-04-24 02:34:30.213598 | orchestrator | Friday 24 April 2026 02:34:21 +0000 (0:00:00.613) 0:02:19.252 ********** 2026-04-24 02:34:30.213612 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-24 02:34:30.213627 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-24 02:34:30.213642 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:30.213662 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-24 02:34:30.213682 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-24 02:34:30.213700 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:30.213719 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-24 02:34:30.213739 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-24 02:34:30.213759 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:30.213778 | orchestrator | 2026-04-24 02:34:30.213798 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL users config] *********** 2026-04-24 02:34:30.213817 | orchestrator | Friday 24 April 2026 02:34:22 +0000 (0:00:01.050) 0:02:20.303 ********** 2026-04-24 02:34:30.213834 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:30.213848 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:30.213890 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:30.213903 | orchestrator | 2026-04-24 02:34:30.213921 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL rules config] *********** 2026-04-24 02:34:30.213944 | orchestrator | Friday 24 April 2026 02:34:23 +0000 (0:00:01.341) 0:02:21.644 ********** 2026-04-24 02:34:30.213971 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:30.213990 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:30.214007 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:30.214116 | orchestrator | 2026-04-24 02:34:30.214138 | orchestrator | TASK [include_role : letsencrypt] ********************************************** 2026-04-24 02:34:30.214157 | orchestrator | Friday 24 April 2026 02:34:25 +0000 (0:00:02.107) 0:02:23.752 ********** 2026-04-24 02:34:30.214173 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:30.214211 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:30.214231 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:30.214248 | orchestrator | 2026-04-24 02:34:30.214267 | orchestrator | TASK [include_role : magnum] *************************************************** 2026-04-24 02:34:30.214338 | orchestrator | Friday 24 April 2026 02:34:25 +0000 (0:00:00.332) 0:02:24.084 ********** 2026-04-24 02:34:30.214359 | orchestrator | included: magnum for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:34:30.214378 | orchestrator | 2026-04-24 02:34:30.214396 | orchestrator | TASK [haproxy-config : Copying over magnum haproxy config] ********************* 2026-04-24 02:34:30.214415 | orchestrator | Friday 24 April 2026 02:34:27 +0000 (0:00:01.222) 0:02:25.307 ********** 2026-04-24 02:34:30.214436 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 02:34:30.214462 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:34:30.214483 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 02:34:30.214520 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:34:30.214555 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 02:34:35.529232 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:34:35.529395 | orchestrator | 2026-04-24 02:34:35.529415 | orchestrator | TASK [haproxy-config : Add configuration for magnum when using single external frontend] *** 2026-04-24 02:34:35.529428 | orchestrator | Friday 24 April 2026 02:34:30 +0000 (0:00:03.137) 0:02:28.445 ********** 2026-04-24 02:34:35.529443 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 02:34:35.529499 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:34:35.529538 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:35.529558 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 02:34:35.529591 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:34:35.529604 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:35.529615 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 02:34:35.529627 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:34:35.529646 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:35.529657 | orchestrator | 2026-04-24 02:34:35.529669 | orchestrator | TASK [haproxy-config : Configuring firewall for magnum] ************************ 2026-04-24 02:34:35.529680 | orchestrator | Friday 24 April 2026 02:34:30 +0000 (0:00:00.720) 0:02:29.165 ********** 2026-04-24 02:34:35.529692 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-24 02:34:35.529707 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-24 02:34:35.529723 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:35.529735 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-24 02:34:35.529747 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-24 02:34:35.529760 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:35.529772 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-24 02:34:35.529786 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-24 02:34:35.529799 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:35.529811 | orchestrator | 2026-04-24 02:34:35.529829 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL users config] ************* 2026-04-24 02:34:35.529842 | orchestrator | Friday 24 April 2026 02:34:31 +0000 (0:00:00.878) 0:02:30.043 ********** 2026-04-24 02:34:35.529854 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:35.529867 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:35.529879 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:35.529891 | orchestrator | 2026-04-24 02:34:35.529904 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL rules config] ************* 2026-04-24 02:34:35.529917 | orchestrator | Friday 24 April 2026 02:34:33 +0000 (0:00:01.643) 0:02:31.687 ********** 2026-04-24 02:34:35.529929 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:35.529942 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:35.529954 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:35.529966 | orchestrator | 2026-04-24 02:34:35.529978 | orchestrator | TASK [include_role : manila] *************************************************** 2026-04-24 02:34:35.530001 | orchestrator | Friday 24 April 2026 02:34:35 +0000 (0:00:02.077) 0:02:33.764 ********** 2026-04-24 02:34:39.969062 | orchestrator | included: manila for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:34:39.969168 | orchestrator | 2026-04-24 02:34:39.969182 | orchestrator | TASK [haproxy-config : Copying over manila haproxy config] ********************* 2026-04-24 02:34:39.969193 | orchestrator | Friday 24 April 2026 02:34:36 +0000 (0:00:01.036) 0:02:34.800 ********** 2026-04-24 02:34:39.969206 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 02:34:39.969247 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:34:39.969259 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 02:34:39.969271 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 02:34:39.969328 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 02:34:39.969357 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:34:39.969369 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 02:34:39.969387 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 02:34:39.969397 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 02:34:39.969408 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:34:39.969423 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 02:34:39.969441 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.922733 | orchestrator | 2026-04-24 02:34:40.922835 | orchestrator | TASK [haproxy-config : Add configuration for manila when using single external frontend] *** 2026-04-24 02:34:40.922852 | orchestrator | Friday 24 April 2026 02:34:40 +0000 (0:00:03.494) 0:02:38.295 ********** 2026-04-24 02:34:40.922894 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 02:34:40.922911 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.922924 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.922936 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.922948 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:40.922974 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 02:34:40.923007 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.923028 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.923040 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.923051 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:40.923062 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 02:34:40.923074 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.923091 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 02:34:40.923110 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 02:34:52.449980 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:52.450170 | orchestrator | 2026-04-24 02:34:52.450190 | orchestrator | TASK [haproxy-config : Configuring firewall for manila] ************************ 2026-04-24 02:34:52.450204 | orchestrator | Friday 24 April 2026 02:34:41 +0000 (0:00:00.968) 0:02:39.263 ********** 2026-04-24 02:34:52.450216 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-24 02:34:52.450230 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-24 02:34:52.450284 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:52.450298 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-24 02:34:52.450310 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-24 02:34:52.450321 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:52.450332 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-24 02:34:52.450343 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-24 02:34:52.450354 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:52.450365 | orchestrator | 2026-04-24 02:34:52.450376 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL users config] ************* 2026-04-24 02:34:52.450387 | orchestrator | Friday 24 April 2026 02:34:41 +0000 (0:00:00.898) 0:02:40.162 ********** 2026-04-24 02:34:52.450398 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:52.450409 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:52.450419 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:52.450430 | orchestrator | 2026-04-24 02:34:52.450441 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL rules config] ************* 2026-04-24 02:34:52.450451 | orchestrator | Friday 24 April 2026 02:34:43 +0000 (0:00:01.379) 0:02:41.542 ********** 2026-04-24 02:34:52.450462 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:34:52.450473 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:34:52.450483 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:34:52.450494 | orchestrator | 2026-04-24 02:34:52.450505 | orchestrator | TASK [include_role : mariadb] ************************************************** 2026-04-24 02:34:52.450516 | orchestrator | Friday 24 April 2026 02:34:45 +0000 (0:00:02.063) 0:02:43.605 ********** 2026-04-24 02:34:52.450526 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:34:52.450537 | orchestrator | 2026-04-24 02:34:52.450548 | orchestrator | TASK [mariadb : Ensure mysql monitor user exist] ******************************* 2026-04-24 02:34:52.450559 | orchestrator | Friday 24 April 2026 02:34:46 +0000 (0:00:01.335) 0:02:44.941 ********** 2026-04-24 02:34:52.450570 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 02:34:52.450581 | orchestrator | 2026-04-24 02:34:52.450592 | orchestrator | TASK [haproxy-config : Copying over mariadb haproxy config] ******************** 2026-04-24 02:34:52.450622 | orchestrator | Friday 24 April 2026 02:34:49 +0000 (0:00:03.072) 0:02:48.013 ********** 2026-04-24 02:34:52.450666 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:34:52.450683 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 02:34:52.450696 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:52.450713 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:34:52.450733 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 02:34:52.450745 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:34:52.450766 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:34:54.766537 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 02:34:54.766637 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:54.766654 | orchestrator | 2026-04-24 02:34:54.766666 | orchestrator | TASK [haproxy-config : Add configuration for mariadb when using single external frontend] *** 2026-04-24 02:34:54.766677 | orchestrator | Friday 24 April 2026 02:34:52 +0000 (0:00:02.663) 0:02:50.677 ********** 2026-04-24 02:34:54.766728 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:34:54.766743 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 02:34:54.766753 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:34:54.766782 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:34:54.766814 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 02:34:54.766825 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:34:54.766836 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:34:54.766854 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 02:35:04.449926 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:04.450140 | orchestrator | 2026-04-24 02:35:04.450187 | orchestrator | TASK [haproxy-config : Configuring firewall for mariadb] *********************** 2026-04-24 02:35:04.450307 | orchestrator | Friday 24 April 2026 02:34:54 +0000 (0:00:02.321) 0:02:52.998 ********** 2026-04-24 02:35:04.450330 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 02:35:04.450372 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 02:35:04.450397 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:04.450409 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 02:35:04.450419 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 02:35:04.450429 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:04.450452 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 02:35:04.450464 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 02:35:04.450476 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:04.450487 | orchestrator | 2026-04-24 02:35:04.450499 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL users config] ************ 2026-04-24 02:35:04.450544 | orchestrator | Friday 24 April 2026 02:34:57 +0000 (0:00:02.827) 0:02:55.826 ********** 2026-04-24 02:35:04.450557 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:35:04.450640 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:35:04.450654 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:35:04.450666 | orchestrator | 2026-04-24 02:35:04.450678 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL rules config] ************ 2026-04-24 02:35:04.450689 | orchestrator | Friday 24 April 2026 02:34:59 +0000 (0:00:02.043) 0:02:57.870 ********** 2026-04-24 02:35:04.450703 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:04.450720 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:04.450736 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:04.450746 | orchestrator | 2026-04-24 02:35:04.450756 | orchestrator | TASK [include_role : masakari] ************************************************* 2026-04-24 02:35:04.450765 | orchestrator | Friday 24 April 2026 02:35:01 +0000 (0:00:01.417) 0:02:59.287 ********** 2026-04-24 02:35:04.450775 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:04.450784 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:04.450794 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:04.450804 | orchestrator | 2026-04-24 02:35:04.450813 | orchestrator | TASK [include_role : memcached] ************************************************ 2026-04-24 02:35:04.450823 | orchestrator | Friday 24 April 2026 02:35:01 +0000 (0:00:00.322) 0:02:59.610 ********** 2026-04-24 02:35:04.450832 | orchestrator | included: memcached for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:35:04.450842 | orchestrator | 2026-04-24 02:35:04.450852 | orchestrator | TASK [haproxy-config : Copying over memcached haproxy config] ****************** 2026-04-24 02:35:04.450861 | orchestrator | Friday 24 April 2026 02:35:02 +0000 (0:00:01.406) 0:03:01.016 ********** 2026-04-24 02:35:04.450879 | orchestrator | changed: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 02:35:04.450892 | orchestrator | changed: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 02:35:04.450902 | orchestrator | changed: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 02:35:04.450912 | orchestrator | 2026-04-24 02:35:04.450922 | orchestrator | TASK [haproxy-config : Add configuration for memcached when using single external frontend] *** 2026-04-24 02:35:04.450941 | orchestrator | Friday 24 April 2026 02:35:04 +0000 (0:00:01.477) 0:03:02.494 ********** 2026-04-24 02:35:04.450959 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 02:35:11.967746 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:11.967893 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 02:35:11.967927 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:11.967947 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 02:35:11.967959 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:11.967971 | orchestrator | 2026-04-24 02:35:11.967987 | orchestrator | TASK [haproxy-config : Configuring firewall for memcached] ********************* 2026-04-24 02:35:11.968006 | orchestrator | Friday 24 April 2026 02:35:04 +0000 (0:00:00.379) 0:03:02.873 ********** 2026-04-24 02:35:11.968025 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-24 02:35:11.968047 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-24 02:35:11.968065 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:11.968083 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:11.968101 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-24 02:35:11.968155 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:11.968168 | orchestrator | 2026-04-24 02:35:11.968272 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL users config] ********** 2026-04-24 02:35:11.968291 | orchestrator | Friday 24 April 2026 02:35:05 +0000 (0:00:00.868) 0:03:03.741 ********** 2026-04-24 02:35:11.968305 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:11.968317 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:11.968329 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:11.968342 | orchestrator | 2026-04-24 02:35:11.968354 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL rules config] ********** 2026-04-24 02:35:11.968367 | orchestrator | Friday 24 April 2026 02:35:05 +0000 (0:00:00.442) 0:03:04.184 ********** 2026-04-24 02:35:11.968379 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:11.968392 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:11.968404 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:11.968416 | orchestrator | 2026-04-24 02:35:11.968428 | orchestrator | TASK [include_role : mistral] ************************************************** 2026-04-24 02:35:11.968441 | orchestrator | Friday 24 April 2026 02:35:07 +0000 (0:00:01.175) 0:03:05.359 ********** 2026-04-24 02:35:11.968453 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:11.968465 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:11.968477 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:11.968489 | orchestrator | 2026-04-24 02:35:11.968501 | orchestrator | TASK [include_role : neutron] ************************************************** 2026-04-24 02:35:11.968513 | orchestrator | Friday 24 April 2026 02:35:07 +0000 (0:00:00.302) 0:03:05.662 ********** 2026-04-24 02:35:11.968526 | orchestrator | included: neutron for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:35:11.968538 | orchestrator | 2026-04-24 02:35:11.968550 | orchestrator | TASK [haproxy-config : Copying over neutron haproxy config] ******************** 2026-04-24 02:35:11.968561 | orchestrator | Friday 24 April 2026 02:35:08 +0000 (0:00:01.289) 0:03:06.951 ********** 2026-04-24 02:35:11.968596 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 02:35:11.968618 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:11.968630 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:11.968654 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:11.968667 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-24 02:35:11.968690 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.102659 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:12.102765 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:12.102781 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.102815 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:12.102826 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.102837 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 02:35:12.102865 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-24 02:35:12.102876 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.102889 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:12.102896 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.102903 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.102910 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.102925 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 02:35:12.211047 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-24 02:35:12.211170 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:12.211233 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.211248 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:12.211262 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:12.211275 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 02:35:12.211320 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.211343 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:12.211354 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.211367 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.211379 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.211397 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-24 02:35:12.211423 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.519369 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:12.519547 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-24 02:35:12.519580 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.519604 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.519656 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 02:35:12.519735 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:12.519786 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:12.519800 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:12.519812 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.519825 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:12.519843 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:12.519863 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-24 02:35:12.519884 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:13.682789 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.682919 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 02:35:13.682941 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:13.682954 | orchestrator | 2026-04-24 02:35:13.682967 | orchestrator | TASK [haproxy-config : Add configuration for neutron when using single external frontend] *** 2026-04-24 02:35:13.683058 | orchestrator | Friday 24 April 2026 02:35:12 +0000 (0:00:03.802) 0:03:10.754 ********** 2026-04-24 02:35:13.683089 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 02:35:13.683121 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.683134 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.683147 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.683159 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-24 02:35:13.683213 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.683226 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 02:35:13.683247 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:13.759824 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.759924 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:13.759941 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.760002 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.760024 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.760066 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:13.760088 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-24 02:35:13.760108 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.760278 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.760316 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-24 02:35:13.760337 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:13.760358 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:13.760395 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 02:35:13.826802 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:13.826900 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.826994 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.827022 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.827036 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:13.827068 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.827082 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 02:35:13.827105 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.827118 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:13.827130 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:13.827143 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:13.827158 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-24 02:35:13.827264 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-24 02:35:14.051206 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:14.051316 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:14.051350 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:14.051366 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:14.051380 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 02:35:14.051394 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:14.051430 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:14.051474 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:14.051488 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:14.051506 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:14.051521 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:14.051533 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-24 02:35:14.051546 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-24 02:35:14.051564 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 02:35:24.534414 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 02:35:24.534540 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 02:35:24.534559 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:24.534574 | orchestrator | 2026-04-24 02:35:24.534587 | orchestrator | TASK [haproxy-config : Configuring firewall for neutron] *********************** 2026-04-24 02:35:24.534600 | orchestrator | Friday 24 April 2026 02:35:14 +0000 (0:00:01.528) 0:03:12.283 ********** 2026-04-24 02:35:24.534612 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-24 02:35:24.534625 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-24 02:35:24.534637 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:24.534649 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-24 02:35:24.534659 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-24 02:35:24.534671 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:24.534682 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-24 02:35:24.534693 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-24 02:35:24.534728 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:24.534739 | orchestrator | 2026-04-24 02:35:24.534751 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL users config] ************ 2026-04-24 02:35:24.534762 | orchestrator | Friday 24 April 2026 02:35:15 +0000 (0:00:01.955) 0:03:14.238 ********** 2026-04-24 02:35:24.534772 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:35:24.534783 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:35:24.534795 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:35:24.534806 | orchestrator | 2026-04-24 02:35:24.534817 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL rules config] ************ 2026-04-24 02:35:24.534828 | orchestrator | Friday 24 April 2026 02:35:17 +0000 (0:00:01.294) 0:03:15.533 ********** 2026-04-24 02:35:24.534838 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:35:24.534849 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:35:24.534860 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:35:24.534871 | orchestrator | 2026-04-24 02:35:24.534881 | orchestrator | TASK [include_role : placement] ************************************************ 2026-04-24 02:35:24.534892 | orchestrator | Friday 24 April 2026 02:35:19 +0000 (0:00:02.107) 0:03:17.640 ********** 2026-04-24 02:35:24.534903 | orchestrator | included: placement for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:35:24.534914 | orchestrator | 2026-04-24 02:35:24.534925 | orchestrator | TASK [haproxy-config : Copying over placement haproxy config] ****************** 2026-04-24 02:35:24.534954 | orchestrator | Friday 24 April 2026 02:35:20 +0000 (0:00:01.218) 0:03:18.859 ********** 2026-04-24 02:35:24.534969 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 02:35:24.534991 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 02:35:24.535006 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 02:35:24.535026 | orchestrator | 2026-04-24 02:35:24.535040 | orchestrator | TASK [haproxy-config : Add configuration for placement when using single external frontend] *** 2026-04-24 02:35:24.535053 | orchestrator | Friday 24 April 2026 02:35:24 +0000 (0:00:03.401) 0:03:22.260 ********** 2026-04-24 02:35:24.535065 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 02:35:24.535079 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:24.535100 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 02:35:34.708778 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:34.708912 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 02:35:34.708932 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:34.708945 | orchestrator | 2026-04-24 02:35:34.708956 | orchestrator | TASK [haproxy-config : Configuring firewall for placement] ********************* 2026-04-24 02:35:34.708969 | orchestrator | Friday 24 April 2026 02:35:24 +0000 (0:00:00.509) 0:03:22.770 ********** 2026-04-24 02:35:34.708981 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-24 02:35:34.709019 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-24 02:35:34.709033 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:34.709044 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-24 02:35:34.709056 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-24 02:35:34.709066 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:34.709077 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-24 02:35:34.709088 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-24 02:35:34.709099 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:34.709110 | orchestrator | 2026-04-24 02:35:34.709121 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL users config] ********** 2026-04-24 02:35:34.709159 | orchestrator | Friday 24 April 2026 02:35:25 +0000 (0:00:00.758) 0:03:23.528 ********** 2026-04-24 02:35:34.709170 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:35:34.709181 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:35:34.709192 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:35:34.709203 | orchestrator | 2026-04-24 02:35:34.709213 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL rules config] ********** 2026-04-24 02:35:34.709224 | orchestrator | Friday 24 April 2026 02:35:27 +0000 (0:00:01.885) 0:03:25.414 ********** 2026-04-24 02:35:34.709235 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:35:34.709246 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:35:34.709256 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:35:34.709267 | orchestrator | 2026-04-24 02:35:34.709278 | orchestrator | TASK [include_role : nova] ***************************************************** 2026-04-24 02:35:34.709289 | orchestrator | Friday 24 April 2026 02:35:29 +0000 (0:00:01.944) 0:03:27.358 ********** 2026-04-24 02:35:34.709300 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:35:34.709310 | orchestrator | 2026-04-24 02:35:34.709321 | orchestrator | TASK [haproxy-config : Copying over nova haproxy config] *********************** 2026-04-24 02:35:34.709346 | orchestrator | Friday 24 April 2026 02:35:30 +0000 (0:00:01.523) 0:03:28.882 ********** 2026-04-24 02:35:34.709391 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 02:35:34.709462 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 02:35:34.709479 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:35:34.709492 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:35:34.709505 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:35:34.709526 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:35:35.928344 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 02:35:35.928449 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:35:35.928466 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:35:35.928480 | orchestrator | 2026-04-24 02:35:35.928495 | orchestrator | TASK [haproxy-config : Add configuration for nova when using single external frontend] *** 2026-04-24 02:35:35.928508 | orchestrator | Friday 24 April 2026 02:35:34 +0000 (0:00:04.061) 0:03:32.943 ********** 2026-04-24 02:35:35.928537 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 02:35:35.928592 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:35:35.928614 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:35:35.928626 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:35.928640 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 02:35:35.928652 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:35:35.928663 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:35:35.928674 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:35.928705 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 02:35:48.089497 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 02:35:48.089620 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 02:35:48.089640 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:48.089655 | orchestrator | 2026-04-24 02:35:48.089668 | orchestrator | TASK [haproxy-config : Configuring firewall for nova] ************************** 2026-04-24 02:35:48.089681 | orchestrator | Friday 24 April 2026 02:35:35 +0000 (0:00:01.217) 0:03:34.160 ********** 2026-04-24 02:35:48.089694 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089757 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089770 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089782 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089795 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:48.089806 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089818 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089852 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089864 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089875 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:35:48.089886 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089897 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089922 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089952 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-24 02:35:48.089964 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:35:48.089975 | orchestrator | 2026-04-24 02:35:48.089987 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL users config] *************** 2026-04-24 02:35:48.089998 | orchestrator | Friday 24 April 2026 02:35:36 +0000 (0:00:00.891) 0:03:35.051 ********** 2026-04-24 02:35:48.090009 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:35:48.090128 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:35:48.090141 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:35:48.090153 | orchestrator | 2026-04-24 02:35:48.090164 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL rules config] *************** 2026-04-24 02:35:48.090175 | orchestrator | Friday 24 April 2026 02:35:38 +0000 (0:00:01.357) 0:03:36.408 ********** 2026-04-24 02:35:48.090186 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:35:48.090197 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:35:48.090207 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:35:48.090218 | orchestrator | 2026-04-24 02:35:48.090229 | orchestrator | TASK [include_role : nova-cell] ************************************************ 2026-04-24 02:35:48.090240 | orchestrator | Friday 24 April 2026 02:35:40 +0000 (0:00:02.121) 0:03:38.529 ********** 2026-04-24 02:35:48.090250 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:35:48.090261 | orchestrator | 2026-04-24 02:35:48.090272 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-novncproxy] ****************** 2026-04-24 02:35:48.090283 | orchestrator | Friday 24 April 2026 02:35:41 +0000 (0:00:01.651) 0:03:40.181 ********** 2026-04-24 02:35:48.090294 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-novncproxy) 2026-04-24 02:35:48.090306 | orchestrator | 2026-04-24 02:35:48.090317 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config] *** 2026-04-24 02:35:48.090328 | orchestrator | Friday 24 April 2026 02:35:42 +0000 (0:00:00.880) 0:03:41.061 ********** 2026-04-24 02:35:48.090341 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-24 02:35:48.090367 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-24 02:35:48.090379 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-24 02:35:48.090391 | orchestrator | 2026-04-24 02:35:48.090403 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-novncproxy when using single external frontend] *** 2026-04-24 02:35:48.090414 | orchestrator | Friday 24 April 2026 02:35:46 +0000 (0:00:03.894) 0:03:44.956 ********** 2026-04-24 02:35:48.090426 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:35:48.090437 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:35:48.090464 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:36:07.392463 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:07.392611 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:36:07.392633 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:07.392647 | orchestrator | 2026-04-24 02:36:07.392659 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-novncproxy] ***** 2026-04-24 02:36:07.392672 | orchestrator | Friday 24 April 2026 02:35:48 +0000 (0:00:01.369) 0:03:46.326 ********** 2026-04-24 02:36:07.392686 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 02:36:07.392701 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 02:36:07.392739 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:07.392752 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 02:36:07.392763 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 02:36:07.392775 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:07.392786 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 02:36:07.392797 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 02:36:07.392808 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:07.392819 | orchestrator | 2026-04-24 02:36:07.392834 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-24 02:36:07.392852 | orchestrator | Friday 24 April 2026 02:35:49 +0000 (0:00:01.595) 0:03:47.921 ********** 2026-04-24 02:36:07.392870 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:36:07.392934 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:36:07.392950 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:36:07.392961 | orchestrator | 2026-04-24 02:36:07.392973 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-24 02:36:07.392984 | orchestrator | Friday 24 April 2026 02:35:52 +0000 (0:00:02.644) 0:03:50.565 ********** 2026-04-24 02:36:07.392994 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:36:07.393005 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:36:07.393026 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:36:07.393067 | orchestrator | 2026-04-24 02:36:07.393135 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-spicehtml5proxy] ************* 2026-04-24 02:36:07.393148 | orchestrator | Friday 24 April 2026 02:35:55 +0000 (0:00:02.947) 0:03:53.513 ********** 2026-04-24 02:36:07.393188 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-spicehtml5proxy) 2026-04-24 02:36:07.393203 | orchestrator | 2026-04-24 02:36:07.393214 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-spicehtml5proxy haproxy config] *** 2026-04-24 02:36:07.393226 | orchestrator | Friday 24 April 2026 02:35:56 +0000 (0:00:01.073) 0:03:54.586 ********** 2026-04-24 02:36:07.393255 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:36:07.393267 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:07.393302 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:36:07.393326 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:07.393338 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:36:07.393350 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:07.393361 | orchestrator | 2026-04-24 02:36:07.393372 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-spicehtml5proxy when using single external frontend] *** 2026-04-24 02:36:07.393383 | orchestrator | Friday 24 April 2026 02:35:57 +0000 (0:00:01.003) 0:03:55.590 ********** 2026-04-24 02:36:07.393394 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:36:07.393406 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:07.393417 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:36:07.393428 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:07.393440 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 02:36:07.393451 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:07.393462 | orchestrator | 2026-04-24 02:36:07.393473 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-spicehtml5proxy] *** 2026-04-24 02:36:07.393484 | orchestrator | Friday 24 April 2026 02:35:58 +0000 (0:00:01.486) 0:03:57.076 ********** 2026-04-24 02:36:07.393495 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:07.393506 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:07.393517 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:07.393527 | orchestrator | 2026-04-24 02:36:07.393539 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-24 02:36:07.393550 | orchestrator | Friday 24 April 2026 02:36:00 +0000 (0:00:01.703) 0:03:58.779 ********** 2026-04-24 02:36:07.393561 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:36:07.393573 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:36:07.393584 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:36:07.393594 | orchestrator | 2026-04-24 02:36:07.393605 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-24 02:36:07.393616 | orchestrator | Friday 24 April 2026 02:36:03 +0000 (0:00:02.925) 0:04:01.705 ********** 2026-04-24 02:36:07.393636 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:36:07.393647 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:36:07.393657 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:36:07.393668 | orchestrator | 2026-04-24 02:36:07.393697 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-serialproxy] ***************** 2026-04-24 02:36:07.393709 | orchestrator | Friday 24 April 2026 02:36:06 +0000 (0:00:02.700) 0:04:04.406 ********** 2026-04-24 02:36:07.393720 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-serialproxy) 2026-04-24 02:36:07.393732 | orchestrator | 2026-04-24 02:36:07.393750 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-serialproxy haproxy config] *** 2026-04-24 02:36:22.693238 | orchestrator | Friday 24 April 2026 02:36:07 +0000 (0:00:01.219) 0:04:05.625 ********** 2026-04-24 02:36:22.693356 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 02:36:22.693377 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:22.693391 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 02:36:22.693403 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:22.693414 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 02:36:22.693425 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:22.693437 | orchestrator | 2026-04-24 02:36:22.693449 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-serialproxy when using single external frontend] *** 2026-04-24 02:36:22.693461 | orchestrator | Friday 24 April 2026 02:36:08 +0000 (0:00:01.315) 0:04:06.941 ********** 2026-04-24 02:36:22.693473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 02:36:22.693484 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:22.693495 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 02:36:22.693530 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:22.693542 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 02:36:22.693553 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:22.693565 | orchestrator | 2026-04-24 02:36:22.693591 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-serialproxy] **** 2026-04-24 02:36:22.693603 | orchestrator | Friday 24 April 2026 02:36:10 +0000 (0:00:01.468) 0:04:08.410 ********** 2026-04-24 02:36:22.693614 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:22.693625 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:22.693636 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:22.693647 | orchestrator | 2026-04-24 02:36:22.693658 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-24 02:36:22.693685 | orchestrator | Friday 24 April 2026 02:36:11 +0000 (0:00:01.804) 0:04:10.215 ********** 2026-04-24 02:36:22.693697 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:36:22.693708 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:36:22.693719 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:36:22.693729 | orchestrator | 2026-04-24 02:36:22.693740 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-24 02:36:22.693751 | orchestrator | Friday 24 April 2026 02:36:14 +0000 (0:00:02.509) 0:04:12.725 ********** 2026-04-24 02:36:22.693762 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:36:22.693775 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:36:22.693787 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:36:22.693800 | orchestrator | 2026-04-24 02:36:22.693812 | orchestrator | TASK [include_role : octavia] ************************************************** 2026-04-24 02:36:22.693825 | orchestrator | Friday 24 April 2026 02:36:17 +0000 (0:00:03.265) 0:04:15.991 ********** 2026-04-24 02:36:22.693837 | orchestrator | included: octavia for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:36:22.693850 | orchestrator | 2026-04-24 02:36:22.693862 | orchestrator | TASK [haproxy-config : Copying over octavia haproxy config] ******************** 2026-04-24 02:36:22.693874 | orchestrator | Friday 24 April 2026 02:36:19 +0000 (0:00:01.641) 0:04:17.632 ********** 2026-04-24 02:36:22.693889 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 02:36:22.693904 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 02:36:22.693926 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 02:36:22.693939 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 02:36:22.693963 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:36:23.399117 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 02:36:23.399195 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 02:36:23.399204 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.399228 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.399233 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:36:23.399253 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 02:36:23.399259 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 02:36:23.399264 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.399297 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.399308 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:36:23.399313 | orchestrator | 2026-04-24 02:36:23.399320 | orchestrator | TASK [haproxy-config : Add configuration for octavia when using single external frontend] *** 2026-04-24 02:36:23.399326 | orchestrator | Friday 24 April 2026 02:36:22 +0000 (0:00:03.438) 0:04:21.071 ********** 2026-04-24 02:36:23.399333 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 02:36:23.399347 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 02:36:23.552808 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.552880 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.552887 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:36:23.552909 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:23.552916 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 02:36:23.552922 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 02:36:23.552936 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.552951 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.552955 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:36:23.552963 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:23.552967 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 02:36:23.552971 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 02:36:23.552975 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.552982 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 02:36:23.552990 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 02:36:35.297373 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:35.297463 | orchestrator | 2026-04-24 02:36:35.297472 | orchestrator | TASK [haproxy-config : Configuring firewall for octavia] *********************** 2026-04-24 02:36:35.297480 | orchestrator | Friday 24 April 2026 02:36:23 +0000 (0:00:00.718) 0:04:21.790 ********** 2026-04-24 02:36:35.297488 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 02:36:35.297516 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 02:36:35.297524 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:35.297530 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 02:36:35.297536 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 02:36:35.297541 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:35.297547 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 02:36:35.297553 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 02:36:35.297558 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:35.297563 | orchestrator | 2026-04-24 02:36:35.297569 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL users config] ************ 2026-04-24 02:36:35.297574 | orchestrator | Friday 24 April 2026 02:36:24 +0000 (0:00:00.974) 0:04:22.764 ********** 2026-04-24 02:36:35.297580 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:36:35.297585 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:36:35.297590 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:36:35.297596 | orchestrator | 2026-04-24 02:36:35.297601 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL rules config] ************ 2026-04-24 02:36:35.297606 | orchestrator | Friday 24 April 2026 02:36:26 +0000 (0:00:01.805) 0:04:24.570 ********** 2026-04-24 02:36:35.297612 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:36:35.297617 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:36:35.297623 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:36:35.297628 | orchestrator | 2026-04-24 02:36:35.297633 | orchestrator | TASK [include_role : opensearch] *********************************************** 2026-04-24 02:36:35.297639 | orchestrator | Friday 24 April 2026 02:36:28 +0000 (0:00:02.107) 0:04:26.678 ********** 2026-04-24 02:36:35.297644 | orchestrator | included: opensearch for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:36:35.297650 | orchestrator | 2026-04-24 02:36:35.297655 | orchestrator | TASK [haproxy-config : Copying over opensearch haproxy config] ***************** 2026-04-24 02:36:35.297661 | orchestrator | Friday 24 April 2026 02:36:29 +0000 (0:00:01.397) 0:04:28.075 ********** 2026-04-24 02:36:35.297678 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:36:35.297698 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:36:35.297711 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:36:35.297718 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:36:35.297728 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:36:35.297739 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:36:37.237707 | orchestrator | 2026-04-24 02:36:37.237861 | orchestrator | TASK [haproxy-config : Add configuration for opensearch when using single external frontend] *** 2026-04-24 02:36:37.237894 | orchestrator | Friday 24 April 2026 02:36:35 +0000 (0:00:05.453) 0:04:33.529 ********** 2026-04-24 02:36:37.237921 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:36:37.237946 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:36:37.238001 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:37.238113 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:36:37.238140 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:36:37.238220 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:37.238235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:36:37.238248 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:36:37.238260 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:37.238272 | orchestrator | 2026-04-24 02:36:37.238286 | orchestrator | TASK [haproxy-config : Configuring firewall for opensearch] ******************** 2026-04-24 02:36:37.238298 | orchestrator | Friday 24 April 2026 02:36:36 +0000 (0:00:01.057) 0:04:34.587 ********** 2026-04-24 02:36:37.238312 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-24 02:36:37.238327 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-24 02:36:37.238344 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-24 02:36:37.238370 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:37.238390 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-24 02:36:37.238403 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-24 02:36:37.238416 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-24 02:36:37.238428 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:37.238440 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-24 02:36:37.238453 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-24 02:36:37.238480 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-24 02:36:43.263657 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:43.263772 | orchestrator | 2026-04-24 02:36:43.263789 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL users config] ********* 2026-04-24 02:36:43.263802 | orchestrator | Friday 24 April 2026 02:36:37 +0000 (0:00:00.887) 0:04:35.474 ********** 2026-04-24 02:36:43.263813 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:43.263824 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:43.263835 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:43.263846 | orchestrator | 2026-04-24 02:36:43.263857 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL rules config] ********* 2026-04-24 02:36:43.263869 | orchestrator | Friday 24 April 2026 02:36:37 +0000 (0:00:00.431) 0:04:35.906 ********** 2026-04-24 02:36:43.263879 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:43.263890 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:43.263901 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:43.263912 | orchestrator | 2026-04-24 02:36:43.263923 | orchestrator | TASK [include_role : prometheus] *********************************************** 2026-04-24 02:36:43.263934 | orchestrator | Friday 24 April 2026 02:36:39 +0000 (0:00:01.410) 0:04:37.316 ********** 2026-04-24 02:36:43.263945 | orchestrator | included: prometheus for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:36:43.264002 | orchestrator | 2026-04-24 02:36:43.264014 | orchestrator | TASK [haproxy-config : Copying over prometheus haproxy config] ***************** 2026-04-24 02:36:43.264025 | orchestrator | Friday 24 April 2026 02:36:40 +0000 (0:00:01.731) 0:04:39.048 ********** 2026-04-24 02:36:43.264038 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-24 02:36:43.264079 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 02:36:43.264107 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:43.264120 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:43.264132 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 02:36:43.264163 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-24 02:36:43.264176 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 02:36:43.264188 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:43.264208 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:43.264220 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 02:36:43.264237 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-24 02:36:43.264249 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 02:36:43.264269 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:44.949062 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:44.949166 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 02:36:44.949208 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-24 02:36:44.949240 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-24 02:36:44.949253 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:44.949265 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:44.949296 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 02:36:44.949309 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-24 02:36:44.949331 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-24 02:36:44.949349 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:44.949361 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:44.949382 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-24 02:36:45.747212 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 02:36:45.747343 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-24 02:36:45.747360 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.747389 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.747402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 02:36:45.747414 | orchestrator | 2026-04-24 02:36:45.747428 | orchestrator | TASK [haproxy-config : Add configuration for prometheus when using single external frontend] *** 2026-04-24 02:36:45.747440 | orchestrator | Friday 24 April 2026 02:36:45 +0000 (0:00:04.307) 0:04:43.356 ********** 2026-04-24 02:36:45.747452 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-24 02:36:45.747483 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 02:36:45.747503 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.747515 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.747527 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 02:36:45.747546 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-24 02:36:45.747560 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-24 02:36:45.747581 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.848090 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.848178 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 02:36:45.848192 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:45.848224 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-24 02:36:45.848237 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 02:36:45.848248 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.848258 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.848268 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 02:36:45.848324 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-24 02:36:45.848339 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-24 02:36:45.848356 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 02:36:45.848368 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-24 02:36:45.848378 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:45.848401 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:47.406291 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:47.406427 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:47.406447 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 02:36:47.406480 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 02:36:47.406496 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-24 02:36:47.406511 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:47.406526 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-24 02:36:47.406588 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:47.406601 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 02:36:47.406612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 02:36:47.406623 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:47.406635 | orchestrator | 2026-04-24 02:36:47.406646 | orchestrator | TASK [haproxy-config : Configuring firewall for prometheus] ******************** 2026-04-24 02:36:47.406659 | orchestrator | Friday 24 April 2026 02:36:45 +0000 (0:00:00.881) 0:04:44.237 ********** 2026-04-24 02:36:47.406677 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-24 02:36:47.406693 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-24 02:36:47.406707 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-24 02:36:47.406721 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-24 02:36:47.406734 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:47.406745 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-24 02:36:47.406765 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-24 02:36:47.406776 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-24 02:36:47.406788 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-24 02:36:47.406799 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:47.406810 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-24 02:36:47.406828 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-24 02:36:54.589213 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-24 02:36:54.589332 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-24 02:36:54.589353 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:54.589368 | orchestrator | 2026-04-24 02:36:54.589381 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL users config] ********* 2026-04-24 02:36:54.589394 | orchestrator | Friday 24 April 2026 02:36:47 +0000 (0:00:01.400) 0:04:45.638 ********** 2026-04-24 02:36:54.589405 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:54.589415 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:54.589426 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:54.589437 | orchestrator | 2026-04-24 02:36:54.589448 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL rules config] ********* 2026-04-24 02:36:54.589459 | orchestrator | Friday 24 April 2026 02:36:47 +0000 (0:00:00.444) 0:04:46.083 ********** 2026-04-24 02:36:54.589470 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:54.589481 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:54.589492 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:54.589503 | orchestrator | 2026-04-24 02:36:54.589513 | orchestrator | TASK [include_role : rabbitmq] ************************************************* 2026-04-24 02:36:54.589524 | orchestrator | Friday 24 April 2026 02:36:49 +0000 (0:00:01.335) 0:04:47.418 ********** 2026-04-24 02:36:54.589535 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:36:54.589546 | orchestrator | 2026-04-24 02:36:54.589556 | orchestrator | TASK [haproxy-config : Copying over rabbitmq haproxy config] ******************* 2026-04-24 02:36:54.589567 | orchestrator | Friday 24 April 2026 02:36:51 +0000 (0:00:01.863) 0:04:49.281 ********** 2026-04-24 02:36:54.589581 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:36:54.589625 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:36:54.589699 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:36:54.589715 | orchestrator | 2026-04-24 02:36:54.589727 | orchestrator | TASK [haproxy-config : Add configuration for rabbitmq when using single external frontend] *** 2026-04-24 02:36:54.589741 | orchestrator | Friday 24 April 2026 02:36:53 +0000 (0:00:02.136) 0:04:51.418 ********** 2026-04-24 02:36:54.589754 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 02:36:54.589784 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 02:36:54.589799 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:36:54.589812 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:36:54.589825 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 02:36:54.589839 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:36:54.589852 | orchestrator | 2026-04-24 02:36:54.589863 | orchestrator | TASK [haproxy-config : Configuring firewall for rabbitmq] ********************** 2026-04-24 02:36:54.589874 | orchestrator | Friday 24 April 2026 02:36:53 +0000 (0:00:00.453) 0:04:51.871 ********** 2026-04-24 02:36:54.589886 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-24 02:36:54.589905 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:04.984077 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-24 02:37:04.984198 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:04.984216 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-24 02:37:04.984229 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:04.984240 | orchestrator | 2026-04-24 02:37:04.984253 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL users config] *********** 2026-04-24 02:37:04.984266 | orchestrator | Friday 24 April 2026 02:36:54 +0000 (0:00:00.957) 0:04:52.828 ********** 2026-04-24 02:37:04.984276 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:04.984287 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:04.984298 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:04.984309 | orchestrator | 2026-04-24 02:37:04.984321 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL rules config] *********** 2026-04-24 02:37:04.984332 | orchestrator | Friday 24 April 2026 02:36:55 +0000 (0:00:00.501) 0:04:53.330 ********** 2026-04-24 02:37:04.984342 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:04.984379 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:04.984390 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:04.984401 | orchestrator | 2026-04-24 02:37:04.984412 | orchestrator | TASK [include_role : skyline] ************************************************** 2026-04-24 02:37:04.984423 | orchestrator | Friday 24 April 2026 02:36:56 +0000 (0:00:01.317) 0:04:54.647 ********** 2026-04-24 02:37:04.984433 | orchestrator | included: skyline for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:37:04.984445 | orchestrator | 2026-04-24 02:37:04.984456 | orchestrator | TASK [haproxy-config : Copying over skyline haproxy config] ******************** 2026-04-24 02:37:04.984467 | orchestrator | Friday 24 April 2026 02:36:57 +0000 (0:00:01.477) 0:04:56.124 ********** 2026-04-24 02:37:04.984495 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 02:37:04.984514 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 02:37:04.984545 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 02:37:04.984558 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 02:37:04.984587 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 02:37:04.984602 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 02:37:04.984616 | orchestrator | 2026-04-24 02:37:04.984629 | orchestrator | TASK [haproxy-config : Add configuration for skyline when using single external frontend] *** 2026-04-24 02:37:04.984642 | orchestrator | Friday 24 April 2026 02:37:04 +0000 (0:00:06.453) 0:05:02.578 ********** 2026-04-24 02:37:04.984655 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 02:37:04.984676 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 02:37:10.888462 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:10.888600 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 02:37:10.888626 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 02:37:10.888644 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:10.888659 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 02:37:10.888675 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 02:37:10.888715 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:10.888731 | orchestrator | 2026-04-24 02:37:10.888745 | orchestrator | TASK [haproxy-config : Configuring firewall for skyline] *********************** 2026-04-24 02:37:10.888760 | orchestrator | Friday 24 April 2026 02:37:04 +0000 (0:00:00.647) 0:05:03.226 ********** 2026-04-24 02:37:10.888791 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888809 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888825 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888845 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888858 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888872 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:10.888907 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888923 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888937 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888951 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:10.888964 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888978 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-24 02:37:10.888992 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-24 02:37:10.889007 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-24 02:37:10.889021 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:10.889035 | orchestrator | 2026-04-24 02:37:10.889059 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL users config] ************ 2026-04-24 02:37:10.889073 | orchestrator | Friday 24 April 2026 02:37:05 +0000 (0:00:01.005) 0:05:04.232 ********** 2026-04-24 02:37:10.889086 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:37:10.889099 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:37:10.889113 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:37:10.889126 | orchestrator | 2026-04-24 02:37:10.889140 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL rules config] ************ 2026-04-24 02:37:10.889154 | orchestrator | Friday 24 April 2026 02:37:07 +0000 (0:00:01.301) 0:05:05.534 ********** 2026-04-24 02:37:10.889167 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:37:10.889181 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:37:10.889195 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:37:10.889208 | orchestrator | 2026-04-24 02:37:10.889221 | orchestrator | TASK [include_role : swift] **************************************************** 2026-04-24 02:37:10.889236 | orchestrator | Friday 24 April 2026 02:37:09 +0000 (0:00:02.258) 0:05:07.792 ********** 2026-04-24 02:37:10.889250 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:10.889264 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:10.889276 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:10.889285 | orchestrator | 2026-04-24 02:37:10.889294 | orchestrator | TASK [include_role : tacker] *************************************************** 2026-04-24 02:37:10.889303 | orchestrator | Friday 24 April 2026 02:37:10 +0000 (0:00:00.668) 0:05:08.460 ********** 2026-04-24 02:37:10.889312 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:10.889321 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:10.889329 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:10.889337 | orchestrator | 2026-04-24 02:37:10.889345 | orchestrator | TASK [include_role : trove] **************************************************** 2026-04-24 02:37:10.889352 | orchestrator | Friday 24 April 2026 02:37:10 +0000 (0:00:00.327) 0:05:08.787 ********** 2026-04-24 02:37:10.889360 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:10.889374 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.148300 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.148437 | orchestrator | 2026-04-24 02:37:58.148456 | orchestrator | TASK [include_role : venus] **************************************************** 2026-04-24 02:37:58.148470 | orchestrator | Friday 24 April 2026 02:37:10 +0000 (0:00:00.343) 0:05:09.131 ********** 2026-04-24 02:37:58.148481 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.148493 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.148531 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.148543 | orchestrator | 2026-04-24 02:37:58.148555 | orchestrator | TASK [include_role : watcher] ************************************************** 2026-04-24 02:37:58.148567 | orchestrator | Friday 24 April 2026 02:37:11 +0000 (0:00:00.329) 0:05:09.460 ********** 2026-04-24 02:37:58.148578 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.148590 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.148601 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.148611 | orchestrator | 2026-04-24 02:37:58.148623 | orchestrator | TASK [include_role : zun] ****************************************************** 2026-04-24 02:37:58.148649 | orchestrator | Friday 24 April 2026 02:37:11 +0000 (0:00:00.670) 0:05:10.131 ********** 2026-04-24 02:37:58.148662 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.148673 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.148685 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.148821 | orchestrator | 2026-04-24 02:37:58.148845 | orchestrator | RUNNING HANDLER [loadbalancer : Check IP addresses on the API interface] ******* 2026-04-24 02:37:58.148866 | orchestrator | Friday 24 April 2026 02:37:12 +0000 (0:00:00.551) 0:05:10.682 ********** 2026-04-24 02:37:58.148887 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.148902 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.148915 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.148927 | orchestrator | 2026-04-24 02:37:58.148939 | orchestrator | RUNNING HANDLER [loadbalancer : Group HA nodes by status] ********************** 2026-04-24 02:37:58.148978 | orchestrator | Friday 24 April 2026 02:37:13 +0000 (0:00:00.687) 0:05:11.370 ********** 2026-04-24 02:37:58.148991 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.149003 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.149015 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.149027 | orchestrator | 2026-04-24 02:37:58.149039 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup keepalived container] ************** 2026-04-24 02:37:58.149052 | orchestrator | Friday 24 April 2026 02:37:13 +0000 (0:00:00.689) 0:05:12.059 ********** 2026-04-24 02:37:58.149064 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.149076 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.149088 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.149100 | orchestrator | 2026-04-24 02:37:58.149112 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup haproxy container] ***************** 2026-04-24 02:37:58.149124 | orchestrator | Friday 24 April 2026 02:37:14 +0000 (0:00:00.888) 0:05:12.948 ********** 2026-04-24 02:37:58.149136 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.149148 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.149162 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.149174 | orchestrator | 2026-04-24 02:37:58.149187 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup proxysql container] **************** 2026-04-24 02:37:58.149197 | orchestrator | Friday 24 April 2026 02:37:15 +0000 (0:00:00.872) 0:05:13.821 ********** 2026-04-24 02:37:58.149208 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.149219 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.149229 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.149240 | orchestrator | 2026-04-24 02:37:58.149251 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup haproxy container] **************** 2026-04-24 02:37:58.149262 | orchestrator | Friday 24 April 2026 02:37:16 +0000 (0:00:00.898) 0:05:14.719 ********** 2026-04-24 02:37:58.149272 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:37:58.149283 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:37:58.149294 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:37:58.149305 | orchestrator | 2026-04-24 02:37:58.149315 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup haproxy to start] ************** 2026-04-24 02:37:58.149326 | orchestrator | Friday 24 April 2026 02:37:25 +0000 (0:00:09.395) 0:05:24.115 ********** 2026-04-24 02:37:58.149337 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.149348 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.149358 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.149369 | orchestrator | 2026-04-24 02:37:58.149379 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup proxysql container] *************** 2026-04-24 02:37:58.149390 | orchestrator | Friday 24 April 2026 02:37:27 +0000 (0:00:01.220) 0:05:25.336 ********** 2026-04-24 02:37:58.149401 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:37:58.149412 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:37:58.149423 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:37:58.149433 | orchestrator | 2026-04-24 02:37:58.149444 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup proxysql to start] ************* 2026-04-24 02:37:58.149456 | orchestrator | Friday 24 April 2026 02:37:43 +0000 (0:00:16.116) 0:05:41.452 ********** 2026-04-24 02:37:58.149467 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.149478 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.149489 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.149499 | orchestrator | 2026-04-24 02:37:58.149510 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup keepalived container] ************* 2026-04-24 02:37:58.149521 | orchestrator | Friday 24 April 2026 02:37:43 +0000 (0:00:00.712) 0:05:42.165 ********** 2026-04-24 02:37:58.149532 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:37:58.149542 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:37:58.149553 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:37:58.149564 | orchestrator | 2026-04-24 02:37:58.149574 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master haproxy container] ***************** 2026-04-24 02:37:58.149585 | orchestrator | Friday 24 April 2026 02:37:48 +0000 (0:00:04.254) 0:05:46.419 ********** 2026-04-24 02:37:58.149610 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.149621 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.149635 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.149653 | orchestrator | 2026-04-24 02:37:58.149672 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master proxysql container] **************** 2026-04-24 02:37:58.149688 | orchestrator | Friday 24 April 2026 02:37:49 +0000 (0:00:00.958) 0:05:47.378 ********** 2026-04-24 02:37:58.149705 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.149722 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.149740 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.149758 | orchestrator | 2026-04-24 02:37:58.149869 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master keepalived container] ************** 2026-04-24 02:37:58.149885 | orchestrator | Friday 24 April 2026 02:37:49 +0000 (0:00:00.416) 0:05:47.795 ********** 2026-04-24 02:37:58.149896 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.149907 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.149918 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.149929 | orchestrator | 2026-04-24 02:37:58.149940 | orchestrator | RUNNING HANDLER [loadbalancer : Start master haproxy container] **************** 2026-04-24 02:37:58.149951 | orchestrator | Friday 24 April 2026 02:37:49 +0000 (0:00:00.379) 0:05:48.174 ********** 2026-04-24 02:37:58.149962 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.149973 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.149984 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.149995 | orchestrator | 2026-04-24 02:37:58.150006 | orchestrator | RUNNING HANDLER [loadbalancer : Start master proxysql container] *************** 2026-04-24 02:37:58.150070 | orchestrator | Friday 24 April 2026 02:37:50 +0000 (0:00:00.452) 0:05:48.627 ********** 2026-04-24 02:37:58.150084 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.150104 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.150115 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.150126 | orchestrator | 2026-04-24 02:37:58.150137 | orchestrator | RUNNING HANDLER [loadbalancer : Start master keepalived container] ************* 2026-04-24 02:37:58.150148 | orchestrator | Friday 24 April 2026 02:37:51 +0000 (0:00:00.969) 0:05:49.597 ********** 2026-04-24 02:37:58.150159 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:37:58.150169 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:37:58.150180 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:37:58.150191 | orchestrator | 2026-04-24 02:37:58.150202 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for haproxy to listen on VIP] ************* 2026-04-24 02:37:58.150213 | orchestrator | Friday 24 April 2026 02:37:51 +0000 (0:00:00.360) 0:05:49.958 ********** 2026-04-24 02:37:58.150224 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.150235 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.150245 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.150256 | orchestrator | 2026-04-24 02:37:58.150267 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for proxysql to listen on VIP] ************ 2026-04-24 02:37:58.150278 | orchestrator | Friday 24 April 2026 02:37:56 +0000 (0:00:04.781) 0:05:54.740 ********** 2026-04-24 02:37:58.150289 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:37:58.150300 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:37:58.150310 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:37:58.150321 | orchestrator | 2026-04-24 02:37:58.150332 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:37:58.150344 | orchestrator | testbed-node-0 : ok=123  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-24 02:37:58.150357 | orchestrator | testbed-node-1 : ok=122  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-24 02:37:58.150368 | orchestrator | testbed-node-2 : ok=122  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-24 02:37:58.150379 | orchestrator | 2026-04-24 02:37:58.150400 | orchestrator | 2026-04-24 02:37:58.150412 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:37:58.150423 | orchestrator | Friday 24 April 2026 02:37:57 +0000 (0:00:00.792) 0:05:55.532 ********** 2026-04-24 02:37:58.150449 | orchestrator | =============================================================================== 2026-04-24 02:37:58.150460 | orchestrator | loadbalancer : Start backup proxysql container ------------------------- 16.12s 2026-04-24 02:37:58.150471 | orchestrator | loadbalancer : Start backup haproxy container --------------------------- 9.40s 2026-04-24 02:37:58.150482 | orchestrator | haproxy-config : Copying over skyline haproxy config -------------------- 6.45s 2026-04-24 02:37:58.150503 | orchestrator | haproxy-config : Copying over opensearch haproxy config ----------------- 5.45s 2026-04-24 02:37:58.150514 | orchestrator | loadbalancer : Wait for haproxy to listen on VIP ------------------------ 4.78s 2026-04-24 02:37:58.150525 | orchestrator | haproxy-config : Copying over prometheus haproxy config ----------------- 4.31s 2026-04-24 02:37:58.150536 | orchestrator | loadbalancer : Start backup keepalived container ------------------------ 4.25s 2026-04-24 02:37:58.150547 | orchestrator | haproxy-config : Copying over glance haproxy config --------------------- 4.10s 2026-04-24 02:37:58.150557 | orchestrator | haproxy-config : Copying over nova haproxy config ----------------------- 4.06s 2026-04-24 02:37:58.150568 | orchestrator | haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config --- 3.89s 2026-04-24 02:37:58.150579 | orchestrator | haproxy-config : Copying over neutron haproxy config -------------------- 3.80s 2026-04-24 02:37:58.150590 | orchestrator | haproxy-config : Copying over designate haproxy config ------------------ 3.75s 2026-04-24 02:37:58.150601 | orchestrator | haproxy-config : Copying over barbican haproxy config ------------------- 3.53s 2026-04-24 02:37:58.150611 | orchestrator | haproxy-config : Copying over manila haproxy config --------------------- 3.50s 2026-04-24 02:37:58.150622 | orchestrator | haproxy-config : Configuring firewall for glance ------------------------ 3.48s 2026-04-24 02:37:58.150633 | orchestrator | haproxy-config : Copying over cinder haproxy config --------------------- 3.48s 2026-04-24 02:37:58.150644 | orchestrator | haproxy-config : Copying over octavia haproxy config -------------------- 3.44s 2026-04-24 02:37:58.150654 | orchestrator | haproxy-config : Copying over placement haproxy config ------------------ 3.40s 2026-04-24 02:37:58.150666 | orchestrator | haproxy-config : Copying over aodh haproxy config ----------------------- 3.37s 2026-04-24 02:37:58.150677 | orchestrator | service-cert-copy : loadbalancer | Copying over extra CA certificates --- 3.35s 2026-04-24 02:38:00.508005 | orchestrator | 2026-04-24 02:38:00 | INFO  | Task 8cae544e-226a-4e8b-857d-a70e5afb2d7a (opensearch) was prepared for execution. 2026-04-24 02:38:00.508104 | orchestrator | 2026-04-24 02:38:00 | INFO  | It takes a moment until task 8cae544e-226a-4e8b-857d-a70e5afb2d7a (opensearch) has been started and output is visible here. 2026-04-24 02:38:11.175433 | orchestrator | 2026-04-24 02:38:11.175581 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:38:11.175614 | orchestrator | 2026-04-24 02:38:11.175629 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 02:38:11.175643 | orchestrator | Friday 24 April 2026 02:38:04 +0000 (0:00:00.270) 0:00:00.270 ********** 2026-04-24 02:38:11.175658 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:38:11.175673 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:38:11.175686 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:38:11.175699 | orchestrator | 2026-04-24 02:38:11.175712 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 02:38:11.175726 | orchestrator | Friday 24 April 2026 02:38:05 +0000 (0:00:00.318) 0:00:00.589 ********** 2026-04-24 02:38:11.175795 | orchestrator | ok: [testbed-node-0] => (item=enable_opensearch_True) 2026-04-24 02:38:11.175814 | orchestrator | ok: [testbed-node-1] => (item=enable_opensearch_True) 2026-04-24 02:38:11.175829 | orchestrator | ok: [testbed-node-2] => (item=enable_opensearch_True) 2026-04-24 02:38:11.175842 | orchestrator | 2026-04-24 02:38:11.175855 | orchestrator | PLAY [Apply role opensearch] *************************************************** 2026-04-24 02:38:11.175898 | orchestrator | 2026-04-24 02:38:11.175914 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-24 02:38:11.175930 | orchestrator | Friday 24 April 2026 02:38:05 +0000 (0:00:00.437) 0:00:01.026 ********** 2026-04-24 02:38:11.175945 | orchestrator | included: /ansible/roles/opensearch/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:38:11.175960 | orchestrator | 2026-04-24 02:38:11.175975 | orchestrator | TASK [opensearch : Setting sysctl values] ************************************** 2026-04-24 02:38:11.175990 | orchestrator | Friday 24 April 2026 02:38:05 +0000 (0:00:00.476) 0:00:01.503 ********** 2026-04-24 02:38:11.176005 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 02:38:11.176021 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 02:38:11.176037 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 02:38:11.176049 | orchestrator | 2026-04-24 02:38:11.176058 | orchestrator | TASK [opensearch : Ensuring config directories exist] ************************** 2026-04-24 02:38:11.176067 | orchestrator | Friday 24 April 2026 02:38:06 +0000 (0:00:00.664) 0:00:02.168 ********** 2026-04-24 02:38:11.176080 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:11.176095 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:11.176121 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:11.176152 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:11.176172 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:11.176181 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:11.176190 | orchestrator | 2026-04-24 02:38:11.176198 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-24 02:38:11.176206 | orchestrator | Friday 24 April 2026 02:38:08 +0000 (0:00:01.655) 0:00:03.823 ********** 2026-04-24 02:38:11.176214 | orchestrator | included: /ansible/roles/opensearch/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:38:11.176222 | orchestrator | 2026-04-24 02:38:11.176230 | orchestrator | TASK [service-cert-copy : opensearch | Copying over extra CA certificates] ***** 2026-04-24 02:38:11.176238 | orchestrator | Friday 24 April 2026 02:38:08 +0000 (0:00:00.524) 0:00:04.347 ********** 2026-04-24 02:38:11.176257 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:11.971684 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:11.971856 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:11.971878 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:11.971894 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:11.971967 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:11.971983 | orchestrator | 2026-04-24 02:38:11.971996 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS certificate] *** 2026-04-24 02:38:11.972008 | orchestrator | Friday 24 April 2026 02:38:11 +0000 (0:00:02.379) 0:00:06.727 ********** 2026-04-24 02:38:11.972021 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:38:11.972033 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:38:11.972046 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:38:11.972064 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:38:11.972118 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:38:13.066638 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:38:13.066818 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:38:13.066845 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:38:13.066861 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:38:13.066873 | orchestrator | 2026-04-24 02:38:13.066886 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS key] *** 2026-04-24 02:38:13.066899 | orchestrator | Friday 24 April 2026 02:38:11 +0000 (0:00:00.796) 0:00:07.523 ********** 2026-04-24 02:38:13.066936 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:38:13.066965 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:38:13.066997 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:38:13.067010 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:38:13.067031 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:38:13.067050 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:38:13.067081 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-24 02:38:13.067110 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-24 02:38:13.067128 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:38:13.067146 | orchestrator | 2026-04-24 02:38:13.067164 | orchestrator | TASK [opensearch : Copying over config.json files for services] **************** 2026-04-24 02:38:13.067194 | orchestrator | Friday 24 April 2026 02:38:13 +0000 (0:00:01.092) 0:00:08.616 ********** 2026-04-24 02:38:21.229927 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:21.230145 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:21.230178 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:21.230233 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:21.230270 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:21.230284 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:38:21.230307 | orchestrator | 2026-04-24 02:38:21.230321 | orchestrator | TASK [opensearch : Copying over opensearch service config file] **************** 2026-04-24 02:38:21.230333 | orchestrator | Friday 24 April 2026 02:38:15 +0000 (0:00:02.389) 0:00:11.006 ********** 2026-04-24 02:38:21.230344 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:38:21.230357 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:38:21.230368 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:38:21.230379 | orchestrator | 2026-04-24 02:38:21.230390 | orchestrator | TASK [opensearch : Copying over opensearch-dashboards config file] ************* 2026-04-24 02:38:21.230400 | orchestrator | Friday 24 April 2026 02:38:17 +0000 (0:00:02.224) 0:00:13.231 ********** 2026-04-24 02:38:21.230411 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:38:21.230422 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:38:21.230433 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:38:21.230443 | orchestrator | 2026-04-24 02:38:21.230456 | orchestrator | TASK [opensearch : Check opensearch containers] ******************************** 2026-04-24 02:38:21.230469 | orchestrator | Friday 24 April 2026 02:38:19 +0000 (0:00:01.902) 0:00:15.133 ********** 2026-04-24 02:38:21.230482 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:21.230501 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:38:21.230524 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-24 02:41:05.007567 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:41:05.007717 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:41:05.007753 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-24 02:41:05.007768 | orchestrator | 2026-04-24 02:41:05.007782 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-24 02:41:05.007795 | orchestrator | Friday 24 April 2026 02:38:21 +0000 (0:00:01.647) 0:00:16.780 ********** 2026-04-24 02:41:05.007806 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:41:05.007818 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:41:05.007829 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:41:05.007840 | orchestrator | 2026-04-24 02:41:05.007852 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-24 02:41:05.007863 | orchestrator | Friday 24 April 2026 02:38:21 +0000 (0:00:00.303) 0:00:17.083 ********** 2026-04-24 02:41:05.007874 | orchestrator | 2026-04-24 02:41:05.007885 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-24 02:41:05.007896 | orchestrator | Friday 24 April 2026 02:38:21 +0000 (0:00:00.062) 0:00:17.146 ********** 2026-04-24 02:41:05.007906 | orchestrator | 2026-04-24 02:41:05.007917 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-24 02:41:05.007938 | orchestrator | Friday 24 April 2026 02:38:21 +0000 (0:00:00.065) 0:00:17.212 ********** 2026-04-24 02:41:05.007949 | orchestrator | 2026-04-24 02:41:05.007960 | orchestrator | RUNNING HANDLER [opensearch : Disable shard allocation] ************************ 2026-04-24 02:41:05.007986 | orchestrator | Friday 24 April 2026 02:38:21 +0000 (0:00:00.064) 0:00:17.276 ********** 2026-04-24 02:41:05.007998 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:41:05.008009 | orchestrator | 2026-04-24 02:41:05.008020 | orchestrator | RUNNING HANDLER [opensearch : Perform a flush] ********************************* 2026-04-24 02:41:05.008031 | orchestrator | Friday 24 April 2026 02:38:21 +0000 (0:00:00.235) 0:00:17.512 ********** 2026-04-24 02:41:05.008041 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:41:05.008055 | orchestrator | 2026-04-24 02:41:05.008068 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch container] ******************** 2026-04-24 02:41:05.008081 | orchestrator | Friday 24 April 2026 02:38:22 +0000 (0:00:00.628) 0:00:18.140 ********** 2026-04-24 02:41:05.008095 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:41:05.008108 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:41:05.008122 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:41:05.008134 | orchestrator | 2026-04-24 02:41:05.008147 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch-dashboards container] ********* 2026-04-24 02:41:05.008160 | orchestrator | Friday 24 April 2026 02:39:33 +0000 (0:01:11.230) 0:01:29.371 ********** 2026-04-24 02:41:05.008173 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:41:05.008186 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:41:05.008199 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:41:05.008211 | orchestrator | 2026-04-24 02:41:05.008225 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-24 02:41:05.008238 | orchestrator | Friday 24 April 2026 02:40:54 +0000 (0:01:20.469) 0:02:49.841 ********** 2026-04-24 02:41:05.008251 | orchestrator | included: /ansible/roles/opensearch/tasks/post-config.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:41:05.008264 | orchestrator | 2026-04-24 02:41:05.008276 | orchestrator | TASK [opensearch : Wait for OpenSearch to become ready] ************************ 2026-04-24 02:41:05.008287 | orchestrator | Friday 24 April 2026 02:40:54 +0000 (0:00:00.534) 0:02:50.376 ********** 2026-04-24 02:41:05.008298 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:41:05.008309 | orchestrator | 2026-04-24 02:41:05.008320 | orchestrator | TASK [opensearch : Check if a log retention policy exists] ********************* 2026-04-24 02:41:05.008331 | orchestrator | Friday 24 April 2026 02:40:57 +0000 (0:00:02.824) 0:02:53.201 ********** 2026-04-24 02:41:05.008342 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:41:05.008352 | orchestrator | 2026-04-24 02:41:05.008363 | orchestrator | TASK [opensearch : Create new log retention policy] **************************** 2026-04-24 02:41:05.008374 | orchestrator | Friday 24 April 2026 02:40:59 +0000 (0:00:02.201) 0:02:55.402 ********** 2026-04-24 02:41:05.008385 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:41:05.008396 | orchestrator | 2026-04-24 02:41:05.008407 | orchestrator | TASK [opensearch : Apply retention policy to existing indices] ***************** 2026-04-24 02:41:05.008418 | orchestrator | Friday 24 April 2026 02:41:02 +0000 (0:00:02.673) 0:02:58.076 ********** 2026-04-24 02:41:05.008448 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:41:05.008461 | orchestrator | 2026-04-24 02:41:05.008472 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:41:05.008484 | orchestrator | testbed-node-0 : ok=18  changed=11  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 02:41:05.008496 | orchestrator | testbed-node-1 : ok=14  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 02:41:05.008514 | orchestrator | testbed-node-2 : ok=14  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 02:41:05.008525 | orchestrator | 2026-04-24 02:41:05.008536 | orchestrator | 2026-04-24 02:41:05.008554 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:41:05.008565 | orchestrator | Friday 24 April 2026 02:41:04 +0000 (0:00:02.463) 0:03:00.540 ********** 2026-04-24 02:41:05.008576 | orchestrator | =============================================================================== 2026-04-24 02:41:05.008587 | orchestrator | opensearch : Restart opensearch-dashboards container ------------------- 80.47s 2026-04-24 02:41:05.008598 | orchestrator | opensearch : Restart opensearch container ------------------------------ 71.23s 2026-04-24 02:41:05.008609 | orchestrator | opensearch : Wait for OpenSearch to become ready ------------------------ 2.82s 2026-04-24 02:41:05.008620 | orchestrator | opensearch : Create new log retention policy ---------------------------- 2.67s 2026-04-24 02:41:05.008630 | orchestrator | opensearch : Apply retention policy to existing indices ----------------- 2.46s 2026-04-24 02:41:05.008641 | orchestrator | opensearch : Copying over config.json files for services ---------------- 2.39s 2026-04-24 02:41:05.008652 | orchestrator | service-cert-copy : opensearch | Copying over extra CA certificates ----- 2.38s 2026-04-24 02:41:05.008663 | orchestrator | opensearch : Copying over opensearch service config file ---------------- 2.22s 2026-04-24 02:41:05.008673 | orchestrator | opensearch : Check if a log retention policy exists --------------------- 2.20s 2026-04-24 02:41:05.008684 | orchestrator | opensearch : Copying over opensearch-dashboards config file ------------- 1.90s 2026-04-24 02:41:05.008695 | orchestrator | opensearch : Ensuring config directories exist -------------------------- 1.66s 2026-04-24 02:41:05.008705 | orchestrator | opensearch : Check opensearch containers -------------------------------- 1.65s 2026-04-24 02:41:05.008716 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS key --- 1.09s 2026-04-24 02:41:05.008727 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS certificate --- 0.80s 2026-04-24 02:41:05.008738 | orchestrator | opensearch : Setting sysctl values -------------------------------------- 0.66s 2026-04-24 02:41:05.008749 | orchestrator | opensearch : Perform a flush -------------------------------------------- 0.63s 2026-04-24 02:41:05.008766 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.54s 2026-04-24 02:41:05.339689 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.52s 2026-04-24 02:41:05.339793 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.48s 2026-04-24 02:41:05.339809 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.44s 2026-04-24 02:41:07.742944 | orchestrator | 2026-04-24 02:41:07 | INFO  | Task d4e1dea8-ef83-49d1-ad5c-9a7b87b3b2a0 (memcached) was prepared for execution. 2026-04-24 02:41:07.743080 | orchestrator | 2026-04-24 02:41:07 | INFO  | It takes a moment until task d4e1dea8-ef83-49d1-ad5c-9a7b87b3b2a0 (memcached) has been started and output is visible here. 2026-04-24 02:41:19.811874 | orchestrator | 2026-04-24 02:41:19.812041 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:41:19.812073 | orchestrator | 2026-04-24 02:41:19.812096 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 02:41:19.812119 | orchestrator | Friday 24 April 2026 02:41:11 +0000 (0:00:00.252) 0:00:00.252 ********** 2026-04-24 02:41:19.812141 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:41:19.812164 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:41:19.812186 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:41:19.812206 | orchestrator | 2026-04-24 02:41:19.812227 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 02:41:19.812248 | orchestrator | Friday 24 April 2026 02:41:12 +0000 (0:00:00.306) 0:00:00.559 ********** 2026-04-24 02:41:19.812270 | orchestrator | ok: [testbed-node-0] => (item=enable_memcached_True) 2026-04-24 02:41:19.812290 | orchestrator | ok: [testbed-node-1] => (item=enable_memcached_True) 2026-04-24 02:41:19.812309 | orchestrator | ok: [testbed-node-2] => (item=enable_memcached_True) 2026-04-24 02:41:19.812327 | orchestrator | 2026-04-24 02:41:19.812347 | orchestrator | PLAY [Apply role memcached] **************************************************** 2026-04-24 02:41:19.812403 | orchestrator | 2026-04-24 02:41:19.812458 | orchestrator | TASK [memcached : include_tasks] *********************************************** 2026-04-24 02:41:19.812479 | orchestrator | Friday 24 April 2026 02:41:12 +0000 (0:00:00.424) 0:00:00.983 ********** 2026-04-24 02:41:19.812502 | orchestrator | included: /ansible/roles/memcached/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:41:19.812520 | orchestrator | 2026-04-24 02:41:19.812533 | orchestrator | TASK [memcached : Ensuring config directories exist] *************************** 2026-04-24 02:41:19.812545 | orchestrator | Friday 24 April 2026 02:41:13 +0000 (0:00:00.531) 0:00:01.514 ********** 2026-04-24 02:41:19.812558 | orchestrator | changed: [testbed-node-0] => (item=memcached) 2026-04-24 02:41:19.812571 | orchestrator | changed: [testbed-node-1] => (item=memcached) 2026-04-24 02:41:19.812583 | orchestrator | changed: [testbed-node-2] => (item=memcached) 2026-04-24 02:41:19.812596 | orchestrator | 2026-04-24 02:41:19.812607 | orchestrator | TASK [memcached : Copying over config.json files for services] ***************** 2026-04-24 02:41:19.812618 | orchestrator | Friday 24 April 2026 02:41:13 +0000 (0:00:00.723) 0:00:02.237 ********** 2026-04-24 02:41:19.812628 | orchestrator | changed: [testbed-node-1] => (item=memcached) 2026-04-24 02:41:19.812639 | orchestrator | changed: [testbed-node-2] => (item=memcached) 2026-04-24 02:41:19.812650 | orchestrator | changed: [testbed-node-0] => (item=memcached) 2026-04-24 02:41:19.812660 | orchestrator | 2026-04-24 02:41:19.812671 | orchestrator | TASK [memcached : Check memcached container] *********************************** 2026-04-24 02:41:19.812681 | orchestrator | Friday 24 April 2026 02:41:15 +0000 (0:00:01.866) 0:00:04.103 ********** 2026-04-24 02:41:19.812708 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:41:19.812720 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:41:19.812731 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:41:19.812741 | orchestrator | 2026-04-24 02:41:19.812752 | orchestrator | RUNNING HANDLER [memcached : Restart memcached container] ********************** 2026-04-24 02:41:19.812763 | orchestrator | Friday 24 April 2026 02:41:17 +0000 (0:00:01.472) 0:00:05.576 ********** 2026-04-24 02:41:19.812774 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:41:19.812784 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:41:19.812795 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:41:19.812805 | orchestrator | 2026-04-24 02:41:19.812816 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:41:19.812827 | orchestrator | testbed-node-0 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:41:19.812839 | orchestrator | testbed-node-1 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:41:19.812850 | orchestrator | testbed-node-2 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:41:19.812861 | orchestrator | 2026-04-24 02:41:19.812871 | orchestrator | 2026-04-24 02:41:19.812882 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:41:19.812893 | orchestrator | Friday 24 April 2026 02:41:19 +0000 (0:00:02.111) 0:00:07.688 ********** 2026-04-24 02:41:19.812903 | orchestrator | =============================================================================== 2026-04-24 02:41:19.812914 | orchestrator | memcached : Restart memcached container --------------------------------- 2.11s 2026-04-24 02:41:19.812924 | orchestrator | memcached : Copying over config.json files for services ----------------- 1.87s 2026-04-24 02:41:19.812935 | orchestrator | memcached : Check memcached container ----------------------------------- 1.47s 2026-04-24 02:41:19.812946 | orchestrator | memcached : Ensuring config directories exist --------------------------- 0.72s 2026-04-24 02:41:19.812957 | orchestrator | memcached : include_tasks ----------------------------------------------- 0.53s 2026-04-24 02:41:19.812967 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.42s 2026-04-24 02:41:19.812978 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.31s 2026-04-24 02:41:22.176071 | orchestrator | 2026-04-24 02:41:22 | INFO  | Task b77e8cec-cf41-4ebd-9132-3b4a7e85906f (redis) was prepared for execution. 2026-04-24 02:41:22.176154 | orchestrator | 2026-04-24 02:41:22 | INFO  | It takes a moment until task b77e8cec-cf41-4ebd-9132-3b4a7e85906f (redis) has been started and output is visible here. 2026-04-24 02:41:31.087977 | orchestrator | 2026-04-24 02:41:31.088096 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:41:31.088112 | orchestrator | 2026-04-24 02:41:31.088125 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 02:41:31.088136 | orchestrator | Friday 24 April 2026 02:41:26 +0000 (0:00:00.253) 0:00:00.253 ********** 2026-04-24 02:41:31.088148 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:41:31.088160 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:41:31.088171 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:41:31.088182 | orchestrator | 2026-04-24 02:41:31.088193 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 02:41:31.088204 | orchestrator | Friday 24 April 2026 02:41:26 +0000 (0:00:00.290) 0:00:00.543 ********** 2026-04-24 02:41:31.088215 | orchestrator | ok: [testbed-node-0] => (item=enable_redis_True) 2026-04-24 02:41:31.088226 | orchestrator | ok: [testbed-node-1] => (item=enable_redis_True) 2026-04-24 02:41:31.088237 | orchestrator | ok: [testbed-node-2] => (item=enable_redis_True) 2026-04-24 02:41:31.088248 | orchestrator | 2026-04-24 02:41:31.088259 | orchestrator | PLAY [Apply role redis] ******************************************************** 2026-04-24 02:41:31.088269 | orchestrator | 2026-04-24 02:41:31.088280 | orchestrator | TASK [redis : include_tasks] *************************************************** 2026-04-24 02:41:31.088291 | orchestrator | Friday 24 April 2026 02:41:26 +0000 (0:00:00.416) 0:00:00.960 ********** 2026-04-24 02:41:31.088302 | orchestrator | included: /ansible/roles/redis/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:41:31.088314 | orchestrator | 2026-04-24 02:41:31.088325 | orchestrator | TASK [redis : Ensuring config directories exist] ******************************* 2026-04-24 02:41:31.088336 | orchestrator | Friday 24 April 2026 02:41:27 +0000 (0:00:00.512) 0:00:01.473 ********** 2026-04-24 02:41:31.088358 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088383 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088490 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088543 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088588 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088607 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088626 | orchestrator | 2026-04-24 02:41:31.088643 | orchestrator | TASK [redis : Copying over default config.json files] ************************** 2026-04-24 02:41:31.088659 | orchestrator | Friday 24 April 2026 02:41:28 +0000 (0:00:01.052) 0:00:02.525 ********** 2026-04-24 02:41:31.088676 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088813 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088845 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088876 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:31.088907 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095126 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095252 | orchestrator | 2026-04-24 02:41:35.095269 | orchestrator | TASK [redis : Copying over redis config files] ********************************* 2026-04-24 02:41:35.095281 | orchestrator | Friday 24 April 2026 02:41:31 +0000 (0:00:02.510) 0:00:05.035 ********** 2026-04-24 02:41:35.095293 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095319 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095339 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095373 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095434 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095463 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095474 | orchestrator | 2026-04-24 02:41:35.095485 | orchestrator | TASK [redis : Check redis containers] ****************************************** 2026-04-24 02:41:35.095495 | orchestrator | Friday 24 April 2026 02:41:33 +0000 (0:00:02.372) 0:00:07.408 ********** 2026-04-24 02:41:35.095505 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095515 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095531 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095549 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095560 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:35.095577 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 02:41:51.451935 | orchestrator | 2026-04-24 02:41:51.452054 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-24 02:41:51.452073 | orchestrator | Friday 24 April 2026 02:41:34 +0000 (0:00:01.445) 0:00:08.853 ********** 2026-04-24 02:41:51.452085 | orchestrator | 2026-04-24 02:41:51.452097 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-24 02:41:51.452108 | orchestrator | Friday 24 April 2026 02:41:34 +0000 (0:00:00.062) 0:00:08.915 ********** 2026-04-24 02:41:51.452119 | orchestrator | 2026-04-24 02:41:51.452130 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-24 02:41:51.452141 | orchestrator | Friday 24 April 2026 02:41:35 +0000 (0:00:00.062) 0:00:08.978 ********** 2026-04-24 02:41:51.452151 | orchestrator | 2026-04-24 02:41:51.452163 | orchestrator | RUNNING HANDLER [redis : Restart redis container] ****************************** 2026-04-24 02:41:51.452173 | orchestrator | Friday 24 April 2026 02:41:35 +0000 (0:00:00.062) 0:00:09.041 ********** 2026-04-24 02:41:51.452184 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:41:51.452196 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:41:51.452207 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:41:51.452218 | orchestrator | 2026-04-24 02:41:51.452229 | orchestrator | RUNNING HANDLER [redis : Restart redis-sentinel container] ********************* 2026-04-24 02:41:51.452240 | orchestrator | Friday 24 April 2026 02:41:43 +0000 (0:00:07.942) 0:00:16.983 ********** 2026-04-24 02:41:51.452279 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:41:51.452291 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:41:51.452301 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:41:51.452312 | orchestrator | 2026-04-24 02:41:51.452324 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:41:51.452335 | orchestrator | testbed-node-0 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:41:51.452347 | orchestrator | testbed-node-1 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:41:51.452449 | orchestrator | testbed-node-2 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:41:51.452467 | orchestrator | 2026-04-24 02:41:51.452480 | orchestrator | 2026-04-24 02:41:51.452493 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:41:51.452507 | orchestrator | Friday 24 April 2026 02:41:51 +0000 (0:00:08.093) 0:00:25.077 ********** 2026-04-24 02:41:51.452519 | orchestrator | =============================================================================== 2026-04-24 02:41:51.452532 | orchestrator | redis : Restart redis-sentinel container -------------------------------- 8.09s 2026-04-24 02:41:51.452546 | orchestrator | redis : Restart redis container ----------------------------------------- 7.94s 2026-04-24 02:41:51.452558 | orchestrator | redis : Copying over default config.json files -------------------------- 2.51s 2026-04-24 02:41:51.452571 | orchestrator | redis : Copying over redis config files --------------------------------- 2.37s 2026-04-24 02:41:51.452583 | orchestrator | redis : Check redis containers ------------------------------------------ 1.45s 2026-04-24 02:41:51.452595 | orchestrator | redis : Ensuring config directories exist ------------------------------- 1.05s 2026-04-24 02:41:51.452608 | orchestrator | redis : include_tasks --------------------------------------------------- 0.51s 2026-04-24 02:41:51.452621 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.42s 2026-04-24 02:41:51.452634 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.29s 2026-04-24 02:41:51.452647 | orchestrator | redis : Flush handlers -------------------------------------------------- 0.19s 2026-04-24 02:41:53.799597 | orchestrator | 2026-04-24 02:41:53 | INFO  | Task c7905482-456b-4b67-804e-d9459d2396df (mariadb) was prepared for execution. 2026-04-24 02:41:53.799730 | orchestrator | 2026-04-24 02:41:53 | INFO  | It takes a moment until task c7905482-456b-4b67-804e-d9459d2396df (mariadb) has been started and output is visible here. 2026-04-24 02:42:07.343221 | orchestrator | 2026-04-24 02:42:07.343378 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:42:07.343395 | orchestrator | 2026-04-24 02:42:07.343406 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 02:42:07.343417 | orchestrator | Friday 24 April 2026 02:41:58 +0000 (0:00:00.163) 0:00:00.163 ********** 2026-04-24 02:42:07.343427 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:42:07.343437 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:42:07.343447 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:42:07.343457 | orchestrator | 2026-04-24 02:42:07.343467 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 02:42:07.343478 | orchestrator | Friday 24 April 2026 02:41:58 +0000 (0:00:00.321) 0:00:00.484 ********** 2026-04-24 02:42:07.343488 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-24 02:42:07.343498 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-24 02:42:07.343508 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-24 02:42:07.343518 | orchestrator | 2026-04-24 02:42:07.343527 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-24 02:42:07.343537 | orchestrator | 2026-04-24 02:42:07.343546 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-24 02:42:07.343577 | orchestrator | Friday 24 April 2026 02:41:58 +0000 (0:00:00.553) 0:00:01.038 ********** 2026-04-24 02:42:07.343587 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 02:42:07.343597 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 02:42:07.343607 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 02:42:07.343616 | orchestrator | 2026-04-24 02:42:07.343626 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 02:42:07.343635 | orchestrator | Friday 24 April 2026 02:41:59 +0000 (0:00:00.369) 0:00:01.407 ********** 2026-04-24 02:42:07.343645 | orchestrator | included: /ansible/roles/mariadb/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:42:07.343656 | orchestrator | 2026-04-24 02:42:07.343666 | orchestrator | TASK [mariadb : Ensuring config directories exist] ***************************** 2026-04-24 02:42:07.343675 | orchestrator | Friday 24 April 2026 02:41:59 +0000 (0:00:00.544) 0:00:01.951 ********** 2026-04-24 02:42:07.343750 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:42:07.343802 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:42:07.343832 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:42:07.343845 | orchestrator | 2026-04-24 02:42:07.343855 | orchestrator | TASK [mariadb : Ensuring database backup config directory exists] ************** 2026-04-24 02:42:07.343867 | orchestrator | Friday 24 April 2026 02:42:02 +0000 (0:00:02.516) 0:00:04.468 ********** 2026-04-24 02:42:07.343878 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:42:07.343891 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:42:07.343900 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:42:07.343910 | orchestrator | 2026-04-24 02:42:07.343919 | orchestrator | TASK [mariadb : Copying over my.cnf for mariabackup] *************************** 2026-04-24 02:42:07.343929 | orchestrator | Friday 24 April 2026 02:42:02 +0000 (0:00:00.639) 0:00:05.107 ********** 2026-04-24 02:42:07.343938 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:42:07.343948 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:42:07.343958 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:42:07.343967 | orchestrator | 2026-04-24 02:42:07.343977 | orchestrator | TASK [mariadb : Copying over config.json files for services] ******************* 2026-04-24 02:42:07.343986 | orchestrator | Friday 24 April 2026 02:42:04 +0000 (0:00:01.364) 0:00:06.471 ********** 2026-04-24 02:42:07.344006 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:42:15.157882 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:42:15.158297 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:42:15.158393 | orchestrator | 2026-04-24 02:42:15.158413 | orchestrator | TASK [mariadb : Copying over config.json files for mariabackup] **************** 2026-04-24 02:42:15.158428 | orchestrator | Friday 24 April 2026 02:42:07 +0000 (0:00:03.015) 0:00:09.487 ********** 2026-04-24 02:42:15.158441 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:42:15.158456 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:42:15.158469 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:42:15.158481 | orchestrator | 2026-04-24 02:42:15.158494 | orchestrator | TASK [mariadb : Copying over galera.cnf] *************************************** 2026-04-24 02:42:15.158528 | orchestrator | Friday 24 April 2026 02:42:08 +0000 (0:00:01.086) 0:00:10.573 ********** 2026-04-24 02:42:15.158542 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:42:15.158554 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:42:15.158566 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:42:15.158579 | orchestrator | 2026-04-24 02:42:15.158592 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 02:42:15.158604 | orchestrator | Friday 24 April 2026 02:42:12 +0000 (0:00:03.709) 0:00:14.283 ********** 2026-04-24 02:42:15.158615 | orchestrator | included: /ansible/roles/mariadb/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:42:15.158626 | orchestrator | 2026-04-24 02:42:15.158637 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-24 02:42:15.158648 | orchestrator | Friday 24 April 2026 02:42:12 +0000 (0:00:00.538) 0:00:14.821 ********** 2026-04-24 02:42:15.158669 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:15.158734 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:42:15.158756 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:19.816657 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:42:19.816790 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:19.816836 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:42:19.816850 | orchestrator | 2026-04-24 02:42:19.816863 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-24 02:42:19.816876 | orchestrator | Friday 24 April 2026 02:42:15 +0000 (0:00:02.476) 0:00:17.298 ********** 2026-04-24 02:42:19.816890 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:19.816922 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:42:19.816973 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:19.816996 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:42:19.817007 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:19.817019 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:42:19.817030 | orchestrator | 2026-04-24 02:42:19.817042 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-24 02:42:19.817052 | orchestrator | Friday 24 April 2026 02:42:17 +0000 (0:00:02.461) 0:00:19.759 ********** 2026-04-24 02:42:19.817125 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:22.514505 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:42:22.514591 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:22.514602 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:42:22.514621 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 02:42:22.514643 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:42:22.514650 | orchestrator | 2026-04-24 02:42:22.514657 | orchestrator | TASK [mariadb : Check mariadb containers] ************************************** 2026-04-24 02:42:22.514664 | orchestrator | Friday 24 April 2026 02:42:19 +0000 (0:00:02.203) 0:00:21.963 ********** 2026-04-24 02:42:22.514683 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:42:22.514692 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:42:22.514708 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 02:44:37.253035 | orchestrator | 2026-04-24 02:44:37.253225 | orchestrator | TASK [mariadb : Create MariaDB volume] ***************************************** 2026-04-24 02:44:37.253247 | orchestrator | Friday 24 April 2026 02:42:22 +0000 (0:00:02.699) 0:00:24.662 ********** 2026-04-24 02:44:37.253261 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:37.253273 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:44:37.253284 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:44:37.253296 | orchestrator | 2026-04-24 02:44:37.253307 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB volume availability] ************* 2026-04-24 02:44:37.253318 | orchestrator | Friday 24 April 2026 02:42:23 +0000 (0:00:00.836) 0:00:25.499 ********** 2026-04-24 02:44:37.253330 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.253341 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:44:37.253352 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:44:37.253363 | orchestrator | 2026-04-24 02:44:37.253374 | orchestrator | TASK [mariadb : Establish whether the cluster has already existed] ************* 2026-04-24 02:44:37.253385 | orchestrator | Friday 24 April 2026 02:42:23 +0000 (0:00:00.516) 0:00:26.016 ********** 2026-04-24 02:44:37.253395 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.253406 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:44:37.253417 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:44:37.253427 | orchestrator | 2026-04-24 02:44:37.253438 | orchestrator | TASK [mariadb : Check MariaDB service port liveness] *************************** 2026-04-24 02:44:37.253449 | orchestrator | Friday 24 April 2026 02:42:24 +0000 (0:00:00.307) 0:00:26.324 ********** 2026-04-24 02:44:37.253461 | orchestrator | fatal: [testbed-node-0]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.10:3306"} 2026-04-24 02:44:37.253473 | orchestrator | ...ignoring 2026-04-24 02:44:37.253484 | orchestrator | fatal: [testbed-node-1]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.11:3306"} 2026-04-24 02:44:37.253495 | orchestrator | ...ignoring 2026-04-24 02:44:37.253506 | orchestrator | fatal: [testbed-node-2]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.12:3306"} 2026-04-24 02:44:37.253517 | orchestrator | ...ignoring 2026-04-24 02:44:37.253552 | orchestrator | 2026-04-24 02:44:37.253564 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service port liveness] *********** 2026-04-24 02:44:37.253574 | orchestrator | Friday 24 April 2026 02:42:34 +0000 (0:00:10.814) 0:00:37.138 ********** 2026-04-24 02:44:37.253585 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.253596 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:44:37.253606 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:44:37.253617 | orchestrator | 2026-04-24 02:44:37.253628 | orchestrator | TASK [mariadb : Fail on existing but stopped cluster] ************************** 2026-04-24 02:44:37.253638 | orchestrator | Friday 24 April 2026 02:42:35 +0000 (0:00:00.487) 0:00:37.625 ********** 2026-04-24 02:44:37.253649 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:44:37.253660 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:37.253671 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:37.253681 | orchestrator | 2026-04-24 02:44:37.253692 | orchestrator | TASK [mariadb : Check MariaDB service WSREP sync status] *********************** 2026-04-24 02:44:37.253703 | orchestrator | Friday 24 April 2026 02:42:36 +0000 (0:00:00.650) 0:00:38.276 ********** 2026-04-24 02:44:37.253713 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:44:37.253724 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:37.253735 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:37.253745 | orchestrator | 2026-04-24 02:44:37.253770 | orchestrator | TASK [mariadb : Extract MariaDB service WSREP sync status] ********************* 2026-04-24 02:44:37.253782 | orchestrator | Friday 24 April 2026 02:42:36 +0000 (0:00:00.431) 0:00:38.708 ********** 2026-04-24 02:44:37.253793 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:44:37.253804 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:37.253814 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:37.253825 | orchestrator | 2026-04-24 02:44:37.253836 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service WSREP sync status] ******* 2026-04-24 02:44:37.253846 | orchestrator | Friday 24 April 2026 02:42:36 +0000 (0:00:00.420) 0:00:39.129 ********** 2026-04-24 02:44:37.253857 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.253868 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:44:37.253878 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:44:37.253889 | orchestrator | 2026-04-24 02:44:37.253901 | orchestrator | TASK [mariadb : Fail when MariaDB services are not synced across the whole cluster] *** 2026-04-24 02:44:37.253922 | orchestrator | Friday 24 April 2026 02:42:37 +0000 (0:00:00.406) 0:00:39.535 ********** 2026-04-24 02:44:37.253942 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:44:37.253961 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:37.253978 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:37.253995 | orchestrator | 2026-04-24 02:44:37.254079 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 02:44:37.254102 | orchestrator | Friday 24 April 2026 02:42:38 +0000 (0:00:00.830) 0:00:40.365 ********** 2026-04-24 02:44:37.254122 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:37.254214 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:37.254226 | orchestrator | included: /ansible/roles/mariadb/tasks/bootstrap_cluster.yml for testbed-node-0 2026-04-24 02:44:37.254236 | orchestrator | 2026-04-24 02:44:37.254247 | orchestrator | TASK [mariadb : Running MariaDB bootstrap container] *************************** 2026-04-24 02:44:37.254258 | orchestrator | Friday 24 April 2026 02:42:38 +0000 (0:00:00.384) 0:00:40.750 ********** 2026-04-24 02:44:37.254269 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:37.254280 | orchestrator | 2026-04-24 02:44:37.254291 | orchestrator | TASK [mariadb : Store bootstrap host name into facts] ************************** 2026-04-24 02:44:37.254301 | orchestrator | Friday 24 April 2026 02:42:48 +0000 (0:00:09.930) 0:00:50.680 ********** 2026-04-24 02:44:37.254312 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.254323 | orchestrator | 2026-04-24 02:44:37.254334 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 02:44:37.254346 | orchestrator | Friday 24 April 2026 02:42:48 +0000 (0:00:00.140) 0:00:50.821 ********** 2026-04-24 02:44:37.254357 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:44:37.254402 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:37.254414 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:37.254425 | orchestrator | 2026-04-24 02:44:37.254436 | orchestrator | RUNNING HANDLER [mariadb : Starting first MariaDB container] ******************* 2026-04-24 02:44:37.254447 | orchestrator | Friday 24 April 2026 02:42:49 +0000 (0:00:01.036) 0:00:51.858 ********** 2026-04-24 02:44:37.254457 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:37.254468 | orchestrator | 2026-04-24 02:44:37.254479 | orchestrator | RUNNING HANDLER [mariadb : Wait for first MariaDB service port liveness] ******* 2026-04-24 02:44:37.254490 | orchestrator | Friday 24 April 2026 02:42:57 +0000 (0:00:07.615) 0:00:59.473 ********** 2026-04-24 02:44:37.254500 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.254511 | orchestrator | 2026-04-24 02:44:37.254522 | orchestrator | RUNNING HANDLER [mariadb : Wait for first MariaDB service to sync WSREP] ******* 2026-04-24 02:44:37.254533 | orchestrator | Friday 24 April 2026 02:42:58 +0000 (0:00:01.583) 0:01:01.056 ********** 2026-04-24 02:44:37.254544 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.254554 | orchestrator | 2026-04-24 02:44:37.254565 | orchestrator | RUNNING HANDLER [mariadb : Ensure MariaDB is running normally on bootstrap host] *** 2026-04-24 02:44:37.254576 | orchestrator | Friday 24 April 2026 02:43:01 +0000 (0:00:02.498) 0:01:03.555 ********** 2026-04-24 02:44:37.254587 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:37.254597 | orchestrator | 2026-04-24 02:44:37.254608 | orchestrator | RUNNING HANDLER [mariadb : Restart MariaDB on existing cluster members] ******** 2026-04-24 02:44:37.254619 | orchestrator | Friday 24 April 2026 02:43:01 +0000 (0:00:00.127) 0:01:03.683 ********** 2026-04-24 02:44:37.254629 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:44:37.254640 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:37.254651 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:37.254662 | orchestrator | 2026-04-24 02:44:37.254673 | orchestrator | RUNNING HANDLER [mariadb : Start MariaDB on new nodes] ************************* 2026-04-24 02:44:37.254683 | orchestrator | Friday 24 April 2026 02:43:01 +0000 (0:00:00.355) 0:01:04.038 ********** 2026-04-24 02:44:37.254694 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:44:37.254705 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-24 02:44:37.254716 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:44:37.254727 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:44:37.254737 | orchestrator | 2026-04-24 02:44:37.254748 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-24 02:44:37.254759 | orchestrator | skipping: no hosts matched 2026-04-24 02:44:37.254770 | orchestrator | 2026-04-24 02:44:37.254781 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-24 02:44:37.254791 | orchestrator | 2026-04-24 02:44:37.254803 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-24 02:44:37.254820 | orchestrator | Friday 24 April 2026 02:43:02 +0000 (0:00:00.559) 0:01:04.598 ********** 2026-04-24 02:44:37.254837 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:44:37.254848 | orchestrator | 2026-04-24 02:44:37.254859 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-24 02:44:37.254869 | orchestrator | Friday 24 April 2026 02:43:20 +0000 (0:00:18.038) 0:01:22.636 ********** 2026-04-24 02:44:37.254880 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:44:37.254891 | orchestrator | 2026-04-24 02:44:37.254902 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-24 02:44:37.254912 | orchestrator | Friday 24 April 2026 02:43:37 +0000 (0:00:16.565) 0:01:39.202 ********** 2026-04-24 02:44:37.254923 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:44:37.254934 | orchestrator | 2026-04-24 02:44:37.254950 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-24 02:44:37.254961 | orchestrator | 2026-04-24 02:44:37.254980 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-24 02:44:37.254992 | orchestrator | Friday 24 April 2026 02:43:39 +0000 (0:00:02.446) 0:01:41.649 ********** 2026-04-24 02:44:37.255010 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:44:37.255021 | orchestrator | 2026-04-24 02:44:37.255031 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-24 02:44:37.255042 | orchestrator | Friday 24 April 2026 02:44:02 +0000 (0:00:22.950) 0:02:04.599 ********** 2026-04-24 02:44:37.255053 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:44:37.255063 | orchestrator | 2026-04-24 02:44:37.255074 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-24 02:44:37.255084 | orchestrator | Friday 24 April 2026 02:44:14 +0000 (0:00:11.564) 0:02:16.164 ********** 2026-04-24 02:44:37.255095 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:44:37.255105 | orchestrator | 2026-04-24 02:44:37.255118 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-24 02:44:37.255168 | orchestrator | 2026-04-24 02:44:37.255192 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-24 02:44:37.255210 | orchestrator | Friday 24 April 2026 02:44:16 +0000 (0:00:02.619) 0:02:18.784 ********** 2026-04-24 02:44:37.255230 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:37.255248 | orchestrator | 2026-04-24 02:44:37.255267 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-24 02:44:37.255280 | orchestrator | Friday 24 April 2026 02:44:33 +0000 (0:00:16.819) 0:02:35.603 ********** 2026-04-24 02:44:37.255291 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.255301 | orchestrator | 2026-04-24 02:44:37.255312 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-24 02:44:37.255323 | orchestrator | Friday 24 April 2026 02:44:33 +0000 (0:00:00.548) 0:02:36.151 ********** 2026-04-24 02:44:37.255333 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:37.255344 | orchestrator | 2026-04-24 02:44:37.255355 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-24 02:44:37.255365 | orchestrator | 2026-04-24 02:44:37.255376 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-24 02:44:37.255386 | orchestrator | Friday 24 April 2026 02:44:36 +0000 (0:00:02.713) 0:02:38.865 ********** 2026-04-24 02:44:37.255397 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:44:37.255408 | orchestrator | 2026-04-24 02:44:37.255418 | orchestrator | TASK [mariadb : Creating shard root mysql user] ******************************** 2026-04-24 02:44:37.255439 | orchestrator | Friday 24 April 2026 02:44:37 +0000 (0:00:00.532) 0:02:39.397 ********** 2026-04-24 02:44:50.101091 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:50.101247 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:50.101265 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:50.101279 | orchestrator | 2026-04-24 02:44:50.101292 | orchestrator | TASK [mariadb : Creating mysql monitor user] *********************************** 2026-04-24 02:44:50.101304 | orchestrator | Friday 24 April 2026 02:44:39 +0000 (0:00:02.388) 0:02:41.786 ********** 2026-04-24 02:44:50.101316 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:50.101327 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:50.101338 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:50.101353 | orchestrator | 2026-04-24 02:44:50.101372 | orchestrator | TASK [mariadb : Creating database backup user and setting permissions] ********* 2026-04-24 02:44:50.101391 | orchestrator | Friday 24 April 2026 02:44:41 +0000 (0:00:02.135) 0:02:43.921 ********** 2026-04-24 02:44:50.101410 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:50.101428 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:50.101448 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:50.101467 | orchestrator | 2026-04-24 02:44:50.101487 | orchestrator | TASK [mariadb : Granting permissions on Mariabackup database to backup user] *** 2026-04-24 02:44:50.101506 | orchestrator | Friday 24 April 2026 02:44:44 +0000 (0:00:02.377) 0:02:46.299 ********** 2026-04-24 02:44:50.101525 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:50.101543 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:50.101562 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:44:50.101580 | orchestrator | 2026-04-24 02:44:50.101635 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-24 02:44:50.101654 | orchestrator | Friday 24 April 2026 02:44:46 +0000 (0:00:02.231) 0:02:48.531 ********** 2026-04-24 02:44:50.101668 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:44:50.101682 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:44:50.101694 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:44:50.101707 | orchestrator | 2026-04-24 02:44:50.101719 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-24 02:44:50.101732 | orchestrator | Friday 24 April 2026 02:44:49 +0000 (0:00:02.932) 0:02:51.464 ********** 2026-04-24 02:44:50.101744 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:44:50.101757 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:44:50.101769 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:44:50.101782 | orchestrator | 2026-04-24 02:44:50.101794 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:44:50.101807 | orchestrator | testbed-node-0 : ok=34  changed=16  unreachable=0 failed=0 skipped=11  rescued=0 ignored=1  2026-04-24 02:44:50.101822 | orchestrator | testbed-node-1 : ok=20  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=1  2026-04-24 02:44:50.101835 | orchestrator | testbed-node-2 : ok=20  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=1  2026-04-24 02:44:50.101847 | orchestrator | 2026-04-24 02:44:50.101860 | orchestrator | 2026-04-24 02:44:50.101872 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:44:50.101885 | orchestrator | Friday 24 April 2026 02:44:49 +0000 (0:00:00.427) 0:02:51.892 ********** 2026-04-24 02:44:50.101898 | orchestrator | =============================================================================== 2026-04-24 02:44:50.101925 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 40.99s 2026-04-24 02:44:50.101938 | orchestrator | mariadb : Wait for MariaDB service port liveness ----------------------- 28.13s 2026-04-24 02:44:50.101950 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 16.82s 2026-04-24 02:44:50.101961 | orchestrator | mariadb : Check MariaDB service port liveness -------------------------- 10.81s 2026-04-24 02:44:50.101972 | orchestrator | mariadb : Running MariaDB bootstrap container --------------------------- 9.93s 2026-04-24 02:44:50.101983 | orchestrator | mariadb : Starting first MariaDB container ------------------------------ 7.62s 2026-04-24 02:44:50.101995 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ------------------------ 5.07s 2026-04-24 02:44:50.102006 | orchestrator | mariadb : Copying over galera.cnf --------------------------------------- 3.71s 2026-04-24 02:44:50.102158 | orchestrator | mariadb : Copying over config.json files for services ------------------- 3.02s 2026-04-24 02:44:50.102176 | orchestrator | mariadb : Wait for MariaDB service to be ready through VIP -------------- 2.93s 2026-04-24 02:44:50.102187 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ------------------------ 2.71s 2026-04-24 02:44:50.102198 | orchestrator | mariadb : Check mariadb containers -------------------------------------- 2.70s 2026-04-24 02:44:50.102209 | orchestrator | mariadb : Ensuring config directories exist ----------------------------- 2.52s 2026-04-24 02:44:50.102219 | orchestrator | mariadb : Wait for first MariaDB service to sync WSREP ------------------ 2.50s 2026-04-24 02:44:50.102230 | orchestrator | service-cert-copy : mariadb | Copying over extra CA certificates -------- 2.48s 2026-04-24 02:44:50.102241 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS certificate --- 2.46s 2026-04-24 02:44:50.102253 | orchestrator | mariadb : Creating shard root mysql user -------------------------------- 2.39s 2026-04-24 02:44:50.102264 | orchestrator | mariadb : Creating database backup user and setting permissions --------- 2.38s 2026-04-24 02:44:50.102275 | orchestrator | mariadb : Granting permissions on Mariabackup database to backup user --- 2.23s 2026-04-24 02:44:50.102286 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS key ----- 2.20s 2026-04-24 02:44:52.552785 | orchestrator | 2026-04-24 02:44:52 | INFO  | Task 34470b0f-c17c-4c0b-9ccd-415e38c35df1 (rabbitmq) was prepared for execution. 2026-04-24 02:44:52.552892 | orchestrator | 2026-04-24 02:44:52 | INFO  | It takes a moment until task 34470b0f-c17c-4c0b-9ccd-415e38c35df1 (rabbitmq) has been started and output is visible here. 2026-04-24 02:45:04.759825 | orchestrator | 2026-04-24 02:45:04.759897 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:45:04.759907 | orchestrator | 2026-04-24 02:45:04.759914 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 02:45:04.759920 | orchestrator | Friday 24 April 2026 02:44:56 +0000 (0:00:00.157) 0:00:00.157 ********** 2026-04-24 02:45:04.759927 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:45:04.759935 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:45:04.759941 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:45:04.759948 | orchestrator | 2026-04-24 02:45:04.759955 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 02:45:04.759961 | orchestrator | Friday 24 April 2026 02:44:56 +0000 (0:00:00.277) 0:00:00.435 ********** 2026-04-24 02:45:04.759968 | orchestrator | ok: [testbed-node-0] => (item=enable_rabbitmq_True) 2026-04-24 02:45:04.759975 | orchestrator | ok: [testbed-node-1] => (item=enable_rabbitmq_True) 2026-04-24 02:45:04.759981 | orchestrator | ok: [testbed-node-2] => (item=enable_rabbitmq_True) 2026-04-24 02:45:04.759988 | orchestrator | 2026-04-24 02:45:04.759994 | orchestrator | PLAY [Apply role rabbitmq] ***************************************************** 2026-04-24 02:45:04.760002 | orchestrator | 2026-04-24 02:45:04.760009 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-24 02:45:04.760016 | orchestrator | Friday 24 April 2026 02:44:57 +0000 (0:00:00.473) 0:00:00.908 ********** 2026-04-24 02:45:04.760023 | orchestrator | included: /ansible/roles/rabbitmq/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:45:04.760030 | orchestrator | 2026-04-24 02:45:04.760037 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-24 02:45:04.760043 | orchestrator | Friday 24 April 2026 02:44:57 +0000 (0:00:00.467) 0:00:01.376 ********** 2026-04-24 02:45:04.760050 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:45:04.760056 | orchestrator | 2026-04-24 02:45:04.760062 | orchestrator | TASK [rabbitmq : Get current RabbitMQ version] ********************************* 2026-04-24 02:45:04.760069 | orchestrator | Friday 24 April 2026 02:44:58 +0000 (0:00:00.916) 0:00:02.292 ********** 2026-04-24 02:45:04.760076 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:45:04.760083 | orchestrator | 2026-04-24 02:45:04.760120 | orchestrator | TASK [rabbitmq : Get new RabbitMQ version] ************************************* 2026-04-24 02:45:04.760129 | orchestrator | Friday 24 April 2026 02:44:59 +0000 (0:00:00.340) 0:00:02.632 ********** 2026-04-24 02:45:04.760136 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:45:04.760143 | orchestrator | 2026-04-24 02:45:04.760149 | orchestrator | TASK [rabbitmq : Check if running RabbitMQ is at most one version behind] ****** 2026-04-24 02:45:04.760156 | orchestrator | Friday 24 April 2026 02:44:59 +0000 (0:00:00.323) 0:00:02.956 ********** 2026-04-24 02:45:04.760163 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:45:04.760170 | orchestrator | 2026-04-24 02:45:04.760177 | orchestrator | TASK [rabbitmq : Catch when RabbitMQ is being downgraded] ********************** 2026-04-24 02:45:04.760183 | orchestrator | Friday 24 April 2026 02:44:59 +0000 (0:00:00.330) 0:00:03.287 ********** 2026-04-24 02:45:04.760190 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:45:04.760197 | orchestrator | 2026-04-24 02:45:04.760204 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-24 02:45:04.760211 | orchestrator | Friday 24 April 2026 02:45:00 +0000 (0:00:00.457) 0:00:03.744 ********** 2026-04-24 02:45:04.760229 | orchestrator | included: /ansible/roles/rabbitmq/tasks/remove-ha-all-policy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:45:04.760250 | orchestrator | 2026-04-24 02:45:04.760257 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-24 02:45:04.760264 | orchestrator | Friday 24 April 2026 02:45:00 +0000 (0:00:00.714) 0:00:04.459 ********** 2026-04-24 02:45:04.760270 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:45:04.760277 | orchestrator | 2026-04-24 02:45:04.760283 | orchestrator | TASK [rabbitmq : List RabbitMQ policies] *************************************** 2026-04-24 02:45:04.760290 | orchestrator | Friday 24 April 2026 02:45:01 +0000 (0:00:00.811) 0:00:05.270 ********** 2026-04-24 02:45:04.760297 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:45:04.760304 | orchestrator | 2026-04-24 02:45:04.760311 | orchestrator | TASK [rabbitmq : Remove ha-all policy from RabbitMQ] *************************** 2026-04-24 02:45:04.760317 | orchestrator | Friday 24 April 2026 02:45:02 +0000 (0:00:00.361) 0:00:05.632 ********** 2026-04-24 02:45:04.760324 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:45:04.760331 | orchestrator | 2026-04-24 02:45:04.760337 | orchestrator | TASK [rabbitmq : Ensuring config directories exist] **************************** 2026-04-24 02:45:04.760344 | orchestrator | Friday 24 April 2026 02:45:02 +0000 (0:00:00.348) 0:00:05.980 ********** 2026-04-24 02:45:04.760366 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:04.760378 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:04.760387 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:04.760401 | orchestrator | 2026-04-24 02:45:04.760413 | orchestrator | TASK [rabbitmq : Copying over config.json files for services] ****************** 2026-04-24 02:45:04.760422 | orchestrator | Friday 24 April 2026 02:45:03 +0000 (0:00:00.771) 0:00:06.751 ********** 2026-04-24 02:45:04.760431 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:04.760446 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:23.212785 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:23.212897 | orchestrator | 2026-04-24 02:45:23.212910 | orchestrator | TASK [rabbitmq : Copying over rabbitmq-env.conf] ******************************* 2026-04-24 02:45:23.212919 | orchestrator | Friday 24 April 2026 02:45:04 +0000 (0:00:01.490) 0:00:08.242 ********** 2026-04-24 02:45:23.212944 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-24 02:45:23.212952 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-24 02:45:23.212958 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-24 02:45:23.212964 | orchestrator | 2026-04-24 02:45:23.212970 | orchestrator | TASK [rabbitmq : Copying over rabbitmq.conf] *********************************** 2026-04-24 02:45:23.212975 | orchestrator | Friday 24 April 2026 02:45:06 +0000 (0:00:01.336) 0:00:09.579 ********** 2026-04-24 02:45:23.212991 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-24 02:45:23.212998 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-24 02:45:23.213004 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-24 02:45:23.213009 | orchestrator | 2026-04-24 02:45:23.213015 | orchestrator | TASK [rabbitmq : Copying over erl_inetrc] ************************************** 2026-04-24 02:45:23.213021 | orchestrator | Friday 24 April 2026 02:45:07 +0000 (0:00:01.703) 0:00:11.282 ********** 2026-04-24 02:45:23.213027 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-24 02:45:23.213033 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-24 02:45:23.213038 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-24 02:45:23.213044 | orchestrator | 2026-04-24 02:45:23.213050 | orchestrator | TASK [rabbitmq : Copying over advanced.config] ********************************* 2026-04-24 02:45:23.213055 | orchestrator | Friday 24 April 2026 02:45:09 +0000 (0:00:01.396) 0:00:12.678 ********** 2026-04-24 02:45:23.213061 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-24 02:45:23.213067 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-24 02:45:23.213097 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-24 02:45:23.213104 | orchestrator | 2026-04-24 02:45:23.213109 | orchestrator | TASK [rabbitmq : Copying over definitions.json] ******************************** 2026-04-24 02:45:23.213115 | orchestrator | Friday 24 April 2026 02:45:10 +0000 (0:00:01.643) 0:00:14.322 ********** 2026-04-24 02:45:23.213121 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-24 02:45:23.213127 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-24 02:45:23.213132 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-24 02:45:23.213138 | orchestrator | 2026-04-24 02:45:23.213144 | orchestrator | TASK [rabbitmq : Copying over enabled_plugins] ********************************* 2026-04-24 02:45:23.213150 | orchestrator | Friday 24 April 2026 02:45:12 +0000 (0:00:01.485) 0:00:15.807 ********** 2026-04-24 02:45:23.213155 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-24 02:45:23.213161 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-24 02:45:23.213167 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-24 02:45:23.213172 | orchestrator | 2026-04-24 02:45:23.213178 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-24 02:45:23.213184 | orchestrator | Friday 24 April 2026 02:45:13 +0000 (0:00:01.346) 0:00:17.153 ********** 2026-04-24 02:45:23.213190 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:45:23.213197 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:45:23.213216 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:45:23.213230 | orchestrator | 2026-04-24 02:45:23.213237 | orchestrator | TASK [rabbitmq : Check rabbitmq containers] ************************************ 2026-04-24 02:45:23.213242 | orchestrator | Friday 24 April 2026 02:45:14 +0000 (0:00:00.453) 0:00:17.607 ********** 2026-04-24 02:45:23.213250 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:23.213261 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:23.213268 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 02:45:23.213275 | orchestrator | 2026-04-24 02:45:23.213281 | orchestrator | TASK [rabbitmq : Creating rabbitmq volume] ************************************* 2026-04-24 02:45:23.213287 | orchestrator | Friday 24 April 2026 02:45:15 +0000 (0:00:01.268) 0:00:18.875 ********** 2026-04-24 02:45:23.213293 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:45:23.213298 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:45:23.213304 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:45:23.213310 | orchestrator | 2026-04-24 02:45:23.213317 | orchestrator | TASK [rabbitmq : Running RabbitMQ bootstrap container] ************************* 2026-04-24 02:45:23.213327 | orchestrator | Friday 24 April 2026 02:45:16 +0000 (0:00:00.902) 0:00:19.778 ********** 2026-04-24 02:45:23.213334 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:45:23.213340 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:45:23.213347 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:45:23.213353 | orchestrator | 2026-04-24 02:45:23.213360 | orchestrator | RUNNING HANDLER [rabbitmq : Restart rabbitmq container] ************************ 2026-04-24 02:45:23.213370 | orchestrator | Friday 24 April 2026 02:45:23 +0000 (0:00:06.915) 0:00:26.693 ********** 2026-04-24 02:46:55.878098 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:46:55.878190 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:46:55.878200 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:46:55.878207 | orchestrator | 2026-04-24 02:46:55.878214 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-24 02:46:55.878222 | orchestrator | 2026-04-24 02:46:55.878229 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-24 02:46:55.878236 | orchestrator | Friday 24 April 2026 02:45:23 +0000 (0:00:00.527) 0:00:27.221 ********** 2026-04-24 02:46:55.878243 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:46:55.878251 | orchestrator | 2026-04-24 02:46:55.878257 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-24 02:46:55.878264 | orchestrator | Friday 24 April 2026 02:45:24 +0000 (0:00:00.602) 0:00:27.823 ********** 2026-04-24 02:46:55.878270 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:46:55.878276 | orchestrator | 2026-04-24 02:46:55.878283 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-24 02:46:55.878289 | orchestrator | Friday 24 April 2026 02:45:24 +0000 (0:00:00.239) 0:00:28.063 ********** 2026-04-24 02:46:55.878295 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:46:55.878302 | orchestrator | 2026-04-24 02:46:55.878308 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-24 02:46:55.878314 | orchestrator | Friday 24 April 2026 02:45:26 +0000 (0:00:01.603) 0:00:29.666 ********** 2026-04-24 02:46:55.878321 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:46:55.878327 | orchestrator | 2026-04-24 02:46:55.878334 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-24 02:46:55.878340 | orchestrator | 2026-04-24 02:46:55.878346 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-24 02:46:55.878352 | orchestrator | Friday 24 April 2026 02:46:18 +0000 (0:00:52.693) 0:01:22.360 ********** 2026-04-24 02:46:55.878359 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:46:55.878365 | orchestrator | 2026-04-24 02:46:55.878371 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-24 02:46:55.878378 | orchestrator | Friday 24 April 2026 02:46:19 +0000 (0:00:00.606) 0:01:22.966 ********** 2026-04-24 02:46:55.878384 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:46:55.878390 | orchestrator | 2026-04-24 02:46:55.878397 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-24 02:46:55.878403 | orchestrator | Friday 24 April 2026 02:46:19 +0000 (0:00:00.238) 0:01:23.204 ********** 2026-04-24 02:46:55.878409 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:46:55.878416 | orchestrator | 2026-04-24 02:46:55.878422 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-24 02:46:55.878441 | orchestrator | Friday 24 April 2026 02:46:21 +0000 (0:00:01.538) 0:01:24.743 ********** 2026-04-24 02:46:55.878448 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:46:55.878454 | orchestrator | 2026-04-24 02:46:55.878461 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-24 02:46:55.878467 | orchestrator | 2026-04-24 02:46:55.878473 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-24 02:46:55.878480 | orchestrator | Friday 24 April 2026 02:46:35 +0000 (0:00:14.248) 0:01:38.992 ********** 2026-04-24 02:46:55.878486 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:46:55.878492 | orchestrator | 2026-04-24 02:46:55.878517 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-24 02:46:55.878524 | orchestrator | Friday 24 April 2026 02:46:36 +0000 (0:00:00.790) 0:01:39.783 ********** 2026-04-24 02:46:55.878530 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:46:55.878537 | orchestrator | 2026-04-24 02:46:55.878543 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-24 02:46:55.878549 | orchestrator | Friday 24 April 2026 02:46:36 +0000 (0:00:00.233) 0:01:40.016 ********** 2026-04-24 02:46:55.878557 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:46:55.878565 | orchestrator | 2026-04-24 02:46:55.878572 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-24 02:46:55.878579 | orchestrator | Friday 24 April 2026 02:46:38 +0000 (0:00:01.587) 0:01:41.604 ********** 2026-04-24 02:46:55.878586 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:46:55.878593 | orchestrator | 2026-04-24 02:46:55.878600 | orchestrator | PLAY [Apply rabbitmq post-configuration] *************************************** 2026-04-24 02:46:55.878607 | orchestrator | 2026-04-24 02:46:55.878614 | orchestrator | TASK [Include rabbitmq post-deploy.yml] **************************************** 2026-04-24 02:46:55.878621 | orchestrator | Friday 24 April 2026 02:46:52 +0000 (0:00:14.648) 0:01:56.252 ********** 2026-04-24 02:46:55.878629 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:46:55.878635 | orchestrator | 2026-04-24 02:46:55.878642 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-24 02:46:55.878650 | orchestrator | Friday 24 April 2026 02:46:53 +0000 (0:00:00.533) 0:01:56.786 ********** 2026-04-24 02:46:55.878657 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-24 02:46:55.878664 | orchestrator | enable_outward_rabbitmq_True 2026-04-24 02:46:55.878671 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-24 02:46:55.878678 | orchestrator | outward_rabbitmq_restart 2026-04-24 02:46:55.878685 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:46:55.878692 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:46:55.878699 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:46:55.878706 | orchestrator | 2026-04-24 02:46:55.878713 | orchestrator | PLAY [Apply role rabbitmq (outward)] ******************************************* 2026-04-24 02:46:55.878720 | orchestrator | skipping: no hosts matched 2026-04-24 02:46:55.878727 | orchestrator | 2026-04-24 02:46:55.878734 | orchestrator | PLAY [Restart rabbitmq (outward) services] ************************************* 2026-04-24 02:46:55.878741 | orchestrator | skipping: no hosts matched 2026-04-24 02:46:55.878748 | orchestrator | 2026-04-24 02:46:55.878755 | orchestrator | PLAY [Apply rabbitmq (outward) post-configuration] ***************************** 2026-04-24 02:46:55.878762 | orchestrator | skipping: no hosts matched 2026-04-24 02:46:55.878769 | orchestrator | 2026-04-24 02:46:55.878776 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:46:55.878796 | orchestrator | testbed-node-0 : ok=23  changed=14  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-24 02:46:55.878804 | orchestrator | testbed-node-1 : ok=21  changed=14  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:46:55.878811 | orchestrator | testbed-node-2 : ok=21  changed=14  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:46:55.878819 | orchestrator | 2026-04-24 02:46:55.878826 | orchestrator | 2026-04-24 02:46:55.878834 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:46:55.878841 | orchestrator | Friday 24 April 2026 02:46:55 +0000 (0:00:02.264) 0:01:59.051 ********** 2026-04-24 02:46:55.878848 | orchestrator | =============================================================================== 2026-04-24 02:46:55.878855 | orchestrator | rabbitmq : Waiting for rabbitmq to start ------------------------------- 81.59s 2026-04-24 02:46:55.878862 | orchestrator | rabbitmq : Running RabbitMQ bootstrap container ------------------------- 6.92s 2026-04-24 02:46:55.878873 | orchestrator | rabbitmq : Restart rabbitmq container ----------------------------------- 4.73s 2026-04-24 02:46:55.878880 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 2.26s 2026-04-24 02:46:55.878886 | orchestrator | rabbitmq : Get info on RabbitMQ container ------------------------------- 2.00s 2026-04-24 02:46:55.878892 | orchestrator | rabbitmq : Copying over rabbitmq.conf ----------------------------------- 1.70s 2026-04-24 02:46:55.878899 | orchestrator | rabbitmq : Copying over advanced.config --------------------------------- 1.64s 2026-04-24 02:46:55.878905 | orchestrator | rabbitmq : Copying over config.json files for services ------------------ 1.49s 2026-04-24 02:46:55.878911 | orchestrator | rabbitmq : Copying over definitions.json -------------------------------- 1.49s 2026-04-24 02:46:55.878918 | orchestrator | rabbitmq : Copying over erl_inetrc -------------------------------------- 1.40s 2026-04-24 02:46:55.878924 | orchestrator | rabbitmq : Copying over enabled_plugins --------------------------------- 1.35s 2026-04-24 02:46:55.878930 | orchestrator | rabbitmq : Copying over rabbitmq-env.conf ------------------------------- 1.34s 2026-04-24 02:46:55.878936 | orchestrator | rabbitmq : Check rabbitmq containers ------------------------------------ 1.27s 2026-04-24 02:46:55.878943 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 0.92s 2026-04-24 02:46:55.878953 | orchestrator | rabbitmq : Creating rabbitmq volume ------------------------------------- 0.90s 2026-04-24 02:46:55.878959 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 0.81s 2026-04-24 02:46:55.879003 | orchestrator | rabbitmq : Ensuring config directories exist ---------------------------- 0.77s 2026-04-24 02:46:55.879010 | orchestrator | rabbitmq : include_tasks ------------------------------------------------ 0.71s 2026-04-24 02:46:55.879017 | orchestrator | rabbitmq : Put RabbitMQ node into maintenance mode ---------------------- 0.71s 2026-04-24 02:46:55.879023 | orchestrator | Include rabbitmq post-deploy.yml ---------------------------------------- 0.53s 2026-04-24 02:46:58.263693 | orchestrator | 2026-04-24 02:46:58 | INFO  | Task 56516e39-fbab-42ee-9c2c-40e9918c800b (openvswitch) was prepared for execution. 2026-04-24 02:46:58.263794 | orchestrator | 2026-04-24 02:46:58 | INFO  | It takes a moment until task 56516e39-fbab-42ee-9c2c-40e9918c800b (openvswitch) has been started and output is visible here. 2026-04-24 02:47:10.865749 | orchestrator | 2026-04-24 02:47:10.865897 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:47:10.865925 | orchestrator | 2026-04-24 02:47:10.865941 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 02:47:10.865988 | orchestrator | Friday 24 April 2026 02:47:02 +0000 (0:00:00.257) 0:00:00.257 ********** 2026-04-24 02:47:10.866001 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:47:10.866104 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:47:10.866121 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:47:10.866133 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:47:10.866144 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:47:10.866155 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:47:10.866166 | orchestrator | 2026-04-24 02:47:10.866177 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 02:47:10.866188 | orchestrator | Friday 24 April 2026 02:47:03 +0000 (0:00:00.688) 0:00:00.945 ********** 2026-04-24 02:47:10.866199 | orchestrator | ok: [testbed-node-0] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 02:47:10.866211 | orchestrator | ok: [testbed-node-1] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 02:47:10.866222 | orchestrator | ok: [testbed-node-2] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 02:47:10.866233 | orchestrator | ok: [testbed-node-3] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 02:47:10.866244 | orchestrator | ok: [testbed-node-4] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 02:47:10.866255 | orchestrator | ok: [testbed-node-5] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 02:47:10.866268 | orchestrator | 2026-04-24 02:47:10.866307 | orchestrator | PLAY [Apply role openvswitch] ************************************************** 2026-04-24 02:47:10.866320 | orchestrator | 2026-04-24 02:47:10.866333 | orchestrator | TASK [openvswitch : include_tasks] ********************************************* 2026-04-24 02:47:10.866345 | orchestrator | Friday 24 April 2026 02:47:03 +0000 (0:00:00.594) 0:00:01.539 ********** 2026-04-24 02:47:10.866358 | orchestrator | included: /ansible/roles/openvswitch/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:47:10.866373 | orchestrator | 2026-04-24 02:47:10.866385 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-24 02:47:10.866397 | orchestrator | Friday 24 April 2026 02:47:04 +0000 (0:00:01.126) 0:00:02.665 ********** 2026-04-24 02:47:10.866409 | orchestrator | changed: [testbed-node-0] => (item=openvswitch) 2026-04-24 02:47:10.866423 | orchestrator | changed: [testbed-node-1] => (item=openvswitch) 2026-04-24 02:47:10.866435 | orchestrator | changed: [testbed-node-2] => (item=openvswitch) 2026-04-24 02:47:10.866448 | orchestrator | changed: [testbed-node-3] => (item=openvswitch) 2026-04-24 02:47:10.866460 | orchestrator | changed: [testbed-node-4] => (item=openvswitch) 2026-04-24 02:47:10.866472 | orchestrator | changed: [testbed-node-5] => (item=openvswitch) 2026-04-24 02:47:10.866484 | orchestrator | 2026-04-24 02:47:10.866498 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-24 02:47:10.866510 | orchestrator | Friday 24 April 2026 02:47:06 +0000 (0:00:01.192) 0:00:03.858 ********** 2026-04-24 02:47:10.866521 | orchestrator | changed: [testbed-node-1] => (item=openvswitch) 2026-04-24 02:47:10.866531 | orchestrator | changed: [testbed-node-0] => (item=openvswitch) 2026-04-24 02:47:10.866542 | orchestrator | changed: [testbed-node-2] => (item=openvswitch) 2026-04-24 02:47:10.866552 | orchestrator | changed: [testbed-node-4] => (item=openvswitch) 2026-04-24 02:47:10.866564 | orchestrator | changed: [testbed-node-3] => (item=openvswitch) 2026-04-24 02:47:10.866574 | orchestrator | changed: [testbed-node-5] => (item=openvswitch) 2026-04-24 02:47:10.866585 | orchestrator | 2026-04-24 02:47:10.866595 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-24 02:47:10.866606 | orchestrator | Friday 24 April 2026 02:47:07 +0000 (0:00:01.487) 0:00:05.345 ********** 2026-04-24 02:47:10.866617 | orchestrator | skipping: [testbed-node-0] => (item=openvswitch)  2026-04-24 02:47:10.866627 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:47:10.866639 | orchestrator | skipping: [testbed-node-1] => (item=openvswitch)  2026-04-24 02:47:10.866650 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:47:10.866661 | orchestrator | skipping: [testbed-node-2] => (item=openvswitch)  2026-04-24 02:47:10.866671 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:47:10.866682 | orchestrator | skipping: [testbed-node-3] => (item=openvswitch)  2026-04-24 02:47:10.866693 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:47:10.866703 | orchestrator | skipping: [testbed-node-4] => (item=openvswitch)  2026-04-24 02:47:10.866714 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:47:10.866725 | orchestrator | skipping: [testbed-node-5] => (item=openvswitch)  2026-04-24 02:47:10.866735 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:47:10.866746 | orchestrator | 2026-04-24 02:47:10.866757 | orchestrator | TASK [openvswitch : Create /run/openvswitch directory on host] ***************** 2026-04-24 02:47:10.866768 | orchestrator | Friday 24 April 2026 02:47:08 +0000 (0:00:01.211) 0:00:06.557 ********** 2026-04-24 02:47:10.866778 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:47:10.866789 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:47:10.866800 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:47:10.866811 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:47:10.866821 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:47:10.866832 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:47:10.866842 | orchestrator | 2026-04-24 02:47:10.866853 | orchestrator | TASK [openvswitch : Ensuring config directories exist] ************************* 2026-04-24 02:47:10.866871 | orchestrator | Friday 24 April 2026 02:47:09 +0000 (0:00:00.778) 0:00:07.335 ********** 2026-04-24 02:47:10.866906 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:10.866923 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:10.866935 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:10.867087 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:10.867121 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:10.867145 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:13.306310 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307270 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307312 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307326 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307354 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307416 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307430 | orchestrator | 2026-04-24 02:47:13.307443 | orchestrator | TASK [openvswitch : Copying over config.json files for services] *************** 2026-04-24 02:47:13.307455 | orchestrator | Friday 24 April 2026 02:47:10 +0000 (0:00:01.444) 0:00:08.779 ********** 2026-04-24 02:47:13.307466 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307479 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307490 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307502 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307526 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:13.307546 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:16.085903 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086156 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086176 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086206 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086243 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086276 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086289 | orchestrator | 2026-04-24 02:47:16.086303 | orchestrator | TASK [openvswitch : Copying over ovs-vsctl wrapper] **************************** 2026-04-24 02:47:16.086316 | orchestrator | Friday 24 April 2026 02:47:13 +0000 (0:00:02.432) 0:00:11.212 ********** 2026-04-24 02:47:16.086327 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:47:16.086340 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:47:16.086351 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:47:16.086362 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:47:16.086372 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:47:16.086383 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:47:16.086395 | orchestrator | 2026-04-24 02:47:16.086407 | orchestrator | TASK [openvswitch : Check openvswitch containers] ****************************** 2026-04-24 02:47:16.086418 | orchestrator | Friday 24 April 2026 02:47:14 +0000 (0:00:01.017) 0:00:12.230 ********** 2026-04-24 02:47:16.086432 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086446 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086476 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086490 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:16.086557 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:41.498308 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 02:47:41.498462 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:41.498486 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:41.498538 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:41.498551 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:41.498584 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:41.498597 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 02:47:41.498608 | orchestrator | 2026-04-24 02:47:41.498622 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 02:47:41.498634 | orchestrator | Friday 24 April 2026 02:47:16 +0000 (0:00:01.788) 0:00:14.018 ********** 2026-04-24 02:47:41.498646 | orchestrator | 2026-04-24 02:47:41.498657 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 02:47:41.498667 | orchestrator | Friday 24 April 2026 02:47:16 +0000 (0:00:00.406) 0:00:14.425 ********** 2026-04-24 02:47:41.498688 | orchestrator | 2026-04-24 02:47:41.498699 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 02:47:41.498710 | orchestrator | Friday 24 April 2026 02:47:16 +0000 (0:00:00.168) 0:00:14.593 ********** 2026-04-24 02:47:41.498720 | orchestrator | 2026-04-24 02:47:41.498731 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 02:47:41.498742 | orchestrator | Friday 24 April 2026 02:47:16 +0000 (0:00:00.132) 0:00:14.726 ********** 2026-04-24 02:47:41.498753 | orchestrator | 2026-04-24 02:47:41.498763 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 02:47:41.498774 | orchestrator | Friday 24 April 2026 02:47:17 +0000 (0:00:00.135) 0:00:14.861 ********** 2026-04-24 02:47:41.498786 | orchestrator | 2026-04-24 02:47:41.498798 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 02:47:41.498811 | orchestrator | Friday 24 April 2026 02:47:17 +0000 (0:00:00.141) 0:00:15.003 ********** 2026-04-24 02:47:41.498823 | orchestrator | 2026-04-24 02:47:41.498835 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-db-server container] ******** 2026-04-24 02:47:41.498847 | orchestrator | Friday 24 April 2026 02:47:17 +0000 (0:00:00.131) 0:00:15.135 ********** 2026-04-24 02:47:41.498860 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:47:41.498873 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:47:41.498884 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:47:41.498896 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:47:41.498907 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:47:41.498950 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:47:41.498966 | orchestrator | 2026-04-24 02:47:41.498983 | orchestrator | RUNNING HANDLER [openvswitch : Waiting for openvswitch_db service to be ready] *** 2026-04-24 02:47:41.499003 | orchestrator | Friday 24 April 2026 02:47:26 +0000 (0:00:08.742) 0:00:23.877 ********** 2026-04-24 02:47:41.499016 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:47:41.499036 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:47:41.499048 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:47:41.499061 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:47:41.499073 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:47:41.499085 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:47:41.499098 | orchestrator | 2026-04-24 02:47:41.499125 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-24 02:47:41.499137 | orchestrator | Friday 24 April 2026 02:47:27 +0000 (0:00:01.097) 0:00:24.974 ********** 2026-04-24 02:47:41.499158 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:47:41.499169 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:47:41.499180 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:47:41.499191 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:47:41.499202 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:47:41.499213 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:47:41.499223 | orchestrator | 2026-04-24 02:47:41.499234 | orchestrator | TASK [openvswitch : Set system-id, hostname and hw-offload] ******************** 2026-04-24 02:47:41.499245 | orchestrator | Friday 24 April 2026 02:47:35 +0000 (0:00:08.010) 0:00:32.984 ********** 2026-04-24 02:47:41.499256 | orchestrator | changed: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-1'}) 2026-04-24 02:47:41.499279 | orchestrator | changed: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-0'}) 2026-04-24 02:47:41.499300 | orchestrator | changed: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-2'}) 2026-04-24 02:47:41.499311 | orchestrator | changed: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-3'}) 2026-04-24 02:47:41.499322 | orchestrator | changed: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-4'}) 2026-04-24 02:47:41.499333 | orchestrator | changed: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-5'}) 2026-04-24 02:47:41.499343 | orchestrator | changed: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-1'}) 2026-04-24 02:47:41.499369 | orchestrator | changed: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-0'}) 2026-04-24 02:47:54.289419 | orchestrator | changed: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-3'}) 2026-04-24 02:47:54.289535 | orchestrator | changed: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-4'}) 2026-04-24 02:47:54.289552 | orchestrator | changed: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-2'}) 2026-04-24 02:47:54.289564 | orchestrator | changed: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-5'}) 2026-04-24 02:47:54.289575 | orchestrator | ok: [testbed-node-1] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 02:47:54.289587 | orchestrator | ok: [testbed-node-3] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 02:47:54.289598 | orchestrator | ok: [testbed-node-0] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 02:47:54.289609 | orchestrator | ok: [testbed-node-4] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 02:47:54.289620 | orchestrator | ok: [testbed-node-2] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 02:47:54.289630 | orchestrator | ok: [testbed-node-5] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 02:47:54.289642 | orchestrator | 2026-04-24 02:47:54.289654 | orchestrator | TASK [openvswitch : Ensuring OVS bridge is properly setup] ********************* 2026-04-24 02:47:54.289667 | orchestrator | Friday 24 April 2026 02:47:41 +0000 (0:00:06.319) 0:00:39.304 ********** 2026-04-24 02:47:54.289680 | orchestrator | skipping: [testbed-node-3] => (item=br-ex)  2026-04-24 02:47:54.289692 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:47:54.289704 | orchestrator | skipping: [testbed-node-4] => (item=br-ex)  2026-04-24 02:47:54.289715 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:47:54.289726 | orchestrator | skipping: [testbed-node-5] => (item=br-ex)  2026-04-24 02:47:54.289736 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:47:54.289747 | orchestrator | changed: [testbed-node-0] => (item=br-ex) 2026-04-24 02:47:54.289759 | orchestrator | changed: [testbed-node-1] => (item=br-ex) 2026-04-24 02:47:54.289769 | orchestrator | changed: [testbed-node-2] => (item=br-ex) 2026-04-24 02:47:54.289780 | orchestrator | 2026-04-24 02:47:54.289791 | orchestrator | TASK [openvswitch : Ensuring OVS ports are properly setup] ********************* 2026-04-24 02:47:54.289802 | orchestrator | Friday 24 April 2026 02:47:43 +0000 (0:00:02.326) 0:00:41.630 ********** 2026-04-24 02:47:54.289813 | orchestrator | skipping: [testbed-node-3] => (item=['br-ex', 'vxlan0'])  2026-04-24 02:47:54.289824 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:47:54.289835 | orchestrator | skipping: [testbed-node-4] => (item=['br-ex', 'vxlan0'])  2026-04-24 02:47:54.289845 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:47:54.289856 | orchestrator | skipping: [testbed-node-5] => (item=['br-ex', 'vxlan0'])  2026-04-24 02:47:54.289867 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:47:54.289895 | orchestrator | changed: [testbed-node-0] => (item=['br-ex', 'vxlan0']) 2026-04-24 02:47:54.289984 | orchestrator | changed: [testbed-node-1] => (item=['br-ex', 'vxlan0']) 2026-04-24 02:47:54.290014 | orchestrator | changed: [testbed-node-2] => (item=['br-ex', 'vxlan0']) 2026-04-24 02:47:54.290087 | orchestrator | 2026-04-24 02:47:54.290101 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-24 02:47:54.290113 | orchestrator | Friday 24 April 2026 02:47:46 +0000 (0:00:03.020) 0:00:44.651 ********** 2026-04-24 02:47:54.290125 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:47:54.290138 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:47:54.290174 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:47:54.290185 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:47:54.290196 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:47:54.290206 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:47:54.290217 | orchestrator | 2026-04-24 02:47:54.290228 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:47:54.290240 | orchestrator | testbed-node-0 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 02:47:54.290252 | orchestrator | testbed-node-1 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 02:47:54.290263 | orchestrator | testbed-node-2 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 02:47:54.290274 | orchestrator | testbed-node-3 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 02:47:54.290285 | orchestrator | testbed-node-4 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 02:47:54.290296 | orchestrator | testbed-node-5 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 02:47:54.290306 | orchestrator | 2026-04-24 02:47:54.290317 | orchestrator | 2026-04-24 02:47:54.290328 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:47:54.290339 | orchestrator | Friday 24 April 2026 02:47:53 +0000 (0:00:07.051) 0:00:51.702 ********** 2026-04-24 02:47:54.290369 | orchestrator | =============================================================================== 2026-04-24 02:47:54.290381 | orchestrator | openvswitch : Restart openvswitch-vswitchd container ------------------- 15.06s 2026-04-24 02:47:54.290392 | orchestrator | openvswitch : Restart openvswitch-db-server container ------------------- 8.74s 2026-04-24 02:47:54.290403 | orchestrator | openvswitch : Set system-id, hostname and hw-offload -------------------- 6.32s 2026-04-24 02:47:54.290414 | orchestrator | openvswitch : Ensuring OVS ports are properly setup --------------------- 3.02s 2026-04-24 02:47:54.290425 | orchestrator | openvswitch : Copying over config.json files for services --------------- 2.43s 2026-04-24 02:47:54.290435 | orchestrator | openvswitch : Ensuring OVS bridge is properly setup --------------------- 2.33s 2026-04-24 02:47:54.290446 | orchestrator | openvswitch : Check openvswitch containers ------------------------------ 1.79s 2026-04-24 02:47:54.290457 | orchestrator | module-load : Persist modules via modules-load.d ------------------------ 1.49s 2026-04-24 02:47:54.290468 | orchestrator | openvswitch : Ensuring config directories exist ------------------------- 1.44s 2026-04-24 02:47:54.290479 | orchestrator | module-load : Drop module persistence ----------------------------------- 1.21s 2026-04-24 02:47:54.290489 | orchestrator | module-load : Load modules ---------------------------------------------- 1.19s 2026-04-24 02:47:54.290500 | orchestrator | openvswitch : include_tasks --------------------------------------------- 1.13s 2026-04-24 02:47:54.290511 | orchestrator | openvswitch : Flush Handlers -------------------------------------------- 1.12s 2026-04-24 02:47:54.290521 | orchestrator | openvswitch : Waiting for openvswitch_db service to be ready ------------ 1.10s 2026-04-24 02:47:54.290532 | orchestrator | openvswitch : Copying over ovs-vsctl wrapper ---------------------------- 1.02s 2026-04-24 02:47:54.290543 | orchestrator | openvswitch : Create /run/openvswitch directory on host ----------------- 0.78s 2026-04-24 02:47:54.290559 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.69s 2026-04-24 02:47:54.290578 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.59s 2026-04-24 02:47:56.656734 | orchestrator | 2026-04-24 02:47:56 | INFO  | Task c3d64911-0e18-42ae-b515-75f4ef4f24d2 (ovn) was prepared for execution. 2026-04-24 02:47:56.656835 | orchestrator | 2026-04-24 02:47:56 | INFO  | It takes a moment until task c3d64911-0e18-42ae-b515-75f4ef4f24d2 (ovn) has been started and output is visible here. 2026-04-24 02:48:07.358572 | orchestrator | 2026-04-24 02:48:07.358687 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 02:48:07.358704 | orchestrator | 2026-04-24 02:48:07.358717 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 02:48:07.358729 | orchestrator | Friday 24 April 2026 02:48:00 +0000 (0:00:00.163) 0:00:00.163 ********** 2026-04-24 02:48:07.358740 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:48:07.358752 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:48:07.358763 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:48:07.358774 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:48:07.358785 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:48:07.358795 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:48:07.358806 | orchestrator | 2026-04-24 02:48:07.358817 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 02:48:07.358828 | orchestrator | Friday 24 April 2026 02:48:01 +0000 (0:00:00.740) 0:00:00.903 ********** 2026-04-24 02:48:07.358855 | orchestrator | ok: [testbed-node-3] => (item=enable_ovn_True) 2026-04-24 02:48:07.358867 | orchestrator | ok: [testbed-node-4] => (item=enable_ovn_True) 2026-04-24 02:48:07.358878 | orchestrator | ok: [testbed-node-5] => (item=enable_ovn_True) 2026-04-24 02:48:07.358936 | orchestrator | ok: [testbed-node-0] => (item=enable_ovn_True) 2026-04-24 02:48:07.358948 | orchestrator | ok: [testbed-node-1] => (item=enable_ovn_True) 2026-04-24 02:48:07.358959 | orchestrator | ok: [testbed-node-2] => (item=enable_ovn_True) 2026-04-24 02:48:07.358970 | orchestrator | 2026-04-24 02:48:07.358982 | orchestrator | PLAY [Apply role ovn-controller] *********************************************** 2026-04-24 02:48:07.358993 | orchestrator | 2026-04-24 02:48:07.359004 | orchestrator | TASK [ovn-controller : include_tasks] ****************************************** 2026-04-24 02:48:07.359026 | orchestrator | Friday 24 April 2026 02:48:02 +0000 (0:00:00.836) 0:00:01.740 ********** 2026-04-24 02:48:07.359038 | orchestrator | included: /ansible/roles/ovn-controller/tasks/deploy.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:48:07.359051 | orchestrator | 2026-04-24 02:48:07.359062 | orchestrator | TASK [ovn-controller : Ensuring config directories exist] ********************** 2026-04-24 02:48:07.359074 | orchestrator | Friday 24 April 2026 02:48:03 +0000 (0:00:01.079) 0:00:02.819 ********** 2026-04-24 02:48:07.359090 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359107 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359120 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359134 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359172 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359204 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359218 | orchestrator | 2026-04-24 02:48:07.359231 | orchestrator | TASK [ovn-controller : Copying over config.json files for services] ************ 2026-04-24 02:48:07.359245 | orchestrator | Friday 24 April 2026 02:48:04 +0000 (0:00:01.169) 0:00:03.989 ********** 2026-04-24 02:48:07.359264 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359293 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359317 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359331 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359342 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359353 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359373 | orchestrator | 2026-04-24 02:48:07.359384 | orchestrator | TASK [ovn-controller : Ensuring systemd override directory exists] ************* 2026-04-24 02:48:07.359395 | orchestrator | Friday 24 April 2026 02:48:06 +0000 (0:00:01.492) 0:00:05.481 ********** 2026-04-24 02:48:07.359406 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359418 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:07.359438 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.678782 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.678945 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.678967 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.678979 | orchestrator | 2026-04-24 02:48:31.678993 | orchestrator | TASK [ovn-controller : Copying over systemd override] ************************** 2026-04-24 02:48:31.679005 | orchestrator | Friday 24 April 2026 02:48:07 +0000 (0:00:01.163) 0:00:06.644 ********** 2026-04-24 02:48:31.679017 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679028 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679063 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679075 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679086 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679116 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679128 | orchestrator | 2026-04-24 02:48:31.679139 | orchestrator | TASK [ovn-controller : Check ovn-controller containers] ************************ 2026-04-24 02:48:31.679150 | orchestrator | Friday 24 April 2026 02:48:08 +0000 (0:00:01.496) 0:00:08.141 ********** 2026-04-24 02:48:31.679169 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679181 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679192 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679203 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679222 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679233 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:48:31.679244 | orchestrator | 2026-04-24 02:48:31.679255 | orchestrator | TASK [ovn-controller : Create br-int bridge on OpenvSwitch] ******************** 2026-04-24 02:48:31.679266 | orchestrator | Friday 24 April 2026 02:48:10 +0000 (0:00:01.349) 0:00:09.490 ********** 2026-04-24 02:48:31.679278 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:48:31.679292 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:48:31.679304 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:48:31.679316 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:48:31.679329 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:48:31.679341 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:48:31.679353 | orchestrator | 2026-04-24 02:48:31.679365 | orchestrator | TASK [ovn-controller : Configure OVN in OVSDB] ********************************* 2026-04-24 02:48:31.679378 | orchestrator | Friday 24 April 2026 02:48:12 +0000 (0:00:02.508) 0:00:11.999 ********** 2026-04-24 02:48:31.679390 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.13'}) 2026-04-24 02:48:31.679403 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.14'}) 2026-04-24 02:48:31.679416 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.15'}) 2026-04-24 02:48:31.679428 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.10'}) 2026-04-24 02:48:31.679440 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.12'}) 2026-04-24 02:48:31.679452 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.11'}) 2026-04-24 02:48:31.679472 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 02:49:10.113694 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 02:49:10.113897 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 02:49:10.113951 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 02:49:10.113973 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 02:49:10.113993 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 02:49:10.114006 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-24 02:49:10.114079 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-24 02:49:10.114117 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-24 02:49:10.114129 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-24 02:49:10.114140 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-24 02:49:10.114150 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-24 02:49:10.114162 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 02:49:10.114174 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 02:49:10.114185 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 02:49:10.114196 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 02:49:10.114208 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 02:49:10.114219 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 02:49:10.114244 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 02:49:10.114267 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 02:49:10.114278 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 02:49:10.114289 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 02:49:10.114299 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 02:49:10.114310 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 02:49:10.114321 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 02:49:10.114331 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 02:49:10.114342 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 02:49:10.114353 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 02:49:10.114364 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 02:49:10.114375 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 02:49:10.114385 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-24 02:49:10.114397 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-24 02:49:10.114408 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-24 02:49:10.114418 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-24 02:49:10.114429 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-24 02:49:10.114440 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-24 02:49:10.114451 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:89:18:56', 'state': 'present'}) 2026-04-24 02:49:10.114491 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:2f:fa:44', 'state': 'present'}) 2026-04-24 02:49:10.114503 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:71:3a:c3', 'state': 'present'}) 2026-04-24 02:49:10.114534 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:52:c1:40', 'state': 'absent'}) 2026-04-24 02:49:10.114546 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:29:4a:9b', 'state': 'absent'}) 2026-04-24 02:49:10.114556 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:33:12:50', 'state': 'absent'}) 2026-04-24 02:49:10.114567 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-24 02:49:10.114579 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-24 02:49:10.114589 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-24 02:49:10.114600 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-24 02:49:10.114611 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-24 02:49:10.114622 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-24 02:49:10.114633 | orchestrator | 2026-04-24 02:49:10.114645 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 02:49:10.114656 | orchestrator | Friday 24 April 2026 02:48:31 +0000 (0:00:18.412) 0:00:30.412 ********** 2026-04-24 02:49:10.114667 | orchestrator | 2026-04-24 02:49:10.114678 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 02:49:10.114689 | orchestrator | Friday 24 April 2026 02:48:31 +0000 (0:00:00.224) 0:00:30.636 ********** 2026-04-24 02:49:10.114699 | orchestrator | 2026-04-24 02:49:10.114710 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 02:49:10.114721 | orchestrator | Friday 24 April 2026 02:48:31 +0000 (0:00:00.064) 0:00:30.700 ********** 2026-04-24 02:49:10.114731 | orchestrator | 2026-04-24 02:49:10.114742 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 02:49:10.114753 | orchestrator | Friday 24 April 2026 02:48:31 +0000 (0:00:00.064) 0:00:30.765 ********** 2026-04-24 02:49:10.114763 | orchestrator | 2026-04-24 02:49:10.114774 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 02:49:10.114785 | orchestrator | Friday 24 April 2026 02:48:31 +0000 (0:00:00.064) 0:00:30.829 ********** 2026-04-24 02:49:10.114795 | orchestrator | 2026-04-24 02:49:10.114806 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 02:49:10.114817 | orchestrator | Friday 24 April 2026 02:48:31 +0000 (0:00:00.066) 0:00:30.896 ********** 2026-04-24 02:49:10.114827 | orchestrator | 2026-04-24 02:49:10.114865 | orchestrator | RUNNING HANDLER [ovn-controller : Reload systemd config] *********************** 2026-04-24 02:49:10.114877 | orchestrator | Friday 24 April 2026 02:48:31 +0000 (0:00:00.064) 0:00:30.960 ********** 2026-04-24 02:49:10.114888 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:49:10.114900 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:49:10.114911 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:49:10.114921 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:10.114932 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:10.114943 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:10.114954 | orchestrator | 2026-04-24 02:49:10.114965 | orchestrator | RUNNING HANDLER [ovn-controller : Restart ovn-controller container] ************ 2026-04-24 02:49:10.114975 | orchestrator | Friday 24 April 2026 02:48:33 +0000 (0:00:01.774) 0:00:32.735 ********** 2026-04-24 02:49:10.114994 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:49:10.115005 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:49:10.115016 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:49:10.115027 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:49:10.115040 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:49:10.115058 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:49:10.115075 | orchestrator | 2026-04-24 02:49:10.115092 | orchestrator | PLAY [Apply role ovn-db] ******************************************************* 2026-04-24 02:49:10.115109 | orchestrator | 2026-04-24 02:49:10.115128 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-24 02:49:10.115146 | orchestrator | Friday 24 April 2026 02:49:07 +0000 (0:00:34.395) 0:01:07.131 ********** 2026-04-24 02:49:10.115164 | orchestrator | included: /ansible/roles/ovn-db/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:49:10.115183 | orchestrator | 2026-04-24 02:49:10.115201 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-24 02:49:10.115219 | orchestrator | Friday 24 April 2026 02:49:08 +0000 (0:00:00.713) 0:01:07.845 ********** 2026-04-24 02:49:10.115237 | orchestrator | included: /ansible/roles/ovn-db/tasks/lookup_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:49:10.115256 | orchestrator | 2026-04-24 02:49:10.115274 | orchestrator | TASK [ovn-db : Checking for any existing OVN DB container volumes] ************* 2026-04-24 02:49:10.115292 | orchestrator | Friday 24 April 2026 02:49:09 +0000 (0:00:00.551) 0:01:08.397 ********** 2026-04-24 02:49:10.115311 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:10.115331 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:10.115350 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:10.115368 | orchestrator | 2026-04-24 02:49:10.115386 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB volume availability] *************** 2026-04-24 02:49:10.115419 | orchestrator | Friday 24 April 2026 02:49:10 +0000 (0:00:00.997) 0:01:09.394 ********** 2026-04-24 02:49:21.339660 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:21.339772 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:21.339787 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:21.339800 | orchestrator | 2026-04-24 02:49:21.339812 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB volume availability] *************** 2026-04-24 02:49:21.339901 | orchestrator | Friday 24 April 2026 02:49:10 +0000 (0:00:00.319) 0:01:09.714 ********** 2026-04-24 02:49:21.339923 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:21.339936 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:21.339947 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:21.339958 | orchestrator | 2026-04-24 02:49:21.339969 | orchestrator | TASK [ovn-db : Establish whether the OVN NB cluster has already existed] ******* 2026-04-24 02:49:21.339980 | orchestrator | Friday 24 April 2026 02:49:10 +0000 (0:00:00.326) 0:01:10.040 ********** 2026-04-24 02:49:21.339991 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:21.340002 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:21.340013 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:21.340024 | orchestrator | 2026-04-24 02:49:21.340035 | orchestrator | TASK [ovn-db : Establish whether the OVN SB cluster has already existed] ******* 2026-04-24 02:49:21.340046 | orchestrator | Friday 24 April 2026 02:49:11 +0000 (0:00:00.314) 0:01:10.355 ********** 2026-04-24 02:49:21.340056 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:21.340067 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:21.340078 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:21.340088 | orchestrator | 2026-04-24 02:49:21.340099 | orchestrator | TASK [ovn-db : Check if running on all OVN NB DB hosts] ************************ 2026-04-24 02:49:21.340110 | orchestrator | Friday 24 April 2026 02:49:11 +0000 (0:00:00.518) 0:01:10.873 ********** 2026-04-24 02:49:21.340121 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340134 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340145 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340156 | orchestrator | 2026-04-24 02:49:21.340167 | orchestrator | TASK [ovn-db : Check OVN NB service port liveness] ***************************** 2026-04-24 02:49:21.340203 | orchestrator | Friday 24 April 2026 02:49:11 +0000 (0:00:00.292) 0:01:11.166 ********** 2026-04-24 02:49:21.340216 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340228 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340240 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340252 | orchestrator | 2026-04-24 02:49:21.340264 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB service port liveness] ************* 2026-04-24 02:49:21.340277 | orchestrator | Friday 24 April 2026 02:49:12 +0000 (0:00:00.301) 0:01:11.467 ********** 2026-04-24 02:49:21.340289 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340301 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340313 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340325 | orchestrator | 2026-04-24 02:49:21.340337 | orchestrator | TASK [ovn-db : Get OVN NB database information] ******************************** 2026-04-24 02:49:21.340349 | orchestrator | Friday 24 April 2026 02:49:12 +0000 (0:00:00.301) 0:01:11.769 ********** 2026-04-24 02:49:21.340362 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340374 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340385 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340397 | orchestrator | 2026-04-24 02:49:21.340409 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB leader/follower role] ************** 2026-04-24 02:49:21.340421 | orchestrator | Friday 24 April 2026 02:49:12 +0000 (0:00:00.306) 0:01:12.075 ********** 2026-04-24 02:49:21.340433 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340446 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340458 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340469 | orchestrator | 2026-04-24 02:49:21.340479 | orchestrator | TASK [ovn-db : Fail on existing OVN NB cluster with no leader] ***************** 2026-04-24 02:49:21.340490 | orchestrator | Friday 24 April 2026 02:49:13 +0000 (0:00:00.494) 0:01:12.570 ********** 2026-04-24 02:49:21.340501 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340512 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340522 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340533 | orchestrator | 2026-04-24 02:49:21.340544 | orchestrator | TASK [ovn-db : Check if running on all OVN SB DB hosts] ************************ 2026-04-24 02:49:21.340554 | orchestrator | Friday 24 April 2026 02:49:13 +0000 (0:00:00.314) 0:01:12.885 ********** 2026-04-24 02:49:21.340565 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340576 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340587 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340597 | orchestrator | 2026-04-24 02:49:21.340608 | orchestrator | TASK [ovn-db : Check OVN SB service port liveness] ***************************** 2026-04-24 02:49:21.340619 | orchestrator | Friday 24 April 2026 02:49:13 +0000 (0:00:00.295) 0:01:13.180 ********** 2026-04-24 02:49:21.340629 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340640 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340650 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340661 | orchestrator | 2026-04-24 02:49:21.340672 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB service port liveness] ************* 2026-04-24 02:49:21.340683 | orchestrator | Friday 24 April 2026 02:49:14 +0000 (0:00:00.317) 0:01:13.498 ********** 2026-04-24 02:49:21.340693 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340704 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340715 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340725 | orchestrator | 2026-04-24 02:49:21.340736 | orchestrator | TASK [ovn-db : Get OVN SB database information] ******************************** 2026-04-24 02:49:21.340747 | orchestrator | Friday 24 April 2026 02:49:14 +0000 (0:00:00.540) 0:01:14.038 ********** 2026-04-24 02:49:21.340758 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340768 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340779 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340791 | orchestrator | 2026-04-24 02:49:21.340801 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB leader/follower role] ************** 2026-04-24 02:49:21.340844 | orchestrator | Friday 24 April 2026 02:49:15 +0000 (0:00:00.313) 0:01:14.351 ********** 2026-04-24 02:49:21.340882 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340894 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340905 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340915 | orchestrator | 2026-04-24 02:49:21.340926 | orchestrator | TASK [ovn-db : Fail on existing OVN SB cluster with no leader] ***************** 2026-04-24 02:49:21.340937 | orchestrator | Friday 24 April 2026 02:49:15 +0000 (0:00:00.298) 0:01:14.650 ********** 2026-04-24 02:49:21.340965 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.340977 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.340988 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.340999 | orchestrator | 2026-04-24 02:49:21.341010 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-24 02:49:21.341031 | orchestrator | Friday 24 April 2026 02:49:15 +0000 (0:00:00.282) 0:01:14.933 ********** 2026-04-24 02:49:21.341051 | orchestrator | included: /ansible/roles/ovn-db/tasks/bootstrap-initial.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:49:21.341070 | orchestrator | 2026-04-24 02:49:21.341088 | orchestrator | TASK [ovn-db : Set bootstrap args fact for NB (new cluster)] ******************* 2026-04-24 02:49:21.341104 | orchestrator | Friday 24 April 2026 02:49:16 +0000 (0:00:00.822) 0:01:15.755 ********** 2026-04-24 02:49:21.341123 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:21.341142 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:21.341163 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:21.341183 | orchestrator | 2026-04-24 02:49:21.341202 | orchestrator | TASK [ovn-db : Set bootstrap args fact for SB (new cluster)] ******************* 2026-04-24 02:49:21.341216 | orchestrator | Friday 24 April 2026 02:49:16 +0000 (0:00:00.431) 0:01:16.186 ********** 2026-04-24 02:49:21.341227 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:21.341238 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:21.341251 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:21.341270 | orchestrator | 2026-04-24 02:49:21.341287 | orchestrator | TASK [ovn-db : Check NB cluster status] **************************************** 2026-04-24 02:49:21.341305 | orchestrator | Friday 24 April 2026 02:49:17 +0000 (0:00:00.462) 0:01:16.649 ********** 2026-04-24 02:49:21.341323 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.341340 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.341358 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.341376 | orchestrator | 2026-04-24 02:49:21.341394 | orchestrator | TASK [ovn-db : Check SB cluster status] **************************************** 2026-04-24 02:49:21.341414 | orchestrator | Friday 24 April 2026 02:49:17 +0000 (0:00:00.336) 0:01:16.985 ********** 2026-04-24 02:49:21.341433 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.341450 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.341469 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.341487 | orchestrator | 2026-04-24 02:49:21.341505 | orchestrator | TASK [ovn-db : Remove an old node with the same ip address as the new node in NB DB] *** 2026-04-24 02:49:21.341522 | orchestrator | Friday 24 April 2026 02:49:18 +0000 (0:00:00.640) 0:01:17.626 ********** 2026-04-24 02:49:21.341541 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.341590 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.341607 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.341625 | orchestrator | 2026-04-24 02:49:21.341641 | orchestrator | TASK [ovn-db : Remove an old node with the same ip address as the new node in SB DB] *** 2026-04-24 02:49:21.341658 | orchestrator | Friday 24 April 2026 02:49:18 +0000 (0:00:00.324) 0:01:17.950 ********** 2026-04-24 02:49:21.341676 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.341693 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.341711 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.341730 | orchestrator | 2026-04-24 02:49:21.341749 | orchestrator | TASK [ovn-db : Set bootstrap args fact for NB (new member)] ******************** 2026-04-24 02:49:21.341768 | orchestrator | Friday 24 April 2026 02:49:18 +0000 (0:00:00.344) 0:01:18.295 ********** 2026-04-24 02:49:21.341890 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.341915 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.341936 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.341956 | orchestrator | 2026-04-24 02:49:21.341975 | orchestrator | TASK [ovn-db : Set bootstrap args fact for SB (new member)] ******************** 2026-04-24 02:49:21.341994 | orchestrator | Friday 24 April 2026 02:49:19 +0000 (0:00:00.325) 0:01:18.620 ********** 2026-04-24 02:49:21.342015 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:21.342093 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:21.342104 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:21.342115 | orchestrator | 2026-04-24 02:49:21.342127 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-24 02:49:21.342138 | orchestrator | Friday 24 April 2026 02:49:19 +0000 (0:00:00.556) 0:01:19.177 ********** 2026-04-24 02:49:21.342152 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:21.342166 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:21.342178 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:21.342215 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551197 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551307 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551325 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551339 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551392 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551412 | orchestrator | 2026-04-24 02:49:27.551434 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-24 02:49:27.551454 | orchestrator | Friday 24 April 2026 02:49:21 +0000 (0:00:01.446) 0:01:20.623 ********** 2026-04-24 02:49:27.551474 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551493 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551512 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551532 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551594 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551618 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551639 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551658 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551690 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551702 | orchestrator | 2026-04-24 02:49:27.551714 | orchestrator | TASK [ovn-db : Check ovn containers] ******************************************* 2026-04-24 02:49:27.551725 | orchestrator | Friday 24 April 2026 02:49:25 +0000 (0:00:03.846) 0:01:24.470 ********** 2026-04-24 02:49:27.551738 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551751 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551764 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551777 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551790 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:27.551881 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.505253 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.506337 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.506373 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.506384 | orchestrator | 2026-04-24 02:49:55.506396 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 02:49:55.506407 | orchestrator | Friday 24 April 2026 02:49:27 +0000 (0:00:01.981) 0:01:26.452 ********** 2026-04-24 02:49:55.506417 | orchestrator | 2026-04-24 02:49:55.506427 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 02:49:55.506436 | orchestrator | Friday 24 April 2026 02:49:27 +0000 (0:00:00.067) 0:01:26.519 ********** 2026-04-24 02:49:55.506446 | orchestrator | 2026-04-24 02:49:55.506455 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 02:49:55.506464 | orchestrator | Friday 24 April 2026 02:49:27 +0000 (0:00:00.063) 0:01:26.583 ********** 2026-04-24 02:49:55.506474 | orchestrator | 2026-04-24 02:49:55.506483 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-24 02:49:55.506492 | orchestrator | Friday 24 April 2026 02:49:27 +0000 (0:00:00.251) 0:01:26.835 ********** 2026-04-24 02:49:55.506502 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:49:55.506513 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:49:55.506522 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:49:55.506532 | orchestrator | 2026-04-24 02:49:55.506541 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-24 02:49:55.506551 | orchestrator | Friday 24 April 2026 02:49:34 +0000 (0:00:06.558) 0:01:33.393 ********** 2026-04-24 02:49:55.506560 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:49:55.506570 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:49:55.506579 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:49:55.506588 | orchestrator | 2026-04-24 02:49:55.506598 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-24 02:49:55.506607 | orchestrator | Friday 24 April 2026 02:49:41 +0000 (0:00:07.389) 0:01:40.783 ********** 2026-04-24 02:49:55.506617 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:49:55.506626 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:49:55.506636 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:49:55.506645 | orchestrator | 2026-04-24 02:49:55.506654 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-24 02:49:55.506664 | orchestrator | Friday 24 April 2026 02:49:48 +0000 (0:00:07.311) 0:01:48.094 ********** 2026-04-24 02:49:55.506673 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:49:55.506683 | orchestrator | 2026-04-24 02:49:55.506692 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-24 02:49:55.506702 | orchestrator | Friday 24 April 2026 02:49:48 +0000 (0:00:00.129) 0:01:48.224 ********** 2026-04-24 02:49:55.506711 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:55.506722 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:55.506731 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:55.506741 | orchestrator | 2026-04-24 02:49:55.506751 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-24 02:49:55.506760 | orchestrator | Friday 24 April 2026 02:49:49 +0000 (0:00:00.948) 0:01:49.172 ********** 2026-04-24 02:49:55.506769 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:55.506809 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:55.506826 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:49:55.506836 | orchestrator | 2026-04-24 02:49:55.506845 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-24 02:49:55.506855 | orchestrator | Friday 24 April 2026 02:49:50 +0000 (0:00:00.621) 0:01:49.793 ********** 2026-04-24 02:49:55.506864 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:55.506874 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:55.506883 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:55.506892 | orchestrator | 2026-04-24 02:49:55.506902 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-24 02:49:55.506925 | orchestrator | Friday 24 April 2026 02:49:51 +0000 (0:00:00.791) 0:01:50.585 ********** 2026-04-24 02:49:55.506935 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:49:55.506945 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:49:55.506954 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:49:55.506964 | orchestrator | 2026-04-24 02:49:55.506973 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-24 02:49:55.506982 | orchestrator | Friday 24 April 2026 02:49:51 +0000 (0:00:00.644) 0:01:51.229 ********** 2026-04-24 02:49:55.506992 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:55.507001 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:55.507031 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:55.507042 | orchestrator | 2026-04-24 02:49:55.507051 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-24 02:49:55.507061 | orchestrator | Friday 24 April 2026 02:49:53 +0000 (0:00:01.149) 0:01:52.378 ********** 2026-04-24 02:49:55.507070 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:55.507080 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:55.507089 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:55.507098 | orchestrator | 2026-04-24 02:49:55.507108 | orchestrator | TASK [ovn-db : Unset bootstrap args fact] ************************************** 2026-04-24 02:49:55.507118 | orchestrator | Friday 24 April 2026 02:49:53 +0000 (0:00:00.757) 0:01:53.136 ********** 2026-04-24 02:49:55.507127 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:49:55.507137 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:49:55.507146 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:49:55.507156 | orchestrator | 2026-04-24 02:49:55.507165 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-24 02:49:55.507175 | orchestrator | Friday 24 April 2026 02:49:54 +0000 (0:00:00.302) 0:01:53.438 ********** 2026-04-24 02:49:55.507186 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.507199 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.507208 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.507219 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.507236 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.507246 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.507255 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.507269 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:49:55.507287 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.525605 | orchestrator | 2026-04-24 02:50:02.525727 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-24 02:50:02.525749 | orchestrator | Friday 24 April 2026 02:49:55 +0000 (0:00:01.348) 0:01:54.787 ********** 2026-04-24 02:50:02.525767 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.525889 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.525908 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.525921 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.525966 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.525982 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.525996 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526011 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526109 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526125 | orchestrator | 2026-04-24 02:50:02.526139 | orchestrator | TASK [ovn-db : Check ovn containers] ******************************************* 2026-04-24 02:50:02.526152 | orchestrator | Friday 24 April 2026 02:49:59 +0000 (0:00:03.769) 0:01:58.557 ********** 2026-04-24 02:50:02.526191 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526207 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526221 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526235 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526264 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526279 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526294 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526309 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526331 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 02:50:02.526346 | orchestrator | 2026-04-24 02:50:02.526360 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 02:50:02.526374 | orchestrator | Friday 24 April 2026 02:50:02 +0000 (0:00:03.043) 0:02:01.600 ********** 2026-04-24 02:50:02.526388 | orchestrator | 2026-04-24 02:50:02.526402 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 02:50:02.526417 | orchestrator | Friday 24 April 2026 02:50:02 +0000 (0:00:00.066) 0:02:01.667 ********** 2026-04-24 02:50:02.526430 | orchestrator | 2026-04-24 02:50:02.526444 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 02:50:02.526459 | orchestrator | Friday 24 April 2026 02:50:02 +0000 (0:00:00.065) 0:02:01.733 ********** 2026-04-24 02:50:02.526474 | orchestrator | 2026-04-24 02:50:02.526497 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-24 02:50:26.602264 | orchestrator | Friday 24 April 2026 02:50:02 +0000 (0:00:00.069) 0:02:01.802 ********** 2026-04-24 02:50:26.602380 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:50:26.602398 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:50:26.602409 | orchestrator | 2026-04-24 02:50:26.602421 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-24 02:50:26.602432 | orchestrator | Friday 24 April 2026 02:50:08 +0000 (0:00:06.176) 0:02:07.979 ********** 2026-04-24 02:50:26.602443 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:50:26.602454 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:50:26.602465 | orchestrator | 2026-04-24 02:50:26.602476 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-24 02:50:26.602513 | orchestrator | Friday 24 April 2026 02:50:14 +0000 (0:00:06.145) 0:02:14.124 ********** 2026-04-24 02:50:26.602525 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:50:26.602536 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:50:26.602546 | orchestrator | 2026-04-24 02:50:26.602557 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-24 02:50:26.602568 | orchestrator | Friday 24 April 2026 02:50:21 +0000 (0:00:06.221) 0:02:20.346 ********** 2026-04-24 02:50:26.602578 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:50:26.602589 | orchestrator | 2026-04-24 02:50:26.602600 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-24 02:50:26.602610 | orchestrator | Friday 24 April 2026 02:50:21 +0000 (0:00:00.141) 0:02:20.488 ********** 2026-04-24 02:50:26.602621 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:50:26.602633 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:50:26.602643 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:50:26.602654 | orchestrator | 2026-04-24 02:50:26.602664 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-24 02:50:26.602675 | orchestrator | Friday 24 April 2026 02:50:22 +0000 (0:00:01.012) 0:02:21.500 ********** 2026-04-24 02:50:26.602685 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:50:26.602696 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:50:26.602707 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:50:26.602718 | orchestrator | 2026-04-24 02:50:26.602737 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-24 02:50:26.602755 | orchestrator | Friday 24 April 2026 02:50:22 +0000 (0:00:00.637) 0:02:22.137 ********** 2026-04-24 02:50:26.602802 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:50:26.602815 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:50:26.602827 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:50:26.602840 | orchestrator | 2026-04-24 02:50:26.602852 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-24 02:50:26.602864 | orchestrator | Friday 24 April 2026 02:50:23 +0000 (0:00:00.816) 0:02:22.954 ********** 2026-04-24 02:50:26.602877 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:50:26.602889 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:50:26.602902 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:50:26.602914 | orchestrator | 2026-04-24 02:50:26.602926 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-24 02:50:26.602938 | orchestrator | Friday 24 April 2026 02:50:24 +0000 (0:00:00.626) 0:02:23.580 ********** 2026-04-24 02:50:26.602950 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:50:26.602962 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:50:26.602977 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:50:26.602997 | orchestrator | 2026-04-24 02:50:26.603010 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-24 02:50:26.603022 | orchestrator | Friday 24 April 2026 02:50:25 +0000 (0:00:01.014) 0:02:24.595 ********** 2026-04-24 02:50:26.603034 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:50:26.603047 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:50:26.603058 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:50:26.603070 | orchestrator | 2026-04-24 02:50:26.603082 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:50:26.603096 | orchestrator | testbed-node-0 : ok=44  changed=18  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-24 02:50:26.603110 | orchestrator | testbed-node-1 : ok=43  changed=19  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026-04-24 02:50:26.603123 | orchestrator | testbed-node-2 : ok=43  changed=19  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026-04-24 02:50:26.603134 | orchestrator | testbed-node-3 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:50:26.603155 | orchestrator | testbed-node-4 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:50:26.603167 | orchestrator | testbed-node-5 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 02:50:26.603177 | orchestrator | 2026-04-24 02:50:26.603188 | orchestrator | 2026-04-24 02:50:26.603212 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:50:26.603223 | orchestrator | Friday 24 April 2026 02:50:26 +0000 (0:00:00.891) 0:02:25.487 ********** 2026-04-24 02:50:26.603234 | orchestrator | =============================================================================== 2026-04-24 02:50:26.603245 | orchestrator | ovn-controller : Restart ovn-controller container ---------------------- 34.40s 2026-04-24 02:50:26.603255 | orchestrator | ovn-controller : Configure OVN in OVSDB -------------------------------- 18.41s 2026-04-24 02:50:26.603266 | orchestrator | ovn-db : Restart ovn-sb-db container ----------------------------------- 13.54s 2026-04-24 02:50:26.603277 | orchestrator | ovn-db : Restart ovn-northd container ---------------------------------- 13.53s 2026-04-24 02:50:26.603287 | orchestrator | ovn-db : Restart ovn-nb-db container ----------------------------------- 12.73s 2026-04-24 02:50:26.603317 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 3.85s 2026-04-24 02:50:26.603328 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 3.77s 2026-04-24 02:50:26.603339 | orchestrator | ovn-db : Check ovn containers ------------------------------------------- 3.04s 2026-04-24 02:50:26.603350 | orchestrator | ovn-controller : Create br-int bridge on OpenvSwitch -------------------- 2.51s 2026-04-24 02:50:26.603360 | orchestrator | ovn-db : Check ovn containers ------------------------------------------- 1.98s 2026-04-24 02:50:26.603371 | orchestrator | ovn-controller : Reload systemd config ---------------------------------- 1.77s 2026-04-24 02:50:26.603382 | orchestrator | ovn-controller : Copying over systemd override -------------------------- 1.50s 2026-04-24 02:50:26.603392 | orchestrator | ovn-controller : Copying over config.json files for services ------------ 1.49s 2026-04-24 02:50:26.603403 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 1.45s 2026-04-24 02:50:26.603413 | orchestrator | ovn-controller : Check ovn-controller containers ------------------------ 1.35s 2026-04-24 02:50:26.603424 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 1.35s 2026-04-24 02:50:26.603435 | orchestrator | ovn-controller : Ensuring config directories exist ---------------------- 1.17s 2026-04-24 02:50:26.603445 | orchestrator | ovn-controller : Ensuring systemd override directory exists ------------- 1.16s 2026-04-24 02:50:26.603456 | orchestrator | ovn-db : Wait for ovn-nb-db --------------------------------------------- 1.15s 2026-04-24 02:50:26.603467 | orchestrator | ovn-controller : include_tasks ------------------------------------------ 1.08s 2026-04-24 02:50:26.911752 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-24 02:50:26.911897 | orchestrator | + sh -c /opt/configuration/scripts/deploy/100-ceph-with-ansible.sh 2026-04-24 02:50:29.078543 | orchestrator | 2026-04-24 02:50:29 | INFO  | Trying to run play wipe-partitions in environment custom 2026-04-24 02:50:39.166043 | orchestrator | 2026-04-24 02:50:39 | INFO  | Task 7d882c29-39d0-4d3f-be97-0fccb5e5e5a5 (wipe-partitions) was prepared for execution. 2026-04-24 02:50:39.166154 | orchestrator | 2026-04-24 02:50:39 | INFO  | It takes a moment until task 7d882c29-39d0-4d3f-be97-0fccb5e5e5a5 (wipe-partitions) has been started and output is visible here. 2026-04-24 02:50:51.890593 | orchestrator | 2026-04-24 02:50:51.890701 | orchestrator | PLAY [Wipe partitions] ********************************************************* 2026-04-24 02:50:51.890714 | orchestrator | 2026-04-24 02:50:51.890720 | orchestrator | TASK [Find all logical devices owned by UID 167] ******************************* 2026-04-24 02:50:51.890727 | orchestrator | Friday 24 April 2026 02:50:43 +0000 (0:00:00.128) 0:00:00.128 ********** 2026-04-24 02:50:51.890804 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:50:51.890816 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:50:51.890822 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:50:51.890828 | orchestrator | 2026-04-24 02:50:51.890835 | orchestrator | TASK [Remove all rook related logical devices] ********************************* 2026-04-24 02:50:51.890841 | orchestrator | Friday 24 April 2026 02:50:43 +0000 (0:00:00.583) 0:00:00.712 ********** 2026-04-24 02:50:51.890847 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:50:51.890853 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:50:51.890860 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:50:51.890866 | orchestrator | 2026-04-24 02:50:51.890872 | orchestrator | TASK [Find all logical devices with prefix ceph] ******************************* 2026-04-24 02:50:51.890878 | orchestrator | Friday 24 April 2026 02:50:44 +0000 (0:00:00.376) 0:00:01.088 ********** 2026-04-24 02:50:51.890884 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:50:51.890892 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:50:51.890898 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:50:51.890904 | orchestrator | 2026-04-24 02:50:51.890910 | orchestrator | TASK [Remove all ceph related logical devices] ********************************* 2026-04-24 02:50:51.890917 | orchestrator | Friday 24 April 2026 02:50:44 +0000 (0:00:00.649) 0:00:01.737 ********** 2026-04-24 02:50:51.890923 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:50:51.890928 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:50:51.890935 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:50:51.890942 | orchestrator | 2026-04-24 02:50:51.890948 | orchestrator | TASK [Check device availability] *********************************************** 2026-04-24 02:50:51.890954 | orchestrator | Friday 24 April 2026 02:50:45 +0000 (0:00:00.279) 0:00:02.017 ********** 2026-04-24 02:50:51.890960 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdb) 2026-04-24 02:50:51.890967 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdb) 2026-04-24 02:50:51.890973 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdb) 2026-04-24 02:50:51.890980 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdc) 2026-04-24 02:50:51.890986 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdc) 2026-04-24 02:50:51.890992 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdc) 2026-04-24 02:50:51.891012 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdd) 2026-04-24 02:50:51.891019 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdd) 2026-04-24 02:50:51.891025 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdd) 2026-04-24 02:50:51.891032 | orchestrator | 2026-04-24 02:50:51.891038 | orchestrator | TASK [Wipe partitions with wipefs] ********************************************* 2026-04-24 02:50:51.891044 | orchestrator | Friday 24 April 2026 02:50:46 +0000 (0:00:01.232) 0:00:03.250 ********** 2026-04-24 02:50:51.891051 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdb) 2026-04-24 02:50:51.891057 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdb) 2026-04-24 02:50:51.891064 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdb) 2026-04-24 02:50:51.891070 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdc) 2026-04-24 02:50:51.891076 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdc) 2026-04-24 02:50:51.891083 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdc) 2026-04-24 02:50:51.891089 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdd) 2026-04-24 02:50:51.891095 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdd) 2026-04-24 02:50:51.891101 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdd) 2026-04-24 02:50:51.891106 | orchestrator | 2026-04-24 02:50:51.891112 | orchestrator | TASK [Overwrite first 32M with zeros] ****************************************** 2026-04-24 02:50:51.891119 | orchestrator | Friday 24 April 2026 02:50:48 +0000 (0:00:01.591) 0:00:04.841 ********** 2026-04-24 02:50:51.891126 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdb) 2026-04-24 02:50:51.891131 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdb) 2026-04-24 02:50:51.891138 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdb) 2026-04-24 02:50:51.891144 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdc) 2026-04-24 02:50:51.891160 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdc) 2026-04-24 02:50:51.891166 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdc) 2026-04-24 02:50:51.891173 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdd) 2026-04-24 02:50:51.891179 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdd) 2026-04-24 02:50:51.891185 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdd) 2026-04-24 02:50:51.891192 | orchestrator | 2026-04-24 02:50:51.891198 | orchestrator | TASK [Reload udev rules] ******************************************************* 2026-04-24 02:50:51.891206 | orchestrator | Friday 24 April 2026 02:50:50 +0000 (0:00:02.190) 0:00:07.032 ********** 2026-04-24 02:50:51.891212 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:50:51.891219 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:50:51.891225 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:50:51.891232 | orchestrator | 2026-04-24 02:50:51.891239 | orchestrator | TASK [Request device events from the kernel] *********************************** 2026-04-24 02:50:51.891245 | orchestrator | Friday 24 April 2026 02:50:50 +0000 (0:00:00.592) 0:00:07.625 ********** 2026-04-24 02:50:51.891252 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:50:51.891260 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:50:51.891267 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:50:51.891274 | orchestrator | 2026-04-24 02:50:51.891280 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:50:51.891287 | orchestrator | testbed-node-3 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:50:51.891296 | orchestrator | testbed-node-4 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:50:51.891325 | orchestrator | testbed-node-5 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:50:51.891333 | orchestrator | 2026-04-24 02:50:51.891340 | orchestrator | 2026-04-24 02:50:51.891346 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:50:51.891353 | orchestrator | Friday 24 April 2026 02:50:51 +0000 (0:00:00.644) 0:00:08.270 ********** 2026-04-24 02:50:51.891359 | orchestrator | =============================================================================== 2026-04-24 02:50:51.891366 | orchestrator | Overwrite first 32M with zeros ------------------------------------------ 2.19s 2026-04-24 02:50:51.891373 | orchestrator | Wipe partitions with wipefs --------------------------------------------- 1.59s 2026-04-24 02:50:51.891379 | orchestrator | Check device availability ----------------------------------------------- 1.23s 2026-04-24 02:50:51.891385 | orchestrator | Find all logical devices with prefix ceph ------------------------------- 0.65s 2026-04-24 02:50:51.891392 | orchestrator | Request device events from the kernel ----------------------------------- 0.65s 2026-04-24 02:50:51.891398 | orchestrator | Reload udev rules ------------------------------------------------------- 0.59s 2026-04-24 02:50:51.891404 | orchestrator | Find all logical devices owned by UID 167 ------------------------------- 0.58s 2026-04-24 02:50:51.891410 | orchestrator | Remove all rook related logical devices --------------------------------- 0.38s 2026-04-24 02:50:51.891416 | orchestrator | Remove all ceph related logical devices --------------------------------- 0.28s 2026-04-24 02:51:04.397045 | orchestrator | 2026-04-24 02:51:04 | INFO  | Task 1445caaa-00b7-4f27-a82f-8370408fce58 (facts) was prepared for execution. 2026-04-24 02:51:04.397241 | orchestrator | 2026-04-24 02:51:04 | INFO  | It takes a moment until task 1445caaa-00b7-4f27-a82f-8370408fce58 (facts) has been started and output is visible here. 2026-04-24 02:51:18.193695 | orchestrator | 2026-04-24 02:51:18.193867 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-24 02:51:18.193885 | orchestrator | 2026-04-24 02:51:18.193898 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-24 02:51:18.193910 | orchestrator | Friday 24 April 2026 02:51:08 +0000 (0:00:00.276) 0:00:00.276 ********** 2026-04-24 02:51:18.193949 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:51:18.193962 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:51:18.193974 | orchestrator | ok: [testbed-manager] 2026-04-24 02:51:18.193985 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:51:18.193995 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:51:18.194006 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:51:18.194080 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:51:18.194095 | orchestrator | 2026-04-24 02:51:18.194106 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-24 02:51:18.194119 | orchestrator | Friday 24 April 2026 02:51:09 +0000 (0:00:01.143) 0:00:01.419 ********** 2026-04-24 02:51:18.194130 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:51:18.194143 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:51:18.194153 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:51:18.194164 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:51:18.194174 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:18.194185 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:18.194196 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:51:18.194206 | orchestrator | 2026-04-24 02:51:18.194217 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-24 02:51:18.194228 | orchestrator | 2026-04-24 02:51:18.194239 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 02:51:18.194249 | orchestrator | Friday 24 April 2026 02:51:11 +0000 (0:00:01.328) 0:00:02.747 ********** 2026-04-24 02:51:18.194260 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:51:18.194271 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:51:18.194281 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:51:18.194292 | orchestrator | ok: [testbed-manager] 2026-04-24 02:51:18.194302 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:51:18.194313 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:51:18.194323 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:51:18.194334 | orchestrator | 2026-04-24 02:51:18.194345 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-24 02:51:18.194355 | orchestrator | 2026-04-24 02:51:18.194366 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-24 02:51:18.194377 | orchestrator | Friday 24 April 2026 02:51:17 +0000 (0:00:06.030) 0:00:08.778 ********** 2026-04-24 02:51:18.194387 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:51:18.194398 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:51:18.194408 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:51:18.194419 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:51:18.194430 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:18.194440 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:18.194451 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:51:18.194461 | orchestrator | 2026-04-24 02:51:18.194472 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:51:18.194483 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:51:18.194601 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:51:18.194622 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:51:18.194633 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:51:18.194644 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:51:18.194654 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:51:18.194678 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:51:18.194689 | orchestrator | 2026-04-24 02:51:18.194699 | orchestrator | 2026-04-24 02:51:18.194710 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:51:18.194792 | orchestrator | Friday 24 April 2026 02:51:17 +0000 (0:00:00.565) 0:00:09.344 ********** 2026-04-24 02:51:18.194804 | orchestrator | =============================================================================== 2026-04-24 02:51:18.194826 | orchestrator | Gathers facts about hosts ----------------------------------------------- 6.03s 2026-04-24 02:51:18.194837 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.33s 2026-04-24 02:51:18.194848 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.14s 2026-04-24 02:51:18.194859 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.57s 2026-04-24 02:51:20.603924 | orchestrator | 2026-04-24 02:51:20 | INFO  | Task 8ae06697-73c1-4dab-bc8c-78c6124ff966 (ceph-configure-lvm-volumes) was prepared for execution. 2026-04-24 02:51:20.604047 | orchestrator | 2026-04-24 02:51:20 | INFO  | It takes a moment until task 8ae06697-73c1-4dab-bc8c-78c6124ff966 (ceph-configure-lvm-volumes) has been started and output is visible here. 2026-04-24 02:51:32.996315 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-24 02:51:32.996434 | orchestrator | 2.16.14 2026-04-24 02:51:32.996452 | orchestrator | 2026-04-24 02:51:32.996464 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-24 02:51:32.996477 | orchestrator | 2026-04-24 02:51:32.996488 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-24 02:51:32.996500 | orchestrator | Friday 24 April 2026 02:51:25 +0000 (0:00:00.362) 0:00:00.362 ********** 2026-04-24 02:51:32.996512 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 02:51:32.996524 | orchestrator | 2026-04-24 02:51:32.996551 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-24 02:51:32.996563 | orchestrator | Friday 24 April 2026 02:51:25 +0000 (0:00:00.267) 0:00:00.630 ********** 2026-04-24 02:51:32.996574 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:51:32.996585 | orchestrator | 2026-04-24 02:51:32.996597 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.996608 | orchestrator | Friday 24 April 2026 02:51:25 +0000 (0:00:00.255) 0:00:00.885 ********** 2026-04-24 02:51:32.996619 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop0) 2026-04-24 02:51:32.996630 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop1) 2026-04-24 02:51:32.996641 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop2) 2026-04-24 02:51:32.996652 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop3) 2026-04-24 02:51:32.996663 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop4) 2026-04-24 02:51:32.996674 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop5) 2026-04-24 02:51:32.996685 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop6) 2026-04-24 02:51:32.996695 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop7) 2026-04-24 02:51:32.996735 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sda) 2026-04-24 02:51:32.996746 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdb) 2026-04-24 02:51:32.996757 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdc) 2026-04-24 02:51:32.996782 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdd) 2026-04-24 02:51:32.996848 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sr0) 2026-04-24 02:51:32.996863 | orchestrator | 2026-04-24 02:51:32.996883 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.996901 | orchestrator | Friday 24 April 2026 02:51:26 +0000 (0:00:00.540) 0:00:01.425 ********** 2026-04-24 02:51:32.996921 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.996941 | orchestrator | 2026-04-24 02:51:32.996959 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.996978 | orchestrator | Friday 24 April 2026 02:51:26 +0000 (0:00:00.210) 0:00:01.635 ********** 2026-04-24 02:51:32.996997 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.997015 | orchestrator | 2026-04-24 02:51:32.997034 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997055 | orchestrator | Friday 24 April 2026 02:51:26 +0000 (0:00:00.230) 0:00:01.865 ********** 2026-04-24 02:51:32.997073 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.997090 | orchestrator | 2026-04-24 02:51:32.997102 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997115 | orchestrator | Friday 24 April 2026 02:51:26 +0000 (0:00:00.222) 0:00:02.088 ********** 2026-04-24 02:51:32.997127 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.997139 | orchestrator | 2026-04-24 02:51:32.997151 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997163 | orchestrator | Friday 24 April 2026 02:51:27 +0000 (0:00:00.202) 0:00:02.291 ********** 2026-04-24 02:51:32.997263 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.997280 | orchestrator | 2026-04-24 02:51:32.997298 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997327 | orchestrator | Friday 24 April 2026 02:51:27 +0000 (0:00:00.212) 0:00:02.503 ********** 2026-04-24 02:51:32.997346 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.997364 | orchestrator | 2026-04-24 02:51:32.997382 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997401 | orchestrator | Friday 24 April 2026 02:51:27 +0000 (0:00:00.209) 0:00:02.712 ********** 2026-04-24 02:51:32.997420 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.997438 | orchestrator | 2026-04-24 02:51:32.997458 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997474 | orchestrator | Friday 24 April 2026 02:51:27 +0000 (0:00:00.217) 0:00:02.930 ********** 2026-04-24 02:51:32.997485 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.997496 | orchestrator | 2026-04-24 02:51:32.997507 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997524 | orchestrator | Friday 24 April 2026 02:51:28 +0000 (0:00:00.213) 0:00:03.143 ********** 2026-04-24 02:51:32.997551 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951) 2026-04-24 02:51:32.997575 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951) 2026-04-24 02:51:32.997592 | orchestrator | 2026-04-24 02:51:32.997610 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997654 | orchestrator | Friday 24 April 2026 02:51:28 +0000 (0:00:00.434) 0:00:03.578 ********** 2026-04-24 02:51:32.997674 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23) 2026-04-24 02:51:32.997692 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23) 2026-04-24 02:51:32.997778 | orchestrator | 2026-04-24 02:51:32.997792 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997804 | orchestrator | Friday 24 April 2026 02:51:29 +0000 (0:00:00.659) 0:00:04.237 ********** 2026-04-24 02:51:32.997827 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c) 2026-04-24 02:51:32.997857 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c) 2026-04-24 02:51:32.997868 | orchestrator | 2026-04-24 02:51:32.997878 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997889 | orchestrator | Friday 24 April 2026 02:51:29 +0000 (0:00:00.687) 0:00:04.925 ********** 2026-04-24 02:51:32.997900 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76) 2026-04-24 02:51:32.997911 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76) 2026-04-24 02:51:32.997922 | orchestrator | 2026-04-24 02:51:32.997932 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:32.997943 | orchestrator | Friday 24 April 2026 02:51:30 +0000 (0:00:00.879) 0:00:05.804 ********** 2026-04-24 02:51:32.997954 | orchestrator | ok: [testbed-node-3] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-24 02:51:32.997965 | orchestrator | 2026-04-24 02:51:32.997976 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:32.997986 | orchestrator | Friday 24 April 2026 02:51:31 +0000 (0:00:00.336) 0:00:06.141 ********** 2026-04-24 02:51:32.997997 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop0) 2026-04-24 02:51:32.998008 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop1) 2026-04-24 02:51:32.998169 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop2) 2026-04-24 02:51:32.998186 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop3) 2026-04-24 02:51:32.998197 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop4) 2026-04-24 02:51:32.998208 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop5) 2026-04-24 02:51:32.998218 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop6) 2026-04-24 02:51:32.998229 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop7) 2026-04-24 02:51:32.998239 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sda) 2026-04-24 02:51:32.998249 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdb) 2026-04-24 02:51:32.998260 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdc) 2026-04-24 02:51:32.998270 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdd) 2026-04-24 02:51:32.998281 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sr0) 2026-04-24 02:51:32.998315 | orchestrator | 2026-04-24 02:51:32.998327 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:32.998337 | orchestrator | Friday 24 April 2026 02:51:31 +0000 (0:00:00.385) 0:00:06.526 ********** 2026-04-24 02:51:32.998348 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.998359 | orchestrator | 2026-04-24 02:51:32.998369 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:32.998380 | orchestrator | Friday 24 April 2026 02:51:31 +0000 (0:00:00.228) 0:00:06.755 ********** 2026-04-24 02:51:32.998390 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.998401 | orchestrator | 2026-04-24 02:51:32.998412 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:32.998422 | orchestrator | Friday 24 April 2026 02:51:31 +0000 (0:00:00.203) 0:00:06.958 ********** 2026-04-24 02:51:32.998433 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.998443 | orchestrator | 2026-04-24 02:51:32.998454 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:32.998464 | orchestrator | Friday 24 April 2026 02:51:32 +0000 (0:00:00.234) 0:00:07.193 ********** 2026-04-24 02:51:32.998484 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.998496 | orchestrator | 2026-04-24 02:51:32.998507 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:32.998518 | orchestrator | Friday 24 April 2026 02:51:32 +0000 (0:00:00.231) 0:00:07.424 ********** 2026-04-24 02:51:32.998528 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.998539 | orchestrator | 2026-04-24 02:51:32.998550 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:32.998561 | orchestrator | Friday 24 April 2026 02:51:32 +0000 (0:00:00.206) 0:00:07.630 ********** 2026-04-24 02:51:32.998571 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.998582 | orchestrator | 2026-04-24 02:51:32.998593 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:32.998603 | orchestrator | Friday 24 April 2026 02:51:32 +0000 (0:00:00.235) 0:00:07.865 ********** 2026-04-24 02:51:32.998614 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:32.998625 | orchestrator | 2026-04-24 02:51:32.998647 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:41.176761 | orchestrator | Friday 24 April 2026 02:51:32 +0000 (0:00:00.226) 0:00:08.092 ********** 2026-04-24 02:51:41.176882 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.176900 | orchestrator | 2026-04-24 02:51:41.176913 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:41.176924 | orchestrator | Friday 24 April 2026 02:51:33 +0000 (0:00:00.223) 0:00:08.315 ********** 2026-04-24 02:51:41.176935 | orchestrator | ok: [testbed-node-3] => (item=sda1) 2026-04-24 02:51:41.176947 | orchestrator | ok: [testbed-node-3] => (item=sda14) 2026-04-24 02:51:41.176959 | orchestrator | ok: [testbed-node-3] => (item=sda15) 2026-04-24 02:51:41.176987 | orchestrator | ok: [testbed-node-3] => (item=sda16) 2026-04-24 02:51:41.176999 | orchestrator | 2026-04-24 02:51:41.177011 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:41.177022 | orchestrator | Friday 24 April 2026 02:51:34 +0000 (0:00:01.147) 0:00:09.462 ********** 2026-04-24 02:51:41.177033 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177043 | orchestrator | 2026-04-24 02:51:41.177071 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:41.177083 | orchestrator | Friday 24 April 2026 02:51:34 +0000 (0:00:00.252) 0:00:09.715 ********** 2026-04-24 02:51:41.177094 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177116 | orchestrator | 2026-04-24 02:51:41.177127 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:41.177139 | orchestrator | Friday 24 April 2026 02:51:34 +0000 (0:00:00.220) 0:00:09.935 ********** 2026-04-24 02:51:41.177150 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177161 | orchestrator | 2026-04-24 02:51:41.177172 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:41.177182 | orchestrator | Friday 24 April 2026 02:51:35 +0000 (0:00:00.222) 0:00:10.158 ********** 2026-04-24 02:51:41.177193 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177204 | orchestrator | 2026-04-24 02:51:41.177215 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-24 02:51:41.177226 | orchestrator | Friday 24 April 2026 02:51:35 +0000 (0:00:00.220) 0:00:10.378 ********** 2026-04-24 02:51:41.177237 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': None}) 2026-04-24 02:51:41.177249 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': None}) 2026-04-24 02:51:41.177261 | orchestrator | 2026-04-24 02:51:41.177273 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-24 02:51:41.177286 | orchestrator | Friday 24 April 2026 02:51:35 +0000 (0:00:00.222) 0:00:10.601 ********** 2026-04-24 02:51:41.177298 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177310 | orchestrator | 2026-04-24 02:51:41.177322 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-24 02:51:41.177334 | orchestrator | Friday 24 April 2026 02:51:35 +0000 (0:00:00.149) 0:00:10.750 ********** 2026-04-24 02:51:41.177372 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177386 | orchestrator | 2026-04-24 02:51:41.177398 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-24 02:51:41.177411 | orchestrator | Friday 24 April 2026 02:51:35 +0000 (0:00:00.141) 0:00:10.892 ********** 2026-04-24 02:51:41.177423 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177435 | orchestrator | 2026-04-24 02:51:41.177447 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-24 02:51:41.177460 | orchestrator | Friday 24 April 2026 02:51:35 +0000 (0:00:00.174) 0:00:11.066 ********** 2026-04-24 02:51:41.177472 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:51:41.177485 | orchestrator | 2026-04-24 02:51:41.177496 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-24 02:51:41.177507 | orchestrator | Friday 24 April 2026 02:51:36 +0000 (0:00:00.142) 0:00:11.208 ********** 2026-04-24 02:51:41.177518 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}}) 2026-04-24 02:51:41.177530 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '02e41f6c-bc12-5c7e-a521-6aced039912f'}}) 2026-04-24 02:51:41.177540 | orchestrator | 2026-04-24 02:51:41.177551 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-24 02:51:41.177562 | orchestrator | Friday 24 April 2026 02:51:36 +0000 (0:00:00.183) 0:00:11.392 ********** 2026-04-24 02:51:41.177573 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}})  2026-04-24 02:51:41.177585 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '02e41f6c-bc12-5c7e-a521-6aced039912f'}})  2026-04-24 02:51:41.177596 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177607 | orchestrator | 2026-04-24 02:51:41.177618 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-24 02:51:41.177629 | orchestrator | Friday 24 April 2026 02:51:36 +0000 (0:00:00.353) 0:00:11.745 ********** 2026-04-24 02:51:41.177639 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}})  2026-04-24 02:51:41.177651 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '02e41f6c-bc12-5c7e-a521-6aced039912f'}})  2026-04-24 02:51:41.177662 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177672 | orchestrator | 2026-04-24 02:51:41.177683 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-24 02:51:41.177721 | orchestrator | Friday 24 April 2026 02:51:36 +0000 (0:00:00.161) 0:00:11.907 ********** 2026-04-24 02:51:41.177735 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}})  2026-04-24 02:51:41.177765 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '02e41f6c-bc12-5c7e-a521-6aced039912f'}})  2026-04-24 02:51:41.177777 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177787 | orchestrator | 2026-04-24 02:51:41.177799 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-24 02:51:41.177810 | orchestrator | Friday 24 April 2026 02:51:36 +0000 (0:00:00.167) 0:00:12.074 ********** 2026-04-24 02:51:41.177821 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:51:41.177832 | orchestrator | 2026-04-24 02:51:41.177843 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-24 02:51:41.177859 | orchestrator | Friday 24 April 2026 02:51:37 +0000 (0:00:00.146) 0:00:12.221 ********** 2026-04-24 02:51:41.177871 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:51:41.177881 | orchestrator | 2026-04-24 02:51:41.177892 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-24 02:51:41.177903 | orchestrator | Friday 24 April 2026 02:51:37 +0000 (0:00:00.155) 0:00:12.377 ********** 2026-04-24 02:51:41.177923 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177933 | orchestrator | 2026-04-24 02:51:41.177944 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-24 02:51:41.177955 | orchestrator | Friday 24 April 2026 02:51:37 +0000 (0:00:00.135) 0:00:12.512 ********** 2026-04-24 02:51:41.177965 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.177976 | orchestrator | 2026-04-24 02:51:41.177987 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-24 02:51:41.177998 | orchestrator | Friday 24 April 2026 02:51:37 +0000 (0:00:00.143) 0:00:12.656 ********** 2026-04-24 02:51:41.178008 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.178083 | orchestrator | 2026-04-24 02:51:41.178098 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-24 02:51:41.178109 | orchestrator | Friday 24 April 2026 02:51:37 +0000 (0:00:00.133) 0:00:12.789 ********** 2026-04-24 02:51:41.178120 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 02:51:41.178130 | orchestrator |  "ceph_osd_devices": { 2026-04-24 02:51:41.178141 | orchestrator |  "sdb": { 2026-04-24 02:51:41.178152 | orchestrator |  "osd_lvm_uuid": "30beaf4b-e88f-5ba2-bed2-60586ab1edc3" 2026-04-24 02:51:41.178163 | orchestrator |  }, 2026-04-24 02:51:41.178174 | orchestrator |  "sdc": { 2026-04-24 02:51:41.178184 | orchestrator |  "osd_lvm_uuid": "02e41f6c-bc12-5c7e-a521-6aced039912f" 2026-04-24 02:51:41.178195 | orchestrator |  } 2026-04-24 02:51:41.178206 | orchestrator |  } 2026-04-24 02:51:41.178217 | orchestrator | } 2026-04-24 02:51:41.178228 | orchestrator | 2026-04-24 02:51:41.178239 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-24 02:51:41.178250 | orchestrator | Friday 24 April 2026 02:51:37 +0000 (0:00:00.163) 0:00:12.952 ********** 2026-04-24 02:51:41.178260 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.178271 | orchestrator | 2026-04-24 02:51:41.178282 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-24 02:51:41.178293 | orchestrator | Friday 24 April 2026 02:51:38 +0000 (0:00:00.161) 0:00:13.114 ********** 2026-04-24 02:51:41.178303 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.178314 | orchestrator | 2026-04-24 02:51:41.178325 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-24 02:51:41.178336 | orchestrator | Friday 24 April 2026 02:51:38 +0000 (0:00:00.143) 0:00:13.258 ********** 2026-04-24 02:51:41.178347 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:51:41.178357 | orchestrator | 2026-04-24 02:51:41.178368 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-24 02:51:41.178378 | orchestrator | Friday 24 April 2026 02:51:38 +0000 (0:00:00.154) 0:00:13.413 ********** 2026-04-24 02:51:41.178389 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 02:51:41.178400 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-24 02:51:41.178411 | orchestrator |  "ceph_osd_devices": { 2026-04-24 02:51:41.178421 | orchestrator |  "sdb": { 2026-04-24 02:51:41.178432 | orchestrator |  "osd_lvm_uuid": "30beaf4b-e88f-5ba2-bed2-60586ab1edc3" 2026-04-24 02:51:41.178443 | orchestrator |  }, 2026-04-24 02:51:41.178454 | orchestrator |  "sdc": { 2026-04-24 02:51:41.178465 | orchestrator |  "osd_lvm_uuid": "02e41f6c-bc12-5c7e-a521-6aced039912f" 2026-04-24 02:51:41.178475 | orchestrator |  } 2026-04-24 02:51:41.178486 | orchestrator |  }, 2026-04-24 02:51:41.178497 | orchestrator |  "lvm_volumes": [ 2026-04-24 02:51:41.178507 | orchestrator |  { 2026-04-24 02:51:41.178518 | orchestrator |  "data": "osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3", 2026-04-24 02:51:41.178529 | orchestrator |  "data_vg": "ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3" 2026-04-24 02:51:41.178540 | orchestrator |  }, 2026-04-24 02:51:41.178551 | orchestrator |  { 2026-04-24 02:51:41.178561 | orchestrator |  "data": "osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f", 2026-04-24 02:51:41.178580 | orchestrator |  "data_vg": "ceph-02e41f6c-bc12-5c7e-a521-6aced039912f" 2026-04-24 02:51:41.178591 | orchestrator |  } 2026-04-24 02:51:41.178601 | orchestrator |  ] 2026-04-24 02:51:41.178612 | orchestrator |  } 2026-04-24 02:51:41.178623 | orchestrator | } 2026-04-24 02:51:41.178633 | orchestrator | 2026-04-24 02:51:41.178644 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-24 02:51:41.178655 | orchestrator | Friday 24 April 2026 02:51:38 +0000 (0:00:00.419) 0:00:13.833 ********** 2026-04-24 02:51:41.178666 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 02:51:41.178677 | orchestrator | 2026-04-24 02:51:41.178688 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-24 02:51:41.178740 | orchestrator | 2026-04-24 02:51:41.178752 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-24 02:51:41.178762 | orchestrator | Friday 24 April 2026 02:51:40 +0000 (0:00:01.919) 0:00:15.752 ********** 2026-04-24 02:51:41.178773 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-24 02:51:41.178784 | orchestrator | 2026-04-24 02:51:41.178795 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-24 02:51:41.178806 | orchestrator | Friday 24 April 2026 02:51:40 +0000 (0:00:00.263) 0:00:16.016 ********** 2026-04-24 02:51:41.178817 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:51:41.178827 | orchestrator | 2026-04-24 02:51:41.178847 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.767989 | orchestrator | Friday 24 April 2026 02:51:41 +0000 (0:00:00.259) 0:00:16.275 ********** 2026-04-24 02:51:50.768096 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop0) 2026-04-24 02:51:50.768111 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop1) 2026-04-24 02:51:50.768158 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop2) 2026-04-24 02:51:50.769662 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop3) 2026-04-24 02:51:50.769738 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop4) 2026-04-24 02:51:50.769748 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop5) 2026-04-24 02:51:50.769758 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop6) 2026-04-24 02:51:50.769768 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop7) 2026-04-24 02:51:50.769778 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sda) 2026-04-24 02:51:50.769788 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdb) 2026-04-24 02:51:50.769798 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdc) 2026-04-24 02:51:50.769807 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdd) 2026-04-24 02:51:50.769817 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sr0) 2026-04-24 02:51:50.769827 | orchestrator | 2026-04-24 02:51:50.769844 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.769860 | orchestrator | Friday 24 April 2026 02:51:41 +0000 (0:00:00.437) 0:00:16.712 ********** 2026-04-24 02:51:50.769876 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.769893 | orchestrator | 2026-04-24 02:51:50.769911 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.769927 | orchestrator | Friday 24 April 2026 02:51:41 +0000 (0:00:00.245) 0:00:16.958 ********** 2026-04-24 02:51:50.769943 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.769954 | orchestrator | 2026-04-24 02:51:50.769963 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.769973 | orchestrator | Friday 24 April 2026 02:51:42 +0000 (0:00:00.213) 0:00:17.172 ********** 2026-04-24 02:51:50.770007 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.770131 | orchestrator | 2026-04-24 02:51:50.770147 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770156 | orchestrator | Friday 24 April 2026 02:51:42 +0000 (0:00:00.227) 0:00:17.400 ********** 2026-04-24 02:51:50.770166 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.770175 | orchestrator | 2026-04-24 02:51:50.770185 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770199 | orchestrator | Friday 24 April 2026 02:51:42 +0000 (0:00:00.635) 0:00:18.035 ********** 2026-04-24 02:51:50.770215 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.770230 | orchestrator | 2026-04-24 02:51:50.770246 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770263 | orchestrator | Friday 24 April 2026 02:51:43 +0000 (0:00:00.218) 0:00:18.253 ********** 2026-04-24 02:51:50.770279 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.770296 | orchestrator | 2026-04-24 02:51:50.770308 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770318 | orchestrator | Friday 24 April 2026 02:51:43 +0000 (0:00:00.209) 0:00:18.463 ********** 2026-04-24 02:51:50.770327 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.770337 | orchestrator | 2026-04-24 02:51:50.770346 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770356 | orchestrator | Friday 24 April 2026 02:51:43 +0000 (0:00:00.213) 0:00:18.676 ********** 2026-04-24 02:51:50.770365 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.770375 | orchestrator | 2026-04-24 02:51:50.770384 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770393 | orchestrator | Friday 24 April 2026 02:51:43 +0000 (0:00:00.212) 0:00:18.888 ********** 2026-04-24 02:51:50.770403 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b) 2026-04-24 02:51:50.770414 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b) 2026-04-24 02:51:50.770424 | orchestrator | 2026-04-24 02:51:50.770434 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770444 | orchestrator | Friday 24 April 2026 02:51:44 +0000 (0:00:00.453) 0:00:19.342 ********** 2026-04-24 02:51:50.770453 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5) 2026-04-24 02:51:50.770463 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5) 2026-04-24 02:51:50.770472 | orchestrator | 2026-04-24 02:51:50.770482 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770491 | orchestrator | Friday 24 April 2026 02:51:44 +0000 (0:00:00.472) 0:00:19.814 ********** 2026-04-24 02:51:50.770500 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1) 2026-04-24 02:51:50.770510 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1) 2026-04-24 02:51:50.770520 | orchestrator | 2026-04-24 02:51:50.770529 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770564 | orchestrator | Friday 24 April 2026 02:51:45 +0000 (0:00:00.498) 0:00:20.313 ********** 2026-04-24 02:51:50.770574 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd) 2026-04-24 02:51:50.770584 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd) 2026-04-24 02:51:50.770594 | orchestrator | 2026-04-24 02:51:50.770603 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:50.770646 | orchestrator | Friday 24 April 2026 02:51:45 +0000 (0:00:00.708) 0:00:21.021 ********** 2026-04-24 02:51:50.770657 | orchestrator | ok: [testbed-node-4] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-24 02:51:50.770680 | orchestrator | 2026-04-24 02:51:50.770761 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.770772 | orchestrator | Friday 24 April 2026 02:51:46 +0000 (0:00:00.609) 0:00:21.631 ********** 2026-04-24 02:51:50.770781 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop0) 2026-04-24 02:51:50.770791 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop1) 2026-04-24 02:51:50.770801 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop2) 2026-04-24 02:51:50.770810 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop3) 2026-04-24 02:51:50.770820 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop4) 2026-04-24 02:51:50.770829 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop5) 2026-04-24 02:51:50.770838 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop6) 2026-04-24 02:51:50.770848 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop7) 2026-04-24 02:51:50.770857 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sda) 2026-04-24 02:51:50.770867 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdb) 2026-04-24 02:51:50.770877 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdc) 2026-04-24 02:51:50.770887 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdd) 2026-04-24 02:51:50.770896 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sr0) 2026-04-24 02:51:50.770906 | orchestrator | 2026-04-24 02:51:50.770915 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.770925 | orchestrator | Friday 24 April 2026 02:51:47 +0000 (0:00:00.872) 0:00:22.504 ********** 2026-04-24 02:51:50.770934 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.770944 | orchestrator | 2026-04-24 02:51:50.770953 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.770963 | orchestrator | Friday 24 April 2026 02:51:47 +0000 (0:00:00.229) 0:00:22.733 ********** 2026-04-24 02:51:50.770972 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.770982 | orchestrator | 2026-04-24 02:51:50.770991 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.771001 | orchestrator | Friday 24 April 2026 02:51:47 +0000 (0:00:00.238) 0:00:22.971 ********** 2026-04-24 02:51:50.771010 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.771020 | orchestrator | 2026-04-24 02:51:50.771047 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.771068 | orchestrator | Friday 24 April 2026 02:51:48 +0000 (0:00:00.238) 0:00:23.209 ********** 2026-04-24 02:51:50.771087 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.771097 | orchestrator | 2026-04-24 02:51:50.771107 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.771116 | orchestrator | Friday 24 April 2026 02:51:48 +0000 (0:00:00.230) 0:00:23.440 ********** 2026-04-24 02:51:50.771126 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.771135 | orchestrator | 2026-04-24 02:51:50.771145 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.771154 | orchestrator | Friday 24 April 2026 02:51:48 +0000 (0:00:00.209) 0:00:23.650 ********** 2026-04-24 02:51:50.771164 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.771173 | orchestrator | 2026-04-24 02:51:50.771183 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.771192 | orchestrator | Friday 24 April 2026 02:51:48 +0000 (0:00:00.204) 0:00:23.855 ********** 2026-04-24 02:51:50.771202 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.771218 | orchestrator | 2026-04-24 02:51:50.771228 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.771237 | orchestrator | Friday 24 April 2026 02:51:48 +0000 (0:00:00.218) 0:00:24.073 ********** 2026-04-24 02:51:50.771247 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:50.771256 | orchestrator | 2026-04-24 02:51:50.771266 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.771275 | orchestrator | Friday 24 April 2026 02:51:49 +0000 (0:00:00.217) 0:00:24.290 ********** 2026-04-24 02:51:50.771285 | orchestrator | ok: [testbed-node-4] => (item=sda1) 2026-04-24 02:51:50.771295 | orchestrator | ok: [testbed-node-4] => (item=sda14) 2026-04-24 02:51:50.771305 | orchestrator | ok: [testbed-node-4] => (item=sda15) 2026-04-24 02:51:50.771314 | orchestrator | ok: [testbed-node-4] => (item=sda16) 2026-04-24 02:51:50.771324 | orchestrator | 2026-04-24 02:51:50.771333 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:50.771343 | orchestrator | Friday 24 April 2026 02:51:50 +0000 (0:00:00.903) 0:00:25.194 ********** 2026-04-24 02:51:50.771352 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.083898 | orchestrator | 2026-04-24 02:51:57.084017 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:57.084031 | orchestrator | Friday 24 April 2026 02:51:50 +0000 (0:00:00.674) 0:00:25.868 ********** 2026-04-24 02:51:57.084040 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084050 | orchestrator | 2026-04-24 02:51:57.084058 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:57.084067 | orchestrator | Friday 24 April 2026 02:51:51 +0000 (0:00:00.240) 0:00:26.108 ********** 2026-04-24 02:51:57.084089 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084106 | orchestrator | 2026-04-24 02:51:57.084115 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:51:57.084124 | orchestrator | Friday 24 April 2026 02:51:51 +0000 (0:00:00.216) 0:00:26.325 ********** 2026-04-24 02:51:57.084132 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084141 | orchestrator | 2026-04-24 02:51:57.084149 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-24 02:51:57.084158 | orchestrator | Friday 24 April 2026 02:51:51 +0000 (0:00:00.209) 0:00:26.535 ********** 2026-04-24 02:51:57.084166 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': None}) 2026-04-24 02:51:57.084174 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': None}) 2026-04-24 02:51:57.084182 | orchestrator | 2026-04-24 02:51:57.084190 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-24 02:51:57.084198 | orchestrator | Friday 24 April 2026 02:51:51 +0000 (0:00:00.191) 0:00:26.726 ********** 2026-04-24 02:51:57.084206 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084214 | orchestrator | 2026-04-24 02:51:57.084222 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-24 02:51:57.084230 | orchestrator | Friday 24 April 2026 02:51:51 +0000 (0:00:00.141) 0:00:26.868 ********** 2026-04-24 02:51:57.084238 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084246 | orchestrator | 2026-04-24 02:51:57.084254 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-24 02:51:57.084261 | orchestrator | Friday 24 April 2026 02:51:51 +0000 (0:00:00.166) 0:00:27.034 ********** 2026-04-24 02:51:57.084269 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084277 | orchestrator | 2026-04-24 02:51:57.084285 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-24 02:51:57.084293 | orchestrator | Friday 24 April 2026 02:51:52 +0000 (0:00:00.140) 0:00:27.175 ********** 2026-04-24 02:51:57.084301 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:51:57.084310 | orchestrator | 2026-04-24 02:51:57.084318 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-24 02:51:57.084326 | orchestrator | Friday 24 April 2026 02:51:52 +0000 (0:00:00.157) 0:00:27.332 ********** 2026-04-24 02:51:57.084355 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd69a3297-462a-55c2-bfb1-0665b5ed4cb1'}}) 2026-04-24 02:51:57.084364 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '33584b54-1593-569e-98b0-f98fe2b18be3'}}) 2026-04-24 02:51:57.084373 | orchestrator | 2026-04-24 02:51:57.084381 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-24 02:51:57.084389 | orchestrator | Friday 24 April 2026 02:51:52 +0000 (0:00:00.192) 0:00:27.525 ********** 2026-04-24 02:51:57.084397 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd69a3297-462a-55c2-bfb1-0665b5ed4cb1'}})  2026-04-24 02:51:57.084407 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '33584b54-1593-569e-98b0-f98fe2b18be3'}})  2026-04-24 02:51:57.084415 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084423 | orchestrator | 2026-04-24 02:51:57.084431 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-24 02:51:57.084439 | orchestrator | Friday 24 April 2026 02:51:52 +0000 (0:00:00.180) 0:00:27.706 ********** 2026-04-24 02:51:57.084449 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd69a3297-462a-55c2-bfb1-0665b5ed4cb1'}})  2026-04-24 02:51:57.084458 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '33584b54-1593-569e-98b0-f98fe2b18be3'}})  2026-04-24 02:51:57.084468 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084477 | orchestrator | 2026-04-24 02:51:57.084486 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-24 02:51:57.084495 | orchestrator | Friday 24 April 2026 02:51:52 +0000 (0:00:00.394) 0:00:28.100 ********** 2026-04-24 02:51:57.084504 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd69a3297-462a-55c2-bfb1-0665b5ed4cb1'}})  2026-04-24 02:51:57.084513 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '33584b54-1593-569e-98b0-f98fe2b18be3'}})  2026-04-24 02:51:57.084523 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084531 | orchestrator | 2026-04-24 02:51:57.084541 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-24 02:51:57.084550 | orchestrator | Friday 24 April 2026 02:51:53 +0000 (0:00:00.158) 0:00:28.259 ********** 2026-04-24 02:51:57.084560 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:51:57.084568 | orchestrator | 2026-04-24 02:51:57.084577 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-24 02:51:57.084587 | orchestrator | Friday 24 April 2026 02:51:53 +0000 (0:00:00.153) 0:00:28.412 ********** 2026-04-24 02:51:57.084596 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:51:57.084605 | orchestrator | 2026-04-24 02:51:57.084614 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-24 02:51:57.084623 | orchestrator | Friday 24 April 2026 02:51:53 +0000 (0:00:00.148) 0:00:28.561 ********** 2026-04-24 02:51:57.084647 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084657 | orchestrator | 2026-04-24 02:51:57.084666 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-24 02:51:57.084676 | orchestrator | Friday 24 April 2026 02:51:53 +0000 (0:00:00.144) 0:00:28.705 ********** 2026-04-24 02:51:57.084713 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084722 | orchestrator | 2026-04-24 02:51:57.084731 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-24 02:51:57.084741 | orchestrator | Friday 24 April 2026 02:51:53 +0000 (0:00:00.145) 0:00:28.850 ********** 2026-04-24 02:51:57.084754 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084764 | orchestrator | 2026-04-24 02:51:57.084773 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-24 02:51:57.084782 | orchestrator | Friday 24 April 2026 02:51:53 +0000 (0:00:00.147) 0:00:28.997 ********** 2026-04-24 02:51:57.084798 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 02:51:57.084807 | orchestrator |  "ceph_osd_devices": { 2026-04-24 02:51:57.084815 | orchestrator |  "sdb": { 2026-04-24 02:51:57.084823 | orchestrator |  "osd_lvm_uuid": "d69a3297-462a-55c2-bfb1-0665b5ed4cb1" 2026-04-24 02:51:57.084831 | orchestrator |  }, 2026-04-24 02:51:57.084839 | orchestrator |  "sdc": { 2026-04-24 02:51:57.084847 | orchestrator |  "osd_lvm_uuid": "33584b54-1593-569e-98b0-f98fe2b18be3" 2026-04-24 02:51:57.084855 | orchestrator |  } 2026-04-24 02:51:57.084863 | orchestrator |  } 2026-04-24 02:51:57.084871 | orchestrator | } 2026-04-24 02:51:57.084879 | orchestrator | 2026-04-24 02:51:57.084887 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-24 02:51:57.084895 | orchestrator | Friday 24 April 2026 02:51:54 +0000 (0:00:00.180) 0:00:29.178 ********** 2026-04-24 02:51:57.084903 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084911 | orchestrator | 2026-04-24 02:51:57.084919 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-24 02:51:57.084927 | orchestrator | Friday 24 April 2026 02:51:54 +0000 (0:00:00.144) 0:00:29.322 ********** 2026-04-24 02:51:57.084935 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084942 | orchestrator | 2026-04-24 02:51:57.084950 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-24 02:51:57.084958 | orchestrator | Friday 24 April 2026 02:51:54 +0000 (0:00:00.147) 0:00:29.470 ********** 2026-04-24 02:51:57.084966 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:51:57.084974 | orchestrator | 2026-04-24 02:51:57.084982 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-24 02:51:57.084990 | orchestrator | Friday 24 April 2026 02:51:54 +0000 (0:00:00.158) 0:00:29.628 ********** 2026-04-24 02:51:57.084998 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 02:51:57.085006 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-24 02:51:57.085013 | orchestrator |  "ceph_osd_devices": { 2026-04-24 02:51:57.085021 | orchestrator |  "sdb": { 2026-04-24 02:51:57.085029 | orchestrator |  "osd_lvm_uuid": "d69a3297-462a-55c2-bfb1-0665b5ed4cb1" 2026-04-24 02:51:57.085038 | orchestrator |  }, 2026-04-24 02:51:57.085046 | orchestrator |  "sdc": { 2026-04-24 02:51:57.085054 | orchestrator |  "osd_lvm_uuid": "33584b54-1593-569e-98b0-f98fe2b18be3" 2026-04-24 02:51:57.085062 | orchestrator |  } 2026-04-24 02:51:57.085070 | orchestrator |  }, 2026-04-24 02:51:57.085078 | orchestrator |  "lvm_volumes": [ 2026-04-24 02:51:57.085086 | orchestrator |  { 2026-04-24 02:51:57.085094 | orchestrator |  "data": "osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1", 2026-04-24 02:51:57.085102 | orchestrator |  "data_vg": "ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1" 2026-04-24 02:51:57.085110 | orchestrator |  }, 2026-04-24 02:51:57.085117 | orchestrator |  { 2026-04-24 02:51:57.085125 | orchestrator |  "data": "osd-block-33584b54-1593-569e-98b0-f98fe2b18be3", 2026-04-24 02:51:57.085133 | orchestrator |  "data_vg": "ceph-33584b54-1593-569e-98b0-f98fe2b18be3" 2026-04-24 02:51:57.085141 | orchestrator |  } 2026-04-24 02:51:57.085149 | orchestrator |  ] 2026-04-24 02:51:57.085157 | orchestrator |  } 2026-04-24 02:51:57.085165 | orchestrator | } 2026-04-24 02:51:57.085173 | orchestrator | 2026-04-24 02:51:57.085181 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-24 02:51:57.085189 | orchestrator | Friday 24 April 2026 02:51:54 +0000 (0:00:00.438) 0:00:30.067 ********** 2026-04-24 02:51:57.085197 | orchestrator | changed: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-24 02:51:57.085205 | orchestrator | 2026-04-24 02:51:57.085212 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-24 02:51:57.085220 | orchestrator | 2026-04-24 02:51:57.085228 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-24 02:51:57.085236 | orchestrator | Friday 24 April 2026 02:51:56 +0000 (0:00:01.183) 0:00:31.250 ********** 2026-04-24 02:51:57.085249 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-24 02:51:57.085257 | orchestrator | 2026-04-24 02:51:57.085265 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-24 02:51:57.085272 | orchestrator | Friday 24 April 2026 02:51:56 +0000 (0:00:00.262) 0:00:31.513 ********** 2026-04-24 02:51:57.085280 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:51:57.085288 | orchestrator | 2026-04-24 02:51:57.085296 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:51:57.085304 | orchestrator | Friday 24 April 2026 02:51:56 +0000 (0:00:00.254) 0:00:31.767 ********** 2026-04-24 02:51:57.085312 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop0) 2026-04-24 02:51:57.085320 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop1) 2026-04-24 02:51:57.085328 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop2) 2026-04-24 02:51:57.085336 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop3) 2026-04-24 02:51:57.085344 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop4) 2026-04-24 02:51:57.085357 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop5) 2026-04-24 02:52:06.035224 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop6) 2026-04-24 02:52:06.035328 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop7) 2026-04-24 02:52:06.035342 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sda) 2026-04-24 02:52:06.035352 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdb) 2026-04-24 02:52:06.035374 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdc) 2026-04-24 02:52:06.035383 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdd) 2026-04-24 02:52:06.035392 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sr0) 2026-04-24 02:52:06.035401 | orchestrator | 2026-04-24 02:52:06.035411 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035421 | orchestrator | Friday 24 April 2026 02:51:57 +0000 (0:00:00.408) 0:00:32.176 ********** 2026-04-24 02:52:06.035430 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.035441 | orchestrator | 2026-04-24 02:52:06.035450 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035459 | orchestrator | Friday 24 April 2026 02:51:57 +0000 (0:00:00.215) 0:00:32.392 ********** 2026-04-24 02:52:06.035467 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.035476 | orchestrator | 2026-04-24 02:52:06.035485 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035494 | orchestrator | Friday 24 April 2026 02:51:57 +0000 (0:00:00.202) 0:00:32.594 ********** 2026-04-24 02:52:06.035502 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.035511 | orchestrator | 2026-04-24 02:52:06.035520 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035529 | orchestrator | Friday 24 April 2026 02:51:57 +0000 (0:00:00.193) 0:00:32.787 ********** 2026-04-24 02:52:06.035537 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.035546 | orchestrator | 2026-04-24 02:52:06.035555 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035564 | orchestrator | Friday 24 April 2026 02:51:58 +0000 (0:00:00.639) 0:00:33.427 ********** 2026-04-24 02:52:06.035573 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.035582 | orchestrator | 2026-04-24 02:52:06.035590 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035599 | orchestrator | Friday 24 April 2026 02:51:58 +0000 (0:00:00.224) 0:00:33.652 ********** 2026-04-24 02:52:06.035629 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.035638 | orchestrator | 2026-04-24 02:52:06.035647 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035655 | orchestrator | Friday 24 April 2026 02:51:58 +0000 (0:00:00.212) 0:00:33.864 ********** 2026-04-24 02:52:06.035664 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.035699 | orchestrator | 2026-04-24 02:52:06.035710 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035719 | orchestrator | Friday 24 April 2026 02:51:58 +0000 (0:00:00.208) 0:00:34.072 ********** 2026-04-24 02:52:06.035728 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.035736 | orchestrator | 2026-04-24 02:52:06.035745 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035754 | orchestrator | Friday 24 April 2026 02:51:59 +0000 (0:00:00.229) 0:00:34.302 ********** 2026-04-24 02:52:06.035762 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c) 2026-04-24 02:52:06.035773 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c) 2026-04-24 02:52:06.035781 | orchestrator | 2026-04-24 02:52:06.035790 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035799 | orchestrator | Friday 24 April 2026 02:51:59 +0000 (0:00:00.424) 0:00:34.726 ********** 2026-04-24 02:52:06.035808 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d) 2026-04-24 02:52:06.035817 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d) 2026-04-24 02:52:06.035825 | orchestrator | 2026-04-24 02:52:06.035834 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035843 | orchestrator | Friday 24 April 2026 02:52:00 +0000 (0:00:00.465) 0:00:35.192 ********** 2026-04-24 02:52:06.035851 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025) 2026-04-24 02:52:06.035860 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025) 2026-04-24 02:52:06.035869 | orchestrator | 2026-04-24 02:52:06.035877 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035886 | orchestrator | Friday 24 April 2026 02:52:00 +0000 (0:00:00.493) 0:00:35.686 ********** 2026-04-24 02:52:06.035896 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229) 2026-04-24 02:52:06.035905 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229) 2026-04-24 02:52:06.035913 | orchestrator | 2026-04-24 02:52:06.035922 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:52:06.035931 | orchestrator | Friday 24 April 2026 02:52:01 +0000 (0:00:00.430) 0:00:36.117 ********** 2026-04-24 02:52:06.035939 | orchestrator | ok: [testbed-node-5] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-24 02:52:06.035948 | orchestrator | 2026-04-24 02:52:06.035957 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.035982 | orchestrator | Friday 24 April 2026 02:52:01 +0000 (0:00:00.340) 0:00:36.457 ********** 2026-04-24 02:52:06.035991 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop0) 2026-04-24 02:52:06.036000 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop1) 2026-04-24 02:52:06.036008 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop2) 2026-04-24 02:52:06.037435 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop3) 2026-04-24 02:52:06.037489 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop4) 2026-04-24 02:52:06.037506 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop5) 2026-04-24 02:52:06.037539 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop6) 2026-04-24 02:52:06.037553 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop7) 2026-04-24 02:52:06.037569 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sda) 2026-04-24 02:52:06.037583 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdb) 2026-04-24 02:52:06.037598 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdc) 2026-04-24 02:52:06.037607 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdd) 2026-04-24 02:52:06.037616 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sr0) 2026-04-24 02:52:06.037624 | orchestrator | 2026-04-24 02:52:06.037634 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037643 | orchestrator | Friday 24 April 2026 02:52:01 +0000 (0:00:00.609) 0:00:37.066 ********** 2026-04-24 02:52:06.037651 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.037661 | orchestrator | 2026-04-24 02:52:06.037670 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037704 | orchestrator | Friday 24 April 2026 02:52:02 +0000 (0:00:00.210) 0:00:37.277 ********** 2026-04-24 02:52:06.037714 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.037722 | orchestrator | 2026-04-24 02:52:06.037731 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037740 | orchestrator | Friday 24 April 2026 02:52:02 +0000 (0:00:00.216) 0:00:37.494 ********** 2026-04-24 02:52:06.037748 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.037757 | orchestrator | 2026-04-24 02:52:06.037766 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037775 | orchestrator | Friday 24 April 2026 02:52:02 +0000 (0:00:00.217) 0:00:37.712 ********** 2026-04-24 02:52:06.037783 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.037792 | orchestrator | 2026-04-24 02:52:06.037801 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037809 | orchestrator | Friday 24 April 2026 02:52:02 +0000 (0:00:00.226) 0:00:37.938 ********** 2026-04-24 02:52:06.037818 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.037827 | orchestrator | 2026-04-24 02:52:06.037835 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037844 | orchestrator | Friday 24 April 2026 02:52:03 +0000 (0:00:00.207) 0:00:38.146 ********** 2026-04-24 02:52:06.037853 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.037861 | orchestrator | 2026-04-24 02:52:06.037870 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037879 | orchestrator | Friday 24 April 2026 02:52:03 +0000 (0:00:00.229) 0:00:38.375 ********** 2026-04-24 02:52:06.037887 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.037896 | orchestrator | 2026-04-24 02:52:06.037905 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037914 | orchestrator | Friday 24 April 2026 02:52:03 +0000 (0:00:00.211) 0:00:38.587 ********** 2026-04-24 02:52:06.037922 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.037931 | orchestrator | 2026-04-24 02:52:06.037940 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.037949 | orchestrator | Friday 24 April 2026 02:52:03 +0000 (0:00:00.210) 0:00:38.798 ********** 2026-04-24 02:52:06.037963 | orchestrator | ok: [testbed-node-5] => (item=sda1) 2026-04-24 02:52:06.037978 | orchestrator | ok: [testbed-node-5] => (item=sda14) 2026-04-24 02:52:06.037994 | orchestrator | ok: [testbed-node-5] => (item=sda15) 2026-04-24 02:52:06.038009 | orchestrator | ok: [testbed-node-5] => (item=sda16) 2026-04-24 02:52:06.038111 | orchestrator | 2026-04-24 02:52:06.038139 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.038154 | orchestrator | Friday 24 April 2026 02:52:04 +0000 (0:00:00.911) 0:00:39.709 ********** 2026-04-24 02:52:06.038168 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.038183 | orchestrator | 2026-04-24 02:52:06.038198 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.038213 | orchestrator | Friday 24 April 2026 02:52:04 +0000 (0:00:00.208) 0:00:39.917 ********** 2026-04-24 02:52:06.038229 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.038245 | orchestrator | 2026-04-24 02:52:06.038260 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.038273 | orchestrator | Friday 24 April 2026 02:52:05 +0000 (0:00:00.204) 0:00:40.121 ********** 2026-04-24 02:52:06.038289 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.038305 | orchestrator | 2026-04-24 02:52:06.038320 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:52:06.038336 | orchestrator | Friday 24 April 2026 02:52:05 +0000 (0:00:00.804) 0:00:40.926 ********** 2026-04-24 02:52:06.038350 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:06.038366 | orchestrator | 2026-04-24 02:52:06.038401 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-24 02:52:10.368816 | orchestrator | Friday 24 April 2026 02:52:06 +0000 (0:00:00.207) 0:00:41.134 ********** 2026-04-24 02:52:10.368901 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': None}) 2026-04-24 02:52:10.368911 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': None}) 2026-04-24 02:52:10.368919 | orchestrator | 2026-04-24 02:52:10.368927 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-24 02:52:10.368949 | orchestrator | Friday 24 April 2026 02:52:06 +0000 (0:00:00.178) 0:00:41.312 ********** 2026-04-24 02:52:10.368956 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.368964 | orchestrator | 2026-04-24 02:52:10.368970 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-24 02:52:10.368977 | orchestrator | Friday 24 April 2026 02:52:06 +0000 (0:00:00.143) 0:00:41.456 ********** 2026-04-24 02:52:10.368984 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.368991 | orchestrator | 2026-04-24 02:52:10.368997 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-24 02:52:10.369004 | orchestrator | Friday 24 April 2026 02:52:06 +0000 (0:00:00.160) 0:00:41.616 ********** 2026-04-24 02:52:10.369011 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369017 | orchestrator | 2026-04-24 02:52:10.369024 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-24 02:52:10.369031 | orchestrator | Friday 24 April 2026 02:52:06 +0000 (0:00:00.146) 0:00:41.762 ********** 2026-04-24 02:52:10.369037 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:52:10.369045 | orchestrator | 2026-04-24 02:52:10.369051 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-24 02:52:10.369058 | orchestrator | Friday 24 April 2026 02:52:06 +0000 (0:00:00.141) 0:00:41.904 ********** 2026-04-24 02:52:10.369065 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}}) 2026-04-24 02:52:10.369072 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '91b687e8-7bed-5064-bb30-d809c43c423f'}}) 2026-04-24 02:52:10.369079 | orchestrator | 2026-04-24 02:52:10.369085 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-24 02:52:10.369092 | orchestrator | Friday 24 April 2026 02:52:06 +0000 (0:00:00.187) 0:00:42.092 ********** 2026-04-24 02:52:10.369099 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}})  2026-04-24 02:52:10.369107 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '91b687e8-7bed-5064-bb30-d809c43c423f'}})  2026-04-24 02:52:10.369114 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369140 | orchestrator | 2026-04-24 02:52:10.369147 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-24 02:52:10.369154 | orchestrator | Friday 24 April 2026 02:52:07 +0000 (0:00:00.162) 0:00:42.255 ********** 2026-04-24 02:52:10.369160 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}})  2026-04-24 02:52:10.369167 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '91b687e8-7bed-5064-bb30-d809c43c423f'}})  2026-04-24 02:52:10.369174 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369180 | orchestrator | 2026-04-24 02:52:10.369187 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-24 02:52:10.369193 | orchestrator | Friday 24 April 2026 02:52:07 +0000 (0:00:00.181) 0:00:42.436 ********** 2026-04-24 02:52:10.369200 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}})  2026-04-24 02:52:10.369207 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '91b687e8-7bed-5064-bb30-d809c43c423f'}})  2026-04-24 02:52:10.369213 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369220 | orchestrator | 2026-04-24 02:52:10.369226 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-24 02:52:10.369233 | orchestrator | Friday 24 April 2026 02:52:07 +0000 (0:00:00.165) 0:00:42.602 ********** 2026-04-24 02:52:10.369240 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:52:10.369246 | orchestrator | 2026-04-24 02:52:10.369253 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-24 02:52:10.369259 | orchestrator | Friday 24 April 2026 02:52:07 +0000 (0:00:00.157) 0:00:42.759 ********** 2026-04-24 02:52:10.369266 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:52:10.369272 | orchestrator | 2026-04-24 02:52:10.369279 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-24 02:52:10.369285 | orchestrator | Friday 24 April 2026 02:52:08 +0000 (0:00:00.389) 0:00:43.148 ********** 2026-04-24 02:52:10.369292 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369300 | orchestrator | 2026-04-24 02:52:10.369307 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-24 02:52:10.369315 | orchestrator | Friday 24 April 2026 02:52:08 +0000 (0:00:00.159) 0:00:43.308 ********** 2026-04-24 02:52:10.369322 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369330 | orchestrator | 2026-04-24 02:52:10.369337 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-24 02:52:10.369345 | orchestrator | Friday 24 April 2026 02:52:08 +0000 (0:00:00.140) 0:00:43.448 ********** 2026-04-24 02:52:10.369352 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369360 | orchestrator | 2026-04-24 02:52:10.369367 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-24 02:52:10.369375 | orchestrator | Friday 24 April 2026 02:52:08 +0000 (0:00:00.145) 0:00:43.594 ********** 2026-04-24 02:52:10.369383 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 02:52:10.369390 | orchestrator |  "ceph_osd_devices": { 2026-04-24 02:52:10.369399 | orchestrator |  "sdb": { 2026-04-24 02:52:10.369418 | orchestrator |  "osd_lvm_uuid": "010e5db2-c467-553c-8ec0-8c3d6c1ddd71" 2026-04-24 02:52:10.369427 | orchestrator |  }, 2026-04-24 02:52:10.369434 | orchestrator |  "sdc": { 2026-04-24 02:52:10.369441 | orchestrator |  "osd_lvm_uuid": "91b687e8-7bed-5064-bb30-d809c43c423f" 2026-04-24 02:52:10.369452 | orchestrator |  } 2026-04-24 02:52:10.369464 | orchestrator |  } 2026-04-24 02:52:10.369476 | orchestrator | } 2026-04-24 02:52:10.369489 | orchestrator | 2026-04-24 02:52:10.369506 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-24 02:52:10.369520 | orchestrator | Friday 24 April 2026 02:52:08 +0000 (0:00:00.149) 0:00:43.744 ********** 2026-04-24 02:52:10.369533 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369554 | orchestrator | 2026-04-24 02:52:10.369568 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-24 02:52:10.369576 | orchestrator | Friday 24 April 2026 02:52:08 +0000 (0:00:00.139) 0:00:43.883 ********** 2026-04-24 02:52:10.369584 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369591 | orchestrator | 2026-04-24 02:52:10.369599 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-24 02:52:10.369607 | orchestrator | Friday 24 April 2026 02:52:08 +0000 (0:00:00.152) 0:00:44.036 ********** 2026-04-24 02:52:10.369614 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:52:10.369622 | orchestrator | 2026-04-24 02:52:10.369629 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-24 02:52:10.369637 | orchestrator | Friday 24 April 2026 02:52:09 +0000 (0:00:00.156) 0:00:44.193 ********** 2026-04-24 02:52:10.369645 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 02:52:10.369653 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-24 02:52:10.369661 | orchestrator |  "ceph_osd_devices": { 2026-04-24 02:52:10.369714 | orchestrator |  "sdb": { 2026-04-24 02:52:10.369730 | orchestrator |  "osd_lvm_uuid": "010e5db2-c467-553c-8ec0-8c3d6c1ddd71" 2026-04-24 02:52:10.369741 | orchestrator |  }, 2026-04-24 02:52:10.369751 | orchestrator |  "sdc": { 2026-04-24 02:52:10.369774 | orchestrator |  "osd_lvm_uuid": "91b687e8-7bed-5064-bb30-d809c43c423f" 2026-04-24 02:52:10.369781 | orchestrator |  } 2026-04-24 02:52:10.369788 | orchestrator |  }, 2026-04-24 02:52:10.369795 | orchestrator |  "lvm_volumes": [ 2026-04-24 02:52:10.369802 | orchestrator |  { 2026-04-24 02:52:10.369809 | orchestrator |  "data": "osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71", 2026-04-24 02:52:10.369816 | orchestrator |  "data_vg": "ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71" 2026-04-24 02:52:10.369822 | orchestrator |  }, 2026-04-24 02:52:10.369829 | orchestrator |  { 2026-04-24 02:52:10.369836 | orchestrator |  "data": "osd-block-91b687e8-7bed-5064-bb30-d809c43c423f", 2026-04-24 02:52:10.369842 | orchestrator |  "data_vg": "ceph-91b687e8-7bed-5064-bb30-d809c43c423f" 2026-04-24 02:52:10.369849 | orchestrator |  } 2026-04-24 02:52:10.369856 | orchestrator |  ] 2026-04-24 02:52:10.369863 | orchestrator |  } 2026-04-24 02:52:10.369869 | orchestrator | } 2026-04-24 02:52:10.369876 | orchestrator | 2026-04-24 02:52:10.369883 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-24 02:52:10.369890 | orchestrator | Friday 24 April 2026 02:52:09 +0000 (0:00:00.225) 0:00:44.419 ********** 2026-04-24 02:52:10.369896 | orchestrator | changed: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-24 02:52:10.369903 | orchestrator | 2026-04-24 02:52:10.369909 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:52:10.369916 | orchestrator | testbed-node-3 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-24 02:52:10.369924 | orchestrator | testbed-node-4 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-24 02:52:10.369931 | orchestrator | testbed-node-5 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-24 02:52:10.369938 | orchestrator | 2026-04-24 02:52:10.369944 | orchestrator | 2026-04-24 02:52:10.369951 | orchestrator | 2026-04-24 02:52:10.369958 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:52:10.369964 | orchestrator | Friday 24 April 2026 02:52:10 +0000 (0:00:01.039) 0:00:45.458 ********** 2026-04-24 02:52:10.369971 | orchestrator | =============================================================================== 2026-04-24 02:52:10.369978 | orchestrator | Write configuration file ------------------------------------------------ 4.14s 2026-04-24 02:52:10.369991 | orchestrator | Add known partitions to the list of available block devices ------------- 1.87s 2026-04-24 02:52:10.369998 | orchestrator | Add known links to the list of available block devices ------------------ 1.39s 2026-04-24 02:52:10.370005 | orchestrator | Add known partitions to the list of available block devices ------------- 1.15s 2026-04-24 02:52:10.370067 | orchestrator | Print configuration data ------------------------------------------------ 1.08s 2026-04-24 02:52:10.370075 | orchestrator | Add known partitions to the list of available block devices ------------- 0.91s 2026-04-24 02:52:10.370082 | orchestrator | Add known partitions to the list of available block devices ------------- 0.90s 2026-04-24 02:52:10.370089 | orchestrator | Add known links to the list of available block devices ------------------ 0.88s 2026-04-24 02:52:10.370097 | orchestrator | Add known partitions to the list of available block devices ------------- 0.80s 2026-04-24 02:52:10.370104 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 0.79s 2026-04-24 02:52:10.370111 | orchestrator | Get initial list of available block devices ----------------------------- 0.77s 2026-04-24 02:52:10.370118 | orchestrator | Generate lvm_volumes structure (block + wal) ---------------------------- 0.74s 2026-04-24 02:52:10.370126 | orchestrator | Add known links to the list of available block devices ------------------ 0.71s 2026-04-24 02:52:10.370142 | orchestrator | Generate lvm_volumes structure (block + db) ----------------------------- 0.70s 2026-04-24 02:52:10.803511 | orchestrator | Set OSD devices config data --------------------------------------------- 0.69s 2026-04-24 02:52:10.803612 | orchestrator | Add known links to the list of available block devices ------------------ 0.69s 2026-04-24 02:52:10.803627 | orchestrator | Add known partitions to the list of available block devices ------------- 0.67s 2026-04-24 02:52:10.803661 | orchestrator | Add known links to the list of available block devices ------------------ 0.66s 2026-04-24 02:52:10.803765 | orchestrator | Add known links to the list of available block devices ------------------ 0.64s 2026-04-24 02:52:10.803780 | orchestrator | Add known links to the list of available block devices ------------------ 0.64s 2026-04-24 02:52:33.328005 | orchestrator | 2026-04-24 02:52:33 | INFO  | Task 47b2dcf8-3570-4d65-816c-222fe3f76ae5 (sync inventory) is running in background. Output coming soon. 2026-04-24 02:53:01.984193 | orchestrator | 2026-04-24 02:52:34 | INFO  | Starting group_vars file reorganization 2026-04-24 02:53:01.984293 | orchestrator | 2026-04-24 02:52:34 | INFO  | Moved 0 file(s) to their respective directories 2026-04-24 02:53:01.984306 | orchestrator | 2026-04-24 02:52:34 | INFO  | Group_vars file reorganization completed 2026-04-24 02:53:01.984315 | orchestrator | 2026-04-24 02:52:37 | INFO  | Starting variable preparation from inventory 2026-04-24 02:53:01.984324 | orchestrator | 2026-04-24 02:52:40 | INFO  | Writing 050-kolla-ceph-rgw-hosts.yml with ceph_rgw_hosts 2026-04-24 02:53:01.984333 | orchestrator | 2026-04-24 02:52:40 | INFO  | Writing 050-infrastructure-cephclient-mons.yml with cephclient_mons 2026-04-24 02:53:01.984342 | orchestrator | 2026-04-24 02:52:40 | INFO  | Writing 050-ceph-cluster-fsid.yml with ceph_cluster_fsid 2026-04-24 02:53:01.984350 | orchestrator | 2026-04-24 02:52:40 | INFO  | 3 file(s) written, 6 host(s) processed 2026-04-24 02:53:01.984359 | orchestrator | 2026-04-24 02:52:40 | INFO  | Variable preparation completed 2026-04-24 02:53:01.984367 | orchestrator | 2026-04-24 02:52:42 | INFO  | Starting inventory overwrite handling 2026-04-24 02:53:01.984376 | orchestrator | 2026-04-24 02:52:42 | INFO  | Handling group overwrites in 99-overwrite 2026-04-24 02:53:01.984384 | orchestrator | 2026-04-24 02:52:42 | INFO  | Removing group frr:children from 60-generic 2026-04-24 02:53:01.984393 | orchestrator | 2026-04-24 02:52:42 | INFO  | Removing group netbird:children from 50-infrastructure 2026-04-24 02:53:01.984401 | orchestrator | 2026-04-24 02:52:42 | INFO  | Removing group ceph-mds from 50-ceph 2026-04-24 02:53:01.984432 | orchestrator | 2026-04-24 02:52:42 | INFO  | Removing group ceph-rgw from 50-ceph 2026-04-24 02:53:01.984441 | orchestrator | 2026-04-24 02:52:42 | INFO  | Handling group overwrites in 20-roles 2026-04-24 02:53:01.984450 | orchestrator | 2026-04-24 02:52:42 | INFO  | Removing group k3s_node from 50-infrastructure 2026-04-24 02:53:01.984459 | orchestrator | 2026-04-24 02:52:42 | INFO  | Removed 5 group(s) in total 2026-04-24 02:53:01.984467 | orchestrator | 2026-04-24 02:52:42 | INFO  | Inventory overwrite handling completed 2026-04-24 02:53:01.984476 | orchestrator | 2026-04-24 02:52:43 | INFO  | Starting merge of inventory files 2026-04-24 02:53:01.984484 | orchestrator | 2026-04-24 02:52:43 | INFO  | Inventory files merged successfully 2026-04-24 02:53:01.984492 | orchestrator | 2026-04-24 02:52:48 | INFO  | Generating ClusterShell configuration from Ansible inventory 2026-04-24 02:53:01.984501 | orchestrator | 2026-04-24 02:53:00 | INFO  | Successfully wrote ClusterShell configuration 2026-04-24 02:53:01.984510 | orchestrator | [master 5b941de] 2026-04-24-02-53 2026-04-24 02:53:01.984519 | orchestrator | 1 file changed, 30 insertions(+), 9 deletions(-) 2026-04-24 02:53:04.284594 | orchestrator | 2026-04-24 02:53:04 | INFO  | Task 59a78bc6-968a-41da-89f7-a62a0dc27440 (ceph-create-lvm-devices) was prepared for execution. 2026-04-24 02:53:04.284746 | orchestrator | 2026-04-24 02:53:04 | INFO  | It takes a moment until task 59a78bc6-968a-41da-89f7-a62a0dc27440 (ceph-create-lvm-devices) has been started and output is visible here. 2026-04-24 02:53:16.521376 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-24 02:53:16.521502 | orchestrator | 2.16.14 2026-04-24 02:53:16.521516 | orchestrator | 2026-04-24 02:53:16.521527 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-24 02:53:16.521536 | orchestrator | 2026-04-24 02:53:16.522336 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-24 02:53:16.522367 | orchestrator | Friday 24 April 2026 02:53:08 +0000 (0:00:00.328) 0:00:00.328 ********** 2026-04-24 02:53:16.522380 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 02:53:16.522390 | orchestrator | 2026-04-24 02:53:16.522400 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-24 02:53:16.522464 | orchestrator | Friday 24 April 2026 02:53:08 +0000 (0:00:00.245) 0:00:00.574 ********** 2026-04-24 02:53:16.522475 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:16.522486 | orchestrator | 2026-04-24 02:53:16.522497 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.522507 | orchestrator | Friday 24 April 2026 02:53:09 +0000 (0:00:00.260) 0:00:00.834 ********** 2026-04-24 02:53:16.522517 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop0) 2026-04-24 02:53:16.522527 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop1) 2026-04-24 02:53:16.522552 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop2) 2026-04-24 02:53:16.522562 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop3) 2026-04-24 02:53:16.522572 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop4) 2026-04-24 02:53:16.522582 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop5) 2026-04-24 02:53:16.522593 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop6) 2026-04-24 02:53:16.522603 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop7) 2026-04-24 02:53:16.522649 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sda) 2026-04-24 02:53:16.522668 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdb) 2026-04-24 02:53:16.522722 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdc) 2026-04-24 02:53:16.522732 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdd) 2026-04-24 02:53:16.522741 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sr0) 2026-04-24 02:53:16.522750 | orchestrator | 2026-04-24 02:53:16.522758 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.522767 | orchestrator | Friday 24 April 2026 02:53:09 +0000 (0:00:00.537) 0:00:01.371 ********** 2026-04-24 02:53:16.522780 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.522794 | orchestrator | 2026-04-24 02:53:16.522808 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.522823 | orchestrator | Friday 24 April 2026 02:53:09 +0000 (0:00:00.210) 0:00:01.582 ********** 2026-04-24 02:53:16.522837 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.522851 | orchestrator | 2026-04-24 02:53:16.522865 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.522879 | orchestrator | Friday 24 April 2026 02:53:10 +0000 (0:00:00.235) 0:00:01.817 ********** 2026-04-24 02:53:16.522893 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.522907 | orchestrator | 2026-04-24 02:53:16.522921 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.522935 | orchestrator | Friday 24 April 2026 02:53:10 +0000 (0:00:00.206) 0:00:02.024 ********** 2026-04-24 02:53:16.522949 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.522963 | orchestrator | 2026-04-24 02:53:16.522979 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.522993 | orchestrator | Friday 24 April 2026 02:53:10 +0000 (0:00:00.209) 0:00:02.233 ********** 2026-04-24 02:53:16.523008 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.523023 | orchestrator | 2026-04-24 02:53:16.523038 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.523050 | orchestrator | Friday 24 April 2026 02:53:10 +0000 (0:00:00.213) 0:00:02.446 ********** 2026-04-24 02:53:16.523059 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.523068 | orchestrator | 2026-04-24 02:53:16.523077 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.523085 | orchestrator | Friday 24 April 2026 02:53:11 +0000 (0:00:00.207) 0:00:02.653 ********** 2026-04-24 02:53:16.523094 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.523102 | orchestrator | 2026-04-24 02:53:16.523112 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.523126 | orchestrator | Friday 24 April 2026 02:53:11 +0000 (0:00:00.210) 0:00:02.864 ********** 2026-04-24 02:53:16.523140 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.523154 | orchestrator | 2026-04-24 02:53:16.523168 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.523182 | orchestrator | Friday 24 April 2026 02:53:11 +0000 (0:00:00.211) 0:00:03.075 ********** 2026-04-24 02:53:16.523196 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951) 2026-04-24 02:53:16.523213 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951) 2026-04-24 02:53:16.523228 | orchestrator | 2026-04-24 02:53:16.523244 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.523283 | orchestrator | Friday 24 April 2026 02:53:11 +0000 (0:00:00.426) 0:00:03.502 ********** 2026-04-24 02:53:16.523298 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23) 2026-04-24 02:53:16.523312 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23) 2026-04-24 02:53:16.523386 | orchestrator | 2026-04-24 02:53:16.523405 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.523470 | orchestrator | Friday 24 April 2026 02:53:12 +0000 (0:00:00.644) 0:00:04.147 ********** 2026-04-24 02:53:16.523486 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c) 2026-04-24 02:53:16.523501 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c) 2026-04-24 02:53:16.523516 | orchestrator | 2026-04-24 02:53:16.523531 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.523547 | orchestrator | Friday 24 April 2026 02:53:13 +0000 (0:00:00.686) 0:00:04.833 ********** 2026-04-24 02:53:16.523564 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76) 2026-04-24 02:53:16.523592 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76) 2026-04-24 02:53:16.523609 | orchestrator | 2026-04-24 02:53:16.523648 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:16.523663 | orchestrator | Friday 24 April 2026 02:53:14 +0000 (0:00:00.934) 0:00:05.768 ********** 2026-04-24 02:53:16.523678 | orchestrator | ok: [testbed-node-3] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-24 02:53:16.523692 | orchestrator | 2026-04-24 02:53:16.523705 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:16.523720 | orchestrator | Friday 24 April 2026 02:53:14 +0000 (0:00:00.355) 0:00:06.123 ********** 2026-04-24 02:53:16.523734 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop0) 2026-04-24 02:53:16.523749 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop1) 2026-04-24 02:53:16.523764 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop2) 2026-04-24 02:53:16.523779 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop3) 2026-04-24 02:53:16.523794 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop4) 2026-04-24 02:53:16.523809 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop5) 2026-04-24 02:53:16.523823 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop6) 2026-04-24 02:53:16.523836 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop7) 2026-04-24 02:53:16.523845 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sda) 2026-04-24 02:53:16.523853 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdb) 2026-04-24 02:53:16.523862 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdc) 2026-04-24 02:53:16.523870 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdd) 2026-04-24 02:53:16.523882 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sr0) 2026-04-24 02:53:16.523896 | orchestrator | 2026-04-24 02:53:16.523910 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:16.523925 | orchestrator | Friday 24 April 2026 02:53:14 +0000 (0:00:00.466) 0:00:06.589 ********** 2026-04-24 02:53:16.523940 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.523955 | orchestrator | 2026-04-24 02:53:16.523971 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:16.523987 | orchestrator | Friday 24 April 2026 02:53:15 +0000 (0:00:00.223) 0:00:06.813 ********** 2026-04-24 02:53:16.524001 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.524016 | orchestrator | 2026-04-24 02:53:16.524031 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:16.524045 | orchestrator | Friday 24 April 2026 02:53:15 +0000 (0:00:00.195) 0:00:07.008 ********** 2026-04-24 02:53:16.524060 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.524088 | orchestrator | 2026-04-24 02:53:16.524112 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:16.524120 | orchestrator | Friday 24 April 2026 02:53:15 +0000 (0:00:00.234) 0:00:07.243 ********** 2026-04-24 02:53:16.524129 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.524138 | orchestrator | 2026-04-24 02:53:16.524146 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:16.524155 | orchestrator | Friday 24 April 2026 02:53:15 +0000 (0:00:00.216) 0:00:07.459 ********** 2026-04-24 02:53:16.524164 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.524172 | orchestrator | 2026-04-24 02:53:16.524181 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:16.524189 | orchestrator | Friday 24 April 2026 02:53:16 +0000 (0:00:00.231) 0:00:07.691 ********** 2026-04-24 02:53:16.524198 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.524206 | orchestrator | 2026-04-24 02:53:16.524215 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:16.524223 | orchestrator | Friday 24 April 2026 02:53:16 +0000 (0:00:00.246) 0:00:07.937 ********** 2026-04-24 02:53:16.524232 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:16.524240 | orchestrator | 2026-04-24 02:53:16.524260 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:25.060448 | orchestrator | Friday 24 April 2026 02:53:16 +0000 (0:00:00.210) 0:00:08.148 ********** 2026-04-24 02:53:25.060562 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.060580 | orchestrator | 2026-04-24 02:53:25.060593 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:25.060658 | orchestrator | Friday 24 April 2026 02:53:17 +0000 (0:00:00.726) 0:00:08.875 ********** 2026-04-24 02:53:25.060673 | orchestrator | ok: [testbed-node-3] => (item=sda1) 2026-04-24 02:53:25.060685 | orchestrator | ok: [testbed-node-3] => (item=sda14) 2026-04-24 02:53:25.060697 | orchestrator | ok: [testbed-node-3] => (item=sda15) 2026-04-24 02:53:25.060708 | orchestrator | ok: [testbed-node-3] => (item=sda16) 2026-04-24 02:53:25.060720 | orchestrator | 2026-04-24 02:53:25.060731 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:25.060743 | orchestrator | Friday 24 April 2026 02:53:17 +0000 (0:00:00.690) 0:00:09.565 ********** 2026-04-24 02:53:25.060754 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.060764 | orchestrator | 2026-04-24 02:53:25.060776 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:25.060787 | orchestrator | Friday 24 April 2026 02:53:18 +0000 (0:00:00.222) 0:00:09.788 ********** 2026-04-24 02:53:25.060798 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.060809 | orchestrator | 2026-04-24 02:53:25.060836 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:25.060848 | orchestrator | Friday 24 April 2026 02:53:18 +0000 (0:00:00.211) 0:00:09.999 ********** 2026-04-24 02:53:25.060859 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.060870 | orchestrator | 2026-04-24 02:53:25.060881 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:25.060892 | orchestrator | Friday 24 April 2026 02:53:18 +0000 (0:00:00.217) 0:00:10.216 ********** 2026-04-24 02:53:25.060903 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.060914 | orchestrator | 2026-04-24 02:53:25.060925 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-24 02:53:25.060936 | orchestrator | Friday 24 April 2026 02:53:18 +0000 (0:00:00.210) 0:00:10.427 ********** 2026-04-24 02:53:25.060947 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.060958 | orchestrator | 2026-04-24 02:53:25.060969 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-24 02:53:25.060983 | orchestrator | Friday 24 April 2026 02:53:18 +0000 (0:00:00.151) 0:00:10.579 ********** 2026-04-24 02:53:25.060996 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}}) 2026-04-24 02:53:25.061035 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '02e41f6c-bc12-5c7e-a521-6aced039912f'}}) 2026-04-24 02:53:25.061048 | orchestrator | 2026-04-24 02:53:25.061062 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-24 02:53:25.061076 | orchestrator | Friday 24 April 2026 02:53:19 +0000 (0:00:00.200) 0:00:10.779 ********** 2026-04-24 02:53:25.061104 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}) 2026-04-24 02:53:25.061117 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}) 2026-04-24 02:53:25.061128 | orchestrator | 2026-04-24 02:53:25.061139 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-24 02:53:25.061150 | orchestrator | Friday 24 April 2026 02:53:21 +0000 (0:00:02.055) 0:00:12.834 ********** 2026-04-24 02:53:25.061162 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:25.061182 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:25.061201 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061219 | orchestrator | 2026-04-24 02:53:25.061237 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-24 02:53:25.061255 | orchestrator | Friday 24 April 2026 02:53:21 +0000 (0:00:00.180) 0:00:13.015 ********** 2026-04-24 02:53:25.061273 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}) 2026-04-24 02:53:25.061291 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}) 2026-04-24 02:53:25.061309 | orchestrator | 2026-04-24 02:53:25.061328 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-24 02:53:25.061347 | orchestrator | Friday 24 April 2026 02:53:22 +0000 (0:00:01.521) 0:00:14.536 ********** 2026-04-24 02:53:25.061366 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:25.061385 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:25.061405 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061416 | orchestrator | 2026-04-24 02:53:25.061427 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-24 02:53:25.061438 | orchestrator | Friday 24 April 2026 02:53:23 +0000 (0:00:00.160) 0:00:14.697 ********** 2026-04-24 02:53:25.061469 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061481 | orchestrator | 2026-04-24 02:53:25.061492 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-24 02:53:25.061503 | orchestrator | Friday 24 April 2026 02:53:23 +0000 (0:00:00.372) 0:00:15.070 ********** 2026-04-24 02:53:25.061513 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:25.061524 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:25.061535 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061546 | orchestrator | 2026-04-24 02:53:25.061556 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-24 02:53:25.061567 | orchestrator | Friday 24 April 2026 02:53:23 +0000 (0:00:00.162) 0:00:15.233 ********** 2026-04-24 02:53:25.061589 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061600 | orchestrator | 2026-04-24 02:53:25.061660 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-24 02:53:25.061672 | orchestrator | Friday 24 April 2026 02:53:23 +0000 (0:00:00.138) 0:00:15.371 ********** 2026-04-24 02:53:25.061690 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:25.061701 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:25.061712 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061723 | orchestrator | 2026-04-24 02:53:25.061734 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-24 02:53:25.061745 | orchestrator | Friday 24 April 2026 02:53:23 +0000 (0:00:00.176) 0:00:15.547 ********** 2026-04-24 02:53:25.061756 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061766 | orchestrator | 2026-04-24 02:53:25.061777 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-24 02:53:25.061788 | orchestrator | Friday 24 April 2026 02:53:24 +0000 (0:00:00.160) 0:00:15.708 ********** 2026-04-24 02:53:25.061799 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:25.061810 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:25.061820 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061831 | orchestrator | 2026-04-24 02:53:25.061842 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-24 02:53:25.061853 | orchestrator | Friday 24 April 2026 02:53:24 +0000 (0:00:00.182) 0:00:15.890 ********** 2026-04-24 02:53:25.061864 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:25.061875 | orchestrator | 2026-04-24 02:53:25.061886 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-24 02:53:25.061896 | orchestrator | Friday 24 April 2026 02:53:24 +0000 (0:00:00.160) 0:00:16.050 ********** 2026-04-24 02:53:25.061907 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:25.061918 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:25.061929 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.061939 | orchestrator | 2026-04-24 02:53:25.061950 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-24 02:53:25.061961 | orchestrator | Friday 24 April 2026 02:53:24 +0000 (0:00:00.148) 0:00:16.199 ********** 2026-04-24 02:53:25.061972 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:25.061983 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:25.061993 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.062004 | orchestrator | 2026-04-24 02:53:25.062015 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-24 02:53:25.062148 | orchestrator | Friday 24 April 2026 02:53:24 +0000 (0:00:00.162) 0:00:16.362 ********** 2026-04-24 02:53:25.062159 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:25.062171 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:25.062191 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.062202 | orchestrator | 2026-04-24 02:53:25.062213 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-24 02:53:25.062224 | orchestrator | Friday 24 April 2026 02:53:24 +0000 (0:00:00.184) 0:00:16.547 ********** 2026-04-24 02:53:25.062235 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:25.062245 | orchestrator | 2026-04-24 02:53:25.062256 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-24 02:53:25.062276 | orchestrator | Friday 24 April 2026 02:53:25 +0000 (0:00:00.143) 0:00:16.690 ********** 2026-04-24 02:53:31.906636 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.906775 | orchestrator | 2026-04-24 02:53:31.906790 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-24 02:53:31.906801 | orchestrator | Friday 24 April 2026 02:53:25 +0000 (0:00:00.150) 0:00:16.841 ********** 2026-04-24 02:53:31.906810 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.906820 | orchestrator | 2026-04-24 02:53:31.906829 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-24 02:53:31.906838 | orchestrator | Friday 24 April 2026 02:53:25 +0000 (0:00:00.365) 0:00:17.207 ********** 2026-04-24 02:53:31.906847 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 02:53:31.906856 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-24 02:53:31.906866 | orchestrator | } 2026-04-24 02:53:31.906875 | orchestrator | 2026-04-24 02:53:31.906884 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-24 02:53:31.906892 | orchestrator | Friday 24 April 2026 02:53:25 +0000 (0:00:00.148) 0:00:17.355 ********** 2026-04-24 02:53:31.906901 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 02:53:31.906910 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-24 02:53:31.906918 | orchestrator | } 2026-04-24 02:53:31.906927 | orchestrator | 2026-04-24 02:53:31.906936 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-24 02:53:31.906963 | orchestrator | Friday 24 April 2026 02:53:25 +0000 (0:00:00.159) 0:00:17.514 ********** 2026-04-24 02:53:31.906972 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 02:53:31.906981 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-24 02:53:31.906990 | orchestrator | } 2026-04-24 02:53:31.906998 | orchestrator | 2026-04-24 02:53:31.907007 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-24 02:53:31.907016 | orchestrator | Friday 24 April 2026 02:53:26 +0000 (0:00:00.165) 0:00:17.679 ********** 2026-04-24 02:53:31.907025 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:31.907033 | orchestrator | 2026-04-24 02:53:31.907042 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-24 02:53:31.907051 | orchestrator | Friday 24 April 2026 02:53:26 +0000 (0:00:00.684) 0:00:18.364 ********** 2026-04-24 02:53:31.907060 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:31.907068 | orchestrator | 2026-04-24 02:53:31.907077 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-24 02:53:31.907086 | orchestrator | Friday 24 April 2026 02:53:27 +0000 (0:00:00.540) 0:00:18.904 ********** 2026-04-24 02:53:31.907094 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:31.907103 | orchestrator | 2026-04-24 02:53:31.907112 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-24 02:53:31.907120 | orchestrator | Friday 24 April 2026 02:53:27 +0000 (0:00:00.556) 0:00:19.461 ********** 2026-04-24 02:53:31.907129 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:31.907138 | orchestrator | 2026-04-24 02:53:31.907147 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-24 02:53:31.907155 | orchestrator | Friday 24 April 2026 02:53:27 +0000 (0:00:00.155) 0:00:19.616 ********** 2026-04-24 02:53:31.907164 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907173 | orchestrator | 2026-04-24 02:53:31.907182 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-24 02:53:31.907211 | orchestrator | Friday 24 April 2026 02:53:28 +0000 (0:00:00.124) 0:00:19.740 ********** 2026-04-24 02:53:31.907221 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907229 | orchestrator | 2026-04-24 02:53:31.907238 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-24 02:53:31.907247 | orchestrator | Friday 24 April 2026 02:53:28 +0000 (0:00:00.123) 0:00:19.864 ********** 2026-04-24 02:53:31.907256 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 02:53:31.907264 | orchestrator |  "vgs_report": { 2026-04-24 02:53:31.907273 | orchestrator |  "vg": [] 2026-04-24 02:53:31.907282 | orchestrator |  } 2026-04-24 02:53:31.907291 | orchestrator | } 2026-04-24 02:53:31.907300 | orchestrator | 2026-04-24 02:53:31.907309 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-24 02:53:31.907318 | orchestrator | Friday 24 April 2026 02:53:28 +0000 (0:00:00.164) 0:00:20.028 ********** 2026-04-24 02:53:31.907326 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907335 | orchestrator | 2026-04-24 02:53:31.907344 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-24 02:53:31.907353 | orchestrator | Friday 24 April 2026 02:53:28 +0000 (0:00:00.142) 0:00:20.170 ********** 2026-04-24 02:53:31.907361 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907370 | orchestrator | 2026-04-24 02:53:31.907378 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-24 02:53:31.907387 | orchestrator | Friday 24 April 2026 02:53:28 +0000 (0:00:00.367) 0:00:20.538 ********** 2026-04-24 02:53:31.907395 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907404 | orchestrator | 2026-04-24 02:53:31.907413 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-24 02:53:31.907421 | orchestrator | Friday 24 April 2026 02:53:29 +0000 (0:00:00.148) 0:00:20.687 ********** 2026-04-24 02:53:31.907430 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907438 | orchestrator | 2026-04-24 02:53:31.907450 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-24 02:53:31.907464 | orchestrator | Friday 24 April 2026 02:53:29 +0000 (0:00:00.150) 0:00:20.837 ********** 2026-04-24 02:53:31.907478 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907492 | orchestrator | 2026-04-24 02:53:31.907505 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-24 02:53:31.907517 | orchestrator | Friday 24 April 2026 02:53:29 +0000 (0:00:00.148) 0:00:20.986 ********** 2026-04-24 02:53:31.907530 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907545 | orchestrator | 2026-04-24 02:53:31.907559 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-24 02:53:31.907573 | orchestrator | Friday 24 April 2026 02:53:29 +0000 (0:00:00.147) 0:00:21.133 ********** 2026-04-24 02:53:31.907588 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907652 | orchestrator | 2026-04-24 02:53:31.907663 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-24 02:53:31.907672 | orchestrator | Friday 24 April 2026 02:53:29 +0000 (0:00:00.146) 0:00:21.279 ********** 2026-04-24 02:53:31.907700 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907709 | orchestrator | 2026-04-24 02:53:31.907718 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-24 02:53:31.907727 | orchestrator | Friday 24 April 2026 02:53:29 +0000 (0:00:00.145) 0:00:21.424 ********** 2026-04-24 02:53:31.907737 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907755 | orchestrator | 2026-04-24 02:53:31.907778 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-24 02:53:31.907792 | orchestrator | Friday 24 April 2026 02:53:29 +0000 (0:00:00.133) 0:00:21.558 ********** 2026-04-24 02:53:31.907806 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907820 | orchestrator | 2026-04-24 02:53:31.907833 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-24 02:53:31.907846 | orchestrator | Friday 24 April 2026 02:53:30 +0000 (0:00:00.159) 0:00:21.718 ********** 2026-04-24 02:53:31.907874 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907889 | orchestrator | 2026-04-24 02:53:31.907903 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-24 02:53:31.907919 | orchestrator | Friday 24 April 2026 02:53:30 +0000 (0:00:00.145) 0:00:21.864 ********** 2026-04-24 02:53:31.907933 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907948 | orchestrator | 2026-04-24 02:53:31.907966 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-24 02:53:31.907976 | orchestrator | Friday 24 April 2026 02:53:30 +0000 (0:00:00.151) 0:00:22.015 ********** 2026-04-24 02:53:31.907984 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.907993 | orchestrator | 2026-04-24 02:53:31.908001 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-24 02:53:31.908010 | orchestrator | Friday 24 April 2026 02:53:30 +0000 (0:00:00.140) 0:00:22.155 ********** 2026-04-24 02:53:31.908018 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.908027 | orchestrator | 2026-04-24 02:53:31.908035 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-24 02:53:31.908044 | orchestrator | Friday 24 April 2026 02:53:30 +0000 (0:00:00.357) 0:00:22.513 ********** 2026-04-24 02:53:31.908054 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:31.908064 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:31.908073 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.908081 | orchestrator | 2026-04-24 02:53:31.908090 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-24 02:53:31.908098 | orchestrator | Friday 24 April 2026 02:53:31 +0000 (0:00:00.200) 0:00:22.713 ********** 2026-04-24 02:53:31.908107 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:31.908116 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:31.908124 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.908133 | orchestrator | 2026-04-24 02:53:31.908141 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-24 02:53:31.908150 | orchestrator | Friday 24 April 2026 02:53:31 +0000 (0:00:00.163) 0:00:22.877 ********** 2026-04-24 02:53:31.908158 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:31.908167 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:31.908176 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.908184 | orchestrator | 2026-04-24 02:53:31.908193 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-24 02:53:31.908201 | orchestrator | Friday 24 April 2026 02:53:31 +0000 (0:00:00.164) 0:00:23.041 ********** 2026-04-24 02:53:31.908210 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:31.908218 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:31.908227 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.908236 | orchestrator | 2026-04-24 02:53:31.908244 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-24 02:53:31.908253 | orchestrator | Friday 24 April 2026 02:53:31 +0000 (0:00:00.161) 0:00:23.203 ********** 2026-04-24 02:53:31.908267 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:31.908276 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:31.908284 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:31.908293 | orchestrator | 2026-04-24 02:53:31.908301 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-24 02:53:31.908310 | orchestrator | Friday 24 April 2026 02:53:31 +0000 (0:00:00.171) 0:00:23.374 ********** 2026-04-24 02:53:31.908328 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:37.415460 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:37.416972 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:37.418356 | orchestrator | 2026-04-24 02:53:37.418376 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-24 02:53:37.418397 | orchestrator | Friday 24 April 2026 02:53:31 +0000 (0:00:00.162) 0:00:23.536 ********** 2026-04-24 02:53:37.418406 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:37.418416 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:37.418423 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:37.418431 | orchestrator | 2026-04-24 02:53:37.418464 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-24 02:53:37.418472 | orchestrator | Friday 24 April 2026 02:53:32 +0000 (0:00:00.159) 0:00:23.695 ********** 2026-04-24 02:53:37.418480 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:37.418488 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:37.418495 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:37.418502 | orchestrator | 2026-04-24 02:53:37.418509 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-24 02:53:37.418517 | orchestrator | Friday 24 April 2026 02:53:32 +0000 (0:00:00.171) 0:00:23.867 ********** 2026-04-24 02:53:37.418524 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:37.418532 | orchestrator | 2026-04-24 02:53:37.418539 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-24 02:53:37.418547 | orchestrator | Friday 24 April 2026 02:53:32 +0000 (0:00:00.531) 0:00:24.398 ********** 2026-04-24 02:53:37.418554 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:37.418561 | orchestrator | 2026-04-24 02:53:37.418568 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-24 02:53:37.418575 | orchestrator | Friday 24 April 2026 02:53:33 +0000 (0:00:00.571) 0:00:24.970 ********** 2026-04-24 02:53:37.418582 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:53:37.418589 | orchestrator | 2026-04-24 02:53:37.418612 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-24 02:53:37.418621 | orchestrator | Friday 24 April 2026 02:53:33 +0000 (0:00:00.158) 0:00:25.128 ********** 2026-04-24 02:53:37.418629 | orchestrator | ok: [testbed-node-3] => (item={'lv_name': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'vg_name': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}) 2026-04-24 02:53:37.418638 | orchestrator | ok: [testbed-node-3] => (item={'lv_name': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'vg_name': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}) 2026-04-24 02:53:37.418666 | orchestrator | 2026-04-24 02:53:37.418674 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-24 02:53:37.418681 | orchestrator | Friday 24 April 2026 02:53:33 +0000 (0:00:00.177) 0:00:25.305 ********** 2026-04-24 02:53:37.418688 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:37.418696 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:37.418703 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:37.418710 | orchestrator | 2026-04-24 02:53:37.418717 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-24 02:53:37.418724 | orchestrator | Friday 24 April 2026 02:53:34 +0000 (0:00:00.391) 0:00:25.697 ********** 2026-04-24 02:53:37.418731 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:37.418739 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:37.418746 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:37.418753 | orchestrator | 2026-04-24 02:53:37.418760 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-24 02:53:37.418767 | orchestrator | Friday 24 April 2026 02:53:34 +0000 (0:00:00.158) 0:00:25.855 ********** 2026-04-24 02:53:37.418774 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 02:53:37.418781 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 02:53:37.418788 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:53:37.418795 | orchestrator | 2026-04-24 02:53:37.418802 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-24 02:53:37.418810 | orchestrator | Friday 24 April 2026 02:53:34 +0000 (0:00:00.161) 0:00:26.017 ********** 2026-04-24 02:53:37.418838 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 02:53:37.418846 | orchestrator |  "lvm_report": { 2026-04-24 02:53:37.418853 | orchestrator |  "lv": [ 2026-04-24 02:53:37.418860 | orchestrator |  { 2026-04-24 02:53:37.418868 | orchestrator |  "lv_name": "osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f", 2026-04-24 02:53:37.418875 | orchestrator |  "vg_name": "ceph-02e41f6c-bc12-5c7e-a521-6aced039912f" 2026-04-24 02:53:37.418883 | orchestrator |  }, 2026-04-24 02:53:37.418890 | orchestrator |  { 2026-04-24 02:53:37.418897 | orchestrator |  "lv_name": "osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3", 2026-04-24 02:53:37.418904 | orchestrator |  "vg_name": "ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3" 2026-04-24 02:53:37.418911 | orchestrator |  } 2026-04-24 02:53:37.418918 | orchestrator |  ], 2026-04-24 02:53:37.418925 | orchestrator |  "pv": [ 2026-04-24 02:53:37.418932 | orchestrator |  { 2026-04-24 02:53:37.418940 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-24 02:53:37.418947 | orchestrator |  "vg_name": "ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3" 2026-04-24 02:53:37.418954 | orchestrator |  }, 2026-04-24 02:53:37.418961 | orchestrator |  { 2026-04-24 02:53:37.418972 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-24 02:53:37.418980 | orchestrator |  "vg_name": "ceph-02e41f6c-bc12-5c7e-a521-6aced039912f" 2026-04-24 02:53:37.418987 | orchestrator |  } 2026-04-24 02:53:37.418994 | orchestrator |  ] 2026-04-24 02:53:37.419001 | orchestrator |  } 2026-04-24 02:53:37.419008 | orchestrator | } 2026-04-24 02:53:37.419022 | orchestrator | 2026-04-24 02:53:37.419029 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-24 02:53:37.419036 | orchestrator | 2026-04-24 02:53:37.419044 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-24 02:53:37.419051 | orchestrator | Friday 24 April 2026 02:53:34 +0000 (0:00:00.313) 0:00:26.330 ********** 2026-04-24 02:53:37.419058 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-24 02:53:37.419065 | orchestrator | 2026-04-24 02:53:37.419072 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-24 02:53:37.419079 | orchestrator | Friday 24 April 2026 02:53:34 +0000 (0:00:00.254) 0:00:26.585 ********** 2026-04-24 02:53:37.419087 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:53:37.419094 | orchestrator | 2026-04-24 02:53:37.419101 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:37.419108 | orchestrator | Friday 24 April 2026 02:53:35 +0000 (0:00:00.241) 0:00:26.827 ********** 2026-04-24 02:53:37.419115 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop0) 2026-04-24 02:53:37.419122 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop1) 2026-04-24 02:53:37.419129 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop2) 2026-04-24 02:53:37.419136 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop3) 2026-04-24 02:53:37.419143 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop4) 2026-04-24 02:53:37.419150 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop5) 2026-04-24 02:53:37.419157 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop6) 2026-04-24 02:53:37.419164 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop7) 2026-04-24 02:53:37.419171 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sda) 2026-04-24 02:53:37.419178 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdb) 2026-04-24 02:53:37.419185 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdc) 2026-04-24 02:53:37.419192 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdd) 2026-04-24 02:53:37.419200 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sr0) 2026-04-24 02:53:37.419207 | orchestrator | 2026-04-24 02:53:37.419214 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:37.419221 | orchestrator | Friday 24 April 2026 02:53:35 +0000 (0:00:00.424) 0:00:27.252 ********** 2026-04-24 02:53:37.419228 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:37.419235 | orchestrator | 2026-04-24 02:53:37.419242 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:37.419249 | orchestrator | Friday 24 April 2026 02:53:35 +0000 (0:00:00.200) 0:00:27.453 ********** 2026-04-24 02:53:37.419256 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:37.419263 | orchestrator | 2026-04-24 02:53:37.419270 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:37.419278 | orchestrator | Friday 24 April 2026 02:53:36 +0000 (0:00:00.667) 0:00:28.120 ********** 2026-04-24 02:53:37.419285 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:37.419292 | orchestrator | 2026-04-24 02:53:37.419299 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:37.419306 | orchestrator | Friday 24 April 2026 02:53:36 +0000 (0:00:00.239) 0:00:28.359 ********** 2026-04-24 02:53:37.419313 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:37.419320 | orchestrator | 2026-04-24 02:53:37.419327 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:37.419335 | orchestrator | Friday 24 April 2026 02:53:36 +0000 (0:00:00.229) 0:00:28.589 ********** 2026-04-24 02:53:37.419347 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:37.419354 | orchestrator | 2026-04-24 02:53:37.419361 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:37.419368 | orchestrator | Friday 24 April 2026 02:53:37 +0000 (0:00:00.223) 0:00:28.812 ********** 2026-04-24 02:53:37.419375 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:37.419382 | orchestrator | 2026-04-24 02:53:37.419394 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:48.868211 | orchestrator | Friday 24 April 2026 02:53:37 +0000 (0:00:00.230) 0:00:29.042 ********** 2026-04-24 02:53:48.868329 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.868345 | orchestrator | 2026-04-24 02:53:48.868358 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:48.868370 | orchestrator | Friday 24 April 2026 02:53:37 +0000 (0:00:00.207) 0:00:29.250 ********** 2026-04-24 02:53:48.868381 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.868392 | orchestrator | 2026-04-24 02:53:48.868404 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:48.868415 | orchestrator | Friday 24 April 2026 02:53:37 +0000 (0:00:00.220) 0:00:29.470 ********** 2026-04-24 02:53:48.868427 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b) 2026-04-24 02:53:48.868439 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b) 2026-04-24 02:53:48.868450 | orchestrator | 2026-04-24 02:53:48.868478 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:48.868490 | orchestrator | Friday 24 April 2026 02:53:38 +0000 (0:00:00.457) 0:00:29.927 ********** 2026-04-24 02:53:48.868501 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5) 2026-04-24 02:53:48.868513 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5) 2026-04-24 02:53:48.868524 | orchestrator | 2026-04-24 02:53:48.868535 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:48.868546 | orchestrator | Friday 24 April 2026 02:53:38 +0000 (0:00:00.466) 0:00:30.394 ********** 2026-04-24 02:53:48.868557 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1) 2026-04-24 02:53:48.868568 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1) 2026-04-24 02:53:48.868579 | orchestrator | 2026-04-24 02:53:48.868665 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:48.868678 | orchestrator | Friday 24 April 2026 02:53:39 +0000 (0:00:00.731) 0:00:31.126 ********** 2026-04-24 02:53:48.868689 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd) 2026-04-24 02:53:48.868700 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd) 2026-04-24 02:53:48.868711 | orchestrator | 2026-04-24 02:53:48.868723 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:53:48.868747 | orchestrator | Friday 24 April 2026 02:53:40 +0000 (0:00:00.980) 0:00:32.106 ********** 2026-04-24 02:53:48.868761 | orchestrator | ok: [testbed-node-4] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-24 02:53:48.868773 | orchestrator | 2026-04-24 02:53:48.868797 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.868811 | orchestrator | Friday 24 April 2026 02:53:40 +0000 (0:00:00.371) 0:00:32.478 ********** 2026-04-24 02:53:48.868824 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop0) 2026-04-24 02:53:48.868837 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop1) 2026-04-24 02:53:48.868848 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop2) 2026-04-24 02:53:48.868885 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop3) 2026-04-24 02:53:48.868896 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop4) 2026-04-24 02:53:48.868908 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop5) 2026-04-24 02:53:48.868918 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop6) 2026-04-24 02:53:48.868936 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop7) 2026-04-24 02:53:48.868955 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sda) 2026-04-24 02:53:48.868973 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdb) 2026-04-24 02:53:48.868992 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdc) 2026-04-24 02:53:48.869012 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdd) 2026-04-24 02:53:48.869030 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sr0) 2026-04-24 02:53:48.869049 | orchestrator | 2026-04-24 02:53:48.869067 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869085 | orchestrator | Friday 24 April 2026 02:53:41 +0000 (0:00:00.447) 0:00:32.926 ********** 2026-04-24 02:53:48.869104 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869122 | orchestrator | 2026-04-24 02:53:48.869139 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869156 | orchestrator | Friday 24 April 2026 02:53:41 +0000 (0:00:00.220) 0:00:33.147 ********** 2026-04-24 02:53:48.869175 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869193 | orchestrator | 2026-04-24 02:53:48.869211 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869229 | orchestrator | Friday 24 April 2026 02:53:41 +0000 (0:00:00.224) 0:00:33.371 ********** 2026-04-24 02:53:48.869248 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869269 | orchestrator | 2026-04-24 02:53:48.869313 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869335 | orchestrator | Friday 24 April 2026 02:53:41 +0000 (0:00:00.232) 0:00:33.603 ********** 2026-04-24 02:53:48.869355 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869375 | orchestrator | 2026-04-24 02:53:48.869394 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869411 | orchestrator | Friday 24 April 2026 02:53:42 +0000 (0:00:00.223) 0:00:33.827 ********** 2026-04-24 02:53:48.869429 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869448 | orchestrator | 2026-04-24 02:53:48.869467 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869486 | orchestrator | Friday 24 April 2026 02:53:42 +0000 (0:00:00.197) 0:00:34.024 ********** 2026-04-24 02:53:48.869505 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869524 | orchestrator | 2026-04-24 02:53:48.869542 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869561 | orchestrator | Friday 24 April 2026 02:53:42 +0000 (0:00:00.223) 0:00:34.248 ********** 2026-04-24 02:53:48.869619 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869632 | orchestrator | 2026-04-24 02:53:48.869643 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869654 | orchestrator | Friday 24 April 2026 02:53:42 +0000 (0:00:00.223) 0:00:34.471 ********** 2026-04-24 02:53:48.869664 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869675 | orchestrator | 2026-04-24 02:53:48.869686 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869697 | orchestrator | Friday 24 April 2026 02:53:43 +0000 (0:00:00.646) 0:00:35.117 ********** 2026-04-24 02:53:48.869707 | orchestrator | ok: [testbed-node-4] => (item=sda1) 2026-04-24 02:53:48.869731 | orchestrator | ok: [testbed-node-4] => (item=sda14) 2026-04-24 02:53:48.869742 | orchestrator | ok: [testbed-node-4] => (item=sda15) 2026-04-24 02:53:48.869753 | orchestrator | ok: [testbed-node-4] => (item=sda16) 2026-04-24 02:53:48.869764 | orchestrator | 2026-04-24 02:53:48.869775 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869785 | orchestrator | Friday 24 April 2026 02:53:44 +0000 (0:00:00.680) 0:00:35.798 ********** 2026-04-24 02:53:48.869796 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869807 | orchestrator | 2026-04-24 02:53:48.869817 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869828 | orchestrator | Friday 24 April 2026 02:53:44 +0000 (0:00:00.245) 0:00:36.044 ********** 2026-04-24 02:53:48.869838 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869849 | orchestrator | 2026-04-24 02:53:48.869860 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869871 | orchestrator | Friday 24 April 2026 02:53:44 +0000 (0:00:00.237) 0:00:36.281 ********** 2026-04-24 02:53:48.869887 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869905 | orchestrator | 2026-04-24 02:53:48.869923 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:53:48.869941 | orchestrator | Friday 24 April 2026 02:53:44 +0000 (0:00:00.226) 0:00:36.508 ********** 2026-04-24 02:53:48.869958 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.869976 | orchestrator | 2026-04-24 02:53:48.869994 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-24 02:53:48.870012 | orchestrator | Friday 24 April 2026 02:53:45 +0000 (0:00:00.240) 0:00:36.749 ********** 2026-04-24 02:53:48.870108 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.870128 | orchestrator | 2026-04-24 02:53:48.870145 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-24 02:53:48.870162 | orchestrator | Friday 24 April 2026 02:53:45 +0000 (0:00:00.153) 0:00:36.902 ********** 2026-04-24 02:53:48.870182 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd69a3297-462a-55c2-bfb1-0665b5ed4cb1'}}) 2026-04-24 02:53:48.870201 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '33584b54-1593-569e-98b0-f98fe2b18be3'}}) 2026-04-24 02:53:48.870218 | orchestrator | 2026-04-24 02:53:48.870237 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-24 02:53:48.870256 | orchestrator | Friday 24 April 2026 02:53:45 +0000 (0:00:00.208) 0:00:37.110 ********** 2026-04-24 02:53:48.870271 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}) 2026-04-24 02:53:48.870284 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}) 2026-04-24 02:53:48.870294 | orchestrator | 2026-04-24 02:53:48.870305 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-24 02:53:48.870316 | orchestrator | Friday 24 April 2026 02:53:47 +0000 (0:00:01.868) 0:00:38.979 ********** 2026-04-24 02:53:48.870326 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:53:48.870342 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:53:48.870360 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:48.870379 | orchestrator | 2026-04-24 02:53:48.870398 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-24 02:53:48.870416 | orchestrator | Friday 24 April 2026 02:53:47 +0000 (0:00:00.184) 0:00:39.163 ********** 2026-04-24 02:53:48.870433 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}) 2026-04-24 02:53:48.870483 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}) 2026-04-24 02:53:55.112728 | orchestrator | 2026-04-24 02:53:55.112831 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-24 02:53:55.112845 | orchestrator | Friday 24 April 2026 02:53:48 +0000 (0:00:01.332) 0:00:40.496 ********** 2026-04-24 02:53:55.112856 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:53:55.112867 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:53:55.112876 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.112886 | orchestrator | 2026-04-24 02:53:55.112910 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-24 02:53:55.112919 | orchestrator | Friday 24 April 2026 02:53:49 +0000 (0:00:00.394) 0:00:40.890 ********** 2026-04-24 02:53:55.112927 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.112936 | orchestrator | 2026-04-24 02:53:55.112944 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-24 02:53:55.112953 | orchestrator | Friday 24 April 2026 02:53:49 +0000 (0:00:00.159) 0:00:41.050 ********** 2026-04-24 02:53:55.112962 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:53:55.112971 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:53:55.112979 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.112988 | orchestrator | 2026-04-24 02:53:55.112996 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-24 02:53:55.113005 | orchestrator | Friday 24 April 2026 02:53:49 +0000 (0:00:00.169) 0:00:41.219 ********** 2026-04-24 02:53:55.113013 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113021 | orchestrator | 2026-04-24 02:53:55.113030 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-24 02:53:55.113038 | orchestrator | Friday 24 April 2026 02:53:49 +0000 (0:00:00.156) 0:00:41.376 ********** 2026-04-24 02:53:55.113047 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:53:55.113056 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:53:55.113064 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113074 | orchestrator | 2026-04-24 02:53:55.113083 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-24 02:53:55.113091 | orchestrator | Friday 24 April 2026 02:53:49 +0000 (0:00:00.170) 0:00:41.547 ********** 2026-04-24 02:53:55.113100 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113108 | orchestrator | 2026-04-24 02:53:55.113116 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-24 02:53:55.113125 | orchestrator | Friday 24 April 2026 02:53:50 +0000 (0:00:00.155) 0:00:41.703 ********** 2026-04-24 02:53:55.113133 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:53:55.113142 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:53:55.113151 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113159 | orchestrator | 2026-04-24 02:53:55.113167 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-24 02:53:55.113197 | orchestrator | Friday 24 April 2026 02:53:50 +0000 (0:00:00.167) 0:00:41.870 ********** 2026-04-24 02:53:55.113206 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:53:55.113215 | orchestrator | 2026-04-24 02:53:55.113224 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-24 02:53:55.113233 | orchestrator | Friday 24 April 2026 02:53:50 +0000 (0:00:00.151) 0:00:42.022 ********** 2026-04-24 02:53:55.113243 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:53:55.113252 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:53:55.113262 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113272 | orchestrator | 2026-04-24 02:53:55.113281 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-24 02:53:55.113290 | orchestrator | Friday 24 April 2026 02:53:50 +0000 (0:00:00.169) 0:00:42.191 ********** 2026-04-24 02:53:55.113299 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:53:55.113309 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:53:55.113318 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113327 | orchestrator | 2026-04-24 02:53:55.113336 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-24 02:53:55.113360 | orchestrator | Friday 24 April 2026 02:53:50 +0000 (0:00:00.168) 0:00:42.359 ********** 2026-04-24 02:53:55.113370 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:53:55.113380 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:53:55.113389 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113398 | orchestrator | 2026-04-24 02:53:55.113407 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-24 02:53:55.113417 | orchestrator | Friday 24 April 2026 02:53:50 +0000 (0:00:00.159) 0:00:42.518 ********** 2026-04-24 02:53:55.113431 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113440 | orchestrator | 2026-04-24 02:53:55.113450 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-24 02:53:55.113459 | orchestrator | Friday 24 April 2026 02:53:51 +0000 (0:00:00.371) 0:00:42.890 ********** 2026-04-24 02:53:55.113468 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113477 | orchestrator | 2026-04-24 02:53:55.113486 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-24 02:53:55.113495 | orchestrator | Friday 24 April 2026 02:53:51 +0000 (0:00:00.147) 0:00:43.037 ********** 2026-04-24 02:53:55.113502 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113510 | orchestrator | 2026-04-24 02:53:55.113518 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-24 02:53:55.113526 | orchestrator | Friday 24 April 2026 02:53:51 +0000 (0:00:00.151) 0:00:43.188 ********** 2026-04-24 02:53:55.113535 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 02:53:55.113544 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-24 02:53:55.113554 | orchestrator | } 2026-04-24 02:53:55.113563 | orchestrator | 2026-04-24 02:53:55.113572 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-24 02:53:55.113618 | orchestrator | Friday 24 April 2026 02:53:51 +0000 (0:00:00.169) 0:00:43.358 ********** 2026-04-24 02:53:55.113628 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 02:53:55.113637 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-24 02:53:55.113690 | orchestrator | } 2026-04-24 02:53:55.113700 | orchestrator | 2026-04-24 02:53:55.113709 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-24 02:53:55.113717 | orchestrator | Friday 24 April 2026 02:53:51 +0000 (0:00:00.174) 0:00:43.532 ********** 2026-04-24 02:53:55.113726 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 02:53:55.113735 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-24 02:53:55.113744 | orchestrator | } 2026-04-24 02:53:55.113752 | orchestrator | 2026-04-24 02:53:55.113760 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-24 02:53:55.113769 | orchestrator | Friday 24 April 2026 02:53:52 +0000 (0:00:00.170) 0:00:43.702 ********** 2026-04-24 02:53:55.113832 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:53:55.113841 | orchestrator | 2026-04-24 02:53:55.113849 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-24 02:53:55.113857 | orchestrator | Friday 24 April 2026 02:53:52 +0000 (0:00:00.541) 0:00:44.243 ********** 2026-04-24 02:53:55.113866 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:53:55.113874 | orchestrator | 2026-04-24 02:53:55.113882 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-24 02:53:55.113891 | orchestrator | Friday 24 April 2026 02:53:53 +0000 (0:00:00.546) 0:00:44.790 ********** 2026-04-24 02:53:55.113899 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:53:55.113908 | orchestrator | 2026-04-24 02:53:55.113916 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-24 02:53:55.113924 | orchestrator | Friday 24 April 2026 02:53:53 +0000 (0:00:00.510) 0:00:45.300 ********** 2026-04-24 02:53:55.113933 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:53:55.113941 | orchestrator | 2026-04-24 02:53:55.113949 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-24 02:53:55.113957 | orchestrator | Friday 24 April 2026 02:53:53 +0000 (0:00:00.160) 0:00:45.461 ********** 2026-04-24 02:53:55.113965 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.113974 | orchestrator | 2026-04-24 02:53:55.113982 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-24 02:53:55.113991 | orchestrator | Friday 24 April 2026 02:53:53 +0000 (0:00:00.113) 0:00:45.574 ********** 2026-04-24 02:53:55.113999 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.114008 | orchestrator | 2026-04-24 02:53:55.114067 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-24 02:53:55.114076 | orchestrator | Friday 24 April 2026 02:53:54 +0000 (0:00:00.349) 0:00:45.923 ********** 2026-04-24 02:53:55.114084 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 02:53:55.114093 | orchestrator |  "vgs_report": { 2026-04-24 02:53:55.114101 | orchestrator |  "vg": [] 2026-04-24 02:53:55.114109 | orchestrator |  } 2026-04-24 02:53:55.114118 | orchestrator | } 2026-04-24 02:53:55.114126 | orchestrator | 2026-04-24 02:53:55.114135 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-24 02:53:55.114143 | orchestrator | Friday 24 April 2026 02:53:54 +0000 (0:00:00.168) 0:00:46.091 ********** 2026-04-24 02:53:55.114151 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.114160 | orchestrator | 2026-04-24 02:53:55.114168 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-24 02:53:55.114176 | orchestrator | Friday 24 April 2026 02:53:54 +0000 (0:00:00.175) 0:00:46.267 ********** 2026-04-24 02:53:55.114184 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.114193 | orchestrator | 2026-04-24 02:53:55.114201 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-24 02:53:55.114210 | orchestrator | Friday 24 April 2026 02:53:54 +0000 (0:00:00.160) 0:00:46.428 ********** 2026-04-24 02:53:55.114218 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.114226 | orchestrator | 2026-04-24 02:53:55.114234 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-24 02:53:55.114243 | orchestrator | Friday 24 April 2026 02:53:54 +0000 (0:00:00.158) 0:00:46.586 ********** 2026-04-24 02:53:55.114259 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:53:55.114267 | orchestrator | 2026-04-24 02:53:55.114286 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-24 02:54:00.219524 | orchestrator | Friday 24 April 2026 02:53:55 +0000 (0:00:00.157) 0:00:46.744 ********** 2026-04-24 02:54:00.219681 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.219707 | orchestrator | 2026-04-24 02:54:00.219725 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-24 02:54:00.219739 | orchestrator | Friday 24 April 2026 02:53:55 +0000 (0:00:00.152) 0:00:46.896 ********** 2026-04-24 02:54:00.219749 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.219758 | orchestrator | 2026-04-24 02:54:00.219768 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-24 02:54:00.219778 | orchestrator | Friday 24 April 2026 02:53:55 +0000 (0:00:00.151) 0:00:47.048 ********** 2026-04-24 02:54:00.219788 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.219797 | orchestrator | 2026-04-24 02:54:00.219823 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-24 02:54:00.219834 | orchestrator | Friday 24 April 2026 02:53:55 +0000 (0:00:00.158) 0:00:47.206 ********** 2026-04-24 02:54:00.219843 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.219853 | orchestrator | 2026-04-24 02:54:00.219862 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-24 02:54:00.219872 | orchestrator | Friday 24 April 2026 02:53:55 +0000 (0:00:00.152) 0:00:47.358 ********** 2026-04-24 02:54:00.219881 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.219891 | orchestrator | 2026-04-24 02:54:00.219900 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-24 02:54:00.219910 | orchestrator | Friday 24 April 2026 02:53:55 +0000 (0:00:00.146) 0:00:47.505 ********** 2026-04-24 02:54:00.219919 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.219929 | orchestrator | 2026-04-24 02:54:00.219938 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-24 02:54:00.219948 | orchestrator | Friday 24 April 2026 02:53:56 +0000 (0:00:00.378) 0:00:47.884 ********** 2026-04-24 02:54:00.219958 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.219967 | orchestrator | 2026-04-24 02:54:00.219977 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-24 02:54:00.219986 | orchestrator | Friday 24 April 2026 02:53:56 +0000 (0:00:00.145) 0:00:48.030 ********** 2026-04-24 02:54:00.219996 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220005 | orchestrator | 2026-04-24 02:54:00.220015 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-24 02:54:00.220024 | orchestrator | Friday 24 April 2026 02:53:56 +0000 (0:00:00.156) 0:00:48.186 ********** 2026-04-24 02:54:00.220034 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220043 | orchestrator | 2026-04-24 02:54:00.220053 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-24 02:54:00.220062 | orchestrator | Friday 24 April 2026 02:53:56 +0000 (0:00:00.151) 0:00:48.337 ********** 2026-04-24 02:54:00.220072 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220083 | orchestrator | 2026-04-24 02:54:00.220094 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-24 02:54:00.220105 | orchestrator | Friday 24 April 2026 02:53:56 +0000 (0:00:00.157) 0:00:48.495 ********** 2026-04-24 02:54:00.220118 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220131 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220142 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220153 | orchestrator | 2026-04-24 02:54:00.220164 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-24 02:54:00.220197 | orchestrator | Friday 24 April 2026 02:53:57 +0000 (0:00:00.165) 0:00:48.661 ********** 2026-04-24 02:54:00.220209 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220220 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220232 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220243 | orchestrator | 2026-04-24 02:54:00.220254 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-24 02:54:00.220265 | orchestrator | Friday 24 April 2026 02:53:57 +0000 (0:00:00.168) 0:00:48.830 ********** 2026-04-24 02:54:00.220275 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220284 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220294 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220304 | orchestrator | 2026-04-24 02:54:00.220314 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-24 02:54:00.220323 | orchestrator | Friday 24 April 2026 02:53:57 +0000 (0:00:00.168) 0:00:48.999 ********** 2026-04-24 02:54:00.220333 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220342 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220352 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220361 | orchestrator | 2026-04-24 02:54:00.220385 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-24 02:54:00.220396 | orchestrator | Friday 24 April 2026 02:53:57 +0000 (0:00:00.186) 0:00:49.186 ********** 2026-04-24 02:54:00.220405 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220415 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220424 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220433 | orchestrator | 2026-04-24 02:54:00.220448 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-24 02:54:00.220458 | orchestrator | Friday 24 April 2026 02:53:57 +0000 (0:00:00.178) 0:00:49.364 ********** 2026-04-24 02:54:00.220467 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220477 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220486 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220496 | orchestrator | 2026-04-24 02:54:00.220505 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-24 02:54:00.220515 | orchestrator | Friday 24 April 2026 02:53:57 +0000 (0:00:00.168) 0:00:49.533 ********** 2026-04-24 02:54:00.220524 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220534 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220543 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220618 | orchestrator | 2026-04-24 02:54:00.220638 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-24 02:54:00.220655 | orchestrator | Friday 24 April 2026 02:53:58 +0000 (0:00:00.373) 0:00:49.906 ********** 2026-04-24 02:54:00.220672 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220682 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220692 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220701 | orchestrator | 2026-04-24 02:54:00.220711 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-24 02:54:00.220720 | orchestrator | Friday 24 April 2026 02:53:58 +0000 (0:00:00.164) 0:00:50.071 ********** 2026-04-24 02:54:00.220730 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:54:00.220739 | orchestrator | 2026-04-24 02:54:00.220749 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-24 02:54:00.220758 | orchestrator | Friday 24 April 2026 02:53:58 +0000 (0:00:00.549) 0:00:50.620 ********** 2026-04-24 02:54:00.220768 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:54:00.220777 | orchestrator | 2026-04-24 02:54:00.220787 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-24 02:54:00.220796 | orchestrator | Friday 24 April 2026 02:53:59 +0000 (0:00:00.548) 0:00:51.169 ********** 2026-04-24 02:54:00.220805 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:54:00.220815 | orchestrator | 2026-04-24 02:54:00.220824 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-24 02:54:00.220834 | orchestrator | Friday 24 April 2026 02:53:59 +0000 (0:00:00.153) 0:00:51.323 ********** 2026-04-24 02:54:00.220843 | orchestrator | ok: [testbed-node-4] => (item={'lv_name': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'vg_name': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}) 2026-04-24 02:54:00.220854 | orchestrator | ok: [testbed-node-4] => (item={'lv_name': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'vg_name': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}) 2026-04-24 02:54:00.220864 | orchestrator | 2026-04-24 02:54:00.220873 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-24 02:54:00.220882 | orchestrator | Friday 24 April 2026 02:53:59 +0000 (0:00:00.187) 0:00:51.510 ********** 2026-04-24 02:54:00.220892 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220902 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:00.220911 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:00.220920 | orchestrator | 2026-04-24 02:54:00.220930 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-24 02:54:00.220940 | orchestrator | Friday 24 April 2026 02:54:00 +0000 (0:00:00.175) 0:00:51.686 ********** 2026-04-24 02:54:00.220949 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:00.220966 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:07.010006 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:07.010189 | orchestrator | 2026-04-24 02:54:07.010209 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-24 02:54:07.010224 | orchestrator | Friday 24 April 2026 02:54:00 +0000 (0:00:00.166) 0:00:51.852 ********** 2026-04-24 02:54:07.010236 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 02:54:07.010289 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 02:54:07.010302 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:07.010313 | orchestrator | 2026-04-24 02:54:07.010324 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-24 02:54:07.010335 | orchestrator | Friday 24 April 2026 02:54:00 +0000 (0:00:00.169) 0:00:52.022 ********** 2026-04-24 02:54:07.010346 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 02:54:07.010357 | orchestrator |  "lvm_report": { 2026-04-24 02:54:07.010369 | orchestrator |  "lv": [ 2026-04-24 02:54:07.010380 | orchestrator |  { 2026-04-24 02:54:07.010391 | orchestrator |  "lv_name": "osd-block-33584b54-1593-569e-98b0-f98fe2b18be3", 2026-04-24 02:54:07.010402 | orchestrator |  "vg_name": "ceph-33584b54-1593-569e-98b0-f98fe2b18be3" 2026-04-24 02:54:07.010413 | orchestrator |  }, 2026-04-24 02:54:07.010424 | orchestrator |  { 2026-04-24 02:54:07.010434 | orchestrator |  "lv_name": "osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1", 2026-04-24 02:54:07.010445 | orchestrator |  "vg_name": "ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1" 2026-04-24 02:54:07.010456 | orchestrator |  } 2026-04-24 02:54:07.010466 | orchestrator |  ], 2026-04-24 02:54:07.010477 | orchestrator |  "pv": [ 2026-04-24 02:54:07.010488 | orchestrator |  { 2026-04-24 02:54:07.010498 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-24 02:54:07.010511 | orchestrator |  "vg_name": "ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1" 2026-04-24 02:54:07.010525 | orchestrator |  }, 2026-04-24 02:54:07.010539 | orchestrator |  { 2026-04-24 02:54:07.010552 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-24 02:54:07.010565 | orchestrator |  "vg_name": "ceph-33584b54-1593-569e-98b0-f98fe2b18be3" 2026-04-24 02:54:07.010602 | orchestrator |  } 2026-04-24 02:54:07.010615 | orchestrator |  ] 2026-04-24 02:54:07.010628 | orchestrator |  } 2026-04-24 02:54:07.010641 | orchestrator | } 2026-04-24 02:54:07.010653 | orchestrator | 2026-04-24 02:54:07.010666 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-24 02:54:07.010678 | orchestrator | 2026-04-24 02:54:07.010690 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-24 02:54:07.010703 | orchestrator | Friday 24 April 2026 02:54:00 +0000 (0:00:00.356) 0:00:52.378 ********** 2026-04-24 02:54:07.010716 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-24 02:54:07.010728 | orchestrator | 2026-04-24 02:54:07.010741 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-24 02:54:07.010754 | orchestrator | Friday 24 April 2026 02:54:01 +0000 (0:00:00.746) 0:00:53.125 ********** 2026-04-24 02:54:07.010767 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:07.010779 | orchestrator | 2026-04-24 02:54:07.010792 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.010805 | orchestrator | Friday 24 April 2026 02:54:01 +0000 (0:00:00.271) 0:00:53.397 ********** 2026-04-24 02:54:07.010818 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop0) 2026-04-24 02:54:07.010831 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop1) 2026-04-24 02:54:07.010842 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop2) 2026-04-24 02:54:07.010853 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop3) 2026-04-24 02:54:07.010863 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop4) 2026-04-24 02:54:07.010874 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop5) 2026-04-24 02:54:07.010885 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop6) 2026-04-24 02:54:07.010905 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop7) 2026-04-24 02:54:07.010916 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sda) 2026-04-24 02:54:07.010927 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdb) 2026-04-24 02:54:07.010937 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdc) 2026-04-24 02:54:07.010962 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdd) 2026-04-24 02:54:07.010973 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sr0) 2026-04-24 02:54:07.010984 | orchestrator | 2026-04-24 02:54:07.010995 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011006 | orchestrator | Friday 24 April 2026 02:54:02 +0000 (0:00:00.441) 0:00:53.839 ********** 2026-04-24 02:54:07.011016 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:07.011027 | orchestrator | 2026-04-24 02:54:07.011038 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011048 | orchestrator | Friday 24 April 2026 02:54:02 +0000 (0:00:00.207) 0:00:54.047 ********** 2026-04-24 02:54:07.011059 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:07.011070 | orchestrator | 2026-04-24 02:54:07.011081 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011111 | orchestrator | Friday 24 April 2026 02:54:02 +0000 (0:00:00.218) 0:00:54.265 ********** 2026-04-24 02:54:07.011133 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:07.011162 | orchestrator | 2026-04-24 02:54:07.011182 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011201 | orchestrator | Friday 24 April 2026 02:54:02 +0000 (0:00:00.222) 0:00:54.488 ********** 2026-04-24 02:54:07.011221 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:07.011243 | orchestrator | 2026-04-24 02:54:07.011263 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011278 | orchestrator | Friday 24 April 2026 02:54:03 +0000 (0:00:00.205) 0:00:54.693 ********** 2026-04-24 02:54:07.011336 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:07.011348 | orchestrator | 2026-04-24 02:54:07.011359 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011370 | orchestrator | Friday 24 April 2026 02:54:03 +0000 (0:00:00.212) 0:00:54.906 ********** 2026-04-24 02:54:07.011380 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:07.011399 | orchestrator | 2026-04-24 02:54:07.011418 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011436 | orchestrator | Friday 24 April 2026 02:54:03 +0000 (0:00:00.222) 0:00:55.128 ********** 2026-04-24 02:54:07.011455 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:07.011472 | orchestrator | 2026-04-24 02:54:07.011490 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011507 | orchestrator | Friday 24 April 2026 02:54:03 +0000 (0:00:00.213) 0:00:55.342 ********** 2026-04-24 02:54:07.011526 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:07.011544 | orchestrator | 2026-04-24 02:54:07.011560 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011605 | orchestrator | Friday 24 April 2026 02:54:04 +0000 (0:00:00.700) 0:00:56.042 ********** 2026-04-24 02:54:07.011625 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c) 2026-04-24 02:54:07.011645 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c) 2026-04-24 02:54:07.011663 | orchestrator | 2026-04-24 02:54:07.011680 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011697 | orchestrator | Friday 24 April 2026 02:54:04 +0000 (0:00:00.455) 0:00:56.498 ********** 2026-04-24 02:54:07.011833 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d) 2026-04-24 02:54:07.011920 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d) 2026-04-24 02:54:07.011934 | orchestrator | 2026-04-24 02:54:07.011945 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.011956 | orchestrator | Friday 24 April 2026 02:54:05 +0000 (0:00:00.430) 0:00:56.928 ********** 2026-04-24 02:54:07.011967 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025) 2026-04-24 02:54:07.011978 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025) 2026-04-24 02:54:07.011989 | orchestrator | 2026-04-24 02:54:07.012000 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.012011 | orchestrator | Friday 24 April 2026 02:54:05 +0000 (0:00:00.440) 0:00:57.369 ********** 2026-04-24 02:54:07.012022 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229) 2026-04-24 02:54:07.012033 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229) 2026-04-24 02:54:07.012044 | orchestrator | 2026-04-24 02:54:07.012055 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-24 02:54:07.012066 | orchestrator | Friday 24 April 2026 02:54:06 +0000 (0:00:00.464) 0:00:57.833 ********** 2026-04-24 02:54:07.012076 | orchestrator | ok: [testbed-node-5] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-24 02:54:07.012087 | orchestrator | 2026-04-24 02:54:07.012098 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:07.012109 | orchestrator | Friday 24 April 2026 02:54:06 +0000 (0:00:00.361) 0:00:58.195 ********** 2026-04-24 02:54:07.012120 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop0) 2026-04-24 02:54:07.012131 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop1) 2026-04-24 02:54:07.012141 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop2) 2026-04-24 02:54:07.012152 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop3) 2026-04-24 02:54:07.012178 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop4) 2026-04-24 02:54:07.012198 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop5) 2026-04-24 02:54:07.012209 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop6) 2026-04-24 02:54:07.012220 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop7) 2026-04-24 02:54:07.012231 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sda) 2026-04-24 02:54:07.012241 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdb) 2026-04-24 02:54:07.012252 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdc) 2026-04-24 02:54:07.012278 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdd) 2026-04-24 02:54:16.257700 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sr0) 2026-04-24 02:54:16.257814 | orchestrator | 2026-04-24 02:54:16.257831 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.257842 | orchestrator | Friday 24 April 2026 02:54:06 +0000 (0:00:00.436) 0:00:58.632 ********** 2026-04-24 02:54:16.257853 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.257863 | orchestrator | 2026-04-24 02:54:16.257874 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.257900 | orchestrator | Friday 24 April 2026 02:54:07 +0000 (0:00:00.206) 0:00:58.839 ********** 2026-04-24 02:54:16.257911 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.257942 | orchestrator | 2026-04-24 02:54:16.257953 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.257963 | orchestrator | Friday 24 April 2026 02:54:07 +0000 (0:00:00.218) 0:00:59.057 ********** 2026-04-24 02:54:16.257973 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.257983 | orchestrator | 2026-04-24 02:54:16.257993 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258003 | orchestrator | Friday 24 April 2026 02:54:07 +0000 (0:00:00.215) 0:00:59.272 ********** 2026-04-24 02:54:16.258013 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258092 | orchestrator | 2026-04-24 02:54:16.258111 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258129 | orchestrator | Friday 24 April 2026 02:54:07 +0000 (0:00:00.215) 0:00:59.487 ********** 2026-04-24 02:54:16.258147 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258160 | orchestrator | 2026-04-24 02:54:16.258170 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258181 | orchestrator | Friday 24 April 2026 02:54:08 +0000 (0:00:00.704) 0:01:00.192 ********** 2026-04-24 02:54:16.258192 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258202 | orchestrator | 2026-04-24 02:54:16.258214 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258225 | orchestrator | Friday 24 April 2026 02:54:08 +0000 (0:00:00.228) 0:01:00.421 ********** 2026-04-24 02:54:16.258236 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258247 | orchestrator | 2026-04-24 02:54:16.258257 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258269 | orchestrator | Friday 24 April 2026 02:54:09 +0000 (0:00:00.219) 0:01:00.640 ********** 2026-04-24 02:54:16.258280 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258291 | orchestrator | 2026-04-24 02:54:16.258301 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258312 | orchestrator | Friday 24 April 2026 02:54:09 +0000 (0:00:00.241) 0:01:00.881 ********** 2026-04-24 02:54:16.258323 | orchestrator | ok: [testbed-node-5] => (item=sda1) 2026-04-24 02:54:16.258334 | orchestrator | ok: [testbed-node-5] => (item=sda14) 2026-04-24 02:54:16.258346 | orchestrator | ok: [testbed-node-5] => (item=sda15) 2026-04-24 02:54:16.258356 | orchestrator | ok: [testbed-node-5] => (item=sda16) 2026-04-24 02:54:16.258367 | orchestrator | 2026-04-24 02:54:16.258378 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258388 | orchestrator | Friday 24 April 2026 02:54:09 +0000 (0:00:00.675) 0:01:01.557 ********** 2026-04-24 02:54:16.258399 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258410 | orchestrator | 2026-04-24 02:54:16.258420 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258431 | orchestrator | Friday 24 April 2026 02:54:10 +0000 (0:00:00.222) 0:01:01.779 ********** 2026-04-24 02:54:16.258442 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258453 | orchestrator | 2026-04-24 02:54:16.258464 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258475 | orchestrator | Friday 24 April 2026 02:54:10 +0000 (0:00:00.242) 0:01:02.022 ********** 2026-04-24 02:54:16.258486 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258498 | orchestrator | 2026-04-24 02:54:16.258507 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-24 02:54:16.258516 | orchestrator | Friday 24 April 2026 02:54:10 +0000 (0:00:00.222) 0:01:02.244 ********** 2026-04-24 02:54:16.258526 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258535 | orchestrator | 2026-04-24 02:54:16.258545 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-24 02:54:16.258554 | orchestrator | Friday 24 April 2026 02:54:10 +0000 (0:00:00.230) 0:01:02.474 ********** 2026-04-24 02:54:16.258585 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258595 | orchestrator | 2026-04-24 02:54:16.258614 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-24 02:54:16.258623 | orchestrator | Friday 24 April 2026 02:54:10 +0000 (0:00:00.158) 0:01:02.633 ********** 2026-04-24 02:54:16.258634 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}}) 2026-04-24 02:54:16.258645 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': '91b687e8-7bed-5064-bb30-d809c43c423f'}}) 2026-04-24 02:54:16.258654 | orchestrator | 2026-04-24 02:54:16.258664 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-24 02:54:16.258673 | orchestrator | Friday 24 April 2026 02:54:11 +0000 (0:00:00.208) 0:01:02.841 ********** 2026-04-24 02:54:16.258684 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}) 2026-04-24 02:54:16.258695 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}) 2026-04-24 02:54:16.258704 | orchestrator | 2026-04-24 02:54:16.258714 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-24 02:54:16.258742 | orchestrator | Friday 24 April 2026 02:54:13 +0000 (0:00:01.907) 0:01:04.749 ********** 2026-04-24 02:54:16.258752 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:16.258764 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:16.258773 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258783 | orchestrator | 2026-04-24 02:54:16.258799 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-24 02:54:16.258808 | orchestrator | Friday 24 April 2026 02:54:13 +0000 (0:00:00.388) 0:01:05.138 ********** 2026-04-24 02:54:16.258818 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}) 2026-04-24 02:54:16.258828 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}) 2026-04-24 02:54:16.258847 | orchestrator | 2026-04-24 02:54:16.258857 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-24 02:54:16.258867 | orchestrator | Friday 24 April 2026 02:54:14 +0000 (0:00:01.341) 0:01:06.480 ********** 2026-04-24 02:54:16.258876 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:16.258886 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:16.258895 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258905 | orchestrator | 2026-04-24 02:54:16.258914 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-24 02:54:16.258924 | orchestrator | Friday 24 April 2026 02:54:15 +0000 (0:00:00.167) 0:01:06.647 ********** 2026-04-24 02:54:16.258933 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.258943 | orchestrator | 2026-04-24 02:54:16.258953 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-24 02:54:16.258962 | orchestrator | Friday 24 April 2026 02:54:15 +0000 (0:00:00.144) 0:01:06.792 ********** 2026-04-24 02:54:16.258972 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:16.258981 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:16.258997 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.259007 | orchestrator | 2026-04-24 02:54:16.259017 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-24 02:54:16.259026 | orchestrator | Friday 24 April 2026 02:54:15 +0000 (0:00:00.166) 0:01:06.958 ********** 2026-04-24 02:54:16.259036 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.259045 | orchestrator | 2026-04-24 02:54:16.259055 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-24 02:54:16.259064 | orchestrator | Friday 24 April 2026 02:54:15 +0000 (0:00:00.141) 0:01:07.099 ********** 2026-04-24 02:54:16.259074 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:16.259083 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:16.259093 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.259102 | orchestrator | 2026-04-24 02:54:16.259112 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-24 02:54:16.259121 | orchestrator | Friday 24 April 2026 02:54:15 +0000 (0:00:00.184) 0:01:07.284 ********** 2026-04-24 02:54:16.259131 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.259140 | orchestrator | 2026-04-24 02:54:16.259150 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-24 02:54:16.259160 | orchestrator | Friday 24 April 2026 02:54:15 +0000 (0:00:00.133) 0:01:07.418 ********** 2026-04-24 02:54:16.259169 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:16.259179 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:16.259189 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:16.259198 | orchestrator | 2026-04-24 02:54:16.259208 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-24 02:54:16.259217 | orchestrator | Friday 24 April 2026 02:54:15 +0000 (0:00:00.155) 0:01:07.573 ********** 2026-04-24 02:54:16.259227 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:16.259236 | orchestrator | 2026-04-24 02:54:16.259245 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-24 02:54:16.259255 | orchestrator | Friday 24 April 2026 02:54:16 +0000 (0:00:00.153) 0:01:07.727 ********** 2026-04-24 02:54:16.259271 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:22.971390 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:22.971494 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.971510 | orchestrator | 2026-04-24 02:54:22.971523 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-24 02:54:22.971536 | orchestrator | Friday 24 April 2026 02:54:16 +0000 (0:00:00.163) 0:01:07.890 ********** 2026-04-24 02:54:22.971608 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:22.971622 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:22.971634 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.971645 | orchestrator | 2026-04-24 02:54:22.971656 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-24 02:54:22.971667 | orchestrator | Friday 24 April 2026 02:54:16 +0000 (0:00:00.156) 0:01:08.047 ********** 2026-04-24 02:54:22.971700 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:22.971712 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:22.971723 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.971734 | orchestrator | 2026-04-24 02:54:22.971745 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-24 02:54:22.971755 | orchestrator | Friday 24 April 2026 02:54:16 +0000 (0:00:00.378) 0:01:08.425 ********** 2026-04-24 02:54:22.971766 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.971777 | orchestrator | 2026-04-24 02:54:22.971787 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-24 02:54:22.971798 | orchestrator | Friday 24 April 2026 02:54:16 +0000 (0:00:00.187) 0:01:08.612 ********** 2026-04-24 02:54:22.971808 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.971820 | orchestrator | 2026-04-24 02:54:22.971831 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-24 02:54:22.971842 | orchestrator | Friday 24 April 2026 02:54:17 +0000 (0:00:00.146) 0:01:08.759 ********** 2026-04-24 02:54:22.971852 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.971863 | orchestrator | 2026-04-24 02:54:22.971874 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-24 02:54:22.971884 | orchestrator | Friday 24 April 2026 02:54:17 +0000 (0:00:00.156) 0:01:08.916 ********** 2026-04-24 02:54:22.971895 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 02:54:22.971906 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-24 02:54:22.971918 | orchestrator | } 2026-04-24 02:54:22.971930 | orchestrator | 2026-04-24 02:54:22.971942 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-24 02:54:22.971955 | orchestrator | Friday 24 April 2026 02:54:17 +0000 (0:00:00.152) 0:01:09.069 ********** 2026-04-24 02:54:22.971967 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 02:54:22.971980 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-24 02:54:22.971992 | orchestrator | } 2026-04-24 02:54:22.972005 | orchestrator | 2026-04-24 02:54:22.972017 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-24 02:54:22.972029 | orchestrator | Friday 24 April 2026 02:54:17 +0000 (0:00:00.154) 0:01:09.224 ********** 2026-04-24 02:54:22.972041 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 02:54:22.972054 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-24 02:54:22.972066 | orchestrator | } 2026-04-24 02:54:22.972078 | orchestrator | 2026-04-24 02:54:22.972090 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-24 02:54:22.972103 | orchestrator | Friday 24 April 2026 02:54:17 +0000 (0:00:00.148) 0:01:09.372 ********** 2026-04-24 02:54:22.972115 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:22.972127 | orchestrator | 2026-04-24 02:54:22.972140 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-24 02:54:22.972151 | orchestrator | Friday 24 April 2026 02:54:18 +0000 (0:00:00.533) 0:01:09.906 ********** 2026-04-24 02:54:22.972162 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:22.972173 | orchestrator | 2026-04-24 02:54:22.972184 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-24 02:54:22.972194 | orchestrator | Friday 24 April 2026 02:54:18 +0000 (0:00:00.547) 0:01:10.453 ********** 2026-04-24 02:54:22.972205 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:22.972215 | orchestrator | 2026-04-24 02:54:22.972226 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-24 02:54:22.972237 | orchestrator | Friday 24 April 2026 02:54:19 +0000 (0:00:00.565) 0:01:11.019 ********** 2026-04-24 02:54:22.972247 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:22.972258 | orchestrator | 2026-04-24 02:54:22.972269 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-24 02:54:22.972288 | orchestrator | Friday 24 April 2026 02:54:19 +0000 (0:00:00.155) 0:01:11.175 ********** 2026-04-24 02:54:22.972298 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972309 | orchestrator | 2026-04-24 02:54:22.972320 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-24 02:54:22.972331 | orchestrator | Friday 24 April 2026 02:54:19 +0000 (0:00:00.126) 0:01:11.301 ********** 2026-04-24 02:54:22.972341 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972352 | orchestrator | 2026-04-24 02:54:22.972363 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-24 02:54:22.972373 | orchestrator | Friday 24 April 2026 02:54:20 +0000 (0:00:00.349) 0:01:11.651 ********** 2026-04-24 02:54:22.972384 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 02:54:22.972395 | orchestrator |  "vgs_report": { 2026-04-24 02:54:22.972406 | orchestrator |  "vg": [] 2026-04-24 02:54:22.972434 | orchestrator |  } 2026-04-24 02:54:22.972446 | orchestrator | } 2026-04-24 02:54:22.972457 | orchestrator | 2026-04-24 02:54:22.972468 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-24 02:54:22.972478 | orchestrator | Friday 24 April 2026 02:54:20 +0000 (0:00:00.167) 0:01:11.818 ********** 2026-04-24 02:54:22.972489 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972500 | orchestrator | 2026-04-24 02:54:22.972510 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-24 02:54:22.972521 | orchestrator | Friday 24 April 2026 02:54:20 +0000 (0:00:00.132) 0:01:11.951 ********** 2026-04-24 02:54:22.972601 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972614 | orchestrator | 2026-04-24 02:54:22.972625 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-24 02:54:22.972636 | orchestrator | Friday 24 April 2026 02:54:20 +0000 (0:00:00.140) 0:01:12.091 ********** 2026-04-24 02:54:22.972647 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972657 | orchestrator | 2026-04-24 02:54:22.972668 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-24 02:54:22.972679 | orchestrator | Friday 24 April 2026 02:54:20 +0000 (0:00:00.151) 0:01:12.243 ********** 2026-04-24 02:54:22.972690 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972700 | orchestrator | 2026-04-24 02:54:22.972711 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-24 02:54:22.972721 | orchestrator | Friday 24 April 2026 02:54:20 +0000 (0:00:00.149) 0:01:12.392 ********** 2026-04-24 02:54:22.972732 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972743 | orchestrator | 2026-04-24 02:54:22.972754 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-24 02:54:22.972764 | orchestrator | Friday 24 April 2026 02:54:20 +0000 (0:00:00.145) 0:01:12.537 ********** 2026-04-24 02:54:22.972775 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972786 | orchestrator | 2026-04-24 02:54:22.972796 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-24 02:54:22.972807 | orchestrator | Friday 24 April 2026 02:54:21 +0000 (0:00:00.143) 0:01:12.681 ********** 2026-04-24 02:54:22.972818 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972828 | orchestrator | 2026-04-24 02:54:22.972839 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-24 02:54:22.972850 | orchestrator | Friday 24 April 2026 02:54:21 +0000 (0:00:00.128) 0:01:12.810 ********** 2026-04-24 02:54:22.972861 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972871 | orchestrator | 2026-04-24 02:54:22.972882 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-24 02:54:22.972893 | orchestrator | Friday 24 April 2026 02:54:21 +0000 (0:00:00.183) 0:01:12.993 ********** 2026-04-24 02:54:22.972904 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972914 | orchestrator | 2026-04-24 02:54:22.972925 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-24 02:54:22.972936 | orchestrator | Friday 24 April 2026 02:54:21 +0000 (0:00:00.134) 0:01:13.127 ********** 2026-04-24 02:54:22.972954 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.972965 | orchestrator | 2026-04-24 02:54:22.972976 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-24 02:54:22.972987 | orchestrator | Friday 24 April 2026 02:54:21 +0000 (0:00:00.149) 0:01:13.277 ********** 2026-04-24 02:54:22.972997 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.973008 | orchestrator | 2026-04-24 02:54:22.973019 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-24 02:54:22.973030 | orchestrator | Friday 24 April 2026 02:54:22 +0000 (0:00:00.374) 0:01:13.651 ********** 2026-04-24 02:54:22.973040 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.973051 | orchestrator | 2026-04-24 02:54:22.973061 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-24 02:54:22.973072 | orchestrator | Friday 24 April 2026 02:54:22 +0000 (0:00:00.150) 0:01:13.802 ********** 2026-04-24 02:54:22.973083 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.973093 | orchestrator | 2026-04-24 02:54:22.973104 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-24 02:54:22.973115 | orchestrator | Friday 24 April 2026 02:54:22 +0000 (0:00:00.141) 0:01:13.943 ********** 2026-04-24 02:54:22.973125 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.973136 | orchestrator | 2026-04-24 02:54:22.973147 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-24 02:54:22.973157 | orchestrator | Friday 24 April 2026 02:54:22 +0000 (0:00:00.134) 0:01:14.078 ********** 2026-04-24 02:54:22.973169 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:22.973180 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:22.973190 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.973201 | orchestrator | 2026-04-24 02:54:22.973211 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-24 02:54:22.973222 | orchestrator | Friday 24 April 2026 02:54:22 +0000 (0:00:00.193) 0:01:14.272 ********** 2026-04-24 02:54:22.973233 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:22.973244 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:22.973254 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:22.973265 | orchestrator | 2026-04-24 02:54:22.973276 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-24 02:54:22.973287 | orchestrator | Friday 24 April 2026 02:54:22 +0000 (0:00:00.164) 0:01:14.437 ********** 2026-04-24 02:54:22.973304 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.116308 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.116412 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.116436 | orchestrator | 2026-04-24 02:54:26.116477 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-24 02:54:26.116497 | orchestrator | Friday 24 April 2026 02:54:22 +0000 (0:00:00.165) 0:01:14.602 ********** 2026-04-24 02:54:26.116516 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.116533 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.116675 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.116700 | orchestrator | 2026-04-24 02:54:26.116721 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-24 02:54:26.116742 | orchestrator | Friday 24 April 2026 02:54:23 +0000 (0:00:00.160) 0:01:14.763 ********** 2026-04-24 02:54:26.116761 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.116773 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.116784 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.116795 | orchestrator | 2026-04-24 02:54:26.116805 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-24 02:54:26.116816 | orchestrator | Friday 24 April 2026 02:54:23 +0000 (0:00:00.141) 0:01:14.904 ********** 2026-04-24 02:54:26.116827 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.116839 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.116851 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.116866 | orchestrator | 2026-04-24 02:54:26.116890 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-24 02:54:26.116917 | orchestrator | Friday 24 April 2026 02:54:23 +0000 (0:00:00.166) 0:01:15.071 ********** 2026-04-24 02:54:26.116936 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.116955 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.116975 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.116994 | orchestrator | 2026-04-24 02:54:26.117011 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-24 02:54:26.117022 | orchestrator | Friday 24 April 2026 02:54:23 +0000 (0:00:00.175) 0:01:15.246 ********** 2026-04-24 02:54:26.117033 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.117045 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.117056 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.117066 | orchestrator | 2026-04-24 02:54:26.117077 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-24 02:54:26.117088 | orchestrator | Friday 24 April 2026 02:54:23 +0000 (0:00:00.161) 0:01:15.408 ********** 2026-04-24 02:54:26.117098 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:26.117109 | orchestrator | 2026-04-24 02:54:26.117120 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-24 02:54:26.117131 | orchestrator | Friday 24 April 2026 02:54:24 +0000 (0:00:00.747) 0:01:16.156 ********** 2026-04-24 02:54:26.117141 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:26.117152 | orchestrator | 2026-04-24 02:54:26.117162 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-24 02:54:26.117174 | orchestrator | Friday 24 April 2026 02:54:25 +0000 (0:00:00.544) 0:01:16.701 ********** 2026-04-24 02:54:26.117185 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:26.117195 | orchestrator | 2026-04-24 02:54:26.117206 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-24 02:54:26.117217 | orchestrator | Friday 24 April 2026 02:54:25 +0000 (0:00:00.189) 0:01:16.891 ********** 2026-04-24 02:54:26.117239 | orchestrator | ok: [testbed-node-5] => (item={'lv_name': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'vg_name': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}) 2026-04-24 02:54:26.117251 | orchestrator | ok: [testbed-node-5] => (item={'lv_name': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'vg_name': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}) 2026-04-24 02:54:26.117262 | orchestrator | 2026-04-24 02:54:26.117273 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-24 02:54:26.117284 | orchestrator | Friday 24 April 2026 02:54:25 +0000 (0:00:00.172) 0:01:17.063 ********** 2026-04-24 02:54:26.117315 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.117335 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.117346 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.117357 | orchestrator | 2026-04-24 02:54:26.117368 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-24 02:54:26.117379 | orchestrator | Friday 24 April 2026 02:54:25 +0000 (0:00:00.162) 0:01:17.225 ********** 2026-04-24 02:54:26.117389 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.117400 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.117411 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.117422 | orchestrator | 2026-04-24 02:54:26.117432 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-24 02:54:26.117443 | orchestrator | Friday 24 April 2026 02:54:25 +0000 (0:00:00.166) 0:01:17.392 ********** 2026-04-24 02:54:26.117454 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 02:54:26.117465 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 02:54:26.117475 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:26.117486 | orchestrator | 2026-04-24 02:54:26.117497 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-24 02:54:26.117508 | orchestrator | Friday 24 April 2026 02:54:25 +0000 (0:00:00.168) 0:01:17.560 ********** 2026-04-24 02:54:26.117518 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 02:54:26.117529 | orchestrator |  "lvm_report": { 2026-04-24 02:54:26.117540 | orchestrator |  "lv": [ 2026-04-24 02:54:26.117550 | orchestrator |  { 2026-04-24 02:54:26.117593 | orchestrator |  "lv_name": "osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71", 2026-04-24 02:54:26.117606 | orchestrator |  "vg_name": "ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71" 2026-04-24 02:54:26.117617 | orchestrator |  }, 2026-04-24 02:54:26.117628 | orchestrator |  { 2026-04-24 02:54:26.117639 | orchestrator |  "lv_name": "osd-block-91b687e8-7bed-5064-bb30-d809c43c423f", 2026-04-24 02:54:26.117650 | orchestrator |  "vg_name": "ceph-91b687e8-7bed-5064-bb30-d809c43c423f" 2026-04-24 02:54:26.117660 | orchestrator |  } 2026-04-24 02:54:26.117671 | orchestrator |  ], 2026-04-24 02:54:26.117682 | orchestrator |  "pv": [ 2026-04-24 02:54:26.117692 | orchestrator |  { 2026-04-24 02:54:26.117703 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-24 02:54:26.117714 | orchestrator |  "vg_name": "ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71" 2026-04-24 02:54:26.117725 | orchestrator |  }, 2026-04-24 02:54:26.117735 | orchestrator |  { 2026-04-24 02:54:26.117746 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-24 02:54:26.117777 | orchestrator |  "vg_name": "ceph-91b687e8-7bed-5064-bb30-d809c43c423f" 2026-04-24 02:54:26.117788 | orchestrator |  } 2026-04-24 02:54:26.117799 | orchestrator |  ] 2026-04-24 02:54:26.117810 | orchestrator |  } 2026-04-24 02:54:26.117821 | orchestrator | } 2026-04-24 02:54:26.117832 | orchestrator | 2026-04-24 02:54:26.117843 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:54:26.117854 | orchestrator | testbed-node-3 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-24 02:54:26.117865 | orchestrator | testbed-node-4 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-24 02:54:26.117876 | orchestrator | testbed-node-5 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-24 02:54:26.117887 | orchestrator | 2026-04-24 02:54:26.117897 | orchestrator | 2026-04-24 02:54:26.117908 | orchestrator | 2026-04-24 02:54:26.117919 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:54:26.117930 | orchestrator | Friday 24 April 2026 02:54:26 +0000 (0:00:00.159) 0:01:17.720 ********** 2026-04-24 02:54:26.117941 | orchestrator | =============================================================================== 2026-04-24 02:54:26.117951 | orchestrator | Create block VGs -------------------------------------------------------- 5.83s 2026-04-24 02:54:26.117962 | orchestrator | Create block LVs -------------------------------------------------------- 4.20s 2026-04-24 02:54:26.117973 | orchestrator | Get list of Ceph LVs with associated VGs -------------------------------- 1.83s 2026-04-24 02:54:26.117983 | orchestrator | Gather DB VGs with total and available size in bytes -------------------- 1.76s 2026-04-24 02:54:26.117994 | orchestrator | Get list of Ceph PVs with associated VGs -------------------------------- 1.66s 2026-04-24 02:54:26.118005 | orchestrator | Gather WAL VGs with total and available size in bytes ------------------- 1.64s 2026-04-24 02:54:26.118015 | orchestrator | Gather DB+WAL VGs with total and available size in bytes ---------------- 1.63s 2026-04-24 02:54:26.118092 | orchestrator | Add known links to the list of available block devices ------------------ 1.40s 2026-04-24 02:54:26.118113 | orchestrator | Add known partitions to the list of available block devices ------------- 1.35s 2026-04-24 02:54:26.494798 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 1.25s 2026-04-24 02:54:26.495839 | orchestrator | Add known links to the list of available block devices ------------------ 0.98s 2026-04-24 02:54:26.495886 | orchestrator | Add known links to the list of available block devices ------------------ 0.93s 2026-04-24 02:54:26.495918 | orchestrator | Print LVM report data --------------------------------------------------- 0.83s 2026-04-24 02:54:26.495930 | orchestrator | Calculate VG sizes (with buffer) ---------------------------------------- 0.82s 2026-04-24 02:54:26.495940 | orchestrator | Get initial list of available block devices ----------------------------- 0.77s 2026-04-24 02:54:26.495951 | orchestrator | Print 'Create block VGs' ------------------------------------------------ 0.75s 2026-04-24 02:54:26.495962 | orchestrator | Add known links to the list of available block devices ------------------ 0.73s 2026-04-24 02:54:26.495973 | orchestrator | Fail if block LV defined in lvm_volumes is missing ---------------------- 0.73s 2026-04-24 02:54:26.495983 | orchestrator | Add known partitions to the list of available block devices ------------- 0.73s 2026-04-24 02:54:26.495994 | orchestrator | Print 'Create block LVs' ------------------------------------------------ 0.72s 2026-04-24 02:54:39.045891 | orchestrator | 2026-04-24 02:54:39 | INFO  | Task ef4018e2-58e3-4f2f-9d31-7db0cbb36814 (facts) was prepared for execution. 2026-04-24 02:54:39.046087 | orchestrator | 2026-04-24 02:54:39 | INFO  | It takes a moment until task ef4018e2-58e3-4f2f-9d31-7db0cbb36814 (facts) has been started and output is visible here. 2026-04-24 02:54:52.367037 | orchestrator | 2026-04-24 02:54:52.367149 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-24 02:54:52.367266 | orchestrator | 2026-04-24 02:54:52.367292 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-24 02:54:52.367310 | orchestrator | Friday 24 April 2026 02:54:43 +0000 (0:00:00.296) 0:00:00.296 ********** 2026-04-24 02:54:52.367327 | orchestrator | ok: [testbed-manager] 2026-04-24 02:54:52.367346 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:54:52.367362 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:54:52.367379 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:54:52.367396 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:54:52.367413 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:54:52.367430 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:52.367449 | orchestrator | 2026-04-24 02:54:52.367466 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-24 02:54:52.367484 | orchestrator | Friday 24 April 2026 02:54:44 +0000 (0:00:01.183) 0:00:01.480 ********** 2026-04-24 02:54:52.367502 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:54:52.367519 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:54:52.367530 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:54:52.367567 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:54:52.367579 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:54:52.367590 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:52.367600 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:52.367611 | orchestrator | 2026-04-24 02:54:52.367622 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-24 02:54:52.367633 | orchestrator | 2026-04-24 02:54:52.367644 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 02:54:52.367655 | orchestrator | Friday 24 April 2026 02:54:45 +0000 (0:00:01.350) 0:00:02.830 ********** 2026-04-24 02:54:52.367665 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:54:52.367676 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:54:52.367687 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:54:52.367697 | orchestrator | ok: [testbed-manager] 2026-04-24 02:54:52.367707 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:54:52.367716 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:54:52.367726 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:54:52.367735 | orchestrator | 2026-04-24 02:54:52.367745 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-24 02:54:52.367754 | orchestrator | 2026-04-24 02:54:52.367764 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-24 02:54:52.367773 | orchestrator | Friday 24 April 2026 02:54:51 +0000 (0:00:05.411) 0:00:08.242 ********** 2026-04-24 02:54:52.367783 | orchestrator | skipping: [testbed-manager] 2026-04-24 02:54:52.367792 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:54:52.367801 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:54:52.367811 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:54:52.367820 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:54:52.367830 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:54:52.367839 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:54:52.367849 | orchestrator | 2026-04-24 02:54:52.367858 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 02:54:52.367868 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:54:52.367880 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:54:52.367889 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:54:52.367900 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:54:52.367909 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:54:52.367950 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:54:52.367960 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 02:54:52.367970 | orchestrator | 2026-04-24 02:54:52.367979 | orchestrator | 2026-04-24 02:54:52.367989 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 02:54:52.368013 | orchestrator | Friday 24 April 2026 02:54:51 +0000 (0:00:00.548) 0:00:08.790 ********** 2026-04-24 02:54:52.368023 | orchestrator | =============================================================================== 2026-04-24 02:54:52.368033 | orchestrator | Gathers facts about hosts ----------------------------------------------- 5.41s 2026-04-24 02:54:52.368042 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.35s 2026-04-24 02:54:52.368052 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.18s 2026-04-24 02:54:52.368061 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.55s 2026-04-24 02:54:54.781624 | orchestrator | 2026-04-24 02:54:54 | INFO  | Task f0c7cf0b-df80-4183-9b06-56e2e0cc7a8c (ceph) was prepared for execution. 2026-04-24 02:54:54.781725 | orchestrator | 2026-04-24 02:54:54 | INFO  | It takes a moment until task f0c7cf0b-df80-4183-9b06-56e2e0cc7a8c (ceph) has been started and output is visible here. 2026-04-24 02:55:13.194763 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-24 02:55:13.194876 | orchestrator | 2.16.14 2026-04-24 02:55:13.194892 | orchestrator | 2026-04-24 02:55:13.194905 | orchestrator | PLAY [Prepare deployment of Ceph services] ************************************* 2026-04-24 02:55:13.194917 | orchestrator | 2026-04-24 02:55:13.194928 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 02:55:13.194939 | orchestrator | Friday 24 April 2026 02:54:59 +0000 (0:00:00.857) 0:00:00.857 ********** 2026-04-24 02:55:13.194951 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:55:13.194963 | orchestrator | 2026-04-24 02:55:13.194974 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 02:55:13.194985 | orchestrator | Friday 24 April 2026 02:55:01 +0000 (0:00:01.213) 0:00:02.071 ********** 2026-04-24 02:55:13.194996 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:13.195007 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:13.195017 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:13.195028 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:13.195038 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:13.195049 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:13.195060 | orchestrator | 2026-04-24 02:55:13.195071 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 02:55:13.195082 | orchestrator | Friday 24 April 2026 02:55:02 +0000 (0:00:01.272) 0:00:03.343 ********** 2026-04-24 02:55:13.195093 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:13.195104 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:13.195114 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:13.195125 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:13.195135 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:13.195146 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:13.195156 | orchestrator | 2026-04-24 02:55:13.195167 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 02:55:13.195178 | orchestrator | Friday 24 April 2026 02:55:03 +0000 (0:00:00.788) 0:00:04.132 ********** 2026-04-24 02:55:13.195188 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:13.195199 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:13.195210 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:13.195220 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:13.195257 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:13.195268 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:13.195278 | orchestrator | 2026-04-24 02:55:13.195289 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 02:55:13.195303 | orchestrator | Friday 24 April 2026 02:55:04 +0000 (0:00:00.933) 0:00:05.066 ********** 2026-04-24 02:55:13.195315 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:13.195327 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:13.195338 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:13.195350 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:13.195362 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:13.195375 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:13.195387 | orchestrator | 2026-04-24 02:55:13.195400 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 02:55:13.195412 | orchestrator | Friday 24 April 2026 02:55:05 +0000 (0:00:00.843) 0:00:05.909 ********** 2026-04-24 02:55:13.195424 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:13.195436 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:13.195447 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:13.195459 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:13.195471 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:13.195483 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:13.195495 | orchestrator | 2026-04-24 02:55:13.195506 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 02:55:13.195546 | orchestrator | Friday 24 April 2026 02:55:05 +0000 (0:00:00.636) 0:00:06.546 ********** 2026-04-24 02:55:13.195561 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:13.195574 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:13.195586 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:13.195598 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:13.195610 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:13.195622 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:13.195635 | orchestrator | 2026-04-24 02:55:13.195647 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 02:55:13.195657 | orchestrator | Friday 24 April 2026 02:55:06 +0000 (0:00:00.830) 0:00:07.376 ********** 2026-04-24 02:55:13.195680 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:13.195692 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:13.195703 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:13.195713 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:13.195724 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:13.195735 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:13.195745 | orchestrator | 2026-04-24 02:55:13.195756 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 02:55:13.195767 | orchestrator | Friday 24 April 2026 02:55:07 +0000 (0:00:00.617) 0:00:07.994 ********** 2026-04-24 02:55:13.195778 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:13.195788 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:13.195799 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:13.195810 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:13.195821 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:13.195888 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:13.195901 | orchestrator | 2026-04-24 02:55:13.195912 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 02:55:13.195923 | orchestrator | Friday 24 April 2026 02:55:07 +0000 (0:00:00.857) 0:00:08.852 ********** 2026-04-24 02:55:13.195934 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 02:55:13.195945 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 02:55:13.195955 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 02:55:13.195966 | orchestrator | 2026-04-24 02:55:13.195977 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 02:55:13.195987 | orchestrator | Friday 24 April 2026 02:55:08 +0000 (0:00:00.675) 0:00:09.528 ********** 2026-04-24 02:55:13.196007 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:13.196018 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:13.196029 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:13.196059 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:13.196071 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:13.196082 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:13.196092 | orchestrator | 2026-04-24 02:55:13.196103 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 02:55:13.196114 | orchestrator | Friday 24 April 2026 02:55:09 +0000 (0:00:00.760) 0:00:10.288 ********** 2026-04-24 02:55:13.196125 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 02:55:13.196136 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 02:55:13.196146 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 02:55:13.196157 | orchestrator | 2026-04-24 02:55:13.196168 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 02:55:13.196179 | orchestrator | Friday 24 April 2026 02:55:11 +0000 (0:00:02.357) 0:00:12.646 ********** 2026-04-24 02:55:13.196189 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 02:55:13.196201 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 02:55:13.196211 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 02:55:13.196222 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:13.196233 | orchestrator | 2026-04-24 02:55:13.196244 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 02:55:13.196254 | orchestrator | Friday 24 April 2026 02:55:12 +0000 (0:00:00.453) 0:00:13.099 ********** 2026-04-24 02:55:13.196267 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 02:55:13.196281 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 02:55:13.196292 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 02:55:13.196303 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:13.196314 | orchestrator | 2026-04-24 02:55:13.196325 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 02:55:13.196335 | orchestrator | Friday 24 April 2026 02:55:12 +0000 (0:00:00.646) 0:00:13.746 ********** 2026-04-24 02:55:13.196365 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:13.196391 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:13.196403 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:13.196422 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:13.196433 | orchestrator | 2026-04-24 02:55:13.196450 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 02:55:13.196461 | orchestrator | Friday 24 April 2026 02:55:12 +0000 (0:00:00.154) 0:00:13.900 ********** 2026-04-24 02:55:13.196494 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 02:55:10.249754', 'end': '2026-04-24 02:55:10.294420', 'delta': '0:00:00.044666', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 02:55:23.355825 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 02:55:10.797311', 'end': '2026-04-24 02:55:10.842304', 'delta': '0:00:00.044993', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 02:55:23.355934 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 02:55:11.344273', 'end': '2026-04-24 02:55:11.394614', 'delta': '0:00:00.050341', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 02:55:23.355947 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.355958 | orchestrator | 2026-04-24 02:55:23.355967 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 02:55:23.355976 | orchestrator | Friday 24 April 2026 02:55:13 +0000 (0:00:00.188) 0:00:14.088 ********** 2026-04-24 02:55:23.355983 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:23.355992 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:23.355999 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:23.356006 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:23.356013 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:23.356020 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:23.356027 | orchestrator | 2026-04-24 02:55:23.356035 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 02:55:23.356042 | orchestrator | Friday 24 April 2026 02:55:13 +0000 (0:00:00.741) 0:00:14.830 ********** 2026-04-24 02:55:23.356050 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 02:55:23.356057 | orchestrator | 2026-04-24 02:55:23.356065 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 02:55:23.356072 | orchestrator | Friday 24 April 2026 02:55:14 +0000 (0:00:00.932) 0:00:15.762 ********** 2026-04-24 02:55:23.356101 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356109 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356116 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356123 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356130 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356137 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356144 | orchestrator | 2026-04-24 02:55:23.356152 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 02:55:23.356159 | orchestrator | Friday 24 April 2026 02:55:15 +0000 (0:00:00.860) 0:00:16.623 ********** 2026-04-24 02:55:23.356167 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356174 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356181 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356188 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356195 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356202 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356209 | orchestrator | 2026-04-24 02:55:23.356216 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 02:55:23.356223 | orchestrator | Friday 24 April 2026 02:55:16 +0000 (0:00:01.210) 0:00:17.834 ********** 2026-04-24 02:55:23.356230 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356237 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356244 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356251 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356258 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356279 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356286 | orchestrator | 2026-04-24 02:55:23.356294 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 02:55:23.356301 | orchestrator | Friday 24 April 2026 02:55:17 +0000 (0:00:00.676) 0:00:18.510 ********** 2026-04-24 02:55:23.356308 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356315 | orchestrator | 2026-04-24 02:55:23.356322 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 02:55:23.356330 | orchestrator | Friday 24 April 2026 02:55:17 +0000 (0:00:00.133) 0:00:18.643 ********** 2026-04-24 02:55:23.356337 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356344 | orchestrator | 2026-04-24 02:55:23.356351 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 02:55:23.356358 | orchestrator | Friday 24 April 2026 02:55:17 +0000 (0:00:00.218) 0:00:18.862 ********** 2026-04-24 02:55:23.356365 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356372 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356379 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356386 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356393 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356401 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356408 | orchestrator | 2026-04-24 02:55:23.356431 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 02:55:23.356439 | orchestrator | Friday 24 April 2026 02:55:18 +0000 (0:00:00.802) 0:00:19.664 ********** 2026-04-24 02:55:23.356446 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356453 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356461 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356467 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356475 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356482 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356489 | orchestrator | 2026-04-24 02:55:23.356496 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 02:55:23.356503 | orchestrator | Friday 24 April 2026 02:55:19 +0000 (0:00:00.615) 0:00:20.279 ********** 2026-04-24 02:55:23.356510 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356566 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356574 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356588 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356595 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356602 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356609 | orchestrator | 2026-04-24 02:55:23.356617 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 02:55:23.356624 | orchestrator | Friday 24 April 2026 02:55:20 +0000 (0:00:00.798) 0:00:21.078 ********** 2026-04-24 02:55:23.356631 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356638 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356645 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356652 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356659 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356666 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356674 | orchestrator | 2026-04-24 02:55:23.356681 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 02:55:23.356688 | orchestrator | Friday 24 April 2026 02:55:20 +0000 (0:00:00.608) 0:00:21.687 ********** 2026-04-24 02:55:23.356695 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356702 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356709 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356716 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356723 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356730 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356737 | orchestrator | 2026-04-24 02:55:23.356745 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 02:55:23.356752 | orchestrator | Friday 24 April 2026 02:55:21 +0000 (0:00:00.804) 0:00:22.492 ********** 2026-04-24 02:55:23.356759 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356766 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356773 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356780 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356787 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356794 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356801 | orchestrator | 2026-04-24 02:55:23.356808 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 02:55:23.356816 | orchestrator | Friday 24 April 2026 02:55:22 +0000 (0:00:00.629) 0:00:23.121 ********** 2026-04-24 02:55:23.356823 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.356830 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.356837 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:23.356844 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:23.356851 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:23.356858 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:23.356865 | orchestrator | 2026-04-24 02:55:23.356873 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 02:55:23.356880 | orchestrator | Friday 24 April 2026 02:55:23 +0000 (0:00:00.867) 0:00:23.989 ********** 2026-04-24 02:55:23.356888 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.356903 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.356925 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382143 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382219 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382227 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382235 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382242 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382249 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382257 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382335 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382357 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382367 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.382375 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.382383 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.383722 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.383780 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.533736 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.533834 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.533850 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.533865 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.533929 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-05-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.533982 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.533996 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.534007 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.535680 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.535729 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.535772 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.535786 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.535808 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697435 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-12-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.697542 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697560 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697591 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697617 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697625 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:23.697633 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697640 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697647 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697668 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697676 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697682 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697697 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.697711 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.697724 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.916007 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.916108 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.916123 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.916216 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.916245 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.916258 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.916271 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-04-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.916283 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.916310 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.916329 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.916351 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-10-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:23.916363 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:23.916375 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.916386 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:23.916405 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148117 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148247 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148263 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148276 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148304 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148341 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:24.148358 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-08-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:24.148380 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:24.148392 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:24.148404 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:24.148433 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148467 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148493 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148595 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148623 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148635 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.148657 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 02:55:24.397701 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:24.397809 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-07-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 02:55:24.397827 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:24.397841 | orchestrator | 2026-04-24 02:55:24.397854 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 02:55:24.397867 | orchestrator | Friday 24 April 2026 02:55:24 +0000 (0:00:01.051) 0:00:25.040 ********** 2026-04-24 02:55:24.397882 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.397987 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.398003 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.398075 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.398099 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.398111 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.398122 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.398149 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.398171 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.720801 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.720954 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.721017 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.721068 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.721099 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.721122 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.721144 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.721178 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.721212 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-05-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.839977 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840094 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840111 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840123 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840157 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840170 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840183 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:24.840216 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840239 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840262 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.840329 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941263 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941363 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-12-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941399 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941412 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941425 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941481 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941501 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941568 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941589 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941600 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941612 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941623 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:24.941668 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059088 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:25.059194 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059214 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059227 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059241 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-04-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059302 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059317 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059329 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059431 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059457 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059470 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059490 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.059558 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282154 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282245 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-10-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282273 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:25.282283 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282307 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282316 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282324 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282333 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282393 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282408 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282416 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.282432 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503553 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-08-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503622 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:25.503629 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:25.503634 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503640 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503644 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503648 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503652 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503716 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503722 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503726 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503733 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:25.503750 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-07-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 02:55:37.043708 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:37.043822 | orchestrator | 2026-04-24 02:55:37.043839 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 02:55:37.043852 | orchestrator | Friday 24 April 2026 02:55:25 +0000 (0:00:01.351) 0:00:26.392 ********** 2026-04-24 02:55:37.043864 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:37.043875 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:37.043886 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:37.043897 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:37.043908 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:37.043918 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:37.043929 | orchestrator | 2026-04-24 02:55:37.043941 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 02:55:37.043952 | orchestrator | Friday 24 April 2026 02:55:26 +0000 (0:00:00.967) 0:00:27.359 ********** 2026-04-24 02:55:37.043963 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:37.043974 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:37.043985 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:37.043996 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:37.044006 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:37.044017 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:37.044028 | orchestrator | 2026-04-24 02:55:37.044039 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 02:55:37.044050 | orchestrator | Friday 24 April 2026 02:55:27 +0000 (0:00:00.830) 0:00:28.190 ********** 2026-04-24 02:55:37.044061 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.044072 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:37.044083 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:37.044094 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:37.044105 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:37.044115 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:37.044126 | orchestrator | 2026-04-24 02:55:37.044138 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 02:55:37.044150 | orchestrator | Friday 24 April 2026 02:55:27 +0000 (0:00:00.596) 0:00:28.786 ********** 2026-04-24 02:55:37.044161 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.044172 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:37.044183 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:37.044194 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:37.044205 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:37.044216 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:37.044227 | orchestrator | 2026-04-24 02:55:37.044238 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 02:55:37.044251 | orchestrator | Friday 24 April 2026 02:55:28 +0000 (0:00:00.826) 0:00:29.613 ********** 2026-04-24 02:55:37.044264 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.044276 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:37.044290 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:37.044327 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:37.044341 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:37.044354 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:37.044367 | orchestrator | 2026-04-24 02:55:37.044379 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 02:55:37.044393 | orchestrator | Friday 24 April 2026 02:55:29 +0000 (0:00:00.673) 0:00:30.286 ********** 2026-04-24 02:55:37.044405 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.044418 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:37.044430 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:37.044443 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:37.044455 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:37.044467 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:37.044480 | orchestrator | 2026-04-24 02:55:37.044493 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 02:55:37.044532 | orchestrator | Friday 24 April 2026 02:55:30 +0000 (0:00:00.895) 0:00:31.182 ********** 2026-04-24 02:55:37.044545 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-24 02:55:37.044558 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-24 02:55:37.044571 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-24 02:55:37.044583 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-24 02:55:37.044595 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-24 02:55:37.044606 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-24 02:55:37.044617 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-24 02:55:37.044628 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 02:55:37.044638 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-24 02:55:37.044649 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-24 02:55:37.044660 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-24 02:55:37.044671 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 02:55:37.044682 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-24 02:55:37.044692 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-24 02:55:37.044703 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 02:55:37.044714 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 02:55:37.044724 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 02:55:37.044749 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-24 02:55:37.044761 | orchestrator | 2026-04-24 02:55:37.044813 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 02:55:37.044825 | orchestrator | Friday 24 April 2026 02:55:31 +0000 (0:00:01.577) 0:00:32.760 ********** 2026-04-24 02:55:37.044836 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 02:55:37.044848 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 02:55:37.044859 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 02:55:37.044870 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.044881 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 02:55:37.044892 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 02:55:37.044903 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 02:55:37.044931 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:37.044943 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 02:55:37.044953 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 02:55:37.044964 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 02:55:37.044975 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:37.044985 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 02:55:37.044996 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 02:55:37.045017 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 02:55:37.045028 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:37.045039 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 02:55:37.045049 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 02:55:37.045060 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 02:55:37.045071 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:37.045081 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 02:55:37.045092 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 02:55:37.045103 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 02:55:37.045114 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:37.045124 | orchestrator | 2026-04-24 02:55:37.045135 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 02:55:37.045146 | orchestrator | Friday 24 April 2026 02:55:32 +0000 (0:00:00.929) 0:00:33.689 ********** 2026-04-24 02:55:37.045157 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:37.045168 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:37.045178 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:37.045190 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:55:37.045201 | orchestrator | 2026-04-24 02:55:37.045212 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 02:55:37.045224 | orchestrator | Friday 24 April 2026 02:55:33 +0000 (0:00:00.983) 0:00:34.673 ********** 2026-04-24 02:55:37.045235 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.045246 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:37.045257 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:37.045267 | orchestrator | 2026-04-24 02:55:37.045278 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 02:55:37.045289 | orchestrator | Friday 24 April 2026 02:55:34 +0000 (0:00:00.365) 0:00:35.038 ********** 2026-04-24 02:55:37.045300 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.045311 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:37.045321 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:37.045332 | orchestrator | 2026-04-24 02:55:37.045343 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 02:55:37.045354 | orchestrator | Friday 24 April 2026 02:55:34 +0000 (0:00:00.361) 0:00:35.400 ********** 2026-04-24 02:55:37.045364 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.045375 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:37.045386 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:37.045397 | orchestrator | 2026-04-24 02:55:37.045407 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 02:55:37.045418 | orchestrator | Friday 24 April 2026 02:55:35 +0000 (0:00:00.549) 0:00:35.949 ********** 2026-04-24 02:55:37.045429 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:37.045440 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:37.045450 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:37.045461 | orchestrator | 2026-04-24 02:55:37.045472 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 02:55:37.045483 | orchestrator | Friday 24 April 2026 02:55:35 +0000 (0:00:00.429) 0:00:36.379 ********** 2026-04-24 02:55:37.045494 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:55:37.045523 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:55:37.045535 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:55:37.045545 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.045556 | orchestrator | 2026-04-24 02:55:37.045567 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 02:55:37.045642 | orchestrator | Friday 24 April 2026 02:55:35 +0000 (0:00:00.407) 0:00:36.786 ********** 2026-04-24 02:55:37.045655 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:55:37.045666 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:55:37.045677 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:55:37.045687 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.045698 | orchestrator | 2026-04-24 02:55:37.045709 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 02:55:37.045720 | orchestrator | Friday 24 April 2026 02:55:36 +0000 (0:00:00.391) 0:00:37.177 ********** 2026-04-24 02:55:37.045737 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:55:37.045748 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:55:37.045759 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:55:37.045770 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:37.045780 | orchestrator | 2026-04-24 02:55:37.045791 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 02:55:37.045802 | orchestrator | Friday 24 April 2026 02:55:36 +0000 (0:00:00.407) 0:00:37.585 ********** 2026-04-24 02:55:37.045813 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:37.045824 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:37.045835 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:37.045845 | orchestrator | 2026-04-24 02:55:37.045856 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 02:55:37.045875 | orchestrator | Friday 24 April 2026 02:55:37 +0000 (0:00:00.353) 0:00:37.938 ********** 2026-04-24 02:55:56.947108 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 02:55:56.947209 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 02:55:56.947226 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 02:55:56.947236 | orchestrator | 2026-04-24 02:55:56.947247 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 02:55:56.947257 | orchestrator | Friday 24 April 2026 02:55:37 +0000 (0:00:00.953) 0:00:38.892 ********** 2026-04-24 02:55:56.947266 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 02:55:56.947276 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 02:55:56.947284 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 02:55:56.947292 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 02:55:56.947301 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 02:55:56.947310 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 02:55:56.947318 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 02:55:56.947327 | orchestrator | 2026-04-24 02:55:56.947336 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 02:55:56.947345 | orchestrator | Friday 24 April 2026 02:55:38 +0000 (0:00:00.880) 0:00:39.772 ********** 2026-04-24 02:55:56.947355 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 02:55:56.947364 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 02:55:56.947373 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 02:55:56.947382 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 02:55:56.947391 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 02:55:56.947399 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 02:55:56.947408 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 02:55:56.947418 | orchestrator | 2026-04-24 02:55:56.947428 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 02:55:56.947458 | orchestrator | Friday 24 April 2026 02:55:40 +0000 (0:00:01.953) 0:00:41.725 ********** 2026-04-24 02:55:56.947466 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:55:56.947473 | orchestrator | 2026-04-24 02:55:56.947479 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 02:55:56.947484 | orchestrator | Friday 24 April 2026 02:55:42 +0000 (0:00:01.233) 0:00:42.958 ********** 2026-04-24 02:55:56.947490 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:55:56.947547 | orchestrator | 2026-04-24 02:55:56.947553 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 02:55:56.947559 | orchestrator | Friday 24 April 2026 02:55:43 +0000 (0:00:01.261) 0:00:44.220 ********** 2026-04-24 02:55:56.947565 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:56.947571 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:56.947576 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:56.947582 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:56.947587 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:56.947593 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:56.947598 | orchestrator | 2026-04-24 02:55:56.947604 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 02:55:56.947609 | orchestrator | Friday 24 April 2026 02:55:44 +0000 (0:00:01.256) 0:00:45.477 ********** 2026-04-24 02:55:56.947614 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.947620 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:56.947625 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.947630 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:56.947636 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.947641 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:56.947646 | orchestrator | 2026-04-24 02:55:56.947652 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 02:55:56.947658 | orchestrator | Friday 24 April 2026 02:55:45 +0000 (0:00:00.740) 0:00:46.218 ********** 2026-04-24 02:55:56.947664 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:56.947670 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:56.947676 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.947683 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:56.947688 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.947694 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.947700 | orchestrator | 2026-04-24 02:55:56.947716 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 02:55:56.947723 | orchestrator | Friday 24 April 2026 02:55:46 +0000 (0:00:00.908) 0:00:47.126 ********** 2026-04-24 02:55:56.947729 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.947735 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:56.947741 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.947747 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.947753 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:56.947759 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:56.947765 | orchestrator | 2026-04-24 02:55:56.947771 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 02:55:56.947777 | orchestrator | Friday 24 April 2026 02:55:46 +0000 (0:00:00.717) 0:00:47.844 ********** 2026-04-24 02:55:56.947783 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:56.947789 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:56.947809 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:56.947815 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:56.947821 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:56.947827 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:56.947833 | orchestrator | 2026-04-24 02:55:56.947839 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 02:55:56.947850 | orchestrator | Friday 24 April 2026 02:55:48 +0000 (0:00:01.341) 0:00:49.186 ********** 2026-04-24 02:55:56.947857 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:56.947863 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:56.947869 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:56.947875 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.947881 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.947887 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.947893 | orchestrator | 2026-04-24 02:55:56.947899 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 02:55:56.947905 | orchestrator | Friday 24 April 2026 02:55:48 +0000 (0:00:00.611) 0:00:49.798 ********** 2026-04-24 02:55:56.947913 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:56.947925 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:56.947934 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:56.947943 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.947953 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.947962 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.947970 | orchestrator | 2026-04-24 02:55:56.947978 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 02:55:56.947987 | orchestrator | Friday 24 April 2026 02:55:49 +0000 (0:00:00.827) 0:00:50.625 ********** 2026-04-24 02:55:56.947997 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:56.948006 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:56.948016 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:56.948025 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:56.948035 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:56.948044 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:56.948052 | orchestrator | 2026-04-24 02:55:56.948057 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 02:55:56.948063 | orchestrator | Friday 24 April 2026 02:55:50 +0000 (0:00:01.052) 0:00:51.677 ********** 2026-04-24 02:55:56.948068 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:56.948073 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:56.948079 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:56.948084 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:56.948089 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:56.948094 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:56.948100 | orchestrator | 2026-04-24 02:55:56.948105 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 02:55:56.948110 | orchestrator | Friday 24 April 2026 02:55:52 +0000 (0:00:01.354) 0:00:53.032 ********** 2026-04-24 02:55:56.948116 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:56.948121 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:56.948126 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:56.948132 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.948137 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.948142 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.948148 | orchestrator | 2026-04-24 02:55:56.948153 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 02:55:56.948158 | orchestrator | Friday 24 April 2026 02:55:52 +0000 (0:00:00.673) 0:00:53.706 ********** 2026-04-24 02:55:56.948164 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:56.948169 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:56.948174 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:56.948180 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:55:56.948185 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:55:56.948190 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:55:56.948195 | orchestrator | 2026-04-24 02:55:56.948201 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 02:55:56.948206 | orchestrator | Friday 24 April 2026 02:55:53 +0000 (0:00:00.859) 0:00:54.565 ********** 2026-04-24 02:55:56.948211 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:56.948217 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:56.948227 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:56.948233 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.948238 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.948243 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.948249 | orchestrator | 2026-04-24 02:55:56.948254 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 02:55:56.948259 | orchestrator | Friday 24 April 2026 02:55:54 +0000 (0:00:00.613) 0:00:55.179 ********** 2026-04-24 02:55:56.948265 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:56.948270 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:56.948275 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:56.948281 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.948286 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.948291 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.948296 | orchestrator | 2026-04-24 02:55:56.948302 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 02:55:56.948307 | orchestrator | Friday 24 April 2026 02:55:55 +0000 (0:00:00.914) 0:00:56.093 ********** 2026-04-24 02:55:56.948312 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:55:56.948318 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:55:56.948323 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:55:56.948328 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.948334 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.948343 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.948348 | orchestrator | 2026-04-24 02:55:56.948354 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 02:55:56.948359 | orchestrator | Friday 24 April 2026 02:55:55 +0000 (0:00:00.643) 0:00:56.737 ********** 2026-04-24 02:55:56.948364 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:56.948370 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:55:56.948375 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:55:56.948381 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:55:56.948390 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:55:56.948399 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:55:56.948408 | orchestrator | 2026-04-24 02:55:56.948416 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 02:55:56.948425 | orchestrator | Friday 24 April 2026 02:55:56 +0000 (0:00:00.824) 0:00:57.562 ********** 2026-04-24 02:55:56.948433 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:55:56.948448 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:12.301690 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:12.301801 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:12.301813 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:12.301822 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:12.301853 | orchestrator | 2026-04-24 02:57:12.301862 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 02:57:12.301871 | orchestrator | Friday 24 April 2026 02:55:57 +0000 (0:00:00.583) 0:00:58.146 ********** 2026-04-24 02:57:12.301878 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:12.301886 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:12.301893 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:12.301901 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:57:12.301910 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:57:12.301917 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:57:12.301924 | orchestrator | 2026-04-24 02:57:12.301932 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 02:57:12.301940 | orchestrator | Friday 24 April 2026 02:55:58 +0000 (0:00:00.865) 0:00:59.011 ********** 2026-04-24 02:57:12.301947 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:12.301954 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:12.301962 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:12.301969 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:57:12.301976 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:57:12.301983 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:57:12.302081 | orchestrator | 2026-04-24 02:57:12.302092 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 02:57:12.302100 | orchestrator | Friday 24 April 2026 02:55:58 +0000 (0:00:00.647) 0:00:59.659 ********** 2026-04-24 02:57:12.302107 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:12.302115 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:12.302122 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:12.302130 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:57:12.302137 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:57:12.302144 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:57:12.302198 | orchestrator | 2026-04-24 02:57:12.302208 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 02:57:12.302217 | orchestrator | Friday 24 April 2026 02:56:00 +0000 (0:00:01.313) 0:01:00.972 ********** 2026-04-24 02:57:12.302225 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:57:12.302253 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:57:12.302261 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:57:12.302269 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:57:12.302277 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:57:12.302285 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:57:12.302293 | orchestrator | 2026-04-24 02:57:12.302301 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 02:57:12.302309 | orchestrator | Friday 24 April 2026 02:56:01 +0000 (0:00:01.787) 0:01:02.760 ********** 2026-04-24 02:57:12.302317 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:57:12.302325 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:57:12.302333 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:57:12.302341 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:57:12.302349 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:57:12.302357 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:57:12.302365 | orchestrator | 2026-04-24 02:57:12.302372 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 02:57:12.302378 | orchestrator | Friday 24 April 2026 02:56:04 +0000 (0:00:02.375) 0:01:05.135 ********** 2026-04-24 02:57:12.302385 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:57:12.302393 | orchestrator | 2026-04-24 02:57:12.302401 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 02:57:12.302409 | orchestrator | Friday 24 April 2026 02:56:05 +0000 (0:00:01.255) 0:01:06.391 ********** 2026-04-24 02:57:12.302434 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:12.302444 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:12.302452 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:12.302460 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:12.302510 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:12.302518 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:12.302524 | orchestrator | 2026-04-24 02:57:12.302530 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 02:57:12.302537 | orchestrator | Friday 24 April 2026 02:56:06 +0000 (0:00:00.618) 0:01:07.010 ********** 2026-04-24 02:57:12.302542 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:12.302548 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:12.302554 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:12.302560 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:12.302588 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:12.302596 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:12.302602 | orchestrator | 2026-04-24 02:57:12.302609 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 02:57:12.302617 | orchestrator | Friday 24 April 2026 02:56:06 +0000 (0:00:00.818) 0:01:07.828 ********** 2026-04-24 02:57:12.302624 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 02:57:12.302645 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 02:57:12.302661 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 02:57:12.302669 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 02:57:12.302676 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 02:57:12.302683 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 02:57:12.302691 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 02:57:12.302698 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 02:57:12.302706 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 02:57:12.302729 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 02:57:12.302737 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 02:57:12.302744 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 02:57:12.302751 | orchestrator | 2026-04-24 02:57:12.302759 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 02:57:12.302766 | orchestrator | Friday 24 April 2026 02:56:08 +0000 (0:00:01.352) 0:01:09.181 ********** 2026-04-24 02:57:12.302773 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:57:12.302780 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:57:12.302787 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:57:12.302794 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:57:12.302801 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:57:12.302808 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:57:12.302815 | orchestrator | 2026-04-24 02:57:12.302822 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 02:57:12.302829 | orchestrator | Friday 24 April 2026 02:56:09 +0000 (0:00:01.135) 0:01:10.316 ********** 2026-04-24 02:57:12.302837 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:12.302844 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:12.302851 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:12.302858 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:12.302865 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:12.302872 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:12.302879 | orchestrator | 2026-04-24 02:57:12.302886 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 02:57:12.302893 | orchestrator | Friday 24 April 2026 02:56:10 +0000 (0:00:00.663) 0:01:10.979 ********** 2026-04-24 02:57:12.302900 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:12.302907 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:12.302914 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:12.302921 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:12.302948 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:12.302956 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:12.302963 | orchestrator | 2026-04-24 02:57:12.302970 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 02:57:12.302978 | orchestrator | Friday 24 April 2026 02:56:10 +0000 (0:00:00.836) 0:01:11.816 ********** 2026-04-24 02:57:12.302985 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:12.302992 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:12.302999 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:12.303004 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:12.303010 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:12.303031 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:12.303040 | orchestrator | 2026-04-24 02:57:12.303047 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 02:57:12.303054 | orchestrator | Friday 24 April 2026 02:56:11 +0000 (0:00:00.591) 0:01:12.408 ********** 2026-04-24 02:57:12.303068 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:57:12.303076 | orchestrator | 2026-04-24 02:57:12.303083 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 02:57:12.303090 | orchestrator | Friday 24 April 2026 02:56:12 +0000 (0:00:01.221) 0:01:13.629 ********** 2026-04-24 02:57:12.303097 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:57:12.303105 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:12.303113 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:57:12.303120 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:12.303127 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:12.303134 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:57:12.303141 | orchestrator | 2026-04-24 02:57:12.303148 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 02:57:12.303172 | orchestrator | Friday 24 April 2026 02:57:11 +0000 (0:00:58.881) 0:02:12.511 ********** 2026-04-24 02:57:12.303182 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 02:57:12.303189 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 02:57:12.303196 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 02:57:12.303203 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:12.303210 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 02:57:12.303217 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 02:57:12.303224 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 02:57:12.303232 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:12.303239 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 02:57:12.303246 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 02:57:12.303257 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 02:57:12.303265 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:12.303271 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 02:57:12.303279 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 02:57:12.303286 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 02:57:12.303293 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:12.303320 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 02:57:12.303328 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 02:57:12.303335 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 02:57:12.303348 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.036400 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 02:57:36.036562 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 02:57:36.036580 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 02:57:36.036592 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.036605 | orchestrator | 2026-04-24 02:57:36.036617 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 02:57:36.036629 | orchestrator | Friday 24 April 2026 02:57:12 +0000 (0:00:00.685) 0:02:13.196 ********** 2026-04-24 02:57:36.036640 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.036650 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.036662 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.036672 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.036683 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.036718 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.036730 | orchestrator | 2026-04-24 02:57:36.036741 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 02:57:36.036752 | orchestrator | Friday 24 April 2026 02:57:13 +0000 (0:00:00.832) 0:02:14.028 ********** 2026-04-24 02:57:36.036763 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.036774 | orchestrator | 2026-04-24 02:57:36.036784 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 02:57:36.036795 | orchestrator | Friday 24 April 2026 02:57:13 +0000 (0:00:00.143) 0:02:14.171 ********** 2026-04-24 02:57:36.036806 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.036817 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.036827 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.036838 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.036849 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.036859 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.036870 | orchestrator | 2026-04-24 02:57:36.036881 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 02:57:36.036892 | orchestrator | Friday 24 April 2026 02:57:13 +0000 (0:00:00.639) 0:02:14.811 ********** 2026-04-24 02:57:36.036903 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.036913 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.036924 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.036935 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.036948 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.036960 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.036973 | orchestrator | 2026-04-24 02:57:36.036987 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 02:57:36.036999 | orchestrator | Friday 24 April 2026 02:57:14 +0000 (0:00:00.852) 0:02:15.663 ********** 2026-04-24 02:57:36.037012 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.037024 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.037037 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.037050 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.037062 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.037075 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.037087 | orchestrator | 2026-04-24 02:57:36.037099 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 02:57:36.037113 | orchestrator | Friday 24 April 2026 02:57:15 +0000 (0:00:00.637) 0:02:16.301 ********** 2026-04-24 02:57:36.037125 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:36.037138 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:36.037151 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:36.037163 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:57:36.037176 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:57:36.037188 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:57:36.037201 | orchestrator | 2026-04-24 02:57:36.037213 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 02:57:36.037226 | orchestrator | Friday 24 April 2026 02:57:19 +0000 (0:00:03.627) 0:02:19.929 ********** 2026-04-24 02:57:36.037238 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:36.037250 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:36.037262 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:36.037275 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:57:36.037288 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:57:36.037298 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:57:36.037309 | orchestrator | 2026-04-24 02:57:36.037320 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 02:57:36.037331 | orchestrator | Friday 24 April 2026 02:57:19 +0000 (0:00:00.600) 0:02:20.529 ********** 2026-04-24 02:57:36.037343 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:57:36.037355 | orchestrator | 2026-04-24 02:57:36.037366 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 02:57:36.037385 | orchestrator | Friday 24 April 2026 02:57:20 +0000 (0:00:01.291) 0:02:21.820 ********** 2026-04-24 02:57:36.037396 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.037407 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.037418 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.037429 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.037475 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.037488 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.037499 | orchestrator | 2026-04-24 02:57:36.037510 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 02:57:36.037521 | orchestrator | Friday 24 April 2026 02:57:21 +0000 (0:00:00.844) 0:02:22.665 ********** 2026-04-24 02:57:36.037531 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.037542 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.037553 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.037564 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.037574 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.037585 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.037596 | orchestrator | 2026-04-24 02:57:36.037607 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 02:57:36.037618 | orchestrator | Friday 24 April 2026 02:57:22 +0000 (0:00:00.617) 0:02:23.282 ********** 2026-04-24 02:57:36.037628 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.037656 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.037668 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.037679 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.037689 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.037714 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.037725 | orchestrator | 2026-04-24 02:57:36.037736 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 02:57:36.037747 | orchestrator | Friday 24 April 2026 02:57:23 +0000 (0:00:00.881) 0:02:24.163 ********** 2026-04-24 02:57:36.037758 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.037769 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.037779 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.037790 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.037801 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.037811 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.037822 | orchestrator | 2026-04-24 02:57:36.037833 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 02:57:36.037844 | orchestrator | Friday 24 April 2026 02:57:23 +0000 (0:00:00.632) 0:02:24.796 ********** 2026-04-24 02:57:36.037854 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.037865 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.037876 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.037886 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.037897 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.037907 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.037918 | orchestrator | 2026-04-24 02:57:36.037929 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 02:57:36.037939 | orchestrator | Friday 24 April 2026 02:57:24 +0000 (0:00:00.908) 0:02:25.704 ********** 2026-04-24 02:57:36.037950 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.037961 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.037971 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.037982 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.037993 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.038003 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.038014 | orchestrator | 2026-04-24 02:57:36.038087 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 02:57:36.038099 | orchestrator | Friday 24 April 2026 02:57:25 +0000 (0:00:00.637) 0:02:26.342 ********** 2026-04-24 02:57:36.038118 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.038129 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.038140 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.038151 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.038161 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.038172 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.038183 | orchestrator | 2026-04-24 02:57:36.038193 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 02:57:36.038204 | orchestrator | Friday 24 April 2026 02:57:26 +0000 (0:00:00.840) 0:02:27.183 ********** 2026-04-24 02:57:36.038215 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:36.038225 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:36.038236 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:36.038247 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:36.038257 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:36.038268 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:36.038279 | orchestrator | 2026-04-24 02:57:36.038290 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 02:57:36.038300 | orchestrator | Friday 24 April 2026 02:57:26 +0000 (0:00:00.640) 0:02:27.824 ********** 2026-04-24 02:57:36.038311 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:36.038322 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:36.038333 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:36.038344 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:57:36.038354 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:57:36.038365 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:57:36.038376 | orchestrator | 2026-04-24 02:57:36.038386 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 02:57:36.038397 | orchestrator | Friday 24 April 2026 02:57:28 +0000 (0:00:01.280) 0:02:29.104 ********** 2026-04-24 02:57:36.038409 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:57:36.038421 | orchestrator | 2026-04-24 02:57:36.038432 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 02:57:36.038485 | orchestrator | Friday 24 April 2026 02:57:29 +0000 (0:00:01.261) 0:02:30.366 ********** 2026-04-24 02:57:36.038533 | orchestrator | changed: [testbed-node-3] => (item=/etc/ceph) 2026-04-24 02:57:36.038558 | orchestrator | changed: [testbed-node-4] => (item=/etc/ceph) 2026-04-24 02:57:36.038569 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-24 02:57:36.038580 | orchestrator | changed: [testbed-node-5] => (item=/etc/ceph) 2026-04-24 02:57:36.038590 | orchestrator | changed: [testbed-node-0] => (item=/etc/ceph) 2026-04-24 02:57:36.038601 | orchestrator | changed: [testbed-node-1] => (item=/etc/ceph) 2026-04-24 02:57:36.038612 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-24 02:57:36.038629 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-24 02:57:36.038640 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-24 02:57:36.038651 | orchestrator | changed: [testbed-node-2] => (item=/etc/ceph) 2026-04-24 02:57:36.038661 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-24 02:57:36.038672 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-24 02:57:36.038683 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-24 02:57:36.038693 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-24 02:57:36.038704 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-24 02:57:36.038715 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-24 02:57:36.038726 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-24 02:57:36.038745 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-24 02:57:41.406590 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-24 02:57:41.406725 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-24 02:57:41.406740 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-24 02:57:41.406752 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-24 02:57:41.406763 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-24 02:57:41.406774 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-24 02:57:41.406785 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-24 02:57:41.406796 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-24 02:57:41.406806 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-24 02:57:41.406817 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-24 02:57:41.406828 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-24 02:57:41.406838 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-24 02:57:41.406849 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-24 02:57:41.406861 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-24 02:57:41.406871 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-24 02:57:41.406882 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-24 02:57:41.406892 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-24 02:57:41.406902 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-24 02:57:41.406913 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-24 02:57:41.406923 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-24 02:57:41.406934 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-24 02:57:41.406958 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-24 02:57:41.406970 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-24 02:57:41.406980 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-24 02:57:41.406991 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-24 02:57:41.407002 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 02:57:41.407013 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-24 02:57:41.407023 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-24 02:57:41.407034 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-24 02:57:41.407045 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 02:57:41.407056 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 02:57:41.407066 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-24 02:57:41.407077 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 02:57:41.407088 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-24 02:57:41.407098 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 02:57:41.407109 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 02:57:41.407120 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 02:57:41.407131 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 02:57:41.407142 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 02:57:41.407153 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 02:57:41.407163 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 02:57:41.407174 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 02:57:41.407185 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 02:57:41.407203 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 02:57:41.407215 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 02:57:41.407225 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 02:57:41.407236 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 02:57:41.407247 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 02:57:41.407257 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 02:57:41.407283 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 02:57:41.407295 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 02:57:41.407306 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 02:57:41.407316 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 02:57:41.407327 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 02:57:41.407338 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 02:57:41.407348 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 02:57:41.407359 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 02:57:41.407370 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 02:57:41.407396 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 02:57:41.407408 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 02:57:41.407418 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 02:57:41.407429 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 02:57:41.407440 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 02:57:41.407450 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 02:57:41.407484 | orchestrator | changed: [testbed-node-5] => (item=/var/run/ceph) 2026-04-24 02:57:41.407495 | orchestrator | changed: [testbed-node-4] => (item=/var/run/ceph) 2026-04-24 02:57:41.407505 | orchestrator | changed: [testbed-node-3] => (item=/var/run/ceph) 2026-04-24 02:57:41.407516 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 02:57:41.407527 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 02:57:41.407537 | orchestrator | changed: [testbed-node-5] => (item=/var/log/ceph) 2026-04-24 02:57:41.407548 | orchestrator | changed: [testbed-node-0] => (item=/var/run/ceph) 2026-04-24 02:57:41.407559 | orchestrator | changed: [testbed-node-4] => (item=/var/log/ceph) 2026-04-24 02:57:41.407569 | orchestrator | changed: [testbed-node-3] => (item=/var/log/ceph) 2026-04-24 02:57:41.407580 | orchestrator | changed: [testbed-node-2] => (item=/var/run/ceph) 2026-04-24 02:57:41.407591 | orchestrator | changed: [testbed-node-1] => (item=/var/run/ceph) 2026-04-24 02:57:41.407601 | orchestrator | changed: [testbed-node-0] => (item=/var/log/ceph) 2026-04-24 02:57:41.407612 | orchestrator | changed: [testbed-node-2] => (item=/var/log/ceph) 2026-04-24 02:57:41.407623 | orchestrator | changed: [testbed-node-1] => (item=/var/log/ceph) 2026-04-24 02:57:41.407634 | orchestrator | 2026-04-24 02:57:41.407645 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 02:57:41.407656 | orchestrator | Friday 24 April 2026 02:57:36 +0000 (0:00:06.551) 0:02:36.917 ********** 2026-04-24 02:57:41.407667 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:41.407678 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:41.407688 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:41.407700 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:57:41.407719 | orchestrator | 2026-04-24 02:57:41.407730 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 02:57:41.407741 | orchestrator | Friday 24 April 2026 02:57:37 +0000 (0:00:01.074) 0:02:37.991 ********** 2026-04-24 02:57:41.407752 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:41.407764 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:41.407775 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:41.407786 | orchestrator | 2026-04-24 02:57:41.407797 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 02:57:41.407808 | orchestrator | Friday 24 April 2026 02:57:37 +0000 (0:00:00.704) 0:02:38.696 ********** 2026-04-24 02:57:41.407818 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:41.407829 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:41.407840 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:41.407851 | orchestrator | 2026-04-24 02:57:41.407861 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 02:57:41.407872 | orchestrator | Friday 24 April 2026 02:57:39 +0000 (0:00:01.220) 0:02:39.916 ********** 2026-04-24 02:57:41.407883 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:41.407894 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:41.407904 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:41.407915 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:41.407926 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:41.407936 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:41.407947 | orchestrator | 2026-04-24 02:57:41.407957 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 02:57:41.407973 | orchestrator | Friday 24 April 2026 02:57:39 +0000 (0:00:00.889) 0:02:40.805 ********** 2026-04-24 02:57:41.407985 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:41.407995 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:41.408006 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:41.408017 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:41.408027 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:41.408038 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:41.408049 | orchestrator | 2026-04-24 02:57:41.408059 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 02:57:41.408070 | orchestrator | Friday 24 April 2026 02:57:40 +0000 (0:00:00.652) 0:02:41.458 ********** 2026-04-24 02:57:41.408080 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:41.408091 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:41.408102 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:41.408113 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:41.408123 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:41.408134 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:41.408145 | orchestrator | 2026-04-24 02:57:41.408161 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 02:57:54.974581 | orchestrator | Friday 24 April 2026 02:57:41 +0000 (0:00:00.845) 0:02:42.303 ********** 2026-04-24 02:57:54.974701 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.974718 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.974730 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.974740 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.974747 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.974754 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.974778 | orchestrator | 2026-04-24 02:57:54.974785 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 02:57:54.974792 | orchestrator | Friday 24 April 2026 02:57:42 +0000 (0:00:00.623) 0:02:42.926 ********** 2026-04-24 02:57:54.974800 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.974810 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.974826 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.974837 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.974847 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.974857 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.974867 | orchestrator | 2026-04-24 02:57:54.974877 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 02:57:54.974890 | orchestrator | Friday 24 April 2026 02:57:42 +0000 (0:00:00.847) 0:02:43.774 ********** 2026-04-24 02:57:54.974901 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.974912 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.974923 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.974933 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.974941 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.974948 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.974954 | orchestrator | 2026-04-24 02:57:54.974960 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 02:57:54.974967 | orchestrator | Friday 24 April 2026 02:57:43 +0000 (0:00:00.585) 0:02:44.360 ********** 2026-04-24 02:57:54.974973 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.974979 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.974985 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.974992 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.974998 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975004 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975010 | orchestrator | 2026-04-24 02:57:54.975016 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 02:57:54.975023 | orchestrator | Friday 24 April 2026 02:57:44 +0000 (0:00:00.858) 0:02:45.218 ********** 2026-04-24 02:57:54.975029 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.975035 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.975041 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.975047 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975053 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975059 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975065 | orchestrator | 2026-04-24 02:57:54.975072 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 02:57:54.975078 | orchestrator | Friday 24 April 2026 02:57:44 +0000 (0:00:00.601) 0:02:45.820 ********** 2026-04-24 02:57:54.975084 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975092 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975099 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975106 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:54.975114 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:54.975121 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:54.975128 | orchestrator | 2026-04-24 02:57:54.975135 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 02:57:54.975143 | orchestrator | Friday 24 April 2026 02:57:47 +0000 (0:00:02.852) 0:02:48.672 ********** 2026-04-24 02:57:54.975149 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:54.975157 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:54.975163 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:54.975170 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975177 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975183 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975189 | orchestrator | 2026-04-24 02:57:54.975195 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 02:57:54.975209 | orchestrator | Friday 24 April 2026 02:57:48 +0000 (0:00:00.618) 0:02:49.290 ********** 2026-04-24 02:57:54.975215 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:57:54.975221 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:57:54.975227 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:57:54.975233 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975239 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975245 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975251 | orchestrator | 2026-04-24 02:57:54.975257 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 02:57:54.975264 | orchestrator | Friday 24 April 2026 02:57:49 +0000 (0:00:00.920) 0:02:50.211 ********** 2026-04-24 02:57:54.975270 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.975276 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.975293 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.975299 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975305 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975311 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975318 | orchestrator | 2026-04-24 02:57:54.975324 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 02:57:54.975330 | orchestrator | Friday 24 April 2026 02:57:49 +0000 (0:00:00.625) 0:02:50.836 ********** 2026-04-24 02:57:54.975337 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:54.975345 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:54.975351 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 02:57:54.975357 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975377 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975384 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975390 | orchestrator | 2026-04-24 02:57:54.975396 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 02:57:54.975402 | orchestrator | Friday 24 April 2026 02:57:50 +0000 (0:00:00.890) 0:02:51.726 ********** 2026-04-24 02:57:54.975410 | orchestrator | skipping: [testbed-node-3] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}])  2026-04-24 02:57:54.975419 | orchestrator | skipping: [testbed-node-3] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}])  2026-04-24 02:57:54.975427 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.975433 | orchestrator | skipping: [testbed-node-4] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}])  2026-04-24 02:57:54.975440 | orchestrator | skipping: [testbed-node-4] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}])  2026-04-24 02:57:54.975494 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.975501 | orchestrator | skipping: [testbed-node-5] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}])  2026-04-24 02:57:54.975514 | orchestrator | skipping: [testbed-node-5] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}])  2026-04-24 02:57:54.975520 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.975526 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975532 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975538 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975545 | orchestrator | 2026-04-24 02:57:54.975551 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 02:57:54.975557 | orchestrator | Friday 24 April 2026 02:57:51 +0000 (0:00:00.664) 0:02:52.391 ********** 2026-04-24 02:57:54.975563 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.975569 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.975576 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.975582 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975588 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975594 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975600 | orchestrator | 2026-04-24 02:57:54.975606 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 02:57:54.975612 | orchestrator | Friday 24 April 2026 02:57:52 +0000 (0:00:00.952) 0:02:53.343 ********** 2026-04-24 02:57:54.975618 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.975624 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.975631 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.975637 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975643 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975648 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975655 | orchestrator | 2026-04-24 02:57:54.975661 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 02:57:54.975667 | orchestrator | Friday 24 April 2026 02:57:53 +0000 (0:00:00.642) 0:02:53.986 ********** 2026-04-24 02:57:54.975678 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.975684 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.975690 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.975697 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975703 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975709 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975715 | orchestrator | 2026-04-24 02:57:54.975721 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 02:57:54.975727 | orchestrator | Friday 24 April 2026 02:57:53 +0000 (0:00:00.913) 0:02:54.900 ********** 2026-04-24 02:57:54.975734 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:57:54.975740 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:57:54.975746 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:57:54.975752 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:57:54.975758 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:57:54.975764 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:57:54.975770 | orchestrator | 2026-04-24 02:57:54.975776 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 02:57:54.975788 | orchestrator | Friday 24 April 2026 02:57:54 +0000 (0:00:00.965) 0:02:55.865 ********** 2026-04-24 02:58:12.677763 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.677911 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:58:12.677939 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:58:12.677960 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:12.677979 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:12.678000 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:12.678104 | orchestrator | 2026-04-24 02:58:12.678119 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 02:58:12.678167 | orchestrator | Friday 24 April 2026 02:57:55 +0000 (0:00:00.681) 0:02:56.546 ********** 2026-04-24 02:58:12.678178 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:58:12.678196 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:58:12.678213 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:58:12.678224 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:12.678241 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:12.678255 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:12.678266 | orchestrator | 2026-04-24 02:58:12.678279 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 02:58:12.678299 | orchestrator | Friday 24 April 2026 02:57:56 +0000 (0:00:00.841) 0:02:57.387 ********** 2026-04-24 02:58:12.678312 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:58:12.678324 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:58:12.678337 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:58:12.678350 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.678362 | orchestrator | 2026-04-24 02:58:12.678376 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 02:58:12.678388 | orchestrator | Friday 24 April 2026 02:57:56 +0000 (0:00:00.489) 0:02:57.877 ********** 2026-04-24 02:58:12.678400 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:58:12.678413 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:58:12.678425 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:58:12.678501 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.678516 | orchestrator | 2026-04-24 02:58:12.678527 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 02:58:12.678538 | orchestrator | Friday 24 April 2026 02:57:57 +0000 (0:00:00.450) 0:02:58.328 ********** 2026-04-24 02:58:12.678548 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:58:12.678559 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:58:12.678569 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:58:12.678580 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.678591 | orchestrator | 2026-04-24 02:58:12.678601 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 02:58:12.678612 | orchestrator | Friday 24 April 2026 02:57:57 +0000 (0:00:00.427) 0:02:58.755 ********** 2026-04-24 02:58:12.678622 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:58:12.678633 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:58:12.678644 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:58:12.678654 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:12.678665 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:12.678676 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:12.678686 | orchestrator | 2026-04-24 02:58:12.678697 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 02:58:12.678708 | orchestrator | Friday 24 April 2026 02:57:58 +0000 (0:00:00.665) 0:02:59.420 ********** 2026-04-24 02:58:12.678718 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 02:58:12.678729 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 02:58:12.678739 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 02:58:12.678750 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-24 02:58:12.678760 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:12.678771 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-24 02:58:12.678782 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:12.678792 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-24 02:58:12.678803 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:12.678813 | orchestrator | 2026-04-24 02:58:12.678824 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 02:58:12.678844 | orchestrator | Friday 24 April 2026 02:58:00 +0000 (0:00:01.815) 0:03:01.236 ********** 2026-04-24 02:58:12.678855 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:58:12.678866 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:58:12.678877 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:58:12.678887 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:12.678898 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:12.678908 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:12.678919 | orchestrator | 2026-04-24 02:58:12.678930 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-24 02:58:12.678940 | orchestrator | Friday 24 April 2026 02:58:02 +0000 (0:00:02.646) 0:03:03.883 ********** 2026-04-24 02:58:12.678951 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:58:12.678985 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:58:12.679005 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:58:12.679024 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:12.679044 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:12.679063 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:12.679082 | orchestrator | 2026-04-24 02:58:12.679101 | orchestrator | RUNNING HANDLER [ceph-handler : Mons handler] ********************************** 2026-04-24 02:58:12.679121 | orchestrator | Friday 24 April 2026 02:58:03 +0000 (0:00:01.002) 0:03:04.885 ********** 2026-04-24 02:58:12.679167 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.679187 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:58:12.679200 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:58:12.679211 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mons.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:58:12.679222 | orchestrator | 2026-04-24 02:58:12.679233 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called before restart] ******** 2026-04-24 02:58:12.679244 | orchestrator | Friday 24 April 2026 02:58:05 +0000 (0:00:01.139) 0:03:06.025 ********** 2026-04-24 02:58:12.679254 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:12.679284 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:12.679296 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:12.679306 | orchestrator | 2026-04-24 02:58:12.679317 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mon restart script] *********************** 2026-04-24 02:58:12.679327 | orchestrator | Friday 24 April 2026 02:58:05 +0000 (0:00:00.344) 0:03:06.369 ********** 2026-04-24 02:58:12.679338 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:12.679348 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:12.679359 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:12.679370 | orchestrator | 2026-04-24 02:58:12.679380 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mon daemon(s)] ******************** 2026-04-24 02:58:12.679391 | orchestrator | Friday 24 April 2026 02:58:06 +0000 (0:00:01.507) 0:03:07.877 ********** 2026-04-24 02:58:12.679401 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 02:58:12.679412 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 02:58:12.679422 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 02:58:12.679433 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:12.679474 | orchestrator | 2026-04-24 02:58:12.679485 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called after restart] ********* 2026-04-24 02:58:12.679496 | orchestrator | Friday 24 April 2026 02:58:07 +0000 (0:00:00.662) 0:03:08.540 ********** 2026-04-24 02:58:12.679506 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:12.679517 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:12.679528 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:12.679539 | orchestrator | 2026-04-24 02:58:12.679549 | orchestrator | RUNNING HANDLER [ceph-handler : Osds handler] ********************************** 2026-04-24 02:58:12.679560 | orchestrator | Friday 24 April 2026 02:58:07 +0000 (0:00:00.359) 0:03:08.899 ********** 2026-04-24 02:58:12.679571 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:12.679581 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:12.679592 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:12.679612 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:58:12.679623 | orchestrator | 2026-04-24 02:58:12.679634 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact trigger_restart] ********************** 2026-04-24 02:58:12.679645 | orchestrator | Friday 24 April 2026 02:58:09 +0000 (0:00:01.091) 0:03:09.991 ********** 2026-04-24 02:58:12.679655 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:58:12.679666 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:58:12.679677 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:58:12.679687 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.679698 | orchestrator | 2026-04-24 02:58:12.679708 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called before restart] ******** 2026-04-24 02:58:12.679719 | orchestrator | Friday 24 April 2026 02:58:09 +0000 (0:00:00.422) 0:03:10.413 ********** 2026-04-24 02:58:12.679730 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.679741 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:58:12.679751 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:58:12.679762 | orchestrator | 2026-04-24 02:58:12.679772 | orchestrator | RUNNING HANDLER [ceph-handler : Unset noup flag] ******************************* 2026-04-24 02:58:12.679783 | orchestrator | Friday 24 April 2026 02:58:09 +0000 (0:00:00.320) 0:03:10.733 ********** 2026-04-24 02:58:12.679793 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.679804 | orchestrator | 2026-04-24 02:58:12.679814 | orchestrator | RUNNING HANDLER [ceph-handler : Copy osd restart script] *********************** 2026-04-24 02:58:12.679825 | orchestrator | Friday 24 April 2026 02:58:10 +0000 (0:00:00.257) 0:03:10.991 ********** 2026-04-24 02:58:12.679836 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.679846 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:58:12.679857 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:58:12.679867 | orchestrator | 2026-04-24 02:58:12.679878 | orchestrator | RUNNING HANDLER [ceph-handler : Get pool list] ********************************* 2026-04-24 02:58:12.679888 | orchestrator | Friday 24 April 2026 02:58:10 +0000 (0:00:00.320) 0:03:11.312 ********** 2026-04-24 02:58:12.679899 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.679909 | orchestrator | 2026-04-24 02:58:12.679920 | orchestrator | RUNNING HANDLER [ceph-handler : Get balancer module status] ******************** 2026-04-24 02:58:12.679931 | orchestrator | Friday 24 April 2026 02:58:11 +0000 (0:00:00.725) 0:03:12.038 ********** 2026-04-24 02:58:12.679941 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.679952 | orchestrator | 2026-04-24 02:58:12.679962 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact pools_pgautoscaler_mode] ************** 2026-04-24 02:58:12.679973 | orchestrator | Friday 24 April 2026 02:58:11 +0000 (0:00:00.241) 0:03:12.279 ********** 2026-04-24 02:58:12.679984 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.679994 | orchestrator | 2026-04-24 02:58:12.680005 | orchestrator | RUNNING HANDLER [ceph-handler : Disable balancer] ****************************** 2026-04-24 02:58:12.680015 | orchestrator | Friday 24 April 2026 02:58:11 +0000 (0:00:00.140) 0:03:12.420 ********** 2026-04-24 02:58:12.680033 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.680044 | orchestrator | 2026-04-24 02:58:12.680054 | orchestrator | RUNNING HANDLER [ceph-handler : Disable pg autoscale on pools] ***************** 2026-04-24 02:58:12.680065 | orchestrator | Friday 24 April 2026 02:58:11 +0000 (0:00:00.264) 0:03:12.685 ********** 2026-04-24 02:58:12.680075 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.680086 | orchestrator | 2026-04-24 02:58:12.680097 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph osds daemon(s)] ******************* 2026-04-24 02:58:12.680107 | orchestrator | Friday 24 April 2026 02:58:12 +0000 (0:00:00.261) 0:03:12.946 ********** 2026-04-24 02:58:12.680118 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:58:12.680129 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:58:12.680139 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:58:12.680156 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:12.680167 | orchestrator | 2026-04-24 02:58:12.680178 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called after restart] ********* 2026-04-24 02:58:12.680204 | orchestrator | Friday 24 April 2026 02:58:12 +0000 (0:00:00.427) 0:03:13.374 ********** 2026-04-24 02:58:12.680222 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:31.412251 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:58:31.412370 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:58:31.412387 | orchestrator | 2026-04-24 02:58:31.412400 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable pg autoscale on pools] *************** 2026-04-24 02:58:31.412413 | orchestrator | Friday 24 April 2026 02:58:12 +0000 (0:00:00.319) 0:03:13.694 ********** 2026-04-24 02:58:31.412424 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:31.412484 | orchestrator | 2026-04-24 02:58:31.412519 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable balancer] **************************** 2026-04-24 02:58:31.412538 | orchestrator | Friday 24 April 2026 02:58:13 +0000 (0:00:00.219) 0:03:13.914 ********** 2026-04-24 02:58:31.412551 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:31.412562 | orchestrator | 2026-04-24 02:58:31.412573 | orchestrator | RUNNING HANDLER [ceph-handler : Mdss handler] ********************************** 2026-04-24 02:58:31.412584 | orchestrator | Friday 24 April 2026 02:58:13 +0000 (0:00:00.226) 0:03:14.140 ********** 2026-04-24 02:58:31.412595 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.412606 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:31.412616 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:31.412628 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mdss.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:58:31.412639 | orchestrator | 2026-04-24 02:58:31.412650 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called before restart] ******** 2026-04-24 02:58:31.412661 | orchestrator | Friday 24 April 2026 02:58:14 +0000 (0:00:01.136) 0:03:15.277 ********** 2026-04-24 02:58:31.412671 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:58:31.412684 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:58:31.412695 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:58:31.412706 | orchestrator | 2026-04-24 02:58:31.412717 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mds restart script] *********************** 2026-04-24 02:58:31.412727 | orchestrator | Friday 24 April 2026 02:58:14 +0000 (0:00:00.331) 0:03:15.608 ********** 2026-04-24 02:58:31.412738 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:58:31.412749 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:58:31.412759 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:58:31.412770 | orchestrator | 2026-04-24 02:58:31.412781 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mds daemon(s)] ******************** 2026-04-24 02:58:31.412793 | orchestrator | Friday 24 April 2026 02:58:16 +0000 (0:00:01.449) 0:03:17.058 ********** 2026-04-24 02:58:31.412806 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:58:31.412818 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:58:31.412831 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:58:31.412843 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:31.412856 | orchestrator | 2026-04-24 02:58:31.412868 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called after restart] ********* 2026-04-24 02:58:31.412881 | orchestrator | Friday 24 April 2026 02:58:16 +0000 (0:00:00.686) 0:03:17.745 ********** 2026-04-24 02:58:31.412893 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:58:31.412906 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:58:31.412918 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:58:31.412930 | orchestrator | 2026-04-24 02:58:31.412943 | orchestrator | RUNNING HANDLER [ceph-handler : Rgws handler] ********************************** 2026-04-24 02:58:31.412956 | orchestrator | Friday 24 April 2026 02:58:17 +0000 (0:00:00.370) 0:03:18.116 ********** 2026-04-24 02:58:31.412968 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.412981 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:31.413000 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:31.413049 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_rgws.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 02:58:31.413069 | orchestrator | 2026-04-24 02:58:31.413087 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called before restart] ******** 2026-04-24 02:58:31.413105 | orchestrator | Friday 24 April 2026 02:58:18 +0000 (0:00:01.091) 0:03:19.207 ********** 2026-04-24 02:58:31.413124 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:58:31.413143 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:58:31.413161 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:58:31.413180 | orchestrator | 2026-04-24 02:58:31.413199 | orchestrator | RUNNING HANDLER [ceph-handler : Copy rgw restart script] *********************** 2026-04-24 02:58:31.413218 | orchestrator | Friday 24 April 2026 02:58:18 +0000 (0:00:00.339) 0:03:19.547 ********** 2026-04-24 02:58:31.413231 | orchestrator | changed: [testbed-node-3] 2026-04-24 02:58:31.413241 | orchestrator | changed: [testbed-node-4] 2026-04-24 02:58:31.413252 | orchestrator | changed: [testbed-node-5] 2026-04-24 02:58:31.413263 | orchestrator | 2026-04-24 02:58:31.413276 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph rgw daemon(s)] ******************** 2026-04-24 02:58:31.413295 | orchestrator | Friday 24 April 2026 02:58:19 +0000 (0:00:01.265) 0:03:20.812 ********** 2026-04-24 02:58:31.413312 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 02:58:31.413330 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 02:58:31.413362 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 02:58:31.413380 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:31.413398 | orchestrator | 2026-04-24 02:58:31.413416 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called after restart] ********* 2026-04-24 02:58:31.413460 | orchestrator | Friday 24 April 2026 02:58:20 +0000 (0:00:00.912) 0:03:21.725 ********** 2026-04-24 02:58:31.413481 | orchestrator | ok: [testbed-node-3] 2026-04-24 02:58:31.413499 | orchestrator | ok: [testbed-node-4] 2026-04-24 02:58:31.413517 | orchestrator | ok: [testbed-node-5] 2026-04-24 02:58:31.413533 | orchestrator | 2026-04-24 02:58:31.413544 | orchestrator | RUNNING HANDLER [ceph-handler : Rbdmirrors handler] **************************** 2026-04-24 02:58:31.413555 | orchestrator | Friday 24 April 2026 02:58:21 +0000 (0:00:00.557) 0:03:22.282 ********** 2026-04-24 02:58:31.413565 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:31.413576 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:58:31.413587 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:58:31.413597 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.413608 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:31.413619 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:31.413629 | orchestrator | 2026-04-24 02:58:31.413660 | orchestrator | RUNNING HANDLER [ceph-handler : Mgrs handler] ********************************** 2026-04-24 02:58:31.413672 | orchestrator | Friday 24 April 2026 02:58:22 +0000 (0:00:00.638) 0:03:22.921 ********** 2026-04-24 02:58:31.413687 | orchestrator | skipping: [testbed-node-3] 2026-04-24 02:58:31.413704 | orchestrator | skipping: [testbed-node-4] 2026-04-24 02:58:31.413720 | orchestrator | skipping: [testbed-node-5] 2026-04-24 02:58:31.413737 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mgrs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:58:31.413753 | orchestrator | 2026-04-24 02:58:31.413770 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called before restart] ******** 2026-04-24 02:58:31.413789 | orchestrator | Friday 24 April 2026 02:58:23 +0000 (0:00:01.101) 0:03:24.022 ********** 2026-04-24 02:58:31.413806 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:31.413826 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:31.413844 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:31.413862 | orchestrator | 2026-04-24 02:58:31.413882 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mgr restart script] *********************** 2026-04-24 02:58:31.413900 | orchestrator | Friday 24 April 2026 02:58:23 +0000 (0:00:00.345) 0:03:24.368 ********** 2026-04-24 02:58:31.413919 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:31.413956 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:31.413976 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:31.413995 | orchestrator | 2026-04-24 02:58:31.414014 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mgr daemon(s)] ******************** 2026-04-24 02:58:31.414113 | orchestrator | Friday 24 April 2026 02:58:24 +0000 (0:00:01.273) 0:03:25.642 ********** 2026-04-24 02:58:31.414134 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 02:58:31.414153 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 02:58:31.414172 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 02:58:31.414191 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.414208 | orchestrator | 2026-04-24 02:58:31.414227 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called after restart] ********* 2026-04-24 02:58:31.414244 | orchestrator | Friday 24 April 2026 02:58:25 +0000 (0:00:01.082) 0:03:26.724 ********** 2026-04-24 02:58:31.414262 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:31.414279 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:31.414297 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:31.414315 | orchestrator | 2026-04-24 02:58:31.414334 | orchestrator | PLAY [Apply role ceph-mon] ***************************************************** 2026-04-24 02:58:31.414352 | orchestrator | 2026-04-24 02:58:31.414370 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 02:58:31.414390 | orchestrator | Friday 24 April 2026 02:58:26 +0000 (0:00:00.611) 0:03:27.336 ********** 2026-04-24 02:58:31.414410 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:58:31.414454 | orchestrator | 2026-04-24 02:58:31.414466 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 02:58:31.414477 | orchestrator | Friday 24 April 2026 02:58:27 +0000 (0:00:00.737) 0:03:28.074 ********** 2026-04-24 02:58:31.414488 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:58:31.414499 | orchestrator | 2026-04-24 02:58:31.414510 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 02:58:31.414520 | orchestrator | Friday 24 April 2026 02:58:27 +0000 (0:00:00.552) 0:03:28.626 ********** 2026-04-24 02:58:31.414531 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:31.414541 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:31.414552 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:31.414567 | orchestrator | 2026-04-24 02:58:31.414586 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 02:58:31.414605 | orchestrator | Friday 24 April 2026 02:58:28 +0000 (0:00:00.731) 0:03:29.358 ********** 2026-04-24 02:58:31.414620 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.414631 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:31.414642 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:31.414652 | orchestrator | 2026-04-24 02:58:31.414663 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 02:58:31.414674 | orchestrator | Friday 24 April 2026 02:58:29 +0000 (0:00:00.551) 0:03:29.909 ********** 2026-04-24 02:58:31.414684 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.414695 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:31.414705 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:31.414716 | orchestrator | 2026-04-24 02:58:31.414727 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 02:58:31.414737 | orchestrator | Friday 24 April 2026 02:58:29 +0000 (0:00:00.359) 0:03:30.269 ********** 2026-04-24 02:58:31.414748 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.414758 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:31.414779 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:31.414791 | orchestrator | 2026-04-24 02:58:31.414801 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 02:58:31.414812 | orchestrator | Friday 24 April 2026 02:58:29 +0000 (0:00:00.344) 0:03:30.613 ********** 2026-04-24 02:58:31.414835 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:31.414846 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:31.414856 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:31.414867 | orchestrator | 2026-04-24 02:58:31.414878 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 02:58:31.414889 | orchestrator | Friday 24 April 2026 02:58:30 +0000 (0:00:00.715) 0:03:31.329 ********** 2026-04-24 02:58:31.414899 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.414910 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:31.414921 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:31.414931 | orchestrator | 2026-04-24 02:58:31.414942 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 02:58:31.414952 | orchestrator | Friday 24 April 2026 02:58:31 +0000 (0:00:00.624) 0:03:31.953 ********** 2026-04-24 02:58:31.414963 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:31.414974 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:31.414999 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:53.432099 | orchestrator | 2026-04-24 02:58:53.432252 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 02:58:53.432273 | orchestrator | Friday 24 April 2026 02:58:31 +0000 (0:00:00.346) 0:03:32.299 ********** 2026-04-24 02:58:53.432285 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.432298 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.432309 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.432361 | orchestrator | 2026-04-24 02:58:53.432381 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 02:58:53.432401 | orchestrator | Friday 24 April 2026 02:58:32 +0000 (0:00:00.724) 0:03:33.024 ********** 2026-04-24 02:58:53.432446 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.432466 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.432485 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.432505 | orchestrator | 2026-04-24 02:58:53.432517 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 02:58:53.432528 | orchestrator | Friday 24 April 2026 02:58:32 +0000 (0:00:00.744) 0:03:33.768 ********** 2026-04-24 02:58:53.432539 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:53.432552 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:53.432563 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:53.432573 | orchestrator | 2026-04-24 02:58:53.432585 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 02:58:53.432596 | orchestrator | Friday 24 April 2026 02:58:33 +0000 (0:00:00.612) 0:03:34.381 ********** 2026-04-24 02:58:53.432607 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.432619 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.432631 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.432643 | orchestrator | 2026-04-24 02:58:53.432656 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 02:58:53.432669 | orchestrator | Friday 24 April 2026 02:58:33 +0000 (0:00:00.338) 0:03:34.720 ********** 2026-04-24 02:58:53.432682 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:53.432695 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:53.432707 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:53.432719 | orchestrator | 2026-04-24 02:58:53.432732 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 02:58:53.432744 | orchestrator | Friday 24 April 2026 02:58:34 +0000 (0:00:00.334) 0:03:35.055 ********** 2026-04-24 02:58:53.432756 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:53.432768 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:53.432781 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:53.432793 | orchestrator | 2026-04-24 02:58:53.432805 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 02:58:53.432818 | orchestrator | Friday 24 April 2026 02:58:34 +0000 (0:00:00.344) 0:03:35.399 ********** 2026-04-24 02:58:53.432830 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:53.432869 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:53.432882 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:53.432895 | orchestrator | 2026-04-24 02:58:53.432908 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 02:58:53.432920 | orchestrator | Friday 24 April 2026 02:58:35 +0000 (0:00:00.574) 0:03:35.973 ********** 2026-04-24 02:58:53.432932 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:53.432942 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:53.432953 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:53.432964 | orchestrator | 2026-04-24 02:58:53.432974 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 02:58:53.432985 | orchestrator | Friday 24 April 2026 02:58:35 +0000 (0:00:00.331) 0:03:36.304 ********** 2026-04-24 02:58:53.432996 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:53.433009 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:58:53.433027 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:58:53.433043 | orchestrator | 2026-04-24 02:58:53.433063 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 02:58:53.433083 | orchestrator | Friday 24 April 2026 02:58:35 +0000 (0:00:00.352) 0:03:36.657 ********** 2026-04-24 02:58:53.433102 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.433121 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.433139 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.433157 | orchestrator | 2026-04-24 02:58:53.433173 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 02:58:53.433184 | orchestrator | Friday 24 April 2026 02:58:36 +0000 (0:00:00.341) 0:03:36.999 ********** 2026-04-24 02:58:53.433195 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.433205 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.433216 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.433233 | orchestrator | 2026-04-24 02:58:53.433251 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 02:58:53.433268 | orchestrator | Friday 24 April 2026 02:58:36 +0000 (0:00:00.614) 0:03:37.614 ********** 2026-04-24 02:58:53.433286 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.433304 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.433323 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.433342 | orchestrator | 2026-04-24 02:58:53.433378 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-24 02:58:53.433391 | orchestrator | Friday 24 April 2026 02:58:37 +0000 (0:00:00.562) 0:03:38.176 ********** 2026-04-24 02:58:53.433402 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.433435 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.433446 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.433457 | orchestrator | 2026-04-24 02:58:53.433468 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-24 02:58:53.433478 | orchestrator | Friday 24 April 2026 02:58:37 +0000 (0:00:00.378) 0:03:38.554 ********** 2026-04-24 02:58:53.433490 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:58:53.433501 | orchestrator | 2026-04-24 02:58:53.433512 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-24 02:58:53.433522 | orchestrator | Friday 24 April 2026 02:58:38 +0000 (0:00:00.918) 0:03:39.473 ********** 2026-04-24 02:58:53.433533 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:58:53.433543 | orchestrator | 2026-04-24 02:58:53.433554 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-24 02:58:53.433585 | orchestrator | Friday 24 April 2026 02:58:38 +0000 (0:00:00.174) 0:03:39.648 ********** 2026-04-24 02:58:53.433597 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-24 02:58:53.433608 | orchestrator | 2026-04-24 02:58:53.433619 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-24 02:58:53.433629 | orchestrator | Friday 24 April 2026 02:58:39 +0000 (0:00:01.056) 0:03:40.705 ********** 2026-04-24 02:58:53.433652 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.433663 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.433673 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.433684 | orchestrator | 2026-04-24 02:58:53.433695 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-24 02:58:53.433705 | orchestrator | Friday 24 April 2026 02:58:40 +0000 (0:00:00.372) 0:03:41.077 ********** 2026-04-24 02:58:53.433716 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.433726 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.433737 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.433748 | orchestrator | 2026-04-24 02:58:53.433758 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-24 02:58:53.433769 | orchestrator | Friday 24 April 2026 02:58:40 +0000 (0:00:00.632) 0:03:41.710 ********** 2026-04-24 02:58:53.433779 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:53.433790 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:53.433801 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:53.433812 | orchestrator | 2026-04-24 02:58:53.433822 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-24 02:58:53.433833 | orchestrator | Friday 24 April 2026 02:58:42 +0000 (0:00:01.207) 0:03:42.917 ********** 2026-04-24 02:58:53.433844 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:53.433854 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:53.433865 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:53.433876 | orchestrator | 2026-04-24 02:58:53.433886 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-24 02:58:53.433897 | orchestrator | Friday 24 April 2026 02:58:42 +0000 (0:00:00.785) 0:03:43.702 ********** 2026-04-24 02:58:53.433907 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:53.433918 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:53.433929 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:53.433939 | orchestrator | 2026-04-24 02:58:53.433950 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-24 02:58:53.433961 | orchestrator | Friday 24 April 2026 02:58:43 +0000 (0:00:00.677) 0:03:44.380 ********** 2026-04-24 02:58:53.433971 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.433982 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.433993 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.434003 | orchestrator | 2026-04-24 02:58:53.434014 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-24 02:58:53.434085 | orchestrator | Friday 24 April 2026 02:58:44 +0000 (0:00:00.981) 0:03:45.362 ********** 2026-04-24 02:58:53.434096 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:53.434106 | orchestrator | 2026-04-24 02:58:53.434117 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-24 02:58:53.434128 | orchestrator | Friday 24 April 2026 02:58:45 +0000 (0:00:01.421) 0:03:46.783 ********** 2026-04-24 02:58:53.434139 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.434150 | orchestrator | 2026-04-24 02:58:53.434160 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-24 02:58:53.434171 | orchestrator | Friday 24 April 2026 02:58:46 +0000 (0:00:00.691) 0:03:47.475 ********** 2026-04-24 02:58:53.434182 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 02:58:53.434193 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 02:58:53.434204 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 02:58:53.434215 | orchestrator | changed: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 02:58:53.434225 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-24 02:58:53.434236 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 02:58:53.434247 | orchestrator | changed: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 02:58:53.434257 | orchestrator | changed: [testbed-node-0 -> {{ item }}] 2026-04-24 02:58:53.434268 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 02:58:53.434286 | orchestrator | ok: [testbed-node-1 -> {{ item }}] 2026-04-24 02:58:53.434297 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-24 02:58:53.434308 | orchestrator | ok: [testbed-node-2 -> {{ item }}] 2026-04-24 02:58:53.434318 | orchestrator | 2026-04-24 02:58:53.434329 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-24 02:58:53.434339 | orchestrator | Friday 24 April 2026 02:58:49 +0000 (0:00:03.154) 0:03:50.629 ********** 2026-04-24 02:58:53.434350 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:53.434361 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:53.434380 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:53.434399 | orchestrator | 2026-04-24 02:58:53.434440 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-24 02:58:53.434453 | orchestrator | Friday 24 April 2026 02:58:50 +0000 (0:00:01.234) 0:03:51.864 ********** 2026-04-24 02:58:53.434464 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.434474 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.434485 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.434496 | orchestrator | 2026-04-24 02:58:53.434507 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-24 02:58:53.434517 | orchestrator | Friday 24 April 2026 02:58:51 +0000 (0:00:00.637) 0:03:52.501 ********** 2026-04-24 02:58:53.434528 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:58:53.434538 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:58:53.434549 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:58:53.434559 | orchestrator | 2026-04-24 02:58:53.434570 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-24 02:58:53.434581 | orchestrator | Friday 24 April 2026 02:58:51 +0000 (0:00:00.335) 0:03:52.837 ********** 2026-04-24 02:58:53.434592 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:58:53.434602 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:58:53.434613 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:58:53.434623 | orchestrator | 2026-04-24 02:58:53.434644 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-24 02:59:55.149354 | orchestrator | Friday 24 April 2026 02:58:53 +0000 (0:00:01.487) 0:03:54.324 ********** 2026-04-24 02:59:55.149509 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:59:55.149527 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:59:55.149539 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:59:55.149551 | orchestrator | 2026-04-24 02:59:55.149563 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-24 02:59:55.149574 | orchestrator | Friday 24 April 2026 02:58:54 +0000 (0:00:01.383) 0:03:55.707 ********** 2026-04-24 02:59:55.149585 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:59:55.149596 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:59:55.149607 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:59:55.149619 | orchestrator | 2026-04-24 02:59:55.149630 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-24 02:59:55.149641 | orchestrator | Friday 24 April 2026 02:58:55 +0000 (0:00:00.629) 0:03:56.337 ********** 2026-04-24 02:59:55.149653 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:59:55.149664 | orchestrator | 2026-04-24 02:59:55.149676 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-24 02:59:55.149687 | orchestrator | Friday 24 April 2026 02:58:56 +0000 (0:00:00.603) 0:03:56.940 ********** 2026-04-24 02:59:55.149698 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:59:55.149709 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:59:55.149720 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:59:55.149730 | orchestrator | 2026-04-24 02:59:55.149741 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-24 02:59:55.149752 | orchestrator | Friday 24 April 2026 02:58:56 +0000 (0:00:00.321) 0:03:57.261 ********** 2026-04-24 02:59:55.149763 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:59:55.149803 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:59:55.149815 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:59:55.149826 | orchestrator | 2026-04-24 02:59:55.149837 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-24 02:59:55.149847 | orchestrator | Friday 24 April 2026 02:58:56 +0000 (0:00:00.576) 0:03:57.838 ********** 2026-04-24 02:59:55.149858 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:59:55.149870 | orchestrator | 2026-04-24 02:59:55.149881 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-24 02:59:55.149892 | orchestrator | Friday 24 April 2026 02:58:57 +0000 (0:00:00.571) 0:03:58.409 ********** 2026-04-24 02:59:55.149904 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:59:55.149916 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:59:55.149928 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:59:55.149941 | orchestrator | 2026-04-24 02:59:55.149953 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-24 02:59:55.149966 | orchestrator | Friday 24 April 2026 02:58:59 +0000 (0:00:01.841) 0:04:00.250 ********** 2026-04-24 02:59:55.149978 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:59:55.149990 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:59:55.150003 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:59:55.150069 | orchestrator | 2026-04-24 02:59:55.150082 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-24 02:59:55.150092 | orchestrator | Friday 24 April 2026 02:59:00 +0000 (0:00:01.484) 0:04:01.735 ********** 2026-04-24 02:59:55.150103 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:59:55.150114 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:59:55.150125 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:59:55.150136 | orchestrator | 2026-04-24 02:59:55.150146 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-24 02:59:55.150157 | orchestrator | Friday 24 April 2026 02:59:02 +0000 (0:00:01.795) 0:04:03.530 ********** 2026-04-24 02:59:55.150168 | orchestrator | changed: [testbed-node-0] 2026-04-24 02:59:55.150179 | orchestrator | changed: [testbed-node-1] 2026-04-24 02:59:55.150190 | orchestrator | changed: [testbed-node-2] 2026-04-24 02:59:55.150201 | orchestrator | 2026-04-24 02:59:55.150212 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-24 02:59:55.150223 | orchestrator | Friday 24 April 2026 02:59:04 +0000 (0:00:02.007) 0:04:05.538 ********** 2026-04-24 02:59:55.150233 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:59:55.150244 | orchestrator | 2026-04-24 02:59:55.150255 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-24 02:59:55.150265 | orchestrator | Friday 24 April 2026 02:59:05 +0000 (0:00:00.815) 0:04:06.354 ********** 2026-04-24 02:59:55.150290 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-24 02:59:55.150302 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:59:55.150314 | orchestrator | 2026-04-24 02:59:55.150324 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-24 02:59:55.150335 | orchestrator | Friday 24 April 2026 02:59:27 +0000 (0:00:21.911) 0:04:28.265 ********** 2026-04-24 02:59:55.150346 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:59:55.150357 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:59:55.150385 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:59:55.150396 | orchestrator | 2026-04-24 02:59:55.150407 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-24 02:59:55.150418 | orchestrator | Friday 24 April 2026 02:59:36 +0000 (0:00:09.076) 0:04:37.342 ********** 2026-04-24 02:59:55.150429 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:59:55.150440 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:59:55.150451 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:59:55.150472 | orchestrator | 2026-04-24 02:59:55.150483 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-24 02:59:55.150493 | orchestrator | Friday 24 April 2026 02:59:36 +0000 (0:00:00.324) 0:04:37.666 ********** 2026-04-24 02:59:55.150563 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__112c87546fcbc8336de445e288e37468d116ca3e'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-24 02:59:55.150580 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__112c87546fcbc8336de445e288e37468d116ca3e'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-24 02:59:55.150593 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__112c87546fcbc8336de445e288e37468d116ca3e'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-24 02:59:55.150606 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__112c87546fcbc8336de445e288e37468d116ca3e'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-24 02:59:55.150618 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__112c87546fcbc8336de445e288e37468d116ca3e'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-24 02:59:55.150630 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__112c87546fcbc8336de445e288e37468d116ca3e'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__112c87546fcbc8336de445e288e37468d116ca3e'}])  2026-04-24 02:59:55.150643 | orchestrator | 2026-04-24 02:59:55.150654 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-24 02:59:55.150665 | orchestrator | Friday 24 April 2026 02:59:51 +0000 (0:00:14.651) 0:04:52.318 ********** 2026-04-24 02:59:55.150676 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:59:55.150687 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:59:55.150697 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:59:55.150708 | orchestrator | 2026-04-24 02:59:55.150719 | orchestrator | RUNNING HANDLER [ceph-handler : Mons handler] ********************************** 2026-04-24 02:59:55.150730 | orchestrator | Friday 24 April 2026 02:59:51 +0000 (0:00:00.375) 0:04:52.693 ********** 2026-04-24 02:59:55.150740 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mons.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 02:59:55.150751 | orchestrator | 2026-04-24 02:59:55.150762 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called before restart] ******** 2026-04-24 02:59:55.150772 | orchestrator | Friday 24 April 2026 02:59:52 +0000 (0:00:00.783) 0:04:53.477 ********** 2026-04-24 02:59:55.150783 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:59:55.150794 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:59:55.150805 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:59:55.150816 | orchestrator | 2026-04-24 02:59:55.150826 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mon restart script] *********************** 2026-04-24 02:59:55.150846 | orchestrator | Friday 24 April 2026 02:59:52 +0000 (0:00:00.375) 0:04:53.852 ********** 2026-04-24 02:59:55.150863 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:59:55.150874 | orchestrator | skipping: [testbed-node-1] 2026-04-24 02:59:55.150885 | orchestrator | skipping: [testbed-node-2] 2026-04-24 02:59:55.150896 | orchestrator | 2026-04-24 02:59:55.150907 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mon daemon(s)] ******************** 2026-04-24 02:59:55.150917 | orchestrator | Friday 24 April 2026 02:59:53 +0000 (0:00:00.374) 0:04:54.227 ********** 2026-04-24 02:59:55.150928 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 02:59:55.150939 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 02:59:55.150949 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 02:59:55.150960 | orchestrator | skipping: [testbed-node-0] 2026-04-24 02:59:55.150971 | orchestrator | 2026-04-24 02:59:55.150981 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called after restart] ********* 2026-04-24 02:59:55.150992 | orchestrator | Friday 24 April 2026 02:59:54 +0000 (0:00:00.924) 0:04:55.151 ********** 2026-04-24 02:59:55.151003 | orchestrator | ok: [testbed-node-0] 2026-04-24 02:59:55.151013 | orchestrator | ok: [testbed-node-1] 2026-04-24 02:59:55.151024 | orchestrator | ok: [testbed-node-2] 2026-04-24 02:59:55.151035 | orchestrator | 2026-04-24 02:59:55.151046 | orchestrator | PLAY [Apply role ceph-mgr] ***************************************************** 2026-04-24 02:59:55.151057 | orchestrator | 2026-04-24 02:59:55.151074 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 03:00:21.682467 | orchestrator | Friday 24 April 2026 02:59:55 +0000 (0:00:00.888) 0:04:56.039 ********** 2026-04-24 03:00:21.682582 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:00:21.682599 | orchestrator | 2026-04-24 03:00:21.682612 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 03:00:21.682623 | orchestrator | Friday 24 April 2026 02:59:55 +0000 (0:00:00.538) 0:04:56.577 ********** 2026-04-24 03:00:21.682635 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:00:21.682646 | orchestrator | 2026-04-24 03:00:21.682657 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 03:00:21.682668 | orchestrator | Friday 24 April 2026 02:59:56 +0000 (0:00:00.797) 0:04:57.375 ********** 2026-04-24 03:00:21.682679 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.682691 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.682701 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.682712 | orchestrator | 2026-04-24 03:00:21.682723 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 03:00:21.682734 | orchestrator | Friday 24 April 2026 02:59:57 +0000 (0:00:00.771) 0:04:58.146 ********** 2026-04-24 03:00:21.682745 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.682757 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.682768 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.682779 | orchestrator | 2026-04-24 03:00:21.682790 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 03:00:21.682801 | orchestrator | Friday 24 April 2026 02:59:57 +0000 (0:00:00.321) 0:04:58.467 ********** 2026-04-24 03:00:21.682812 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.682822 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.682833 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.682844 | orchestrator | 2026-04-24 03:00:21.682854 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 03:00:21.682865 | orchestrator | Friday 24 April 2026 02:59:58 +0000 (0:00:00.555) 0:04:59.023 ********** 2026-04-24 03:00:21.682876 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.682887 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.682924 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.682936 | orchestrator | 2026-04-24 03:00:21.682947 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 03:00:21.682958 | orchestrator | Friday 24 April 2026 02:59:58 +0000 (0:00:00.341) 0:04:59.364 ********** 2026-04-24 03:00:21.682969 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.682979 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.682990 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.683000 | orchestrator | 2026-04-24 03:00:21.683011 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 03:00:21.683022 | orchestrator | Friday 24 April 2026 02:59:59 +0000 (0:00:00.719) 0:05:00.084 ********** 2026-04-24 03:00:21.683032 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.683043 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.683053 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.683064 | orchestrator | 2026-04-24 03:00:21.683075 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 03:00:21.683086 | orchestrator | Friday 24 April 2026 02:59:59 +0000 (0:00:00.333) 0:05:00.417 ********** 2026-04-24 03:00:21.683097 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.683107 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.683118 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.683128 | orchestrator | 2026-04-24 03:00:21.683139 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 03:00:21.683150 | orchestrator | Friday 24 April 2026 03:00:00 +0000 (0:00:00.589) 0:05:01.007 ********** 2026-04-24 03:00:21.683160 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.683178 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.683197 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.683215 | orchestrator | 2026-04-24 03:00:21.683233 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 03:00:21.683251 | orchestrator | Friday 24 April 2026 03:00:00 +0000 (0:00:00.769) 0:05:01.776 ********** 2026-04-24 03:00:21.683269 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.683288 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.683307 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.683322 | orchestrator | 2026-04-24 03:00:21.683334 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 03:00:21.683344 | orchestrator | Friday 24 April 2026 03:00:01 +0000 (0:00:00.760) 0:05:02.537 ********** 2026-04-24 03:00:21.683388 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.683400 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.683426 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.683437 | orchestrator | 2026-04-24 03:00:21.683448 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 03:00:21.683459 | orchestrator | Friday 24 April 2026 03:00:01 +0000 (0:00:00.333) 0:05:02.870 ********** 2026-04-24 03:00:21.683470 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.683481 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.683492 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.683502 | orchestrator | 2026-04-24 03:00:21.683513 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 03:00:21.683524 | orchestrator | Friday 24 April 2026 03:00:02 +0000 (0:00:00.641) 0:05:03.512 ********** 2026-04-24 03:00:21.683534 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.683545 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.683556 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.683566 | orchestrator | 2026-04-24 03:00:21.683577 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 03:00:21.683588 | orchestrator | Friday 24 April 2026 03:00:02 +0000 (0:00:00.341) 0:05:03.853 ********** 2026-04-24 03:00:21.683599 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.683609 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.683620 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.683631 | orchestrator | 2026-04-24 03:00:21.683670 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 03:00:21.683682 | orchestrator | Friday 24 April 2026 03:00:03 +0000 (0:00:00.327) 0:05:04.181 ********** 2026-04-24 03:00:21.683693 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.683703 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.683714 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.683725 | orchestrator | 2026-04-24 03:00:21.683736 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 03:00:21.683747 | orchestrator | Friday 24 April 2026 03:00:03 +0000 (0:00:00.361) 0:05:04.543 ********** 2026-04-24 03:00:21.683757 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.683768 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.683779 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.683789 | orchestrator | 2026-04-24 03:00:21.683800 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 03:00:21.683811 | orchestrator | Friday 24 April 2026 03:00:04 +0000 (0:00:00.596) 0:05:05.139 ********** 2026-04-24 03:00:21.683821 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.683832 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.683842 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.683853 | orchestrator | 2026-04-24 03:00:21.683863 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 03:00:21.683874 | orchestrator | Friday 24 April 2026 03:00:04 +0000 (0:00:00.329) 0:05:05.469 ********** 2026-04-24 03:00:21.683885 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.683895 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.683906 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.683917 | orchestrator | 2026-04-24 03:00:21.683927 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 03:00:21.683938 | orchestrator | Friday 24 April 2026 03:00:04 +0000 (0:00:00.358) 0:05:05.827 ********** 2026-04-24 03:00:21.683949 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.683974 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.683984 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.683995 | orchestrator | 2026-04-24 03:00:21.684006 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 03:00:21.684016 | orchestrator | Friday 24 April 2026 03:00:05 +0000 (0:00:00.353) 0:05:06.181 ********** 2026-04-24 03:00:21.684027 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.684037 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.684048 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.684059 | orchestrator | 2026-04-24 03:00:21.684069 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-24 03:00:21.684080 | orchestrator | Friday 24 April 2026 03:00:06 +0000 (0:00:00.854) 0:05:07.036 ********** 2026-04-24 03:00:21.684091 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 03:00:21.684102 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 03:00:21.684114 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 03:00:21.684125 | orchestrator | 2026-04-24 03:00:21.684135 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-24 03:00:21.684146 | orchestrator | Friday 24 April 2026 03:00:06 +0000 (0:00:00.680) 0:05:07.716 ********** 2026-04-24 03:00:21.684157 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:00:21.684168 | orchestrator | 2026-04-24 03:00:21.684179 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-24 03:00:21.684190 | orchestrator | Friday 24 April 2026 03:00:07 +0000 (0:00:00.636) 0:05:08.353 ********** 2026-04-24 03:00:21.684200 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:00:21.684211 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:00:21.684222 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:00:21.684232 | orchestrator | 2026-04-24 03:00:21.684243 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-24 03:00:21.684260 | orchestrator | Friday 24 April 2026 03:00:08 +0000 (0:00:00.676) 0:05:09.029 ********** 2026-04-24 03:00:21.684271 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:00:21.684282 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:00:21.684293 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:00:21.684303 | orchestrator | 2026-04-24 03:00:21.684314 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-24 03:00:21.684325 | orchestrator | Friday 24 April 2026 03:00:08 +0000 (0:00:00.299) 0:05:09.329 ********** 2026-04-24 03:00:21.684335 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 03:00:21.684368 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 03:00:21.684381 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 03:00:21.684391 | orchestrator | changed: [testbed-node-0 -> {{ groups[mon_group_name][0] }}] 2026-04-24 03:00:21.684402 | orchestrator | 2026-04-24 03:00:21.684418 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-24 03:00:21.684430 | orchestrator | Friday 24 April 2026 03:00:18 +0000 (0:00:10.443) 0:05:19.772 ********** 2026-04-24 03:00:21.684440 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:00:21.684451 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:00:21.684462 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:00:21.684473 | orchestrator | 2026-04-24 03:00:21.684483 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-24 03:00:21.684494 | orchestrator | Friday 24 April 2026 03:00:19 +0000 (0:00:00.366) 0:05:20.139 ********** 2026-04-24 03:00:21.684505 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-24 03:00:21.684515 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-24 03:00:21.684526 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-24 03:00:21.684537 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 03:00:21.684547 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:00:21.684558 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:00:21.684569 | orchestrator | 2026-04-24 03:00:21.684580 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-24 03:00:21.684596 | orchestrator | Friday 24 April 2026 03:00:21 +0000 (0:00:02.425) 0:05:22.564 ********** 2026-04-24 03:01:23.035213 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-24 03:01:23.035427 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-24 03:01:23.035448 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-24 03:01:23.035460 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 03:01:23.035472 | orchestrator | changed: [testbed-node-1] => (item=None) 2026-04-24 03:01:23.035483 | orchestrator | changed: [testbed-node-2] => (item=None) 2026-04-24 03:01:23.035496 | orchestrator | 2026-04-24 03:01:23.035508 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-24 03:01:23.035521 | orchestrator | Friday 24 April 2026 03:00:22 +0000 (0:00:01.288) 0:05:23.853 ********** 2026-04-24 03:01:23.035532 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:01:23.035543 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:01:23.035554 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:01:23.035565 | orchestrator | 2026-04-24 03:01:23.035577 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-24 03:01:23.035588 | orchestrator | Friday 24 April 2026 03:00:23 +0000 (0:00:00.676) 0:05:24.529 ********** 2026-04-24 03:01:23.035599 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:01:23.035611 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:01:23.035622 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:01:23.035633 | orchestrator | 2026-04-24 03:01:23.035644 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-24 03:01:23.035655 | orchestrator | Friday 24 April 2026 03:00:23 +0000 (0:00:00.313) 0:05:24.843 ********** 2026-04-24 03:01:23.035695 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:01:23.035707 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:01:23.035718 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:01:23.035729 | orchestrator | 2026-04-24 03:01:23.035742 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-24 03:01:23.035754 | orchestrator | Friday 24 April 2026 03:00:24 +0000 (0:00:00.601) 0:05:25.444 ********** 2026-04-24 03:01:23.035767 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:01:23.035781 | orchestrator | 2026-04-24 03:01:23.035794 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-24 03:01:23.035807 | orchestrator | Friday 24 April 2026 03:00:25 +0000 (0:00:00.568) 0:05:26.013 ********** 2026-04-24 03:01:23.035820 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:01:23.035833 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:01:23.035845 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:01:23.035858 | orchestrator | 2026-04-24 03:01:23.035870 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-24 03:01:23.035883 | orchestrator | Friday 24 April 2026 03:00:25 +0000 (0:00:00.358) 0:05:26.371 ********** 2026-04-24 03:01:23.035896 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:01:23.035909 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:01:23.035926 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:01:23.035950 | orchestrator | 2026-04-24 03:01:23.035977 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-24 03:01:23.035997 | orchestrator | Friday 24 April 2026 03:00:26 +0000 (0:00:00.653) 0:05:27.024 ********** 2026-04-24 03:01:23.036015 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:01:23.036035 | orchestrator | 2026-04-24 03:01:23.036052 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-24 03:01:23.036071 | orchestrator | Friday 24 April 2026 03:00:26 +0000 (0:00:00.619) 0:05:27.644 ********** 2026-04-24 03:01:23.036091 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:01:23.036109 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:01:23.036127 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:01:23.036185 | orchestrator | 2026-04-24 03:01:23.036199 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-24 03:01:23.036210 | orchestrator | Friday 24 April 2026 03:00:27 +0000 (0:00:01.217) 0:05:28.861 ********** 2026-04-24 03:01:23.036221 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:01:23.036232 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:01:23.036243 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:01:23.036254 | orchestrator | 2026-04-24 03:01:23.036264 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-24 03:01:23.036275 | orchestrator | Friday 24 April 2026 03:00:29 +0000 (0:00:01.511) 0:05:30.372 ********** 2026-04-24 03:01:23.036286 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:01:23.036297 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:01:23.036332 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:01:23.036344 | orchestrator | 2026-04-24 03:01:23.036354 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-24 03:01:23.036382 | orchestrator | Friday 24 April 2026 03:00:31 +0000 (0:00:01.849) 0:05:32.222 ********** 2026-04-24 03:01:23.036394 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:01:23.036404 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:01:23.036415 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:01:23.036426 | orchestrator | 2026-04-24 03:01:23.036437 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-24 03:01:23.036448 | orchestrator | Friday 24 April 2026 03:00:33 +0000 (0:00:01.986) 0:05:34.209 ********** 2026-04-24 03:01:23.036458 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:01:23.036469 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:01:23.036480 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/mgr_modules.yml for testbed-node-2 2026-04-24 03:01:23.036503 | orchestrator | 2026-04-24 03:01:23.036514 | orchestrator | TASK [ceph-mgr : Wait for all mgr to be up] ************************************ 2026-04-24 03:01:23.036525 | orchestrator | Friday 24 April 2026 03:00:33 +0000 (0:00:00.687) 0:05:34.897 ********** 2026-04-24 03:01:23.036535 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (30 retries left). 2026-04-24 03:01:23.036546 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (29 retries left). 2026-04-24 03:01:23.036578 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (28 retries left). 2026-04-24 03:01:23.036590 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (27 retries left). 2026-04-24 03:01:23.036601 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (26 retries left). 2026-04-24 03:01:23.036612 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:01:23.036636 | orchestrator | 2026-04-24 03:01:23.036657 | orchestrator | TASK [ceph-mgr : Get enabled modules from ceph-mgr] **************************** 2026-04-24 03:01:23.036668 | orchestrator | Friday 24 April 2026 03:01:04 +0000 (0:00:30.277) 0:06:05.174 ********** 2026-04-24 03:01:23.036679 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:01:23.036690 | orchestrator | 2026-04-24 03:01:23.036701 | orchestrator | TASK [ceph-mgr : Set _ceph_mgr_modules fact (convert _ceph_mgr_modules.stdout to a dict)] *** 2026-04-24 03:01:23.036712 | orchestrator | Friday 24 April 2026 03:01:05 +0000 (0:00:01.336) 0:06:06.511 ********** 2026-04-24 03:01:23.036722 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:01:23.036733 | orchestrator | 2026-04-24 03:01:23.036744 | orchestrator | TASK [ceph-mgr : Set _disabled_ceph_mgr_modules fact] ************************** 2026-04-24 03:01:23.036754 | orchestrator | Friday 24 April 2026 03:01:05 +0000 (0:00:00.307) 0:06:06.818 ********** 2026-04-24 03:01:23.036765 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:01:23.036776 | orchestrator | 2026-04-24 03:01:23.036786 | orchestrator | TASK [ceph-mgr : Disable ceph mgr enabled modules] ***************************** 2026-04-24 03:01:23.036797 | orchestrator | Friday 24 April 2026 03:01:06 +0000 (0:00:00.166) 0:06:06.985 ********** 2026-04-24 03:01:23.036808 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=iostat) 2026-04-24 03:01:23.036819 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=nfs) 2026-04-24 03:01:23.036829 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=restful) 2026-04-24 03:01:23.036840 | orchestrator | 2026-04-24 03:01:23.036850 | orchestrator | TASK [ceph-mgr : Add modules to ceph-mgr] ************************************** 2026-04-24 03:01:23.036861 | orchestrator | Friday 24 April 2026 03:01:12 +0000 (0:00:06.574) 0:06:13.560 ********** 2026-04-24 03:01:23.036872 | orchestrator | skipping: [testbed-node-2] => (item=balancer)  2026-04-24 03:01:23.036883 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=dashboard) 2026-04-24 03:01:23.036893 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=prometheus) 2026-04-24 03:01:23.036904 | orchestrator | skipping: [testbed-node-2] => (item=status)  2026-04-24 03:01:23.036915 | orchestrator | 2026-04-24 03:01:23.036926 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-24 03:01:23.036936 | orchestrator | Friday 24 April 2026 03:01:17 +0000 (0:00:05.197) 0:06:18.757 ********** 2026-04-24 03:01:23.036947 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:01:23.036958 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:01:23.036969 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:01:23.036979 | orchestrator | 2026-04-24 03:01:23.036990 | orchestrator | RUNNING HANDLER [ceph-handler : Mgrs handler] ********************************** 2026-04-24 03:01:23.037001 | orchestrator | Friday 24 April 2026 03:01:18 +0000 (0:00:00.694) 0:06:19.452 ********** 2026-04-24 03:01:23.037012 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mgrs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:01:23.037030 | orchestrator | 2026-04-24 03:01:23.037040 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called before restart] ******** 2026-04-24 03:01:23.037051 | orchestrator | Friday 24 April 2026 03:01:19 +0000 (0:00:00.563) 0:06:20.015 ********** 2026-04-24 03:01:23.037062 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:01:23.037072 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:01:23.037083 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:01:23.037094 | orchestrator | 2026-04-24 03:01:23.037104 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mgr restart script] *********************** 2026-04-24 03:01:23.037115 | orchestrator | Friday 24 April 2026 03:01:19 +0000 (0:00:00.590) 0:06:20.606 ********** 2026-04-24 03:01:23.037126 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:01:23.037137 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:01:23.037148 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:01:23.037158 | orchestrator | 2026-04-24 03:01:23.037169 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mgr daemon(s)] ******************** 2026-04-24 03:01:23.037180 | orchestrator | Friday 24 April 2026 03:01:20 +0000 (0:00:01.262) 0:06:21.869 ********** 2026-04-24 03:01:23.037196 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 03:01:23.037208 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 03:01:23.037218 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 03:01:23.037229 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:01:23.037240 | orchestrator | 2026-04-24 03:01:23.037251 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called after restart] ********* 2026-04-24 03:01:23.037262 | orchestrator | Friday 24 April 2026 03:01:21 +0000 (0:00:00.655) 0:06:22.524 ********** 2026-04-24 03:01:23.037273 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:01:23.037283 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:01:23.037294 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:01:23.037327 | orchestrator | 2026-04-24 03:01:23.037338 | orchestrator | PLAY [Apply role ceph-osd] ***************************************************** 2026-04-24 03:01:23.037349 | orchestrator | 2026-04-24 03:01:23.037360 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 03:01:23.037371 | orchestrator | Friday 24 April 2026 03:01:22 +0000 (0:00:00.589) 0:06:23.113 ********** 2026-04-24 03:01:23.037382 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:01:23.037394 | orchestrator | 2026-04-24 03:01:23.037405 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 03:01:23.037422 | orchestrator | Friday 24 April 2026 03:01:23 +0000 (0:00:00.812) 0:06:23.925 ********** 2026-04-24 03:01:39.857558 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:01:39.857706 | orchestrator | 2026-04-24 03:01:39.857728 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 03:01:39.857742 | orchestrator | Friday 24 April 2026 03:01:23 +0000 (0:00:00.768) 0:06:24.693 ********** 2026-04-24 03:01:39.857754 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.857767 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.857778 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.857789 | orchestrator | 2026-04-24 03:01:39.857809 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 03:01:39.857827 | orchestrator | Friday 24 April 2026 03:01:24 +0000 (0:00:00.347) 0:06:25.041 ********** 2026-04-24 03:01:39.857846 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.857864 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.857881 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.857899 | orchestrator | 2026-04-24 03:01:39.857918 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 03:01:39.857937 | orchestrator | Friday 24 April 2026 03:01:24 +0000 (0:00:00.678) 0:06:25.720 ********** 2026-04-24 03:01:39.857984 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.857996 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.858007 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.858095 | orchestrator | 2026-04-24 03:01:39.858124 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 03:01:39.858144 | orchestrator | Friday 24 April 2026 03:01:25 +0000 (0:00:00.692) 0:06:26.413 ********** 2026-04-24 03:01:39.858163 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.858180 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.858198 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.858218 | orchestrator | 2026-04-24 03:01:39.858237 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 03:01:39.858258 | orchestrator | Friday 24 April 2026 03:01:26 +0000 (0:00:00.934) 0:06:27.348 ********** 2026-04-24 03:01:39.858277 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.858363 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.858392 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.858411 | orchestrator | 2026-04-24 03:01:39.858428 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 03:01:39.858447 | orchestrator | Friday 24 April 2026 03:01:26 +0000 (0:00:00.337) 0:06:27.685 ********** 2026-04-24 03:01:39.858465 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.858484 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.858501 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.858519 | orchestrator | 2026-04-24 03:01:39.858537 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 03:01:39.858557 | orchestrator | Friday 24 April 2026 03:01:27 +0000 (0:00:00.329) 0:06:28.015 ********** 2026-04-24 03:01:39.858576 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.858594 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.858611 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.858630 | orchestrator | 2026-04-24 03:01:39.858650 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 03:01:39.858668 | orchestrator | Friday 24 April 2026 03:01:27 +0000 (0:00:00.328) 0:06:28.343 ********** 2026-04-24 03:01:39.858689 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.858709 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.858729 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.858741 | orchestrator | 2026-04-24 03:01:39.858752 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 03:01:39.858763 | orchestrator | Friday 24 April 2026 03:01:28 +0000 (0:00:01.272) 0:06:29.616 ********** 2026-04-24 03:01:39.858774 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.858784 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.858795 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.858806 | orchestrator | 2026-04-24 03:01:39.858816 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 03:01:39.858827 | orchestrator | Friday 24 April 2026 03:01:29 +0000 (0:00:00.695) 0:06:30.311 ********** 2026-04-24 03:01:39.858838 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.858849 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.858860 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.858870 | orchestrator | 2026-04-24 03:01:39.858881 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 03:01:39.858892 | orchestrator | Friday 24 April 2026 03:01:29 +0000 (0:00:00.327) 0:06:30.639 ********** 2026-04-24 03:01:39.858902 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.858913 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.858923 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.858934 | orchestrator | 2026-04-24 03:01:39.858962 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 03:01:39.858979 | orchestrator | Friday 24 April 2026 03:01:30 +0000 (0:00:00.329) 0:06:30.968 ********** 2026-04-24 03:01:39.858998 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.859017 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.859054 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.859073 | orchestrator | 2026-04-24 03:01:39.859093 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 03:01:39.859105 | orchestrator | Friday 24 April 2026 03:01:30 +0000 (0:00:00.630) 0:06:31.598 ********** 2026-04-24 03:01:39.859116 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.859127 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.859138 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.859149 | orchestrator | 2026-04-24 03:01:39.859160 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 03:01:39.859171 | orchestrator | Friday 24 April 2026 03:01:31 +0000 (0:00:00.367) 0:06:31.966 ********** 2026-04-24 03:01:39.859181 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.859192 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.859202 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.859213 | orchestrator | 2026-04-24 03:01:39.859223 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 03:01:39.859234 | orchestrator | Friday 24 April 2026 03:01:31 +0000 (0:00:00.350) 0:06:32.317 ********** 2026-04-24 03:01:39.859245 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.859278 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.859331 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.859345 | orchestrator | 2026-04-24 03:01:39.859356 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 03:01:39.859367 | orchestrator | Friday 24 April 2026 03:01:31 +0000 (0:00:00.334) 0:06:32.652 ********** 2026-04-24 03:01:39.859378 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.859389 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.859399 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.859410 | orchestrator | 2026-04-24 03:01:39.859421 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 03:01:39.859432 | orchestrator | Friday 24 April 2026 03:01:32 +0000 (0:00:00.572) 0:06:33.224 ********** 2026-04-24 03:01:39.859442 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.859453 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.859463 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.859474 | orchestrator | 2026-04-24 03:01:39.859485 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 03:01:39.859495 | orchestrator | Friday 24 April 2026 03:01:32 +0000 (0:00:00.323) 0:06:33.548 ********** 2026-04-24 03:01:39.859506 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.859517 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.859528 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.859538 | orchestrator | 2026-04-24 03:01:39.859549 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 03:01:39.859560 | orchestrator | Friday 24 April 2026 03:01:33 +0000 (0:00:00.359) 0:06:33.908 ********** 2026-04-24 03:01:39.859570 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.859581 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.859592 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.859602 | orchestrator | 2026-04-24 03:01:39.859613 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-24 03:01:39.859624 | orchestrator | Friday 24 April 2026 03:01:33 +0000 (0:00:00.839) 0:06:34.748 ********** 2026-04-24 03:01:39.859635 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.859645 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.859656 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.859667 | orchestrator | 2026-04-24 03:01:39.859678 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-24 03:01:39.859689 | orchestrator | Friday 24 April 2026 03:01:34 +0000 (0:00:00.340) 0:06:35.088 ********** 2026-04-24 03:01:39.859699 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 03:01:39.859712 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 03:01:39.859731 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 03:01:39.859742 | orchestrator | 2026-04-24 03:01:39.859752 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-24 03:01:39.859764 | orchestrator | Friday 24 April 2026 03:01:34 +0000 (0:00:00.735) 0:06:35.823 ********** 2026-04-24 03:01:39.859775 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:01:39.859786 | orchestrator | 2026-04-24 03:01:39.859797 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-24 03:01:39.859808 | orchestrator | Friday 24 April 2026 03:01:35 +0000 (0:00:00.843) 0:06:36.667 ********** 2026-04-24 03:01:39.859819 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.859829 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.859840 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.859851 | orchestrator | 2026-04-24 03:01:39.859861 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-24 03:01:39.859872 | orchestrator | Friday 24 April 2026 03:01:36 +0000 (0:00:00.325) 0:06:36.992 ********** 2026-04-24 03:01:39.859883 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:01:39.859893 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:01:39.859904 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:01:39.859915 | orchestrator | 2026-04-24 03:01:39.859926 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-24 03:01:39.859936 | orchestrator | Friday 24 April 2026 03:01:36 +0000 (0:00:00.340) 0:06:37.332 ********** 2026-04-24 03:01:39.859947 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.859958 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.859968 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.859979 | orchestrator | 2026-04-24 03:01:39.859990 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-24 03:01:39.860001 | orchestrator | Friday 24 April 2026 03:01:37 +0000 (0:00:00.660) 0:06:37.993 ********** 2026-04-24 03:01:39.860011 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:01:39.860030 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:01:39.860041 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:01:39.860052 | orchestrator | 2026-04-24 03:01:39.860063 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-24 03:01:39.860073 | orchestrator | Friday 24 April 2026 03:01:37 +0000 (0:00:00.594) 0:06:38.587 ********** 2026-04-24 03:01:39.860084 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-24 03:01:39.860096 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-24 03:01:39.860107 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-24 03:01:39.860118 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-24 03:01:39.860129 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-24 03:01:39.860140 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-24 03:01:39.860151 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-24 03:01:39.860169 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-24 03:02:46.406720 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-24 03:02:46.406836 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-24 03:02:46.406852 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-24 03:02:46.406864 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-24 03:02:46.406877 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-24 03:02:46.406914 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-24 03:02:46.406925 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-24 03:02:46.406936 | orchestrator | 2026-04-24 03:02:46.406948 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-24 03:02:46.406959 | orchestrator | Friday 24 April 2026 03:01:39 +0000 (0:00:02.159) 0:06:40.746 ********** 2026-04-24 03:02:46.406970 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:02:46.406982 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:02:46.406993 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:02:46.407004 | orchestrator | 2026-04-24 03:02:46.407015 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-24 03:02:46.407025 | orchestrator | Friday 24 April 2026 03:01:40 +0000 (0:00:00.324) 0:06:41.071 ********** 2026-04-24 03:02:46.407036 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:02:46.407048 | orchestrator | 2026-04-24 03:02:46.407059 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-24 03:02:46.407070 | orchestrator | Friday 24 April 2026 03:01:40 +0000 (0:00:00.831) 0:06:41.902 ********** 2026-04-24 03:02:46.407081 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-24 03:02:46.407092 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-24 03:02:46.407103 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-24 03:02:46.407114 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd/) 2026-04-24 03:02:46.407125 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd/) 2026-04-24 03:02:46.407136 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd/) 2026-04-24 03:02:46.407147 | orchestrator | 2026-04-24 03:02:46.407158 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-24 03:02:46.407169 | orchestrator | Friday 24 April 2026 03:01:42 +0000 (0:00:01.062) 0:06:42.965 ********** 2026-04-24 03:02:46.407179 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:02:46.407190 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 03:02:46.407201 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 03:02:46.407212 | orchestrator | 2026-04-24 03:02:46.407223 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-24 03:02:46.407233 | orchestrator | Friday 24 April 2026 03:01:44 +0000 (0:00:02.184) 0:06:45.149 ********** 2026-04-24 03:02:46.407244 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-24 03:02:46.407288 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 03:02:46.407300 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:02:46.407311 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-24 03:02:46.407321 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 03:02:46.407332 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:02:46.407343 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-24 03:02:46.407354 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-24 03:02:46.407365 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:02:46.407375 | orchestrator | 2026-04-24 03:02:46.407386 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-24 03:02:46.407397 | orchestrator | Friday 24 April 2026 03:01:45 +0000 (0:00:01.242) 0:06:46.392 ********** 2026-04-24 03:02:46.407408 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:02:46.407419 | orchestrator | 2026-04-24 03:02:46.407430 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-24 03:02:46.407456 | orchestrator | Friday 24 April 2026 03:01:47 +0000 (0:00:02.125) 0:06:48.517 ********** 2026-04-24 03:02:46.407468 | orchestrator | included: /ansible/roles/ceph-osd/tasks/scenarios/lvm.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:02:46.407487 | orchestrator | 2026-04-24 03:02:46.407498 | orchestrator | TASK [ceph-osd : Use ceph-volume to create osds] ******************************* 2026-04-24 03:02:46.407509 | orchestrator | Friday 24 April 2026 03:01:48 +0000 (0:00:00.844) 0:06:49.362 ********** 2026-04-24 03:02:46.407522 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}) 2026-04-24 03:02:46.407535 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}) 2026-04-24 03:02:46.407546 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}) 2026-04-24 03:02:46.407557 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}) 2026-04-24 03:02:46.407587 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}) 2026-04-24 03:02:46.407598 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}) 2026-04-24 03:02:46.407609 | orchestrator | 2026-04-24 03:02:46.407620 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-24 03:02:46.407631 | orchestrator | Friday 24 April 2026 03:02:28 +0000 (0:00:39.552) 0:07:28.914 ********** 2026-04-24 03:02:46.407647 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:02:46.407666 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:02:46.407684 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:02:46.407702 | orchestrator | 2026-04-24 03:02:46.407719 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-24 03:02:46.407737 | orchestrator | Friday 24 April 2026 03:02:28 +0000 (0:00:00.318) 0:07:29.233 ********** 2026-04-24 03:02:46.407756 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:02:46.407774 | orchestrator | 2026-04-24 03:02:46.407793 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-24 03:02:46.407811 | orchestrator | Friday 24 April 2026 03:02:29 +0000 (0:00:00.829) 0:07:30.063 ********** 2026-04-24 03:02:46.407830 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:02:46.407847 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:02:46.407863 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:02:46.407874 | orchestrator | 2026-04-24 03:02:46.407884 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-24 03:02:46.407896 | orchestrator | Friday 24 April 2026 03:02:30 +0000 (0:00:01.593) 0:07:31.656 ********** 2026-04-24 03:02:46.407907 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:02:46.407918 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:02:46.407928 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:02:46.407939 | orchestrator | 2026-04-24 03:02:46.407950 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-24 03:02:46.407960 | orchestrator | Friday 24 April 2026 03:02:33 +0000 (0:00:02.624) 0:07:34.281 ********** 2026-04-24 03:02:46.407971 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:02:46.407982 | orchestrator | 2026-04-24 03:02:46.407992 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-24 03:02:46.408003 | orchestrator | Friday 24 April 2026 03:02:34 +0000 (0:00:00.803) 0:07:35.084 ********** 2026-04-24 03:02:46.408014 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:02:46.408024 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:02:46.408035 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:02:46.408046 | orchestrator | 2026-04-24 03:02:46.408066 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-24 03:02:46.408077 | orchestrator | Friday 24 April 2026 03:02:35 +0000 (0:00:01.185) 0:07:36.270 ********** 2026-04-24 03:02:46.408088 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:02:46.408099 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:02:46.408109 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:02:46.408120 | orchestrator | 2026-04-24 03:02:46.408131 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-24 03:02:46.408141 | orchestrator | Friday 24 April 2026 03:02:36 +0000 (0:00:01.153) 0:07:37.424 ********** 2026-04-24 03:02:46.408152 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:02:46.408163 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:02:46.408173 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:02:46.408184 | orchestrator | 2026-04-24 03:02:46.408194 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-24 03:02:46.408205 | orchestrator | Friday 24 April 2026 03:02:38 +0000 (0:00:02.034) 0:07:39.459 ********** 2026-04-24 03:02:46.408216 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:02:46.408227 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:02:46.408237 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:02:46.408248 | orchestrator | 2026-04-24 03:02:46.408297 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-24 03:02:46.408307 | orchestrator | Friday 24 April 2026 03:02:38 +0000 (0:00:00.351) 0:07:39.810 ********** 2026-04-24 03:02:46.408318 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:02:46.408329 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:02:46.408339 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:02:46.408350 | orchestrator | 2026-04-24 03:02:46.408360 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-24 03:02:46.408378 | orchestrator | Friday 24 April 2026 03:02:39 +0000 (0:00:00.366) 0:07:40.176 ********** 2026-04-24 03:02:46.408390 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 03:02:46.408400 | orchestrator | ok: [testbed-node-4] => (item=2) 2026-04-24 03:02:46.408411 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-24 03:02:46.408421 | orchestrator | ok: [testbed-node-3] => (item=4) 2026-04-24 03:02:46.408432 | orchestrator | ok: [testbed-node-4] => (item=3) 2026-04-24 03:02:46.408443 | orchestrator | ok: [testbed-node-5] => (item=1) 2026-04-24 03:02:46.408461 | orchestrator | 2026-04-24 03:02:46.408479 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-24 03:02:46.408506 | orchestrator | Friday 24 April 2026 03:02:40 +0000 (0:00:01.015) 0:07:41.192 ********** 2026-04-24 03:02:46.408527 | orchestrator | changed: [testbed-node-3] => (item=0) 2026-04-24 03:02:46.408545 | orchestrator | changed: [testbed-node-4] => (item=2) 2026-04-24 03:02:46.408562 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-24 03:02:46.408579 | orchestrator | changed: [testbed-node-3] => (item=4) 2026-04-24 03:02:46.408597 | orchestrator | changed: [testbed-node-4] => (item=3) 2026-04-24 03:02:46.408613 | orchestrator | changed: [testbed-node-5] => (item=1) 2026-04-24 03:02:46.408629 | orchestrator | 2026-04-24 03:02:46.408648 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-24 03:02:46.408665 | orchestrator | Friday 24 April 2026 03:02:42 +0000 (0:00:02.517) 0:07:43.709 ********** 2026-04-24 03:02:46.408682 | orchestrator | changed: [testbed-node-3] => (item=0) 2026-04-24 03:02:46.408714 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-24 03:03:17.342321 | orchestrator | changed: [testbed-node-4] => (item=2) 2026-04-24 03:03:17.342434 | orchestrator | changed: [testbed-node-3] => (item=4) 2026-04-24 03:03:17.342451 | orchestrator | changed: [testbed-node-5] => (item=1) 2026-04-24 03:03:17.342464 | orchestrator | changed: [testbed-node-4] => (item=3) 2026-04-24 03:03:17.342476 | orchestrator | 2026-04-24 03:03:17.342489 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-24 03:03:17.342501 | orchestrator | Friday 24 April 2026 03:02:46 +0000 (0:00:03.588) 0:07:47.298 ********** 2026-04-24 03:03:17.342539 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.342551 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.342563 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:03:17.342574 | orchestrator | 2026-04-24 03:03:17.342585 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-24 03:03:17.342596 | orchestrator | Friday 24 April 2026 03:02:48 +0000 (0:00:02.250) 0:07:49.548 ********** 2026-04-24 03:03:17.342607 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.342617 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.342628 | orchestrator | FAILED - RETRYING: [testbed-node-5 -> testbed-node-0]: Wait for all osd to be up (60 retries left). 2026-04-24 03:03:17.342640 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:03:17.342651 | orchestrator | 2026-04-24 03:03:17.342662 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-24 03:03:17.342673 | orchestrator | Friday 24 April 2026 03:03:01 +0000 (0:00:12.439) 0:08:01.988 ********** 2026-04-24 03:03:17.342684 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.342694 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.342705 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:17.342717 | orchestrator | 2026-04-24 03:03:17.342728 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-24 03:03:17.342738 | orchestrator | Friday 24 April 2026 03:03:02 +0000 (0:00:01.215) 0:08:03.204 ********** 2026-04-24 03:03:17.342749 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.342760 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.342770 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:17.342781 | orchestrator | 2026-04-24 03:03:17.342792 | orchestrator | RUNNING HANDLER [ceph-handler : Osds handler] ********************************** 2026-04-24 03:03:17.342804 | orchestrator | Friday 24 April 2026 03:03:02 +0000 (0:00:00.348) 0:08:03.553 ********** 2026-04-24 03:03:17.342818 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:03:17.342831 | orchestrator | 2026-04-24 03:03:17.342843 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact trigger_restart] ********************** 2026-04-24 03:03:17.342857 | orchestrator | Friday 24 April 2026 03:03:03 +0000 (0:00:00.876) 0:08:04.430 ********** 2026-04-24 03:03:17.342869 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 03:03:17.342881 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 03:03:17.342894 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 03:03:17.342906 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.342918 | orchestrator | 2026-04-24 03:03:17.342930 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called before restart] ******** 2026-04-24 03:03:17.342942 | orchestrator | Friday 24 April 2026 03:03:03 +0000 (0:00:00.408) 0:08:04.838 ********** 2026-04-24 03:03:17.342955 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.342967 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.342979 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:17.342991 | orchestrator | 2026-04-24 03:03:17.343003 | orchestrator | RUNNING HANDLER [ceph-handler : Unset noup flag] ******************************* 2026-04-24 03:03:17.343016 | orchestrator | Friday 24 April 2026 03:03:04 +0000 (0:00:00.343) 0:08:05.182 ********** 2026-04-24 03:03:17.343028 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343040 | orchestrator | 2026-04-24 03:03:17.343053 | orchestrator | RUNNING HANDLER [ceph-handler : Copy osd restart script] *********************** 2026-04-24 03:03:17.343065 | orchestrator | Friday 24 April 2026 03:03:04 +0000 (0:00:00.231) 0:08:05.414 ********** 2026-04-24 03:03:17.343077 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343095 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.343115 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:17.343134 | orchestrator | 2026-04-24 03:03:17.343151 | orchestrator | RUNNING HANDLER [ceph-handler : Get pool list] ********************************* 2026-04-24 03:03:17.343184 | orchestrator | Friday 24 April 2026 03:03:05 +0000 (0:00:00.596) 0:08:06.010 ********** 2026-04-24 03:03:17.343196 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343207 | orchestrator | 2026-04-24 03:03:17.343217 | orchestrator | RUNNING HANDLER [ceph-handler : Get balancer module status] ******************** 2026-04-24 03:03:17.343228 | orchestrator | Friday 24 April 2026 03:03:05 +0000 (0:00:00.252) 0:08:06.262 ********** 2026-04-24 03:03:17.343261 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343273 | orchestrator | 2026-04-24 03:03:17.343284 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact pools_pgautoscaler_mode] ************** 2026-04-24 03:03:17.343294 | orchestrator | Friday 24 April 2026 03:03:05 +0000 (0:00:00.255) 0:08:06.517 ********** 2026-04-24 03:03:17.343305 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343316 | orchestrator | 2026-04-24 03:03:17.343327 | orchestrator | RUNNING HANDLER [ceph-handler : Disable balancer] ****************************** 2026-04-24 03:03:17.343337 | orchestrator | Friday 24 April 2026 03:03:05 +0000 (0:00:00.142) 0:08:06.660 ********** 2026-04-24 03:03:17.343348 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343359 | orchestrator | 2026-04-24 03:03:17.343370 | orchestrator | RUNNING HANDLER [ceph-handler : Disable pg autoscale on pools] ***************** 2026-04-24 03:03:17.343381 | orchestrator | Friday 24 April 2026 03:03:06 +0000 (0:00:00.254) 0:08:06.914 ********** 2026-04-24 03:03:17.343391 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343403 | orchestrator | 2026-04-24 03:03:17.343413 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph osds daemon(s)] ******************* 2026-04-24 03:03:17.343424 | orchestrator | Friday 24 April 2026 03:03:06 +0000 (0:00:00.242) 0:08:07.157 ********** 2026-04-24 03:03:17.343453 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 03:03:17.343466 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 03:03:17.343477 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 03:03:17.343487 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343498 | orchestrator | 2026-04-24 03:03:17.343509 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called after restart] ********* 2026-04-24 03:03:17.343520 | orchestrator | Friday 24 April 2026 03:03:06 +0000 (0:00:00.430) 0:08:07.587 ********** 2026-04-24 03:03:17.343531 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343541 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.343552 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:17.343563 | orchestrator | 2026-04-24 03:03:17.343573 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable pg autoscale on pools] *************** 2026-04-24 03:03:17.343584 | orchestrator | Friday 24 April 2026 03:03:07 +0000 (0:00:00.333) 0:08:07.920 ********** 2026-04-24 03:03:17.343595 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343606 | orchestrator | 2026-04-24 03:03:17.343617 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable balancer] **************************** 2026-04-24 03:03:17.343627 | orchestrator | Friday 24 April 2026 03:03:07 +0000 (0:00:00.233) 0:08:08.154 ********** 2026-04-24 03:03:17.343638 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343649 | orchestrator | 2026-04-24 03:03:17.343659 | orchestrator | PLAY [Apply role ceph-crash] *************************************************** 2026-04-24 03:03:17.343670 | orchestrator | 2026-04-24 03:03:17.343681 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 03:03:17.343691 | orchestrator | Friday 24 April 2026 03:03:08 +0000 (0:00:01.322) 0:08:09.477 ********** 2026-04-24 03:03:17.343703 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:03:17.343715 | orchestrator | 2026-04-24 03:03:17.343726 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 03:03:17.343737 | orchestrator | Friday 24 April 2026 03:03:09 +0000 (0:00:01.270) 0:08:10.748 ********** 2026-04-24 03:03:17.343748 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:03:17.343767 | orchestrator | 2026-04-24 03:03:17.343778 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 03:03:17.343788 | orchestrator | Friday 24 April 2026 03:03:11 +0000 (0:00:01.338) 0:08:12.086 ********** 2026-04-24 03:03:17.343799 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.343810 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.343821 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:17.343832 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:17.343843 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:17.343853 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:17.343864 | orchestrator | 2026-04-24 03:03:17.343875 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 03:03:17.343886 | orchestrator | Friday 24 April 2026 03:03:12 +0000 (0:00:01.282) 0:08:13.369 ********** 2026-04-24 03:03:17.343896 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:17.343907 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:17.343918 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:17.343928 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:17.343939 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:17.343950 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:17.343961 | orchestrator | 2026-04-24 03:03:17.343971 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 03:03:17.343982 | orchestrator | Friday 24 April 2026 03:03:13 +0000 (0:00:00.751) 0:08:14.120 ********** 2026-04-24 03:03:17.343993 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:17.344004 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:17.344014 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:17.344025 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:17.344036 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:17.344047 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:17.344057 | orchestrator | 2026-04-24 03:03:17.344069 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 03:03:17.344080 | orchestrator | Friday 24 April 2026 03:03:14 +0000 (0:00:00.960) 0:08:15.080 ********** 2026-04-24 03:03:17.344091 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:17.344101 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:17.344112 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:17.344128 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:17.344139 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:17.344150 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:17.344161 | orchestrator | 2026-04-24 03:03:17.344172 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 03:03:17.344183 | orchestrator | Friday 24 April 2026 03:03:14 +0000 (0:00:00.750) 0:08:15.831 ********** 2026-04-24 03:03:17.344193 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.344204 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.344215 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:17.344226 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:17.344255 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:17.344267 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:17.344277 | orchestrator | 2026-04-24 03:03:17.344288 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 03:03:17.344299 | orchestrator | Friday 24 April 2026 03:03:16 +0000 (0:00:01.462) 0:08:17.294 ********** 2026-04-24 03:03:17.344310 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:17.344320 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:17.344331 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:17.344342 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:17.344353 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:17.344363 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:17.344374 | orchestrator | 2026-04-24 03:03:17.344385 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 03:03:17.344403 | orchestrator | Friday 24 April 2026 03:03:17 +0000 (0:00:00.710) 0:08:18.005 ********** 2026-04-24 03:03:17.344420 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:49.520158 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:49.520334 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:49.520362 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:49.520381 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:49.520400 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:49.520421 | orchestrator | 2026-04-24 03:03:49.520443 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 03:03:49.520463 | orchestrator | Friday 24 April 2026 03:03:18 +0000 (0:00:00.912) 0:08:18.918 ********** 2026-04-24 03:03:49.520477 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:49.520489 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:49.520501 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:49.520512 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:49.520522 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:49.520533 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:49.520544 | orchestrator | 2026-04-24 03:03:49.520555 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 03:03:49.520566 | orchestrator | Friday 24 April 2026 03:03:19 +0000 (0:00:01.071) 0:08:19.989 ********** 2026-04-24 03:03:49.520577 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:49.520588 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:49.520599 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:49.520610 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:49.520621 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:49.520632 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:49.520642 | orchestrator | 2026-04-24 03:03:49.520653 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 03:03:49.520665 | orchestrator | Friday 24 April 2026 03:03:20 +0000 (0:00:01.409) 0:08:21.398 ********** 2026-04-24 03:03:49.520679 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:49.520693 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:49.520706 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:49.520719 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:49.520732 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:49.520749 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:49.520769 | orchestrator | 2026-04-24 03:03:49.520789 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 03:03:49.520807 | orchestrator | Friday 24 April 2026 03:03:21 +0000 (0:00:00.643) 0:08:22.042 ********** 2026-04-24 03:03:49.520826 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:49.520846 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:49.520865 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:49.520885 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:49.520905 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:49.520925 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:49.520938 | orchestrator | 2026-04-24 03:03:49.520952 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 03:03:49.520965 | orchestrator | Friday 24 April 2026 03:03:22 +0000 (0:00:00.911) 0:08:22.954 ********** 2026-04-24 03:03:49.520978 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:49.520991 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:49.521003 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:49.521015 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:49.521028 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:49.521041 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:49.521054 | orchestrator | 2026-04-24 03:03:49.521066 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 03:03:49.521077 | orchestrator | Friday 24 April 2026 03:03:22 +0000 (0:00:00.619) 0:08:23.574 ********** 2026-04-24 03:03:49.521089 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:49.521100 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:49.521111 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:49.521150 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:49.521161 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:49.521172 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:49.521183 | orchestrator | 2026-04-24 03:03:49.521194 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 03:03:49.521205 | orchestrator | Friday 24 April 2026 03:03:23 +0000 (0:00:00.907) 0:08:24.481 ********** 2026-04-24 03:03:49.521216 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:49.521226 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:49.521273 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:49.521285 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:49.521296 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:49.521306 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:49.521317 | orchestrator | 2026-04-24 03:03:49.521328 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 03:03:49.521339 | orchestrator | Friday 24 April 2026 03:03:24 +0000 (0:00:00.623) 0:08:25.105 ********** 2026-04-24 03:03:49.521349 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:49.521360 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:49.521371 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:49.521382 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:49.521392 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:49.521403 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:49.521414 | orchestrator | 2026-04-24 03:03:49.521425 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 03:03:49.521436 | orchestrator | Friday 24 April 2026 03:03:25 +0000 (0:00:00.873) 0:08:25.979 ********** 2026-04-24 03:03:49.521447 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:49.521457 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:49.521468 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:49.521479 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:03:49.521489 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:03:49.521500 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:03:49.521510 | orchestrator | 2026-04-24 03:03:49.521521 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 03:03:49.521532 | orchestrator | Friday 24 April 2026 03:03:25 +0000 (0:00:00.622) 0:08:26.601 ********** 2026-04-24 03:03:49.521542 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:03:49.521553 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:03:49.521563 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:03:49.521574 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:49.521585 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:49.521595 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:49.521606 | orchestrator | 2026-04-24 03:03:49.521617 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 03:03:49.521646 | orchestrator | Friday 24 April 2026 03:03:26 +0000 (0:00:00.928) 0:08:27.529 ********** 2026-04-24 03:03:49.521658 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:49.521669 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:49.521679 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:49.521690 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:49.521700 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:49.521711 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:49.521721 | orchestrator | 2026-04-24 03:03:49.521732 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 03:03:49.521743 | orchestrator | Friday 24 April 2026 03:03:27 +0000 (0:00:00.673) 0:08:28.203 ********** 2026-04-24 03:03:49.521889 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:49.521915 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:49.521926 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:49.521937 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:49.521947 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:49.521958 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:49.521969 | orchestrator | 2026-04-24 03:03:49.521980 | orchestrator | TASK [ceph-crash : Create client.crash keyring] ******************************** 2026-04-24 03:03:49.522110 | orchestrator | Friday 24 April 2026 03:03:28 +0000 (0:00:01.323) 0:08:29.527 ********** 2026-04-24 03:03:49.522127 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:03:49.522138 | orchestrator | 2026-04-24 03:03:49.522149 | orchestrator | TASK [ceph-crash : Get keys from monitors] ************************************* 2026-04-24 03:03:49.522160 | orchestrator | Friday 24 April 2026 03:03:32 +0000 (0:00:04.096) 0:08:33.624 ********** 2026-04-24 03:03:49.522171 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:03:49.522182 | orchestrator | 2026-04-24 03:03:49.522193 | orchestrator | TASK [ceph-crash : Copy ceph key(s) if needed] ********************************* 2026-04-24 03:03:49.522204 | orchestrator | Friday 24 April 2026 03:03:35 +0000 (0:00:02.809) 0:08:36.434 ********** 2026-04-24 03:03:49.522215 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:03:49.522225 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:03:49.522256 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:03:49.522268 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:49.522278 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:03:49.522289 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:03:49.522300 | orchestrator | 2026-04-24 03:03:49.522311 | orchestrator | TASK [ceph-crash : Create /var/lib/ceph/crash/posted] ************************** 2026-04-24 03:03:49.522322 | orchestrator | Friday 24 April 2026 03:03:37 +0000 (0:00:01.538) 0:08:37.972 ********** 2026-04-24 03:03:49.522332 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:03:49.522343 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:03:49.522354 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:03:49.522365 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:03:49.522375 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:03:49.522386 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:03:49.522396 | orchestrator | 2026-04-24 03:03:49.522407 | orchestrator | TASK [ceph-crash : Include_tasks systemd.yml] ********************************** 2026-04-24 03:03:49.522418 | orchestrator | Friday 24 April 2026 03:03:38 +0000 (0:00:01.254) 0:08:39.226 ********** 2026-04-24 03:03:49.522430 | orchestrator | included: /ansible/roles/ceph-crash/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:03:49.522443 | orchestrator | 2026-04-24 03:03:49.522454 | orchestrator | TASK [ceph-crash : Generate systemd unit file for ceph-crash container] ******** 2026-04-24 03:03:49.522464 | orchestrator | Friday 24 April 2026 03:03:39 +0000 (0:00:01.301) 0:08:40.527 ********** 2026-04-24 03:03:49.522475 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:03:49.522486 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:03:49.522496 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:03:49.522507 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:03:49.522518 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:03:49.522528 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:03:49.522539 | orchestrator | 2026-04-24 03:03:49.522550 | orchestrator | TASK [ceph-crash : Start the ceph-crash service] ******************************* 2026-04-24 03:03:49.522561 | orchestrator | Friday 24 April 2026 03:03:41 +0000 (0:00:01.599) 0:08:42.127 ********** 2026-04-24 03:03:49.522571 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:03:49.522582 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:03:49.522593 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:03:49.522603 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:03:49.522614 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:03:49.522624 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:03:49.522635 | orchestrator | 2026-04-24 03:03:49.522646 | orchestrator | RUNNING HANDLER [ceph-handler : Ceph crash handler] **************************** 2026-04-24 03:03:49.522681 | orchestrator | Friday 24 April 2026 03:03:44 +0000 (0:00:03.698) 0:08:45.825 ********** 2026-04-24 03:03:49.522693 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_crash.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:03:49.522713 | orchestrator | 2026-04-24 03:03:49.522724 | orchestrator | RUNNING HANDLER [ceph-handler : Set _crash_handler_called before restart] ****** 2026-04-24 03:03:49.522735 | orchestrator | Friday 24 April 2026 03:03:46 +0000 (0:00:01.299) 0:08:47.125 ********** 2026-04-24 03:03:49.522745 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:03:49.522756 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:03:49.522767 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:03:49.522778 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:03:49.522788 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:03:49.522799 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:03:49.522809 | orchestrator | 2026-04-24 03:03:49.522820 | orchestrator | RUNNING HANDLER [ceph-handler : Restart the ceph-crash service] **************** 2026-04-24 03:03:49.522831 | orchestrator | Friday 24 April 2026 03:03:46 +0000 (0:00:00.696) 0:08:47.822 ********** 2026-04-24 03:03:49.522842 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:03:49.522852 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:03:49.522863 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:03:49.522874 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:03:49.522885 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:03:49.522895 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:03:49.522906 | orchestrator | 2026-04-24 03:03:49.522917 | orchestrator | RUNNING HANDLER [ceph-handler : Set _crash_handler_called after restart] ******* 2026-04-24 03:03:49.522940 | orchestrator | Friday 24 April 2026 03:03:49 +0000 (0:00:02.581) 0:08:50.404 ********** 2026-04-24 03:04:17.454995 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455081 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455089 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455095 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:04:17.455101 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:04:17.455106 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:04:17.455112 | orchestrator | 2026-04-24 03:04:17.455119 | orchestrator | PLAY [Apply role ceph-mds] ***************************************************** 2026-04-24 03:04:17.455126 | orchestrator | 2026-04-24 03:04:17.455132 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 03:04:17.455138 | orchestrator | Friday 24 April 2026 03:03:50 +0000 (0:00:00.901) 0:08:51.305 ********** 2026-04-24 03:04:17.455144 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:04:17.455151 | orchestrator | 2026-04-24 03:04:17.455157 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 03:04:17.455162 | orchestrator | Friday 24 April 2026 03:03:51 +0000 (0:00:00.813) 0:08:52.118 ********** 2026-04-24 03:04:17.455167 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:04:17.455173 | orchestrator | 2026-04-24 03:04:17.455178 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 03:04:17.455184 | orchestrator | Friday 24 April 2026 03:03:51 +0000 (0:00:00.549) 0:08:52.668 ********** 2026-04-24 03:04:17.455189 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455196 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455201 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455206 | orchestrator | 2026-04-24 03:04:17.455212 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 03:04:17.455217 | orchestrator | Friday 24 April 2026 03:03:52 +0000 (0:00:00.620) 0:08:53.289 ********** 2026-04-24 03:04:17.455223 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455228 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455233 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455254 | orchestrator | 2026-04-24 03:04:17.455260 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 03:04:17.455266 | orchestrator | Friday 24 April 2026 03:03:53 +0000 (0:00:00.740) 0:08:54.029 ********** 2026-04-24 03:04:17.455271 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455277 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455299 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455305 | orchestrator | 2026-04-24 03:04:17.455311 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 03:04:17.455316 | orchestrator | Friday 24 April 2026 03:03:53 +0000 (0:00:00.700) 0:08:54.730 ********** 2026-04-24 03:04:17.455321 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455327 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455332 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455338 | orchestrator | 2026-04-24 03:04:17.455343 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 03:04:17.455349 | orchestrator | Friday 24 April 2026 03:03:54 +0000 (0:00:01.006) 0:08:55.737 ********** 2026-04-24 03:04:17.455354 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455359 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455365 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455370 | orchestrator | 2026-04-24 03:04:17.455375 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 03:04:17.455381 | orchestrator | Friday 24 April 2026 03:03:55 +0000 (0:00:00.356) 0:08:56.093 ********** 2026-04-24 03:04:17.455386 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455391 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455397 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455402 | orchestrator | 2026-04-24 03:04:17.455408 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 03:04:17.455413 | orchestrator | Friday 24 April 2026 03:03:55 +0000 (0:00:00.323) 0:08:56.417 ********** 2026-04-24 03:04:17.455418 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455424 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455429 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455434 | orchestrator | 2026-04-24 03:04:17.455440 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 03:04:17.455445 | orchestrator | Friday 24 April 2026 03:03:55 +0000 (0:00:00.355) 0:08:56.772 ********** 2026-04-24 03:04:17.455451 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455456 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455461 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455467 | orchestrator | 2026-04-24 03:04:17.455484 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 03:04:17.455490 | orchestrator | Friday 24 April 2026 03:03:56 +0000 (0:00:01.010) 0:08:57.783 ********** 2026-04-24 03:04:17.455495 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455501 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455506 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455511 | orchestrator | 2026-04-24 03:04:17.455517 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 03:04:17.455522 | orchestrator | Friday 24 April 2026 03:03:57 +0000 (0:00:00.757) 0:08:58.541 ********** 2026-04-24 03:04:17.455527 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455533 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455538 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455544 | orchestrator | 2026-04-24 03:04:17.455549 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 03:04:17.455556 | orchestrator | Friday 24 April 2026 03:03:57 +0000 (0:00:00.325) 0:08:58.866 ********** 2026-04-24 03:04:17.455562 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455569 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455575 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455581 | orchestrator | 2026-04-24 03:04:17.455587 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 03:04:17.455593 | orchestrator | Friday 24 April 2026 03:03:58 +0000 (0:00:00.309) 0:08:59.176 ********** 2026-04-24 03:04:17.455600 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455606 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455613 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455619 | orchestrator | 2026-04-24 03:04:17.455635 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 03:04:17.455647 | orchestrator | Friday 24 April 2026 03:03:58 +0000 (0:00:00.628) 0:08:59.804 ********** 2026-04-24 03:04:17.455653 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455660 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455666 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455672 | orchestrator | 2026-04-24 03:04:17.455678 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 03:04:17.455684 | orchestrator | Friday 24 April 2026 03:03:59 +0000 (0:00:00.381) 0:09:00.186 ********** 2026-04-24 03:04:17.455690 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455697 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455703 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455709 | orchestrator | 2026-04-24 03:04:17.455716 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 03:04:17.455722 | orchestrator | Friday 24 April 2026 03:03:59 +0000 (0:00:00.354) 0:09:00.540 ********** 2026-04-24 03:04:17.455728 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455735 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455741 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455747 | orchestrator | 2026-04-24 03:04:17.455754 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 03:04:17.455760 | orchestrator | Friday 24 April 2026 03:03:59 +0000 (0:00:00.299) 0:09:00.839 ********** 2026-04-24 03:04:17.455766 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455773 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455779 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455785 | orchestrator | 2026-04-24 03:04:17.455791 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 03:04:17.455798 | orchestrator | Friday 24 April 2026 03:04:00 +0000 (0:00:00.597) 0:09:01.437 ********** 2026-04-24 03:04:17.455804 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455810 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455817 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455823 | orchestrator | 2026-04-24 03:04:17.455830 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 03:04:17.455837 | orchestrator | Friday 24 April 2026 03:04:00 +0000 (0:00:00.351) 0:09:01.789 ********** 2026-04-24 03:04:17.455843 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455849 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455855 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455861 | orchestrator | 2026-04-24 03:04:17.455867 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 03:04:17.455872 | orchestrator | Friday 24 April 2026 03:04:01 +0000 (0:00:00.345) 0:09:02.134 ********** 2026-04-24 03:04:17.455878 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:17.455883 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:17.455888 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:17.455894 | orchestrator | 2026-04-24 03:04:17.455899 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-24 03:04:17.455904 | orchestrator | Friday 24 April 2026 03:04:02 +0000 (0:00:00.873) 0:09:03.008 ********** 2026-04-24 03:04:17.455910 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:17.455915 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:17.455921 | orchestrator | included: /ansible/roles/ceph-mds/tasks/create_mds_filesystems.yml for testbed-node-3 2026-04-24 03:04:17.455927 | orchestrator | 2026-04-24 03:04:17.455932 | orchestrator | TASK [ceph-facts : Get current default crush rule details] ********************* 2026-04-24 03:04:17.455938 | orchestrator | Friday 24 April 2026 03:04:02 +0000 (0:00:00.421) 0:09:03.429 ********** 2026-04-24 03:04:17.455943 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:04:17.455949 | orchestrator | 2026-04-24 03:04:17.455954 | orchestrator | TASK [ceph-facts : Get current default crush rule name] ************************ 2026-04-24 03:04:17.455959 | orchestrator | Friday 24 April 2026 03:04:04 +0000 (0:00:02.247) 0:09:05.676 ********** 2026-04-24 03:04:17.455970 | orchestrator | skipping: [testbed-node-3] => (item={'rule_id': 0, 'rule_name': 'replicated_rule', 'type': 1, 'steps': [{'op': 'take', 'item': -1, 'item_name': 'default'}, {'op': 'chooseleaf_firstn', 'num': 0, 'type': 'host'}, {'op': 'emit'}]})  2026-04-24 03:04:17.455978 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:17.455983 | orchestrator | 2026-04-24 03:04:17.455989 | orchestrator | TASK [ceph-mds : Create filesystem pools] ************************************** 2026-04-24 03:04:17.455998 | orchestrator | Friday 24 April 2026 03:04:05 +0000 (0:00:00.236) 0:09:05.913 ********** 2026-04-24 03:04:17.456005 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'application': 'cephfs', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'cephfs_data', 'pg_num': 16, 'pgp_num': 16, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-24 03:04:17.456016 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'application': 'cephfs', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'cephfs_metadata', 'pg_num': 16, 'pgp_num': 16, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-24 03:04:17.456022 | orchestrator | 2026-04-24 03:04:17.456028 | orchestrator | TASK [ceph-mds : Create ceph filesystem] *************************************** 2026-04-24 03:04:17.456033 | orchestrator | Friday 24 April 2026 03:04:12 +0000 (0:00:07.961) 0:09:13.875 ********** 2026-04-24 03:04:17.456038 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:04:17.456044 | orchestrator | 2026-04-24 03:04:17.456049 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-24 03:04:17.456054 | orchestrator | Friday 24 April 2026 03:04:16 +0000 (0:00:03.616) 0:09:17.491 ********** 2026-04-24 03:04:17.456060 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:04:17.456066 | orchestrator | 2026-04-24 03:04:17.456074 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-24 03:04:44.642823 | orchestrator | Friday 24 April 2026 03:04:17 +0000 (0:00:00.855) 0:09:18.347 ********** 2026-04-24 03:04:44.642911 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-24 03:04:44.642925 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-24 03:04:44.642936 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-24 03:04:44.642946 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mds/ceph-testbed-node-3) 2026-04-24 03:04:44.642956 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mds/ceph-testbed-node-4) 2026-04-24 03:04:44.642966 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mds/ceph-testbed-node-5) 2026-04-24 03:04:44.642976 | orchestrator | 2026-04-24 03:04:44.642986 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-24 03:04:44.642996 | orchestrator | Friday 24 April 2026 03:04:18 +0000 (0:00:01.061) 0:09:19.409 ********** 2026-04-24 03:04:44.643006 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:04:44.643016 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 03:04:44.643026 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 03:04:44.643035 | orchestrator | 2026-04-24 03:04:44.643045 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-24 03:04:44.643054 | orchestrator | Friday 24 April 2026 03:04:20 +0000 (0:00:02.164) 0:09:21.573 ********** 2026-04-24 03:04:44.643065 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-24 03:04:44.643075 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 03:04:44.643085 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:04:44.643095 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-24 03:04:44.643104 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 03:04:44.643114 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:04:44.643144 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-24 03:04:44.643154 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-24 03:04:44.643164 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:04:44.643173 | orchestrator | 2026-04-24 03:04:44.643183 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-24 03:04:44.643192 | orchestrator | Friday 24 April 2026 03:04:21 +0000 (0:00:01.184) 0:09:22.758 ********** 2026-04-24 03:04:44.643202 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:04:44.643212 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:04:44.643221 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:04:44.643231 | orchestrator | 2026-04-24 03:04:44.643240 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-24 03:04:44.643250 | orchestrator | Friday 24 April 2026 03:04:24 +0000 (0:00:03.066) 0:09:25.824 ********** 2026-04-24 03:04:44.643259 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:44.643269 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:44.643278 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:44.643288 | orchestrator | 2026-04-24 03:04:44.643297 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-24 03:04:44.643307 | orchestrator | Friday 24 April 2026 03:04:25 +0000 (0:00:00.332) 0:09:26.156 ********** 2026-04-24 03:04:44.643317 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:04:44.643327 | orchestrator | 2026-04-24 03:04:44.643336 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-24 03:04:44.643346 | orchestrator | Friday 24 April 2026 03:04:26 +0000 (0:00:00.821) 0:09:26.979 ********** 2026-04-24 03:04:44.643356 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:04:44.643400 | orchestrator | 2026-04-24 03:04:44.643413 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-24 03:04:44.643424 | orchestrator | Friday 24 April 2026 03:04:26 +0000 (0:00:00.581) 0:09:27.560 ********** 2026-04-24 03:04:44.643436 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:04:44.643448 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:04:44.643459 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:04:44.643470 | orchestrator | 2026-04-24 03:04:44.643492 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-24 03:04:44.643504 | orchestrator | Friday 24 April 2026 03:04:27 +0000 (0:00:01.272) 0:09:28.832 ********** 2026-04-24 03:04:44.643515 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:04:44.643526 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:04:44.643538 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:04:44.643549 | orchestrator | 2026-04-24 03:04:44.643560 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-24 03:04:44.643571 | orchestrator | Friday 24 April 2026 03:04:29 +0000 (0:00:01.495) 0:09:30.328 ********** 2026-04-24 03:04:44.643582 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:04:44.643593 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:04:44.643604 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:04:44.643614 | orchestrator | 2026-04-24 03:04:44.643626 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-24 03:04:44.643637 | orchestrator | Friday 24 April 2026 03:04:31 +0000 (0:00:01.775) 0:09:32.103 ********** 2026-04-24 03:04:44.643648 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:04:44.643659 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:04:44.643670 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:04:44.643681 | orchestrator | 2026-04-24 03:04:44.643692 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-24 03:04:44.643704 | orchestrator | Friday 24 April 2026 03:04:33 +0000 (0:00:02.056) 0:09:34.159 ********** 2026-04-24 03:04:44.643715 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:44.643726 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:44.643745 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:44.643755 | orchestrator | 2026-04-24 03:04:44.643765 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-24 03:04:44.643787 | orchestrator | Friday 24 April 2026 03:04:34 +0000 (0:00:01.606) 0:09:35.766 ********** 2026-04-24 03:04:44.643797 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:04:44.643807 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:04:44.643816 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:04:44.643826 | orchestrator | 2026-04-24 03:04:44.643836 | orchestrator | RUNNING HANDLER [ceph-handler : Mdss handler] ********************************** 2026-04-24 03:04:44.643846 | orchestrator | Friday 24 April 2026 03:04:35 +0000 (0:00:00.698) 0:09:36.465 ********** 2026-04-24 03:04:44.643855 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mdss.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:04:44.643865 | orchestrator | 2026-04-24 03:04:44.643875 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called before restart] ******** 2026-04-24 03:04:44.643884 | orchestrator | Friday 24 April 2026 03:04:36 +0000 (0:00:00.827) 0:09:37.292 ********** 2026-04-24 03:04:44.643894 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:44.643903 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:44.643913 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:44.643922 | orchestrator | 2026-04-24 03:04:44.643932 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mds restart script] *********************** 2026-04-24 03:04:44.643942 | orchestrator | Friday 24 April 2026 03:04:36 +0000 (0:00:00.367) 0:09:37.659 ********** 2026-04-24 03:04:44.643951 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:04:44.643961 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:04:44.643970 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:04:44.643980 | orchestrator | 2026-04-24 03:04:44.643990 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mds daemon(s)] ******************** 2026-04-24 03:04:44.643999 | orchestrator | Friday 24 April 2026 03:04:38 +0000 (0:00:01.300) 0:09:38.959 ********** 2026-04-24 03:04:44.644009 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 03:04:44.644024 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 03:04:44.644042 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 03:04:44.644059 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:44.644076 | orchestrator | 2026-04-24 03:04:44.644094 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called after restart] ********* 2026-04-24 03:04:44.644110 | orchestrator | Friday 24 April 2026 03:04:38 +0000 (0:00:00.925) 0:09:39.884 ********** 2026-04-24 03:04:44.644129 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:44.644146 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:44.644164 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:44.644181 | orchestrator | 2026-04-24 03:04:44.644198 | orchestrator | PLAY [Apply role ceph-rgw] ***************************************************** 2026-04-24 03:04:44.644216 | orchestrator | 2026-04-24 03:04:44.644234 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 03:04:44.644252 | orchestrator | Friday 24 April 2026 03:04:39 +0000 (0:00:00.885) 0:09:40.770 ********** 2026-04-24 03:04:44.644269 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:04:44.644288 | orchestrator | 2026-04-24 03:04:44.644307 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 03:04:44.644326 | orchestrator | Friday 24 April 2026 03:04:40 +0000 (0:00:00.561) 0:09:41.332 ********** 2026-04-24 03:04:44.644346 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:04:44.644387 | orchestrator | 2026-04-24 03:04:44.644407 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 03:04:44.644426 | orchestrator | Friday 24 April 2026 03:04:41 +0000 (0:00:00.823) 0:09:42.156 ********** 2026-04-24 03:04:44.644445 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:44.644480 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:44.644499 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:44.644519 | orchestrator | 2026-04-24 03:04:44.644537 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 03:04:44.644557 | orchestrator | Friday 24 April 2026 03:04:41 +0000 (0:00:00.339) 0:09:42.496 ********** 2026-04-24 03:04:44.644576 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:44.644596 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:44.644615 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:44.644635 | orchestrator | 2026-04-24 03:04:44.644655 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 03:04:44.644683 | orchestrator | Friday 24 April 2026 03:04:42 +0000 (0:00:00.721) 0:09:43.217 ********** 2026-04-24 03:04:44.644702 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:44.644722 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:44.644741 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:44.644760 | orchestrator | 2026-04-24 03:04:44.644779 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 03:04:44.644798 | orchestrator | Friday 24 April 2026 03:04:43 +0000 (0:00:00.879) 0:09:44.097 ********** 2026-04-24 03:04:44.644818 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:04:44.644837 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:04:44.644856 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:04:44.644875 | orchestrator | 2026-04-24 03:04:44.644894 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 03:04:44.644914 | orchestrator | Friday 24 April 2026 03:04:43 +0000 (0:00:00.678) 0:09:44.776 ********** 2026-04-24 03:04:44.644933 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:44.644952 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:44.644971 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:44.644990 | orchestrator | 2026-04-24 03:04:44.645009 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 03:04:44.645029 | orchestrator | Friday 24 April 2026 03:04:44 +0000 (0:00:00.294) 0:09:45.071 ********** 2026-04-24 03:04:44.645048 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:04:44.645067 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:04:44.645086 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:04:44.645105 | orchestrator | 2026-04-24 03:04:44.645124 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 03:04:44.645143 | orchestrator | Friday 24 April 2026 03:04:44 +0000 (0:00:00.296) 0:09:45.367 ********** 2026-04-24 03:04:44.645177 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:06.866841 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:06.866931 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:06.866945 | orchestrator | 2026-04-24 03:05:06.866957 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 03:05:06.866968 | orchestrator | Friday 24 April 2026 03:04:44 +0000 (0:00:00.441) 0:09:45.809 ********** 2026-04-24 03:05:06.866978 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:06.866988 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:06.866998 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:06.867008 | orchestrator | 2026-04-24 03:05:06.867018 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 03:05:06.867028 | orchestrator | Friday 24 April 2026 03:04:45 +0000 (0:00:00.718) 0:09:46.528 ********** 2026-04-24 03:05:06.867037 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:06.867047 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:06.867057 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:06.867068 | orchestrator | 2026-04-24 03:05:06.867079 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 03:05:06.867090 | orchestrator | Friday 24 April 2026 03:04:46 +0000 (0:00:00.733) 0:09:47.262 ********** 2026-04-24 03:05:06.867101 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:06.867113 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:06.867123 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:06.867159 | orchestrator | 2026-04-24 03:05:06.867171 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 03:05:06.867182 | orchestrator | Friday 24 April 2026 03:04:46 +0000 (0:00:00.345) 0:09:47.607 ********** 2026-04-24 03:05:06.867193 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:06.867204 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:06.867216 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:06.867226 | orchestrator | 2026-04-24 03:05:06.867237 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 03:05:06.867248 | orchestrator | Friday 24 April 2026 03:04:47 +0000 (0:00:00.662) 0:09:48.269 ********** 2026-04-24 03:05:06.867259 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:06.867270 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:06.867281 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:06.867292 | orchestrator | 2026-04-24 03:05:06.867303 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 03:05:06.867314 | orchestrator | Friday 24 April 2026 03:04:47 +0000 (0:00:00.414) 0:09:48.683 ********** 2026-04-24 03:05:06.867324 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:06.867335 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:06.867346 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:06.867357 | orchestrator | 2026-04-24 03:05:06.867368 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 03:05:06.867379 | orchestrator | Friday 24 April 2026 03:04:48 +0000 (0:00:00.405) 0:09:49.089 ********** 2026-04-24 03:05:06.867390 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:06.867401 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:06.867414 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:06.867428 | orchestrator | 2026-04-24 03:05:06.867442 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 03:05:06.867454 | orchestrator | Friday 24 April 2026 03:04:48 +0000 (0:00:00.349) 0:09:49.438 ********** 2026-04-24 03:05:06.867504 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:06.867518 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:06.867531 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:06.867544 | orchestrator | 2026-04-24 03:05:06.867556 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 03:05:06.867569 | orchestrator | Friday 24 April 2026 03:04:49 +0000 (0:00:00.621) 0:09:50.060 ********** 2026-04-24 03:05:06.867582 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:06.867595 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:06.867609 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:06.867622 | orchestrator | 2026-04-24 03:05:06.867635 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 03:05:06.867648 | orchestrator | Friday 24 April 2026 03:04:49 +0000 (0:00:00.343) 0:09:50.404 ********** 2026-04-24 03:05:06.867661 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:06.867675 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:06.867687 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:06.867698 | orchestrator | 2026-04-24 03:05:06.867709 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 03:05:06.867720 | orchestrator | Friday 24 April 2026 03:04:49 +0000 (0:00:00.321) 0:09:50.726 ********** 2026-04-24 03:05:06.867744 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:06.867756 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:06.867767 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:06.867777 | orchestrator | 2026-04-24 03:05:06.867788 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 03:05:06.867799 | orchestrator | Friday 24 April 2026 03:04:50 +0000 (0:00:00.379) 0:09:51.105 ********** 2026-04-24 03:05:06.867810 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:06.867821 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:06.867831 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:06.867842 | orchestrator | 2026-04-24 03:05:06.867853 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-24 03:05:06.867873 | orchestrator | Friday 24 April 2026 03:04:51 +0000 (0:00:00.872) 0:09:51.978 ********** 2026-04-24 03:05:06.867884 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:05:06.867896 | orchestrator | 2026-04-24 03:05:06.867907 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-24 03:05:06.867918 | orchestrator | Friday 24 April 2026 03:04:51 +0000 (0:00:00.571) 0:09:52.550 ********** 2026-04-24 03:05:06.867929 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:05:06.867940 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 03:05:06.867951 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 03:05:06.867962 | orchestrator | 2026-04-24 03:05:06.867973 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-24 03:05:06.867984 | orchestrator | Friday 24 April 2026 03:04:54 +0000 (0:00:02.460) 0:09:55.010 ********** 2026-04-24 03:05:06.868010 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-24 03:05:06.868022 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 03:05:06.868034 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:05:06.868045 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-24 03:05:06.868056 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 03:05:06.868067 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:05:06.868078 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-24 03:05:06.868089 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-24 03:05:06.868100 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:05:06.868110 | orchestrator | 2026-04-24 03:05:06.868121 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-24 03:05:06.868132 | orchestrator | Friday 24 April 2026 03:04:55 +0000 (0:00:01.520) 0:09:56.531 ********** 2026-04-24 03:05:06.868143 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:06.868154 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:06.868165 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:06.868176 | orchestrator | 2026-04-24 03:05:06.868187 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-24 03:05:06.868198 | orchestrator | Friday 24 April 2026 03:04:55 +0000 (0:00:00.343) 0:09:56.874 ********** 2026-04-24 03:05:06.868209 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:05:06.868220 | orchestrator | 2026-04-24 03:05:06.868231 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-24 03:05:06.868242 | orchestrator | Friday 24 April 2026 03:04:56 +0000 (0:00:00.828) 0:09:57.702 ********** 2026-04-24 03:05:06.868254 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 03:05:06.868266 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 03:05:06.868277 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 03:05:06.868287 | orchestrator | 2026-04-24 03:05:06.868298 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-24 03:05:06.868309 | orchestrator | Friday 24 April 2026 03:04:57 +0000 (0:00:00.853) 0:09:58.556 ********** 2026-04-24 03:05:06.868320 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:05:06.868331 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-24 03:05:06.868343 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:05:06.868360 | orchestrator | changed: [testbed-node-4 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-24 03:05:06.868371 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:05:06.868382 | orchestrator | changed: [testbed-node-3 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-24 03:05:06.868393 | orchestrator | 2026-04-24 03:05:06.868404 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-24 03:05:06.868415 | orchestrator | Friday 24 April 2026 03:05:02 +0000 (0:00:04.598) 0:10:03.155 ********** 2026-04-24 03:05:06.868426 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:05:06.868436 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 03:05:06.868447 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:05:06.868463 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 03:05:06.868488 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:05:06.868499 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 03:05:06.868510 | orchestrator | 2026-04-24 03:05:06.868521 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-24 03:05:06.868532 | orchestrator | Friday 24 April 2026 03:05:04 +0000 (0:00:02.378) 0:10:05.534 ********** 2026-04-24 03:05:06.868543 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-24 03:05:06.868554 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:05:06.868565 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-24 03:05:06.868575 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:05:06.868586 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-24 03:05:06.868597 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:05:06.868608 | orchestrator | 2026-04-24 03:05:06.868619 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-24 03:05:06.868630 | orchestrator | Friday 24 April 2026 03:05:06 +0000 (0:00:01.452) 0:10:06.986 ********** 2026-04-24 03:05:06.868641 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-3 2026-04-24 03:05:06.868652 | orchestrator | 2026-04-24 03:05:06.868662 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-24 03:05:06.868673 | orchestrator | Friday 24 April 2026 03:05:06 +0000 (0:00:00.224) 0:10:07.211 ********** 2026-04-24 03:05:06.868684 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:06.868701 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602346 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602454 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602469 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602482 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:50.602495 | orchestrator | 2026-04-24 03:05:50.602507 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-24 03:05:50.602520 | orchestrator | Friday 24 April 2026 03:05:06 +0000 (0:00:00.549) 0:10:07.760 ********** 2026-04-24 03:05:50.602532 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602543 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602579 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602591 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602602 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 03:05:50.602613 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:50.602624 | orchestrator | 2026-04-24 03:05:50.602635 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-24 03:05:50.602729 | orchestrator | Friday 24 April 2026 03:05:07 +0000 (0:00:00.552) 0:10:08.313 ********** 2026-04-24 03:05:50.602742 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 03:05:50.602755 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 03:05:50.602766 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 03:05:50.602776 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 03:05:50.602787 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 03:05:50.602798 | orchestrator | 2026-04-24 03:05:50.602809 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-24 03:05:50.602819 | orchestrator | Friday 24 April 2026 03:05:37 +0000 (0:00:30.361) 0:10:38.675 ********** 2026-04-24 03:05:50.602830 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:50.602841 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:50.602851 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:50.602862 | orchestrator | 2026-04-24 03:05:50.602873 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-24 03:05:50.602883 | orchestrator | Friday 24 April 2026 03:05:38 +0000 (0:00:00.331) 0:10:39.006 ********** 2026-04-24 03:05:50.602908 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:50.602920 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:50.602930 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:50.602941 | orchestrator | 2026-04-24 03:05:50.602951 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-24 03:05:50.602962 | orchestrator | Friday 24 April 2026 03:05:38 +0000 (0:00:00.341) 0:10:39.348 ********** 2026-04-24 03:05:50.602973 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:05:50.602984 | orchestrator | 2026-04-24 03:05:50.602995 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-24 03:05:50.603006 | orchestrator | Friday 24 April 2026 03:05:39 +0000 (0:00:00.852) 0:10:40.201 ********** 2026-04-24 03:05:50.603017 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:05:50.603027 | orchestrator | 2026-04-24 03:05:50.603038 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-24 03:05:50.603049 | orchestrator | Friday 24 April 2026 03:05:40 +0000 (0:00:00.792) 0:10:40.993 ********** 2026-04-24 03:05:50.603060 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:05:50.603071 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:05:50.603082 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:05:50.603092 | orchestrator | 2026-04-24 03:05:50.603103 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-24 03:05:50.603124 | orchestrator | Friday 24 April 2026 03:05:41 +0000 (0:00:01.292) 0:10:42.285 ********** 2026-04-24 03:05:50.603135 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:05:50.603146 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:05:50.603156 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:05:50.603167 | orchestrator | 2026-04-24 03:05:50.603178 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-24 03:05:50.603206 | orchestrator | Friday 24 April 2026 03:05:42 +0000 (0:00:01.194) 0:10:43.480 ********** 2026-04-24 03:05:50.603218 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:05:50.603229 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:05:50.603239 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:05:50.603250 | orchestrator | 2026-04-24 03:05:50.603261 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-24 03:05:50.603272 | orchestrator | Friday 24 April 2026 03:05:44 +0000 (0:00:01.797) 0:10:45.277 ********** 2026-04-24 03:05:50.603283 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 03:05:50.603294 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 03:05:50.603305 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 03:05:50.603316 | orchestrator | 2026-04-24 03:05:50.603326 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-24 03:05:50.603337 | orchestrator | Friday 24 April 2026 03:05:47 +0000 (0:00:02.744) 0:10:48.022 ********** 2026-04-24 03:05:50.603348 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:50.603359 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:50.603370 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:50.603380 | orchestrator | 2026-04-24 03:05:50.603391 | orchestrator | RUNNING HANDLER [ceph-handler : Rgws handler] ********************************** 2026-04-24 03:05:50.603402 | orchestrator | Friday 24 April 2026 03:05:47 +0000 (0:00:00.381) 0:10:48.404 ********** 2026-04-24 03:05:50.603413 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_rgws.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:05:50.603424 | orchestrator | 2026-04-24 03:05:50.603434 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called before restart] ******** 2026-04-24 03:05:50.603445 | orchestrator | Friday 24 April 2026 03:05:48 +0000 (0:00:00.823) 0:10:49.227 ********** 2026-04-24 03:05:50.603456 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:50.603467 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:50.603478 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:50.603489 | orchestrator | 2026-04-24 03:05:50.603500 | orchestrator | RUNNING HANDLER [ceph-handler : Copy rgw restart script] *********************** 2026-04-24 03:05:50.603510 | orchestrator | Friday 24 April 2026 03:05:48 +0000 (0:00:00.357) 0:10:49.584 ********** 2026-04-24 03:05:50.603521 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:50.603532 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:05:50.603542 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:05:50.603553 | orchestrator | 2026-04-24 03:05:50.603564 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph rgw daemon(s)] ******************** 2026-04-24 03:05:50.603575 | orchestrator | Friday 24 April 2026 03:05:49 +0000 (0:00:00.372) 0:10:49.957 ********** 2026-04-24 03:05:50.603585 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 03:05:50.603597 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 03:05:50.603607 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 03:05:50.603618 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:05:50.603629 | orchestrator | 2026-04-24 03:05:50.603639 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called after restart] ********* 2026-04-24 03:05:50.603669 | orchestrator | Friday 24 April 2026 03:05:50 +0000 (0:00:00.996) 0:10:50.954 ********** 2026-04-24 03:05:50.603687 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:05:50.603698 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:05:50.603709 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:05:50.603719 | orchestrator | 2026-04-24 03:05:50.603730 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:05:50.603741 | orchestrator | testbed-node-0 : ok=134  changed=35  unreachable=0 failed=0 skipped=125  rescued=0 ignored=0 2026-04-24 03:05:50.603758 | orchestrator | testbed-node-1 : ok=127  changed=31  unreachable=0 failed=0 skipped=120  rescued=0 ignored=0 2026-04-24 03:05:50.603770 | orchestrator | testbed-node-2 : ok=134  changed=33  unreachable=0 failed=0 skipped=119  rescued=0 ignored=0 2026-04-24 03:05:50.603781 | orchestrator | testbed-node-3 : ok=193  changed=45  unreachable=0 failed=0 skipped=162  rescued=0 ignored=0 2026-04-24 03:05:50.603792 | orchestrator | testbed-node-4 : ok=175  changed=40  unreachable=0 failed=0 skipped=123  rescued=0 ignored=0 2026-04-24 03:05:50.603803 | orchestrator | testbed-node-5 : ok=177  changed=41  unreachable=0 failed=0 skipped=121  rescued=0 ignored=0 2026-04-24 03:05:50.603814 | orchestrator | 2026-04-24 03:05:50.603824 | orchestrator | 2026-04-24 03:05:50.603835 | orchestrator | 2026-04-24 03:05:50.603846 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:05:50.603857 | orchestrator | Friday 24 April 2026 03:05:50 +0000 (0:00:00.529) 0:10:51.483 ********** 2026-04-24 03:05:50.603867 | orchestrator | =============================================================================== 2026-04-24 03:05:50.603878 | orchestrator | ceph-container-common : Pulling Ceph container image ------------------- 58.88s 2026-04-24 03:05:50.603889 | orchestrator | ceph-osd : Use ceph-volume to create osds ------------------------------ 39.55s 2026-04-24 03:05:50.603900 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 30.36s 2026-04-24 03:05:50.603917 | orchestrator | ceph-mgr : Wait for all mgr to be up ----------------------------------- 30.28s 2026-04-24 03:05:51.141821 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 21.91s 2026-04-24 03:05:51.141910 | orchestrator | ceph-mon : Set cluster configs ----------------------------------------- 14.65s 2026-04-24 03:05:51.141921 | orchestrator | ceph-osd : Wait for all osd to be up ----------------------------------- 12.44s 2026-04-24 03:05:51.141930 | orchestrator | ceph-mgr : Create ceph mgr keyring(s) on a mon node -------------------- 10.44s 2026-04-24 03:05:51.141938 | orchestrator | ceph-mon : Fetch ceph initial keys -------------------------------------- 9.08s 2026-04-24 03:05:51.141946 | orchestrator | ceph-mds : Create filesystem pools -------------------------------------- 7.96s 2026-04-24 03:05:51.141954 | orchestrator | ceph-mgr : Disable ceph mgr enabled modules ----------------------------- 6.57s 2026-04-24 03:05:51.141962 | orchestrator | ceph-config : Create ceph initial directories --------------------------- 6.55s 2026-04-24 03:05:51.141970 | orchestrator | ceph-mgr : Add modules to ceph-mgr -------------------------------------- 5.20s 2026-04-24 03:05:51.141977 | orchestrator | ceph-rgw : Create rgw keyrings ------------------------------------------ 4.60s 2026-04-24 03:05:51.141986 | orchestrator | ceph-crash : Create client.crash keyring -------------------------------- 4.10s 2026-04-24 03:05:51.141994 | orchestrator | ceph-crash : Start the ceph-crash service ------------------------------- 3.70s 2026-04-24 03:05:51.142002 | orchestrator | ceph-container-common : Get ceph version -------------------------------- 3.63s 2026-04-24 03:05:51.142009 | orchestrator | ceph-mds : Create ceph filesystem --------------------------------------- 3.62s 2026-04-24 03:05:51.142066 | orchestrator | ceph-osd : Systemd start osd -------------------------------------------- 3.59s 2026-04-24 03:05:51.142075 | orchestrator | ceph-mon : Copy admin keyring over to mons ------------------------------ 3.15s 2026-04-24 03:05:53.540973 | orchestrator | 2026-04-24 03:05:53 | INFO  | Task 08b60c21-a240-4469-b2b1-d94d514ae89b (ceph-pools) was prepared for execution. 2026-04-24 03:05:53.541091 | orchestrator | 2026-04-24 03:05:53 | INFO  | It takes a moment until task 08b60c21-a240-4469-b2b1-d94d514ae89b (ceph-pools) has been started and output is visible here. 2026-04-24 03:06:08.810191 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-24 03:06:08.810283 | orchestrator | 2.16.14 2026-04-24 03:06:08.810296 | orchestrator | 2026-04-24 03:06:08.810305 | orchestrator | PLAY [Create ceph pools] ******************************************************* 2026-04-24 03:06:08.810314 | orchestrator | 2026-04-24 03:06:08.810323 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 03:06:08.810331 | orchestrator | Friday 24 April 2026 03:05:58 +0000 (0:00:00.648) 0:00:00.648 ********** 2026-04-24 03:06:08.810340 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:06:08.810349 | orchestrator | 2026-04-24 03:06:08.810357 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 03:06:08.810365 | orchestrator | Friday 24 April 2026 03:05:59 +0000 (0:00:00.759) 0:00:01.408 ********** 2026-04-24 03:06:08.810373 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:08.810381 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:08.810389 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:08.810397 | orchestrator | 2026-04-24 03:06:08.810405 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 03:06:08.810413 | orchestrator | Friday 24 April 2026 03:06:00 +0000 (0:00:00.664) 0:00:02.072 ********** 2026-04-24 03:06:08.810420 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:08.810428 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:08.810436 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:08.810444 | orchestrator | 2026-04-24 03:06:08.810452 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 03:06:08.810460 | orchestrator | Friday 24 April 2026 03:06:00 +0000 (0:00:00.348) 0:00:02.421 ********** 2026-04-24 03:06:08.810480 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:08.810489 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:08.810497 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:08.810505 | orchestrator | 2026-04-24 03:06:08.810513 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 03:06:08.810521 | orchestrator | Friday 24 April 2026 03:06:01 +0000 (0:00:00.867) 0:00:03.288 ********** 2026-04-24 03:06:08.810528 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:08.810536 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:08.810544 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:08.810552 | orchestrator | 2026-04-24 03:06:08.810560 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 03:06:08.810568 | orchestrator | Friday 24 April 2026 03:06:01 +0000 (0:00:00.320) 0:00:03.609 ********** 2026-04-24 03:06:08.810575 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:08.810583 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:08.810591 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:08.810599 | orchestrator | 2026-04-24 03:06:08.810607 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 03:06:08.810615 | orchestrator | Friday 24 April 2026 03:06:01 +0000 (0:00:00.341) 0:00:03.951 ********** 2026-04-24 03:06:08.810622 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:08.810630 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:08.810638 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:08.810646 | orchestrator | 2026-04-24 03:06:08.810654 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 03:06:08.810662 | orchestrator | Friday 24 April 2026 03:06:02 +0000 (0:00:00.349) 0:00:04.301 ********** 2026-04-24 03:06:08.810670 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:08.810679 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:08.810687 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:08.810736 | orchestrator | 2026-04-24 03:06:08.810746 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 03:06:08.810756 | orchestrator | Friday 24 April 2026 03:06:02 +0000 (0:00:00.546) 0:00:04.847 ********** 2026-04-24 03:06:08.810765 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:08.810774 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:08.810784 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:08.810793 | orchestrator | 2026-04-24 03:06:08.810802 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 03:06:08.810812 | orchestrator | Friday 24 April 2026 03:06:03 +0000 (0:00:00.355) 0:00:05.202 ********** 2026-04-24 03:06:08.810822 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 03:06:08.810831 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 03:06:08.810840 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 03:06:08.810849 | orchestrator | 2026-04-24 03:06:08.810858 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 03:06:08.810867 | orchestrator | Friday 24 April 2026 03:06:03 +0000 (0:00:00.671) 0:00:05.874 ********** 2026-04-24 03:06:08.810876 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:08.810885 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:08.810894 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:08.810903 | orchestrator | 2026-04-24 03:06:08.810913 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 03:06:08.810922 | orchestrator | Friday 24 April 2026 03:06:04 +0000 (0:00:00.475) 0:00:06.349 ********** 2026-04-24 03:06:08.810931 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 03:06:08.810940 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 03:06:08.810950 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 03:06:08.810959 | orchestrator | 2026-04-24 03:06:08.810968 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 03:06:08.810978 | orchestrator | Friday 24 April 2026 03:06:06 +0000 (0:00:02.284) 0:00:08.634 ********** 2026-04-24 03:06:08.810987 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 03:06:08.810997 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 03:06:08.811006 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 03:06:08.811016 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:08.811025 | orchestrator | 2026-04-24 03:06:08.811046 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 03:06:08.811055 | orchestrator | Friday 24 April 2026 03:06:07 +0000 (0:00:00.676) 0:00:09.310 ********** 2026-04-24 03:06:08.811067 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 03:06:08.811079 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 03:06:08.811092 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 03:06:08.811106 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:08.811120 | orchestrator | 2026-04-24 03:06:08.811135 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 03:06:08.811149 | orchestrator | Friday 24 April 2026 03:06:08 +0000 (0:00:01.166) 0:00:10.476 ********** 2026-04-24 03:06:08.811176 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:08.811188 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:08.811196 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:08.811204 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:08.811212 | orchestrator | 2026-04-24 03:06:08.811220 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 03:06:08.811228 | orchestrator | Friday 24 April 2026 03:06:08 +0000 (0:00:00.177) 0:00:10.654 ********** 2026-04-24 03:06:08.811238 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'a3168a73d7f5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 03:06:05.211162', 'end': '2026-04-24 03:06:05.259680', 'delta': '0:00:00.048518', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['a3168a73d7f5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 03:06:08.811248 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'cb6ff5b25438', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 03:06:05.772307', 'end': '2026-04-24 03:06:05.826389', 'delta': '0:00:00.054082', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['cb6ff5b25438'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 03:06:08.811263 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '4af70b8ccc8b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 03:06:06.347417', 'end': '2026-04-24 03:06:06.398279', 'delta': '0:00:00.050862', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['4af70b8ccc8b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 03:06:16.079987 | orchestrator | 2026-04-24 03:06:16.080072 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 03:06:16.080102 | orchestrator | Friday 24 April 2026 03:06:08 +0000 (0:00:00.195) 0:00:10.850 ********** 2026-04-24 03:06:16.080110 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:16.080117 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:16.080124 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:16.080130 | orchestrator | 2026-04-24 03:06:16.080136 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 03:06:16.080143 | orchestrator | Friday 24 April 2026 03:06:09 +0000 (0:00:00.480) 0:00:11.330 ********** 2026-04-24 03:06:16.080161 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-24 03:06:16.080168 | orchestrator | 2026-04-24 03:06:16.080174 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 03:06:16.080180 | orchestrator | Friday 24 April 2026 03:06:11 +0000 (0:00:01.802) 0:00:13.133 ********** 2026-04-24 03:06:16.080186 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080193 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080199 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080205 | orchestrator | 2026-04-24 03:06:16.080211 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 03:06:16.080217 | orchestrator | Friday 24 April 2026 03:06:11 +0000 (0:00:00.303) 0:00:13.436 ********** 2026-04-24 03:06:16.080223 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080230 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080236 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080242 | orchestrator | 2026-04-24 03:06:16.080248 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 03:06:16.080254 | orchestrator | Friday 24 April 2026 03:06:12 +0000 (0:00:00.870) 0:00:14.307 ********** 2026-04-24 03:06:16.080260 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080266 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080273 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080279 | orchestrator | 2026-04-24 03:06:16.080285 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 03:06:16.080291 | orchestrator | Friday 24 April 2026 03:06:12 +0000 (0:00:00.294) 0:00:14.601 ********** 2026-04-24 03:06:16.080297 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:16.080304 | orchestrator | 2026-04-24 03:06:16.080310 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 03:06:16.080316 | orchestrator | Friday 24 April 2026 03:06:12 +0000 (0:00:00.149) 0:00:14.751 ********** 2026-04-24 03:06:16.080322 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080328 | orchestrator | 2026-04-24 03:06:16.080334 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 03:06:16.080340 | orchestrator | Friday 24 April 2026 03:06:12 +0000 (0:00:00.232) 0:00:14.984 ********** 2026-04-24 03:06:16.080346 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080353 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080359 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080365 | orchestrator | 2026-04-24 03:06:16.080371 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 03:06:16.080377 | orchestrator | Friday 24 April 2026 03:06:13 +0000 (0:00:00.328) 0:00:15.313 ********** 2026-04-24 03:06:16.080383 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080389 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080395 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080401 | orchestrator | 2026-04-24 03:06:16.080408 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 03:06:16.080414 | orchestrator | Friday 24 April 2026 03:06:13 +0000 (0:00:00.370) 0:00:15.683 ********** 2026-04-24 03:06:16.080420 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080426 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080432 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080438 | orchestrator | 2026-04-24 03:06:16.080449 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 03:06:16.080456 | orchestrator | Friday 24 April 2026 03:06:14 +0000 (0:00:00.621) 0:00:16.305 ********** 2026-04-24 03:06:16.080462 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080468 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080475 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080481 | orchestrator | 2026-04-24 03:06:16.080487 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 03:06:16.080493 | orchestrator | Friday 24 April 2026 03:06:14 +0000 (0:00:00.366) 0:00:16.671 ********** 2026-04-24 03:06:16.080499 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080505 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080512 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080518 | orchestrator | 2026-04-24 03:06:16.080524 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 03:06:16.080530 | orchestrator | Friday 24 April 2026 03:06:14 +0000 (0:00:00.353) 0:00:17.025 ********** 2026-04-24 03:06:16.080536 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080542 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080549 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080556 | orchestrator | 2026-04-24 03:06:16.080564 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 03:06:16.080572 | orchestrator | Friday 24 April 2026 03:06:15 +0000 (0:00:00.556) 0:00:17.582 ********** 2026-04-24 03:06:16.080579 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.080587 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.080594 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.080601 | orchestrator | 2026-04-24 03:06:16.080608 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 03:06:16.080616 | orchestrator | Friday 24 April 2026 03:06:15 +0000 (0:00:00.326) 0:00:17.908 ********** 2026-04-24 03:06:16.080638 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080653 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080662 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080672 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080716 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080723 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080731 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080739 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080796 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.080811 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.199882 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.199979 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.199991 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.200010 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.200021 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.200029 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.200042 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.200051 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-05-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.200058 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.200066 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.200072 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.200082 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.418913 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.418994 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.419028 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.419042 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.419071 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.419096 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.419114 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.419124 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-12-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.419136 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.419147 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.419156 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.419167 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.419180 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.419202 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.656935 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.657067 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.657077 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.657084 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.657091 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.657097 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-24 03:06:16.657131 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.657149 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.657158 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.657166 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.657175 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-04-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-24 03:06:16.657184 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:16.657193 | orchestrator | 2026-04-24 03:06:16.657201 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 03:06:16.657209 | orchestrator | Friday 24 April 2026 03:06:16 +0000 (0:00:00.674) 0:00:18.583 ********** 2026-04-24 03:06:16.657227 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767206 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767323 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767354 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767373 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767390 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767407 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767496 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767519 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767538 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767556 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.767600 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.855818 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856028 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856049 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856063 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856134 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856150 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856162 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-05-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856174 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856187 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856198 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856231 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.856253 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972328 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972539 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:16.972569 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972623 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972654 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972664 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972672 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-12-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972686 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:16.972698 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972706 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:16.972719 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105573 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105650 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105662 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105695 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105719 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105730 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105783 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105798 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105825 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:17.105843 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:27.546862 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:27.546987 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-24-01-42-04-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-24 03:06:27.547033 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:27.547046 | orchestrator | 2026-04-24 03:06:27.547054 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 03:06:27.547063 | orchestrator | Friday 24 April 2026 03:06:17 +0000 (0:00:00.686) 0:00:19.270 ********** 2026-04-24 03:06:27.547069 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:27.547077 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:27.547083 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:27.547089 | orchestrator | 2026-04-24 03:06:27.547095 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 03:06:27.547101 | orchestrator | Friday 24 April 2026 03:06:18 +0000 (0:00:00.861) 0:00:20.131 ********** 2026-04-24 03:06:27.547107 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:27.547113 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:27.547120 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:27.547126 | orchestrator | 2026-04-24 03:06:27.547132 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 03:06:27.547138 | orchestrator | Friday 24 April 2026 03:06:18 +0000 (0:00:00.304) 0:00:20.435 ********** 2026-04-24 03:06:27.547145 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:27.547171 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:27.547179 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:27.547186 | orchestrator | 2026-04-24 03:06:27.547192 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 03:06:27.547199 | orchestrator | Friday 24 April 2026 03:06:19 +0000 (0:00:00.674) 0:00:21.110 ********** 2026-04-24 03:06:27.547205 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547212 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:27.547218 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:27.547224 | orchestrator | 2026-04-24 03:06:27.547230 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 03:06:27.547236 | orchestrator | Friday 24 April 2026 03:06:19 +0000 (0:00:00.340) 0:00:21.450 ********** 2026-04-24 03:06:27.547243 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547249 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:27.547255 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:27.547262 | orchestrator | 2026-04-24 03:06:27.547269 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 03:06:27.547275 | orchestrator | Friday 24 April 2026 03:06:20 +0000 (0:00:00.728) 0:00:22.178 ********** 2026-04-24 03:06:27.547281 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547287 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:27.547294 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:27.547300 | orchestrator | 2026-04-24 03:06:27.547306 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 03:06:27.547312 | orchestrator | Friday 24 April 2026 03:06:20 +0000 (0:00:00.334) 0:00:22.513 ********** 2026-04-24 03:06:27.547319 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-24 03:06:27.547326 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-24 03:06:27.547333 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-24 03:06:27.547339 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-24 03:06:27.547347 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-24 03:06:27.547364 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-24 03:06:27.547371 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-24 03:06:27.547378 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-24 03:06:27.547386 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-24 03:06:27.547392 | orchestrator | 2026-04-24 03:06:27.547399 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 03:06:27.547405 | orchestrator | Friday 24 April 2026 03:06:21 +0000 (0:00:01.080) 0:00:23.594 ********** 2026-04-24 03:06:27.547433 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 03:06:27.547441 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 03:06:27.547448 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 03:06:27.547454 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547460 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 03:06:27.547466 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 03:06:27.547472 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 03:06:27.547479 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:27.547485 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 03:06:27.547491 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 03:06:27.547497 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 03:06:27.547503 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:27.547509 | orchestrator | 2026-04-24 03:06:27.547516 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 03:06:27.547522 | orchestrator | Friday 24 April 2026 03:06:21 +0000 (0:00:00.380) 0:00:23.975 ********** 2026-04-24 03:06:27.547530 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:06:27.547537 | orchestrator | 2026-04-24 03:06:27.547544 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 03:06:27.547553 | orchestrator | Friday 24 April 2026 03:06:22 +0000 (0:00:00.787) 0:00:24.763 ********** 2026-04-24 03:06:27.547559 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547566 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:27.547573 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:27.547579 | orchestrator | 2026-04-24 03:06:27.547586 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 03:06:27.547592 | orchestrator | Friday 24 April 2026 03:06:23 +0000 (0:00:00.339) 0:00:25.102 ********** 2026-04-24 03:06:27.547599 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547605 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:27.547610 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:27.547616 | orchestrator | 2026-04-24 03:06:27.547622 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 03:06:27.547629 | orchestrator | Friday 24 April 2026 03:06:23 +0000 (0:00:00.349) 0:00:25.451 ********** 2026-04-24 03:06:27.547634 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547639 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:06:27.547645 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:06:27.547650 | orchestrator | 2026-04-24 03:06:27.547656 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 03:06:27.547662 | orchestrator | Friday 24 April 2026 03:06:23 +0000 (0:00:00.573) 0:00:26.025 ********** 2026-04-24 03:06:27.547668 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:27.547674 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:27.547680 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:27.547686 | orchestrator | 2026-04-24 03:06:27.547692 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 03:06:27.547699 | orchestrator | Friday 24 April 2026 03:06:24 +0000 (0:00:00.443) 0:00:26.468 ********** 2026-04-24 03:06:27.547715 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 03:06:27.547728 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 03:06:27.547734 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 03:06:27.547741 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547747 | orchestrator | 2026-04-24 03:06:27.547753 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 03:06:27.547759 | orchestrator | Friday 24 April 2026 03:06:24 +0000 (0:00:00.397) 0:00:26.865 ********** 2026-04-24 03:06:27.547765 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 03:06:27.547772 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 03:06:27.547778 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 03:06:27.547805 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547811 | orchestrator | 2026-04-24 03:06:27.547817 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 03:06:27.547823 | orchestrator | Friday 24 April 2026 03:06:25 +0000 (0:00:00.381) 0:00:27.247 ********** 2026-04-24 03:06:27.547829 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 03:06:27.547837 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 03:06:27.547841 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 03:06:27.547845 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:06:27.547848 | orchestrator | 2026-04-24 03:06:27.547852 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 03:06:27.547856 | orchestrator | Friday 24 April 2026 03:06:25 +0000 (0:00:00.387) 0:00:27.635 ********** 2026-04-24 03:06:27.547860 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:06:27.547864 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:06:27.547867 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:06:27.547871 | orchestrator | 2026-04-24 03:06:27.547875 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 03:06:27.547879 | orchestrator | Friday 24 April 2026 03:06:25 +0000 (0:00:00.325) 0:00:27.960 ********** 2026-04-24 03:06:27.547882 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 03:06:27.547886 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 03:06:27.547890 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 03:06:27.547894 | orchestrator | 2026-04-24 03:06:27.547897 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 03:06:27.547901 | orchestrator | Friday 24 April 2026 03:06:26 +0000 (0:00:00.791) 0:00:28.752 ********** 2026-04-24 03:06:27.547905 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 03:06:27.547920 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 03:08:08.938168 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 03:08:08.938312 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 03:08:08.938330 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 03:08:08.938340 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 03:08:08.938350 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 03:08:08.938359 | orchestrator | 2026-04-24 03:08:08.938369 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 03:08:08.938379 | orchestrator | Friday 24 April 2026 03:06:27 +0000 (0:00:00.833) 0:00:29.586 ********** 2026-04-24 03:08:08.938388 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 03:08:08.938396 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 03:08:08.938405 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 03:08:08.938440 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 03:08:08.938450 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 03:08:08.938458 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 03:08:08.938467 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 03:08:08.938475 | orchestrator | 2026-04-24 03:08:08.938485 | orchestrator | TASK [Include tasks from the ceph-osd role] ************************************ 2026-04-24 03:08:08.938493 | orchestrator | Friday 24 April 2026 03:06:29 +0000 (0:00:01.708) 0:00:31.294 ********** 2026-04-24 03:08:08.938502 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:08:08.938512 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:08:08.938521 | orchestrator | included: /ansible/tasks/openstack_config.yml for testbed-node-5 2026-04-24 03:08:08.938529 | orchestrator | 2026-04-24 03:08:08.938538 | orchestrator | TASK [create openstack pool(s)] ************************************************ 2026-04-24 03:08:08.938547 | orchestrator | Friday 24 April 2026 03:06:29 +0000 (0:00:00.393) 0:00:31.688 ********** 2026-04-24 03:08:08.938558 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'backups', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-24 03:08:08.938569 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'volumes', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-24 03:08:08.938595 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'images', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-24 03:08:08.938606 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'metrics', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-24 03:08:08.938617 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'vms', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-24 03:08:08.938628 | orchestrator | 2026-04-24 03:08:08.938638 | orchestrator | TASK [generate keys] *********************************************************** 2026-04-24 03:08:08.938649 | orchestrator | Friday 24 April 2026 03:07:14 +0000 (0:00:44.988) 0:01:16.676 ********** 2026-04-24 03:08:08.938659 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938669 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938680 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938690 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938722 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938732 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938741 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] }}] 2026-04-24 03:08:08.938750 | orchestrator | 2026-04-24 03:08:08.938759 | orchestrator | TASK [get keys from monitors] ************************************************** 2026-04-24 03:08:08.938768 | orchestrator | Friday 24 April 2026 03:07:39 +0000 (0:00:24.519) 0:01:41.196 ********** 2026-04-24 03:08:08.938803 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938813 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938822 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938831 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938839 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938848 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938857 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 03:08:08.938866 | orchestrator | 2026-04-24 03:08:08.938874 | orchestrator | TASK [copy ceph key(s) if needed] ********************************************** 2026-04-24 03:08:08.938896 | orchestrator | Friday 24 April 2026 03:07:51 +0000 (0:00:12.108) 0:01:53.304 ********** 2026-04-24 03:08:08.938917 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.938939 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 03:08:08.939040 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 03:08:08.939050 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.939059 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 03:08:08.939088 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 03:08:08.939164 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.939175 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 03:08:08.939184 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 03:08:08.939212 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.939240 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 03:08:08.939249 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 03:08:08.939293 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.939366 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 03:08:08.939398 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 03:08:08.939413 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 03:08:08.939427 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 03:08:08.939456 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 03:08:08.939486 | orchestrator | changed: [testbed-node-5 -> {{ item.1 }}] 2026-04-24 03:08:08.939496 | orchestrator | 2026-04-24 03:08:08.939525 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:08:08.939536 | orchestrator | testbed-node-3 : ok=25  changed=0 unreachable=0 failed=0 skipped=28  rescued=0 ignored=0 2026-04-24 03:08:08.939566 | orchestrator | testbed-node-4 : ok=18  changed=0 unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-24 03:08:08.939577 | orchestrator | testbed-node-5 : ok=23  changed=3  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-24 03:08:08.939597 | orchestrator | 2026-04-24 03:08:08.939627 | orchestrator | 2026-04-24 03:08:08.939641 | orchestrator | 2026-04-24 03:08:08.939656 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:08:08.939679 | orchestrator | Friday 24 April 2026 03:08:08 +0000 (0:00:17.649) 0:02:10.954 ********** 2026-04-24 03:08:08.939693 | orchestrator | =============================================================================== 2026-04-24 03:08:08.939708 | orchestrator | create openstack pool(s) ----------------------------------------------- 44.99s 2026-04-24 03:08:08.939723 | orchestrator | generate keys ---------------------------------------------------------- 24.52s 2026-04-24 03:08:08.939738 | orchestrator | copy ceph key(s) if needed --------------------------------------------- 17.65s 2026-04-24 03:08:08.939753 | orchestrator | get keys from monitors ------------------------------------------------- 12.11s 2026-04-24 03:08:08.939768 | orchestrator | ceph-facts : Find a running mon container ------------------------------- 2.28s 2026-04-24 03:08:08.939783 | orchestrator | ceph-facts : Get current fsid if cluster is already running ------------- 1.80s 2026-04-24 03:08:08.939795 | orchestrator | ceph-facts : Set_fact ceph_admin_command -------------------------------- 1.71s 2026-04-24 03:08:08.939804 | orchestrator | ceph-facts : Check if the ceph mon socket is in-use --------------------- 1.17s 2026-04-24 03:08:08.939813 | orchestrator | ceph-facts : Set_fact _monitor_addresses - ipv4 ------------------------- 1.08s 2026-04-24 03:08:08.939822 | orchestrator | ceph-facts : Get current fsid ------------------------------------------- 0.87s 2026-04-24 03:08:08.939830 | orchestrator | ceph-facts : Check if podman binary is present -------------------------- 0.87s 2026-04-24 03:08:08.939839 | orchestrator | ceph-facts : Check if the ceph conf exists ------------------------------ 0.86s 2026-04-24 03:08:08.939848 | orchestrator | ceph-facts : Set_fact ceph_run_cmd -------------------------------------- 0.83s 2026-04-24 03:08:08.939867 | orchestrator | ceph-facts : Set_fact rgw_instances ------------------------------------- 0.79s 2026-04-24 03:08:09.312802 | orchestrator | ceph-facts : Import_tasks set_radosgw_address.yml ----------------------- 0.79s 2026-04-24 03:08:09.312865 | orchestrator | ceph-facts : Include facts.yml ------------------------------------------ 0.76s 2026-04-24 03:08:09.312872 | orchestrator | ceph-facts : Read osd pool default crush rule --------------------------- 0.73s 2026-04-24 03:08:09.312878 | orchestrator | ceph-facts : Set_fact devices generate device list when osd_auto_discovery --- 0.69s 2026-04-24 03:08:09.312883 | orchestrator | ceph-facts : Check for a ceph mon socket -------------------------------- 0.68s 2026-04-24 03:08:09.312888 | orchestrator | ceph-facts : Read osd pool default crush rule --------------------------- 0.67s 2026-04-24 03:08:11.722057 | orchestrator | 2026-04-24 03:08:11 | INFO  | Task ad66b576-4ce0-4eb9-9a1e-f0f2d1bc667e (copy-ceph-keys) was prepared for execution. 2026-04-24 03:08:11.722164 | orchestrator | 2026-04-24 03:08:11 | INFO  | It takes a moment until task ad66b576-4ce0-4eb9-9a1e-f0f2d1bc667e (copy-ceph-keys) has been started and output is visible here. 2026-04-24 03:08:50.045047 | orchestrator | 2026-04-24 03:08:50.045164 | orchestrator | PLAY [Copy ceph keys to the configuration repository] ************************** 2026-04-24 03:08:50.045188 | orchestrator | 2026-04-24 03:08:50.045271 | orchestrator | TASK [Check if ceph keys exist] ************************************************ 2026-04-24 03:08:50.045294 | orchestrator | Friday 24 April 2026 03:08:15 +0000 (0:00:00.162) 0:00:00.162 ********** 2026-04-24 03:08:50.045313 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.admin.keyring) 2026-04-24 03:08:50.045333 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045350 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045367 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder-backup.keyring) 2026-04-24 03:08:50.045384 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045403 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.nova.keyring) 2026-04-24 03:08:50.045420 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.glance.keyring) 2026-04-24 03:08:50.045472 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.gnocchi.keyring) 2026-04-24 03:08:50.045493 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.manila.keyring) 2026-04-24 03:08:50.045512 | orchestrator | 2026-04-24 03:08:50.045533 | orchestrator | TASK [Fetch all ceph keys] ***************************************************** 2026-04-24 03:08:50.045552 | orchestrator | Friday 24 April 2026 03:08:20 +0000 (0:00:04.736) 0:00:04.898 ********** 2026-04-24 03:08:50.045591 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.admin.keyring) 2026-04-24 03:08:50.045610 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045624 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045635 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder-backup.keyring) 2026-04-24 03:08:50.045646 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045656 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.nova.keyring) 2026-04-24 03:08:50.045667 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.glance.keyring) 2026-04-24 03:08:50.045677 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.gnocchi.keyring) 2026-04-24 03:08:50.045688 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.manila.keyring) 2026-04-24 03:08:50.045699 | orchestrator | 2026-04-24 03:08:50.045709 | orchestrator | TASK [Create share directory] ************************************************** 2026-04-24 03:08:50.045720 | orchestrator | Friday 24 April 2026 03:08:24 +0000 (0:00:04.202) 0:00:09.101 ********** 2026-04-24 03:08:50.045732 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-24 03:08:50.045743 | orchestrator | 2026-04-24 03:08:50.045754 | orchestrator | TASK [Write ceph keys to the share directory] ********************************** 2026-04-24 03:08:50.045764 | orchestrator | Friday 24 April 2026 03:08:25 +0000 (0:00:00.972) 0:00:10.074 ********** 2026-04-24 03:08:50.045775 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.admin.keyring) 2026-04-24 03:08:50.045787 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045798 | orchestrator | ok: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045808 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.cinder-backup.keyring) 2026-04-24 03:08:50.045819 | orchestrator | ok: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.045830 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.nova.keyring) 2026-04-24 03:08:50.045840 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.glance.keyring) 2026-04-24 03:08:50.045850 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.gnocchi.keyring) 2026-04-24 03:08:50.045861 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.manila.keyring) 2026-04-24 03:08:50.045871 | orchestrator | 2026-04-24 03:08:50.045882 | orchestrator | TASK [Check if target directories exist] *************************************** 2026-04-24 03:08:50.045892 | orchestrator | Friday 24 April 2026 03:08:39 +0000 (0:00:13.608) 0:00:23.683 ********** 2026-04-24 03:08:50.045903 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/infrastructure/files/ceph) 2026-04-24 03:08:50.045914 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-volume) 2026-04-24 03:08:50.045925 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-backup) 2026-04-24 03:08:50.045935 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-backup) 2026-04-24 03:08:50.045977 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/nova) 2026-04-24 03:08:50.045990 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/nova) 2026-04-24 03:08:50.046001 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/glance) 2026-04-24 03:08:50.046011 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/gnocchi) 2026-04-24 03:08:50.046091 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/manila) 2026-04-24 03:08:50.046102 | orchestrator | 2026-04-24 03:08:50.046113 | orchestrator | TASK [Write ceph keys to the configuration directory] ************************** 2026-04-24 03:08:50.046124 | orchestrator | Friday 24 April 2026 03:08:42 +0000 (0:00:03.188) 0:00:26.871 ********** 2026-04-24 03:08:50.046136 | orchestrator | changed: [testbed-manager] => (item=ceph.client.admin.keyring) 2026-04-24 03:08:50.046147 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.046157 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.046168 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder-backup.keyring) 2026-04-24 03:08:50.046179 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-24 03:08:50.046189 | orchestrator | changed: [testbed-manager] => (item=ceph.client.nova.keyring) 2026-04-24 03:08:50.046234 | orchestrator | changed: [testbed-manager] => (item=ceph.client.glance.keyring) 2026-04-24 03:08:50.046246 | orchestrator | changed: [testbed-manager] => (item=ceph.client.gnocchi.keyring) 2026-04-24 03:08:50.046256 | orchestrator | changed: [testbed-manager] => (item=ceph.client.manila.keyring) 2026-04-24 03:08:50.046268 | orchestrator | 2026-04-24 03:08:50.046285 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:08:50.046296 | orchestrator | testbed-manager : ok=6  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:08:50.046308 | orchestrator | 2026-04-24 03:08:50.046319 | orchestrator | 2026-04-24 03:08:50.046330 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:08:50.046340 | orchestrator | Friday 24 April 2026 03:08:49 +0000 (0:00:07.050) 0:00:33.921 ********** 2026-04-24 03:08:50.046351 | orchestrator | =============================================================================== 2026-04-24 03:08:50.046362 | orchestrator | Write ceph keys to the share directory --------------------------------- 13.61s 2026-04-24 03:08:50.046373 | orchestrator | Write ceph keys to the configuration directory -------------------------- 7.05s 2026-04-24 03:08:50.046383 | orchestrator | Check if ceph keys exist ------------------------------------------------ 4.74s 2026-04-24 03:08:50.046394 | orchestrator | Fetch all ceph keys ----------------------------------------------------- 4.20s 2026-04-24 03:08:50.046405 | orchestrator | Check if target directories exist --------------------------------------- 3.19s 2026-04-24 03:08:50.046415 | orchestrator | Create share directory -------------------------------------------------- 0.97s 2026-04-24 03:09:02.412903 | orchestrator | 2026-04-24 03:09:02 | INFO  | Task 21036c1c-420b-4a8f-9c2c-ba6657bc712c (cephclient) was prepared for execution. 2026-04-24 03:09:02.413014 | orchestrator | 2026-04-24 03:09:02 | INFO  | It takes a moment until task 21036c1c-420b-4a8f-9c2c-ba6657bc712c (cephclient) has been started and output is visible here. 2026-04-24 03:10:05.655123 | orchestrator | 2026-04-24 03:10:05.655238 | orchestrator | PLAY [Apply role cephclient] *************************************************** 2026-04-24 03:10:05.655256 | orchestrator | 2026-04-24 03:10:05.655269 | orchestrator | TASK [osism.services.cephclient : Include container tasks] ********************* 2026-04-24 03:10:05.655281 | orchestrator | Friday 24 April 2026 03:09:06 +0000 (0:00:00.252) 0:00:00.252 ********** 2026-04-24 03:10:05.655292 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/cephclient/tasks/container.yml for testbed-manager 2026-04-24 03:10:05.655329 | orchestrator | 2026-04-24 03:10:05.655341 | orchestrator | TASK [osism.services.cephclient : Create required directories] ***************** 2026-04-24 03:10:05.655352 | orchestrator | Friday 24 April 2026 03:09:07 +0000 (0:00:00.268) 0:00:00.521 ********** 2026-04-24 03:10:05.655364 | orchestrator | changed: [testbed-manager] => (item=/opt/cephclient/configuration) 2026-04-24 03:10:05.655422 | orchestrator | changed: [testbed-manager] => (item=/opt/cephclient/data) 2026-04-24 03:10:05.655436 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient) 2026-04-24 03:10:05.655448 | orchestrator | 2026-04-24 03:10:05.655459 | orchestrator | TASK [osism.services.cephclient : Copy configuration files] ******************** 2026-04-24 03:10:05.655470 | orchestrator | Friday 24 April 2026 03:09:08 +0000 (0:00:01.271) 0:00:01.792 ********** 2026-04-24 03:10:05.655481 | orchestrator | changed: [testbed-manager] => (item={'src': 'ceph.conf.j2', 'dest': '/opt/cephclient/configuration/ceph.conf'}) 2026-04-24 03:10:05.655492 | orchestrator | 2026-04-24 03:10:05.655503 | orchestrator | TASK [osism.services.cephclient : Copy keyring file] *************************** 2026-04-24 03:10:05.655513 | orchestrator | Friday 24 April 2026 03:09:09 +0000 (0:00:01.536) 0:00:03.328 ********** 2026-04-24 03:10:05.655524 | orchestrator | changed: [testbed-manager] 2026-04-24 03:10:05.655535 | orchestrator | 2026-04-24 03:10:05.655545 | orchestrator | TASK [osism.services.cephclient : Copy docker-compose.yml file] **************** 2026-04-24 03:10:05.655556 | orchestrator | Friday 24 April 2026 03:09:10 +0000 (0:00:00.945) 0:00:04.274 ********** 2026-04-24 03:10:05.655567 | orchestrator | changed: [testbed-manager] 2026-04-24 03:10:05.655577 | orchestrator | 2026-04-24 03:10:05.655588 | orchestrator | TASK [osism.services.cephclient : Manage cephclient service] ******************* 2026-04-24 03:10:05.655598 | orchestrator | Friday 24 April 2026 03:09:11 +0000 (0:00:00.929) 0:00:05.203 ********** 2026-04-24 03:10:05.655609 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage cephclient service (10 retries left). 2026-04-24 03:10:05.655620 | orchestrator | ok: [testbed-manager] 2026-04-24 03:10:05.655631 | orchestrator | 2026-04-24 03:10:05.655644 | orchestrator | TASK [osism.services.cephclient : Copy wrapper scripts] ************************ 2026-04-24 03:10:05.655656 | orchestrator | Friday 24 April 2026 03:09:55 +0000 (0:00:43.506) 0:00:48.709 ********** 2026-04-24 03:10:05.655669 | orchestrator | changed: [testbed-manager] => (item=ceph) 2026-04-24 03:10:05.655682 | orchestrator | changed: [testbed-manager] => (item=ceph-authtool) 2026-04-24 03:10:05.655694 | orchestrator | changed: [testbed-manager] => (item=rados) 2026-04-24 03:10:05.655707 | orchestrator | changed: [testbed-manager] => (item=radosgw-admin) 2026-04-24 03:10:05.655720 | orchestrator | changed: [testbed-manager] => (item=rbd) 2026-04-24 03:10:05.655732 | orchestrator | 2026-04-24 03:10:05.655744 | orchestrator | TASK [osism.services.cephclient : Remove old wrapper scripts] ****************** 2026-04-24 03:10:05.655757 | orchestrator | Friday 24 April 2026 03:09:59 +0000 (0:00:04.238) 0:00:52.948 ********** 2026-04-24 03:10:05.655769 | orchestrator | ok: [testbed-manager] => (item=crushtool) 2026-04-24 03:10:05.655782 | orchestrator | 2026-04-24 03:10:05.655794 | orchestrator | TASK [osism.services.cephclient : Include package tasks] *********************** 2026-04-24 03:10:05.655806 | orchestrator | Friday 24 April 2026 03:10:00 +0000 (0:00:00.504) 0:00:53.452 ********** 2026-04-24 03:10:05.655819 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:10:05.655831 | orchestrator | 2026-04-24 03:10:05.655843 | orchestrator | TASK [osism.services.cephclient : Include rook task] *************************** 2026-04-24 03:10:05.655855 | orchestrator | Friday 24 April 2026 03:10:00 +0000 (0:00:00.145) 0:00:53.597 ********** 2026-04-24 03:10:05.655868 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:10:05.655880 | orchestrator | 2026-04-24 03:10:05.655907 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Restart cephclient service] ******* 2026-04-24 03:10:05.655921 | orchestrator | Friday 24 April 2026 03:10:00 +0000 (0:00:00.541) 0:00:54.139 ********** 2026-04-24 03:10:05.655933 | orchestrator | changed: [testbed-manager] 2026-04-24 03:10:05.655962 | orchestrator | 2026-04-24 03:10:05.655975 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Ensure that all containers are up] *** 2026-04-24 03:10:05.655987 | orchestrator | Friday 24 April 2026 03:10:02 +0000 (0:00:01.679) 0:00:55.818 ********** 2026-04-24 03:10:05.656000 | orchestrator | changed: [testbed-manager] 2026-04-24 03:10:05.656011 | orchestrator | 2026-04-24 03:10:05.656029 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Wait for an healthy service] ****** 2026-04-24 03:10:05.656049 | orchestrator | Friday 24 April 2026 03:10:03 +0000 (0:00:00.720) 0:00:56.539 ********** 2026-04-24 03:10:05.656067 | orchestrator | changed: [testbed-manager] 2026-04-24 03:10:05.656086 | orchestrator | 2026-04-24 03:10:05.656104 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Copy bash completion scripts] ***** 2026-04-24 03:10:05.656123 | orchestrator | Friday 24 April 2026 03:10:03 +0000 (0:00:00.630) 0:00:57.170 ********** 2026-04-24 03:10:05.656143 | orchestrator | ok: [testbed-manager] => (item=ceph) 2026-04-24 03:10:05.656162 | orchestrator | ok: [testbed-manager] => (item=rados) 2026-04-24 03:10:05.656184 | orchestrator | ok: [testbed-manager] => (item=radosgw-admin) 2026-04-24 03:10:05.656205 | orchestrator | ok: [testbed-manager] => (item=rbd) 2026-04-24 03:10:05.656226 | orchestrator | 2026-04-24 03:10:05.656239 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:10:05.656250 | orchestrator | testbed-manager : ok=12  changed=8  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 03:10:05.656262 | orchestrator | 2026-04-24 03:10:05.656273 | orchestrator | 2026-04-24 03:10:05.656303 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:10:05.656315 | orchestrator | Friday 24 April 2026 03:10:05 +0000 (0:00:01.542) 0:00:58.713 ********** 2026-04-24 03:10:05.656325 | orchestrator | =============================================================================== 2026-04-24 03:10:05.656336 | orchestrator | osism.services.cephclient : Manage cephclient service ------------------ 43.51s 2026-04-24 03:10:05.656346 | orchestrator | osism.services.cephclient : Copy wrapper scripts ------------------------ 4.24s 2026-04-24 03:10:05.656357 | orchestrator | osism.services.cephclient : Restart cephclient service ------------------ 1.68s 2026-04-24 03:10:05.656368 | orchestrator | osism.services.cephclient : Copy bash completion scripts ---------------- 1.54s 2026-04-24 03:10:05.656407 | orchestrator | osism.services.cephclient : Copy configuration files -------------------- 1.54s 2026-04-24 03:10:05.656419 | orchestrator | osism.services.cephclient : Create required directories ----------------- 1.27s 2026-04-24 03:10:05.656430 | orchestrator | osism.services.cephclient : Copy keyring file --------------------------- 0.95s 2026-04-24 03:10:05.656440 | orchestrator | osism.services.cephclient : Copy docker-compose.yml file ---------------- 0.93s 2026-04-24 03:10:05.656451 | orchestrator | osism.services.cephclient : Ensure that all containers are up ----------- 0.72s 2026-04-24 03:10:05.656462 | orchestrator | osism.services.cephclient : Wait for an healthy service ----------------- 0.63s 2026-04-24 03:10:05.656472 | orchestrator | osism.services.cephclient : Include rook task --------------------------- 0.54s 2026-04-24 03:10:05.656483 | orchestrator | osism.services.cephclient : Remove old wrapper scripts ------------------ 0.50s 2026-04-24 03:10:05.656493 | orchestrator | osism.services.cephclient : Include container tasks --------------------- 0.27s 2026-04-24 03:10:05.656504 | orchestrator | osism.services.cephclient : Include package tasks ----------------------- 0.15s 2026-04-24 03:10:08.030830 | orchestrator | 2026-04-24 03:10:08 | INFO  | Task f49732b8-f07b-4063-83d0-9882f862cce3 (ceph-bootstrap-dashboard) was prepared for execution. 2026-04-24 03:10:08.030932 | orchestrator | 2026-04-24 03:10:08 | INFO  | It takes a moment until task f49732b8-f07b-4063-83d0-9882f862cce3 (ceph-bootstrap-dashboard) has been started and output is visible here. 2026-04-24 03:11:32.354932 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-24 03:11:32.355063 | orchestrator | 2.16.14 2026-04-24 03:11:32.355082 | orchestrator | 2026-04-24 03:11:32.355095 | orchestrator | PLAY [Bootstraph ceph dashboard] *********************************************** 2026-04-24 03:11:32.355131 | orchestrator | 2026-04-24 03:11:32.355143 | orchestrator | TASK [Disable the ceph dashboard] ********************************************** 2026-04-24 03:11:32.355155 | orchestrator | Friday 24 April 2026 03:10:12 +0000 (0:00:00.272) 0:00:00.272 ********** 2026-04-24 03:11:32.355166 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355178 | orchestrator | 2026-04-24 03:11:32.355189 | orchestrator | TASK [Set mgr/dashboard/ssl to false] ****************************************** 2026-04-24 03:11:32.355200 | orchestrator | Friday 24 April 2026 03:10:13 +0000 (0:00:01.420) 0:00:01.693 ********** 2026-04-24 03:11:32.355211 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355221 | orchestrator | 2026-04-24 03:11:32.355232 | orchestrator | TASK [Set mgr/dashboard/server_port to 7000] *********************************** 2026-04-24 03:11:32.355243 | orchestrator | Friday 24 April 2026 03:10:15 +0000 (0:00:01.115) 0:00:02.808 ********** 2026-04-24 03:11:32.355253 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355264 | orchestrator | 2026-04-24 03:11:32.355275 | orchestrator | TASK [Set mgr/dashboard/server_addr to 0.0.0.0] ******************************** 2026-04-24 03:11:32.355285 | orchestrator | Friday 24 April 2026 03:10:16 +0000 (0:00:01.077) 0:00:03.885 ********** 2026-04-24 03:11:32.355296 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355307 | orchestrator | 2026-04-24 03:11:32.355317 | orchestrator | TASK [Set mgr/dashboard/standby_behaviour to error] **************************** 2026-04-24 03:11:32.355328 | orchestrator | Friday 24 April 2026 03:10:17 +0000 (0:00:01.197) 0:00:05.083 ********** 2026-04-24 03:11:32.355338 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355349 | orchestrator | 2026-04-24 03:11:32.355375 | orchestrator | TASK [Set mgr/dashboard/standby_error_status_code to 404] ********************** 2026-04-24 03:11:32.355386 | orchestrator | Friday 24 April 2026 03:10:18 +0000 (0:00:01.075) 0:00:06.158 ********** 2026-04-24 03:11:32.355397 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355408 | orchestrator | 2026-04-24 03:11:32.355419 | orchestrator | TASK [Enable the ceph dashboard] *********************************************** 2026-04-24 03:11:32.355430 | orchestrator | Friday 24 April 2026 03:10:19 +0000 (0:00:01.046) 0:00:07.205 ********** 2026-04-24 03:11:32.355441 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355453 | orchestrator | 2026-04-24 03:11:32.355465 | orchestrator | TASK [Write ceph_dashboard_password to temporary file] ************************* 2026-04-24 03:11:32.355477 | orchestrator | Friday 24 April 2026 03:10:21 +0000 (0:00:02.074) 0:00:09.280 ********** 2026-04-24 03:11:32.355488 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355500 | orchestrator | 2026-04-24 03:11:32.355512 | orchestrator | TASK [Create admin user] ******************************************************* 2026-04-24 03:11:32.355524 | orchestrator | Friday 24 April 2026 03:10:22 +0000 (0:00:01.214) 0:00:10.495 ********** 2026-04-24 03:11:32.355537 | orchestrator | changed: [testbed-manager] 2026-04-24 03:11:32.355549 | orchestrator | 2026-04-24 03:11:32.355561 | orchestrator | TASK [Remove temporary file for ceph_dashboard_password] *********************** 2026-04-24 03:11:32.355618 | orchestrator | Friday 24 April 2026 03:11:07 +0000 (0:00:44.676) 0:00:55.171 ********** 2026-04-24 03:11:32.355631 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:11:32.355642 | orchestrator | 2026-04-24 03:11:32.355653 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-24 03:11:32.355664 | orchestrator | 2026-04-24 03:11:32.355674 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-24 03:11:32.355685 | orchestrator | Friday 24 April 2026 03:11:07 +0000 (0:00:00.171) 0:00:55.343 ********** 2026-04-24 03:11:32.355696 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:11:32.355707 | orchestrator | 2026-04-24 03:11:32.355718 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-24 03:11:32.355728 | orchestrator | 2026-04-24 03:11:32.355739 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-24 03:11:32.355749 | orchestrator | Friday 24 April 2026 03:11:19 +0000 (0:00:11.788) 0:01:07.131 ********** 2026-04-24 03:11:32.355770 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:11:32.355780 | orchestrator | 2026-04-24 03:11:32.355791 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-24 03:11:32.355802 | orchestrator | 2026-04-24 03:11:32.355812 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-24 03:11:32.355824 | orchestrator | Friday 24 April 2026 03:11:20 +0000 (0:00:01.278) 0:01:08.410 ********** 2026-04-24 03:11:32.355835 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:11:32.355845 | orchestrator | 2026-04-24 03:11:32.355856 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:11:32.355868 | orchestrator | testbed-manager : ok=9  changed=9  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 03:11:32.355880 | orchestrator | testbed-node-0 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:11:32.355892 | orchestrator | testbed-node-1 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:11:32.355903 | orchestrator | testbed-node-2 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:11:32.355913 | orchestrator | 2026-04-24 03:11:32.355924 | orchestrator | 2026-04-24 03:11:32.355935 | orchestrator | 2026-04-24 03:11:32.355946 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:11:32.355956 | orchestrator | Friday 24 April 2026 03:11:31 +0000 (0:00:11.328) 0:01:19.738 ********** 2026-04-24 03:11:32.355967 | orchestrator | =============================================================================== 2026-04-24 03:11:32.355978 | orchestrator | Create admin user ------------------------------------------------------ 44.68s 2026-04-24 03:11:32.356006 | orchestrator | Restart ceph manager service ------------------------------------------- 24.40s 2026-04-24 03:11:32.356018 | orchestrator | Enable the ceph dashboard ----------------------------------------------- 2.07s 2026-04-24 03:11:32.356028 | orchestrator | Disable the ceph dashboard ---------------------------------------------- 1.42s 2026-04-24 03:11:32.356039 | orchestrator | Write ceph_dashboard_password to temporary file ------------------------- 1.21s 2026-04-24 03:11:32.356050 | orchestrator | Set mgr/dashboard/server_addr to 0.0.0.0 -------------------------------- 1.20s 2026-04-24 03:11:32.356060 | orchestrator | Set mgr/dashboard/ssl to false ------------------------------------------ 1.12s 2026-04-24 03:11:32.356071 | orchestrator | Set mgr/dashboard/server_port to 7000 ----------------------------------- 1.08s 2026-04-24 03:11:32.356082 | orchestrator | Set mgr/dashboard/standby_behaviour to error ---------------------------- 1.08s 2026-04-24 03:11:32.356092 | orchestrator | Set mgr/dashboard/standby_error_status_code to 404 ---------------------- 1.05s 2026-04-24 03:11:32.356103 | orchestrator | Remove temporary file for ceph_dashboard_password ----------------------- 0.17s 2026-04-24 03:11:32.707241 | orchestrator | + sh -c /opt/configuration/scripts/deploy/300-openstack.sh 2026-04-24 03:11:34.727518 | orchestrator | 2026-04-24 03:11:34 | INFO  | Task 6e7da835-2efd-4fe7-bf8e-c84192f21d56 (keystone) was prepared for execution. 2026-04-24 03:11:34.727627 | orchestrator | 2026-04-24 03:11:34 | INFO  | It takes a moment until task 6e7da835-2efd-4fe7-bf8e-c84192f21d56 (keystone) has been started and output is visible here. 2026-04-24 03:11:41.901343 | orchestrator | 2026-04-24 03:11:41.901460 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:11:41.901477 | orchestrator | 2026-04-24 03:11:41.901518 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:11:41.901531 | orchestrator | Friday 24 April 2026 03:11:38 +0000 (0:00:00.267) 0:00:00.267 ********** 2026-04-24 03:11:41.901543 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:11:41.901554 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:11:41.901565 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:11:41.901576 | orchestrator | 2026-04-24 03:11:41.901671 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:11:41.901684 | orchestrator | Friday 24 April 2026 03:11:39 +0000 (0:00:00.318) 0:00:00.585 ********** 2026-04-24 03:11:41.901695 | orchestrator | ok: [testbed-node-0] => (item=enable_keystone_True) 2026-04-24 03:11:41.901706 | orchestrator | ok: [testbed-node-1] => (item=enable_keystone_True) 2026-04-24 03:11:41.901717 | orchestrator | ok: [testbed-node-2] => (item=enable_keystone_True) 2026-04-24 03:11:41.901727 | orchestrator | 2026-04-24 03:11:41.901738 | orchestrator | PLAY [Apply role keystone] ***************************************************** 2026-04-24 03:11:41.901749 | orchestrator | 2026-04-24 03:11:41.901760 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 03:11:41.901770 | orchestrator | Friday 24 April 2026 03:11:39 +0000 (0:00:00.429) 0:00:01.015 ********** 2026-04-24 03:11:41.901782 | orchestrator | included: /ansible/roles/keystone/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:11:41.901794 | orchestrator | 2026-04-24 03:11:41.901805 | orchestrator | TASK [keystone : Ensuring config directories exist] **************************** 2026-04-24 03:11:41.901815 | orchestrator | Friday 24 April 2026 03:11:40 +0000 (0:00:00.567) 0:00:01.583 ********** 2026-04-24 03:11:41.901832 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:41.901849 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:41.901888 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:41.901913 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:41.901928 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:41.901941 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:41.901954 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:41.901968 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:41.901982 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:41.902000 | orchestrator | 2026-04-24 03:11:41.902013 | orchestrator | TASK [keystone : Check if policies shall be overwritten] *********************** 2026-04-24 03:11:41.902079 | orchestrator | Friday 24 April 2026 03:11:41 +0000 (0:00:01.639) 0:00:03.222 ********** 2026-04-24 03:11:47.691822 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:11:47.691932 | orchestrator | 2026-04-24 03:11:47.691965 | orchestrator | TASK [keystone : Set keystone policy file] ************************************* 2026-04-24 03:11:47.691979 | orchestrator | Friday 24 April 2026 03:11:42 +0000 (0:00:00.318) 0:00:03.541 ********** 2026-04-24 03:11:47.691990 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:11:47.692001 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:11:47.692013 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:11:47.692023 | orchestrator | 2026-04-24 03:11:47.692035 | orchestrator | TASK [keystone : Check if Keystone domain-specific config is supplied] ********* 2026-04-24 03:11:47.692046 | orchestrator | Friday 24 April 2026 03:11:42 +0000 (0:00:00.314) 0:00:03.855 ********** 2026-04-24 03:11:47.692057 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:11:47.692068 | orchestrator | 2026-04-24 03:11:47.692079 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 03:11:47.692090 | orchestrator | Friday 24 April 2026 03:11:43 +0000 (0:00:00.878) 0:00:04.734 ********** 2026-04-24 03:11:47.692101 | orchestrator | included: /ansible/roles/keystone/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:11:47.692113 | orchestrator | 2026-04-24 03:11:47.692124 | orchestrator | TASK [service-cert-copy : keystone | Copying over extra CA certificates] ******* 2026-04-24 03:11:47.692135 | orchestrator | Friday 24 April 2026 03:11:43 +0000 (0:00:00.568) 0:00:05.303 ********** 2026-04-24 03:11:47.692151 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:47.692167 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:47.692181 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:47.692238 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:47.692254 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:47.692266 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:47.692278 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:47.692290 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:47.692310 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:47.692322 | orchestrator | 2026-04-24 03:11:47.692334 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS certificate] *** 2026-04-24 03:11:47.692345 | orchestrator | Friday 24 April 2026 03:11:47 +0000 (0:00:03.133) 0:00:08.437 ********** 2026-04-24 03:11:47.692365 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:11:48.519347 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:11:48.519555 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:11:48.519583 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:11:48.519687 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:11:48.519728 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:11:48.519746 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:11:48.519758 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:11:48.519791 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:11:48.519804 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:11:48.519816 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:11:48.519835 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:11:48.519846 | orchestrator | 2026-04-24 03:11:48.519859 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS key] **** 2026-04-24 03:11:48.519871 | orchestrator | Friday 24 April 2026 03:11:47 +0000 (0:00:00.579) 0:00:09.017 ********** 2026-04-24 03:11:48.519886 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:11:48.519906 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:11:48.519929 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:11:51.964944 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:11:51.965075 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:11:51.965098 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:11:51.965147 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:11:51.965162 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:11:51.965189 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:11:51.965202 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:11:51.965232 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:11:51.965244 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:11:51.965256 | orchestrator | 2026-04-24 03:11:51.965268 | orchestrator | TASK [keystone : Copying over config.json files for services] ****************** 2026-04-24 03:11:51.965280 | orchestrator | Friday 24 April 2026 03:11:48 +0000 (0:00:00.833) 0:00:09.851 ********** 2026-04-24 03:11:51.965292 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:51.965313 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:51.965332 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:51.965353 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:56.708276 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:56.708406 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:11:56.708423 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:56.708435 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:56.708462 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:11:56.708474 | orchestrator | 2026-04-24 03:11:56.708488 | orchestrator | TASK [keystone : Copying over keystone.conf] *********************************** 2026-04-24 03:11:56.708501 | orchestrator | Friday 24 April 2026 03:11:51 +0000 (0:00:03.440) 0:00:13.292 ********** 2026-04-24 03:11:56.708536 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:56.708560 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:11:56.708574 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:56.708586 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:11:56.708604 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:11:56.708693 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:12:00.360089 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:12:00.360180 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:12:00.360194 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:12:00.360206 | orchestrator | 2026-04-24 03:12:00.360219 | orchestrator | TASK [keystone : Copying keystone-startup script for keystone] ***************** 2026-04-24 03:12:00.360231 | orchestrator | Friday 24 April 2026 03:11:56 +0000 (0:00:04.740) 0:00:18.033 ********** 2026-04-24 03:12:00.360243 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:12:00.360255 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:12:00.360266 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:12:00.360277 | orchestrator | 2026-04-24 03:12:00.360288 | orchestrator | TASK [keystone : Create Keystone domain-specific config directory] ************* 2026-04-24 03:12:00.360299 | orchestrator | Friday 24 April 2026 03:11:58 +0000 (0:00:01.426) 0:00:19.459 ********** 2026-04-24 03:12:00.360309 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:12:00.360320 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:12:00.360331 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:12:00.360341 | orchestrator | 2026-04-24 03:12:00.360352 | orchestrator | TASK [keystone : Get file list in custom domains folder] *********************** 2026-04-24 03:12:00.360363 | orchestrator | Friday 24 April 2026 03:11:58 +0000 (0:00:00.802) 0:00:20.262 ********** 2026-04-24 03:12:00.360374 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:12:00.360401 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:12:00.360413 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:12:00.360423 | orchestrator | 2026-04-24 03:12:00.360434 | orchestrator | TASK [keystone : Copying Keystone Domain specific settings] ******************** 2026-04-24 03:12:00.360445 | orchestrator | Friday 24 April 2026 03:11:59 +0000 (0:00:00.524) 0:00:20.787 ********** 2026-04-24 03:12:00.360456 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:12:00.360466 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:12:00.360477 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:12:00.360488 | orchestrator | 2026-04-24 03:12:00.360499 | orchestrator | TASK [keystone : Copying over existing policy file] **************************** 2026-04-24 03:12:00.360510 | orchestrator | Friday 24 April 2026 03:11:59 +0000 (0:00:00.319) 0:00:21.106 ********** 2026-04-24 03:12:00.360565 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:12:00.360581 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:12:00.360594 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:12:00.360605 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:12:00.360618 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:12:00.360637 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:12:00.360693 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:12:00.360706 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:12:00.360726 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-24 03:12:19.245402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 03:12:19.245516 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 03:12:19.245532 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:12:19.245546 | orchestrator | 2026-04-24 03:12:19.245558 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 03:12:19.245571 | orchestrator | Friday 24 April 2026 03:12:00 +0000 (0:00:00.577) 0:00:21.683 ********** 2026-04-24 03:12:19.245582 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:12:19.245593 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:12:19.245603 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:12:19.245614 | orchestrator | 2026-04-24 03:12:19.245625 | orchestrator | TASK [keystone : Copying over wsgi-keystone.conf] ****************************** 2026-04-24 03:12:19.245636 | orchestrator | Friday 24 April 2026 03:12:00 +0000 (0:00:00.308) 0:00:21.991 ********** 2026-04-24 03:12:19.245647 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-24 03:12:19.245684 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-24 03:12:19.245740 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-24 03:12:19.245755 | orchestrator | 2026-04-24 03:12:19.245767 | orchestrator | TASK [keystone : Checking whether keystone-paste.ini file exists] ************** 2026-04-24 03:12:19.245777 | orchestrator | Friday 24 April 2026 03:12:02 +0000 (0:00:01.887) 0:00:23.879 ********** 2026-04-24 03:12:19.245788 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:12:19.245799 | orchestrator | 2026-04-24 03:12:19.245809 | orchestrator | TASK [keystone : Copying over keystone-paste.ini] ****************************** 2026-04-24 03:12:19.245820 | orchestrator | Friday 24 April 2026 03:12:03 +0000 (0:00:00.943) 0:00:24.822 ********** 2026-04-24 03:12:19.245831 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:12:19.245841 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:12:19.245852 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:12:19.245862 | orchestrator | 2026-04-24 03:12:19.245873 | orchestrator | TASK [keystone : Generate the required cron jobs for the node] ***************** 2026-04-24 03:12:19.245883 | orchestrator | Friday 24 April 2026 03:12:04 +0000 (0:00:00.529) 0:00:25.352 ********** 2026-04-24 03:12:19.245894 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:12:19.245904 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 03:12:19.245915 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 03:12:19.245926 | orchestrator | 2026-04-24 03:12:19.245936 | orchestrator | TASK [keystone : Set fact with the generated cron jobs for building the crontab later] *** 2026-04-24 03:12:19.245948 | orchestrator | Friday 24 April 2026 03:12:05 +0000 (0:00:01.081) 0:00:26.433 ********** 2026-04-24 03:12:19.245959 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:12:19.245970 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:12:19.245981 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:12:19.245992 | orchestrator | 2026-04-24 03:12:19.246003 | orchestrator | TASK [keystone : Copying files for keystone-fernet] **************************** 2026-04-24 03:12:19.246013 | orchestrator | Friday 24 April 2026 03:12:05 +0000 (0:00:00.514) 0:00:26.948 ********** 2026-04-24 03:12:19.246080 | orchestrator | changed: [testbed-node-0] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-24 03:12:19.246092 | orchestrator | changed: [testbed-node-1] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-24 03:12:19.246103 | orchestrator | changed: [testbed-node-2] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-24 03:12:19.246113 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-24 03:12:19.246124 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-24 03:12:19.246134 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-24 03:12:19.246145 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-24 03:12:19.246156 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-24 03:12:19.246184 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-24 03:12:19.246195 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-24 03:12:19.246206 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-24 03:12:19.246217 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-24 03:12:19.246227 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-24 03:12:19.246238 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-24 03:12:19.246249 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-24 03:12:19.246269 | orchestrator | changed: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 03:12:19.246280 | orchestrator | changed: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 03:12:19.246291 | orchestrator | changed: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 03:12:19.246301 | orchestrator | changed: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 03:12:19.246312 | orchestrator | changed: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 03:12:19.246323 | orchestrator | changed: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 03:12:19.246333 | orchestrator | 2026-04-24 03:12:19.246344 | orchestrator | TASK [keystone : Copying files for keystone-ssh] ******************************* 2026-04-24 03:12:19.246354 | orchestrator | Friday 24 April 2026 03:12:14 +0000 (0:00:08.796) 0:00:35.745 ********** 2026-04-24 03:12:19.246365 | orchestrator | changed: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 03:12:19.246375 | orchestrator | changed: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 03:12:19.246386 | orchestrator | changed: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 03:12:19.246397 | orchestrator | changed: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 03:12:19.246407 | orchestrator | changed: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 03:12:19.246418 | orchestrator | changed: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 03:12:19.246433 | orchestrator | 2026-04-24 03:12:19.246466 | orchestrator | TASK [keystone : Check keystone containers] ************************************ 2026-04-24 03:12:19.246493 | orchestrator | Friday 24 April 2026 03:12:17 +0000 (0:00:02.622) 0:00:38.367 ********** 2026-04-24 03:12:19.246517 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:12:19.246552 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:14:00.911501 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-24 03:14:00.911624 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:14:00.911659 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:14:00.911674 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 03:14:00.911686 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:14:00.911747 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:14:00.911787 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 03:14:00.911799 | orchestrator | 2026-04-24 03:14:00.911813 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 03:14:00.911826 | orchestrator | Friday 24 April 2026 03:12:19 +0000 (0:00:02.206) 0:00:40.574 ********** 2026-04-24 03:14:00.911837 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:14:00.911849 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:14:00.911860 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:14:00.911871 | orchestrator | 2026-04-24 03:14:00.911882 | orchestrator | TASK [keystone : Creating keystone database] *********************************** 2026-04-24 03:14:00.911893 | orchestrator | Friday 24 April 2026 03:12:19 +0000 (0:00:00.515) 0:00:41.089 ********** 2026-04-24 03:14:00.911904 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:14:00.911915 | orchestrator | 2026-04-24 03:14:00.911925 | orchestrator | TASK [keystone : Creating Keystone database user and setting permissions] ****** 2026-04-24 03:14:00.911936 | orchestrator | Friday 24 April 2026 03:12:22 +0000 (0:00:02.336) 0:00:43.426 ********** 2026-04-24 03:14:00.911947 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:14:00.911958 | orchestrator | 2026-04-24 03:14:00.911968 | orchestrator | TASK [keystone : Checking for any running keystone_fernet containers] ********** 2026-04-24 03:14:00.911979 | orchestrator | Friday 24 April 2026 03:12:24 +0000 (0:00:02.186) 0:00:45.612 ********** 2026-04-24 03:14:00.911990 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:14:00.912001 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:14:00.912012 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:14:00.912024 | orchestrator | 2026-04-24 03:14:00.912038 | orchestrator | TASK [keystone : Group nodes where keystone_fernet is running] ***************** 2026-04-24 03:14:00.912050 | orchestrator | Friday 24 April 2026 03:12:25 +0000 (0:00:00.844) 0:00:46.456 ********** 2026-04-24 03:14:00.912063 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:14:00.912111 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:14:00.912130 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:14:00.912143 | orchestrator | 2026-04-24 03:14:00.912156 | orchestrator | TASK [keystone : Fail if any hosts need bootstrapping and not all hosts targeted] *** 2026-04-24 03:14:00.912170 | orchestrator | Friday 24 April 2026 03:12:25 +0000 (0:00:00.358) 0:00:46.815 ********** 2026-04-24 03:14:00.912183 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:14:00.912195 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:14:00.912208 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:14:00.912220 | orchestrator | 2026-04-24 03:14:00.912233 | orchestrator | TASK [keystone : Running Keystone bootstrap container] ************************* 2026-04-24 03:14:00.912246 | orchestrator | Friday 24 April 2026 03:12:26 +0000 (0:00:00.559) 0:00:47.374 ********** 2026-04-24 03:14:00.912259 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:14:00.912271 | orchestrator | 2026-04-24 03:14:00.912284 | orchestrator | TASK [keystone : Running Keystone fernet bootstrap container] ****************** 2026-04-24 03:14:00.912296 | orchestrator | Friday 24 April 2026 03:12:40 +0000 (0:00:14.569) 0:01:01.943 ********** 2026-04-24 03:14:00.912308 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:14:00.912321 | orchestrator | 2026-04-24 03:14:00.912333 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-24 03:14:00.912355 | orchestrator | Friday 24 April 2026 03:12:50 +0000 (0:00:10.281) 0:01:12.225 ********** 2026-04-24 03:14:00.912369 | orchestrator | 2026-04-24 03:14:00.912381 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-24 03:14:00.912393 | orchestrator | Friday 24 April 2026 03:12:50 +0000 (0:00:00.084) 0:01:12.309 ********** 2026-04-24 03:14:00.912403 | orchestrator | 2026-04-24 03:14:00.912414 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-24 03:14:00.912425 | orchestrator | Friday 24 April 2026 03:12:51 +0000 (0:00:00.091) 0:01:12.401 ********** 2026-04-24 03:14:00.912436 | orchestrator | 2026-04-24 03:14:00.912447 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-ssh container] ******************** 2026-04-24 03:14:00.912457 | orchestrator | Friday 24 April 2026 03:12:51 +0000 (0:00:00.083) 0:01:12.485 ********** 2026-04-24 03:14:00.912468 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:14:00.912479 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:14:00.912490 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:14:00.912501 | orchestrator | 2026-04-24 03:14:00.912511 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-fernet container] ***************** 2026-04-24 03:14:00.912522 | orchestrator | Friday 24 April 2026 03:13:42 +0000 (0:00:51.794) 0:02:04.279 ********** 2026-04-24 03:14:00.912533 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:14:00.912544 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:14:00.912555 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:14:00.912565 | orchestrator | 2026-04-24 03:14:00.912576 | orchestrator | RUNNING HANDLER [keystone : Restart keystone container] ************************ 2026-04-24 03:14:00.912587 | orchestrator | Friday 24 April 2026 03:13:53 +0000 (0:00:10.349) 0:02:14.628 ********** 2026-04-24 03:14:00.912598 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:14:00.912608 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:14:00.912619 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:14:00.912630 | orchestrator | 2026-04-24 03:14:00.912641 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 03:14:00.912652 | orchestrator | Friday 24 April 2026 03:14:00 +0000 (0:00:07.054) 0:02:21.683 ********** 2026-04-24 03:14:00.912671 | orchestrator | included: /ansible/roles/keystone/tasks/distribute_fernet.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:14:51.996640 | orchestrator | 2026-04-24 03:14:51.996762 | orchestrator | TASK [keystone : Waiting for Keystone SSH port to be UP] *********************** 2026-04-24 03:14:51.996780 | orchestrator | Friday 24 April 2026 03:14:00 +0000 (0:00:00.558) 0:02:22.241 ********** 2026-04-24 03:14:51.996793 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:14:51.996805 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:14:51.996816 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:14:51.996827 | orchestrator | 2026-04-24 03:14:51.996838 | orchestrator | TASK [keystone : Run key distribution] ***************************************** 2026-04-24 03:14:51.996849 | orchestrator | Friday 24 April 2026 03:14:02 +0000 (0:00:01.197) 0:02:23.439 ********** 2026-04-24 03:14:51.996860 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:14:51.996871 | orchestrator | 2026-04-24 03:14:51.996882 | orchestrator | TASK [keystone : Creating admin project, user, role, service, and endpoint] **** 2026-04-24 03:14:51.996893 | orchestrator | Friday 24 April 2026 03:14:03 +0000 (0:00:01.829) 0:02:25.269 ********** 2026-04-24 03:14:51.996904 | orchestrator | changed: [testbed-node-0] => (item=RegionOne) 2026-04-24 03:14:51.996916 | orchestrator | 2026-04-24 03:14:51.996926 | orchestrator | TASK [service-ks-register : keystone | Creating services] ********************** 2026-04-24 03:14:51.996937 | orchestrator | Friday 24 April 2026 03:14:15 +0000 (0:00:11.888) 0:02:37.157 ********** 2026-04-24 03:14:51.996948 | orchestrator | changed: [testbed-node-0] => (item=keystone (identity)) 2026-04-24 03:14:51.996959 | orchestrator | 2026-04-24 03:14:51.996969 | orchestrator | TASK [service-ks-register : keystone | Creating endpoints] ********************* 2026-04-24 03:14:51.996980 | orchestrator | Friday 24 April 2026 03:14:40 +0000 (0:00:24.497) 0:03:01.654 ********** 2026-04-24 03:14:51.997045 | orchestrator | ok: [testbed-node-0] => (item=keystone -> https://api-int.testbed.osism.xyz:5000 -> internal) 2026-04-24 03:14:51.997059 | orchestrator | ok: [testbed-node-0] => (item=keystone -> https://api.testbed.osism.xyz:5000 -> public) 2026-04-24 03:14:51.997070 | orchestrator | 2026-04-24 03:14:51.997081 | orchestrator | TASK [service-ks-register : keystone | Creating projects] ********************** 2026-04-24 03:14:51.997092 | orchestrator | Friday 24 April 2026 03:14:46 +0000 (0:00:06.591) 0:03:08.246 ********** 2026-04-24 03:14:51.997102 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:14:51.997113 | orchestrator | 2026-04-24 03:14:51.997123 | orchestrator | TASK [service-ks-register : keystone | Creating users] ************************* 2026-04-24 03:14:51.997134 | orchestrator | Friday 24 April 2026 03:14:47 +0000 (0:00:00.121) 0:03:08.367 ********** 2026-04-24 03:14:51.997145 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:14:51.997155 | orchestrator | 2026-04-24 03:14:51.997197 | orchestrator | TASK [service-ks-register : keystone | Creating roles] ************************* 2026-04-24 03:14:51.997236 | orchestrator | Friday 24 April 2026 03:14:47 +0000 (0:00:00.159) 0:03:08.527 ********** 2026-04-24 03:14:51.997258 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:14:51.997277 | orchestrator | 2026-04-24 03:14:51.997290 | orchestrator | TASK [service-ks-register : keystone | Granting user roles] ******************** 2026-04-24 03:14:51.997302 | orchestrator | Friday 24 April 2026 03:14:47 +0000 (0:00:00.129) 0:03:08.657 ********** 2026-04-24 03:14:51.997314 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:14:51.997331 | orchestrator | 2026-04-24 03:14:51.997349 | orchestrator | TASK [keystone : Creating default user role] *********************************** 2026-04-24 03:14:51.997369 | orchestrator | Friday 24 April 2026 03:14:47 +0000 (0:00:00.537) 0:03:09.194 ********** 2026-04-24 03:14:51.997387 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:14:51.997405 | orchestrator | 2026-04-24 03:14:51.997424 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 03:14:51.997441 | orchestrator | Friday 24 April 2026 03:14:51 +0000 (0:00:03.253) 0:03:12.447 ********** 2026-04-24 03:14:51.997459 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:14:51.997477 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:14:51.997496 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:14:51.997514 | orchestrator | 2026-04-24 03:14:51.997534 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:14:51.997551 | orchestrator | testbed-node-0 : ok=33  changed=19  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 03:14:51.997572 | orchestrator | testbed-node-1 : ok=22  changed=12  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-24 03:14:51.997591 | orchestrator | testbed-node-2 : ok=22  changed=12  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-24 03:14:51.997609 | orchestrator | 2026-04-24 03:14:51.997647 | orchestrator | 2026-04-24 03:14:51.997680 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:14:51.997693 | orchestrator | Friday 24 April 2026 03:14:51 +0000 (0:00:00.450) 0:03:12.898 ********** 2026-04-24 03:14:51.997703 | orchestrator | =============================================================================== 2026-04-24 03:14:51.997714 | orchestrator | keystone : Restart keystone-ssh container ------------------------------ 51.79s 2026-04-24 03:14:51.997725 | orchestrator | service-ks-register : keystone | Creating services --------------------- 24.50s 2026-04-24 03:14:51.997735 | orchestrator | keystone : Running Keystone bootstrap container ------------------------ 14.57s 2026-04-24 03:14:51.997746 | orchestrator | keystone : Creating admin project, user, role, service, and endpoint --- 11.89s 2026-04-24 03:14:51.997757 | orchestrator | keystone : Restart keystone-fernet container --------------------------- 10.35s 2026-04-24 03:14:51.997767 | orchestrator | keystone : Running Keystone fernet bootstrap container ----------------- 10.28s 2026-04-24 03:14:51.997778 | orchestrator | keystone : Copying files for keystone-fernet ---------------------------- 8.80s 2026-04-24 03:14:51.997802 | orchestrator | keystone : Restart keystone container ----------------------------------- 7.05s 2026-04-24 03:14:51.997813 | orchestrator | service-ks-register : keystone | Creating endpoints --------------------- 6.59s 2026-04-24 03:14:51.997842 | orchestrator | keystone : Copying over keystone.conf ----------------------------------- 4.74s 2026-04-24 03:14:51.997854 | orchestrator | keystone : Copying over config.json files for services ------------------ 3.44s 2026-04-24 03:14:51.997865 | orchestrator | keystone : Creating default user role ----------------------------------- 3.25s 2026-04-24 03:14:51.997875 | orchestrator | service-cert-copy : keystone | Copying over extra CA certificates ------- 3.13s 2026-04-24 03:14:51.997886 | orchestrator | keystone : Copying files for keystone-ssh ------------------------------- 2.62s 2026-04-24 03:14:51.997897 | orchestrator | keystone : Creating keystone database ----------------------------------- 2.34s 2026-04-24 03:14:51.997907 | orchestrator | keystone : Check keystone containers ------------------------------------ 2.21s 2026-04-24 03:14:51.997918 | orchestrator | keystone : Creating Keystone database user and setting permissions ------ 2.19s 2026-04-24 03:14:51.997928 | orchestrator | keystone : Copying over wsgi-keystone.conf ------------------------------ 1.89s 2026-04-24 03:14:51.997939 | orchestrator | keystone : Run key distribution ----------------------------------------- 1.83s 2026-04-24 03:14:51.997950 | orchestrator | keystone : Ensuring config directories exist ---------------------------- 1.64s 2026-04-24 03:14:54.370857 | orchestrator | 2026-04-24 03:14:54 | INFO  | Task 19265034-7adc-404d-81c2-19e3ce05803c (placement) was prepared for execution. 2026-04-24 03:14:54.370958 | orchestrator | 2026-04-24 03:14:54 | INFO  | It takes a moment until task 19265034-7adc-404d-81c2-19e3ce05803c (placement) has been started and output is visible here. 2026-04-24 03:15:29.884056 | orchestrator | 2026-04-24 03:15:29.884169 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:15:29.884187 | orchestrator | 2026-04-24 03:15:29.884200 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:15:29.884211 | orchestrator | Friday 24 April 2026 03:14:58 +0000 (0:00:00.262) 0:00:00.262 ********** 2026-04-24 03:15:29.884223 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:15:29.884289 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:15:29.884301 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:15:29.884312 | orchestrator | 2026-04-24 03:15:29.884323 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:15:29.884335 | orchestrator | Friday 24 April 2026 03:14:58 +0000 (0:00:00.315) 0:00:00.578 ********** 2026-04-24 03:15:29.884346 | orchestrator | ok: [testbed-node-0] => (item=enable_placement_True) 2026-04-24 03:15:29.884374 | orchestrator | ok: [testbed-node-1] => (item=enable_placement_True) 2026-04-24 03:15:29.884386 | orchestrator | ok: [testbed-node-2] => (item=enable_placement_True) 2026-04-24 03:15:29.884397 | orchestrator | 2026-04-24 03:15:29.884408 | orchestrator | PLAY [Apply role placement] **************************************************** 2026-04-24 03:15:29.884418 | orchestrator | 2026-04-24 03:15:29.884429 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-24 03:15:29.884440 | orchestrator | Friday 24 April 2026 03:14:59 +0000 (0:00:00.463) 0:00:01.041 ********** 2026-04-24 03:15:29.884451 | orchestrator | included: /ansible/roles/placement/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:15:29.884464 | orchestrator | 2026-04-24 03:15:29.884475 | orchestrator | TASK [service-ks-register : placement | Creating services] ********************* 2026-04-24 03:15:29.884485 | orchestrator | Friday 24 April 2026 03:14:59 +0000 (0:00:00.558) 0:00:01.600 ********** 2026-04-24 03:15:29.884496 | orchestrator | changed: [testbed-node-0] => (item=placement (placement)) 2026-04-24 03:15:29.884507 | orchestrator | 2026-04-24 03:15:29.884518 | orchestrator | TASK [service-ks-register : placement | Creating endpoints] ******************** 2026-04-24 03:15:29.884529 | orchestrator | Friday 24 April 2026 03:15:03 +0000 (0:00:03.799) 0:00:05.399 ********** 2026-04-24 03:15:29.884562 | orchestrator | changed: [testbed-node-0] => (item=placement -> https://api-int.testbed.osism.xyz:8780 -> internal) 2026-04-24 03:15:29.884574 | orchestrator | changed: [testbed-node-0] => (item=placement -> https://api.testbed.osism.xyz:8780 -> public) 2026-04-24 03:15:29.884585 | orchestrator | 2026-04-24 03:15:29.884598 | orchestrator | TASK [service-ks-register : placement | Creating projects] ********************* 2026-04-24 03:15:29.884611 | orchestrator | Friday 24 April 2026 03:15:10 +0000 (0:00:06.477) 0:00:11.876 ********** 2026-04-24 03:15:29.884623 | orchestrator | changed: [testbed-node-0] => (item=service) 2026-04-24 03:15:29.884636 | orchestrator | 2026-04-24 03:15:29.884649 | orchestrator | TASK [service-ks-register : placement | Creating users] ************************ 2026-04-24 03:15:29.884661 | orchestrator | Friday 24 April 2026 03:15:14 +0000 (0:00:03.831) 0:00:15.708 ********** 2026-04-24 03:15:29.884673 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:15:29.884685 | orchestrator | changed: [testbed-node-0] => (item=placement -> service) 2026-04-24 03:15:29.884698 | orchestrator | 2026-04-24 03:15:29.884710 | orchestrator | TASK [service-ks-register : placement | Creating roles] ************************ 2026-04-24 03:15:29.884722 | orchestrator | Friday 24 April 2026 03:15:18 +0000 (0:00:04.072) 0:00:19.780 ********** 2026-04-24 03:15:29.884735 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:15:29.884747 | orchestrator | 2026-04-24 03:15:29.884760 | orchestrator | TASK [service-ks-register : placement | Granting user roles] ******************* 2026-04-24 03:15:29.884772 | orchestrator | Friday 24 April 2026 03:15:21 +0000 (0:00:03.265) 0:00:23.046 ********** 2026-04-24 03:15:29.884784 | orchestrator | changed: [testbed-node-0] => (item=placement -> service -> admin) 2026-04-24 03:15:29.884796 | orchestrator | 2026-04-24 03:15:29.884809 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-24 03:15:29.884821 | orchestrator | Friday 24 April 2026 03:15:25 +0000 (0:00:04.242) 0:00:27.288 ********** 2026-04-24 03:15:29.884833 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:15:29.884845 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:15:29.884857 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:15:29.884870 | orchestrator | 2026-04-24 03:15:29.884882 | orchestrator | TASK [placement : Ensuring config directories exist] *************************** 2026-04-24 03:15:29.884893 | orchestrator | Friday 24 April 2026 03:15:25 +0000 (0:00:00.286) 0:00:27.575 ********** 2026-04-24 03:15:29.884908 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:29.884948 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:29.884970 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:29.884982 | orchestrator | 2026-04-24 03:15:29.884994 | orchestrator | TASK [placement : Check if policies shall be overwritten] ********************** 2026-04-24 03:15:29.885005 | orchestrator | Friday 24 April 2026 03:15:26 +0000 (0:00:01.061) 0:00:28.637 ********** 2026-04-24 03:15:29.885017 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:15:29.885028 | orchestrator | 2026-04-24 03:15:29.885039 | orchestrator | TASK [placement : Set placement policy file] *********************************** 2026-04-24 03:15:29.885050 | orchestrator | Friday 24 April 2026 03:15:27 +0000 (0:00:00.350) 0:00:28.988 ********** 2026-04-24 03:15:29.885061 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:15:29.885072 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:15:29.885083 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:15:29.885094 | orchestrator | 2026-04-24 03:15:29.885104 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-24 03:15:29.885115 | orchestrator | Friday 24 April 2026 03:15:27 +0000 (0:00:00.323) 0:00:29.312 ********** 2026-04-24 03:15:29.885126 | orchestrator | included: /ansible/roles/placement/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:15:29.885137 | orchestrator | 2026-04-24 03:15:29.885148 | orchestrator | TASK [service-cert-copy : placement | Copying over extra CA certificates] ****** 2026-04-24 03:15:29.885159 | orchestrator | Friday 24 April 2026 03:15:28 +0000 (0:00:00.550) 0:00:29.862 ********** 2026-04-24 03:15:29.885170 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:29.885190 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:32.687143 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:32.687350 | orchestrator | 2026-04-24 03:15:32.687383 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS certificate] *** 2026-04-24 03:15:32.687405 | orchestrator | Friday 24 April 2026 03:15:29 +0000 (0:00:01.677) 0:00:31.540 ********** 2026-04-24 03:15:32.687426 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:32.687446 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:15:32.687466 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:32.687486 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:15:32.687505 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:32.687561 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:15:32.687580 | orchestrator | 2026-04-24 03:15:32.687599 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS key] *** 2026-04-24 03:15:32.687643 | orchestrator | Friday 24 April 2026 03:15:30 +0000 (0:00:00.500) 0:00:32.040 ********** 2026-04-24 03:15:32.687678 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:32.687700 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:15:32.687718 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:32.687738 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:15:32.687758 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:32.687778 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:15:32.687797 | orchestrator | 2026-04-24 03:15:32.687812 | orchestrator | TASK [placement : Copying over config.json files for services] ***************** 2026-04-24 03:15:32.687823 | orchestrator | Friday 24 April 2026 03:15:31 +0000 (0:00:00.723) 0:00:32.763 ********** 2026-04-24 03:15:32.687834 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:32.687876 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:39.660340 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:39.660489 | orchestrator | 2026-04-24 03:15:39.660521 | orchestrator | TASK [placement : Copying over placement.conf] ********************************* 2026-04-24 03:15:39.660541 | orchestrator | Friday 24 April 2026 03:15:32 +0000 (0:00:01.580) 0:00:34.344 ********** 2026-04-24 03:15:39.660561 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:39.660581 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:39.660650 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:15:39.660673 | orchestrator | 2026-04-24 03:15:39.660692 | orchestrator | TASK [placement : Copying over placement-api wsgi configuration] *************** 2026-04-24 03:15:39.660710 | orchestrator | Friday 24 April 2026 03:15:34 +0000 (0:00:02.282) 0:00:36.626 ********** 2026-04-24 03:15:39.660752 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-24 03:15:39.660775 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-24 03:15:39.660793 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-24 03:15:39.660812 | orchestrator | 2026-04-24 03:15:39.660825 | orchestrator | TASK [placement : Copying over migrate-db.rc.j2 configuration] ***************** 2026-04-24 03:15:39.660838 | orchestrator | Friday 24 April 2026 03:15:36 +0000 (0:00:01.476) 0:00:38.102 ********** 2026-04-24 03:15:39.660850 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:15:39.660864 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:15:39.660876 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:15:39.660888 | orchestrator | 2026-04-24 03:15:39.660901 | orchestrator | TASK [placement : Copying over existing policy file] *************************** 2026-04-24 03:15:39.660914 | orchestrator | Friday 24 April 2026 03:15:37 +0000 (0:00:01.378) 0:00:39.481 ********** 2026-04-24 03:15:39.660926 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:39.660950 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:15:39.660964 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:39.660977 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:15:39.660990 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-24 03:15:39.661002 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:15:39.661014 | orchestrator | 2026-04-24 03:15:39.661033 | orchestrator | TASK [placement : Check placement containers] ********************************** 2026-04-24 03:15:39.661044 | orchestrator | Friday 24 April 2026 03:15:38 +0000 (0:00:00.759) 0:00:40.241 ********** 2026-04-24 03:15:39.661064 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:16:09.227657 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:16:09.227770 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-24 03:16:09.227781 | orchestrator | 2026-04-24 03:16:09.227789 | orchestrator | TASK [placement : Creating placement databases] ******************************** 2026-04-24 03:16:09.227798 | orchestrator | Friday 24 April 2026 03:15:39 +0000 (0:00:01.080) 0:00:41.321 ********** 2026-04-24 03:16:09.227805 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:16:09.227812 | orchestrator | 2026-04-24 03:16:09.227819 | orchestrator | TASK [placement : Creating placement databases user and setting permissions] *** 2026-04-24 03:16:09.227826 | orchestrator | Friday 24 April 2026 03:15:41 +0000 (0:00:02.298) 0:00:43.620 ********** 2026-04-24 03:16:09.227833 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:16:09.227840 | orchestrator | 2026-04-24 03:16:09.227846 | orchestrator | TASK [placement : Running placement bootstrap container] *********************** 2026-04-24 03:16:09.227853 | orchestrator | Friday 24 April 2026 03:15:44 +0000 (0:00:02.172) 0:00:45.792 ********** 2026-04-24 03:16:09.227859 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:16:09.227866 | orchestrator | 2026-04-24 03:16:09.227872 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-24 03:16:09.227879 | orchestrator | Friday 24 April 2026 03:15:58 +0000 (0:00:14.340) 0:01:00.132 ********** 2026-04-24 03:16:09.227885 | orchestrator | 2026-04-24 03:16:09.227891 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-24 03:16:09.227898 | orchestrator | Friday 24 April 2026 03:15:58 +0000 (0:00:00.073) 0:01:00.206 ********** 2026-04-24 03:16:09.227905 | orchestrator | 2026-04-24 03:16:09.227911 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-24 03:16:09.227918 | orchestrator | Friday 24 April 2026 03:15:58 +0000 (0:00:00.072) 0:01:00.278 ********** 2026-04-24 03:16:09.227924 | orchestrator | 2026-04-24 03:16:09.227930 | orchestrator | RUNNING HANDLER [placement : Restart placement-api container] ****************** 2026-04-24 03:16:09.227948 | orchestrator | Friday 24 April 2026 03:15:58 +0000 (0:00:00.072) 0:01:00.351 ********** 2026-04-24 03:16:09.227955 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:16:09.227961 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:16:09.227968 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:16:09.227974 | orchestrator | 2026-04-24 03:16:09.227981 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:16:09.227989 | orchestrator | testbed-node-0 : ok=21  changed=16  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 03:16:09.227996 | orchestrator | testbed-node-1 : ok=12  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 03:16:09.228002 | orchestrator | testbed-node-2 : ok=12  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 03:16:09.228009 | orchestrator | 2026-04-24 03:16:09.228015 | orchestrator | 2026-04-24 03:16:09.228022 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:16:09.228034 | orchestrator | Friday 24 April 2026 03:16:08 +0000 (0:00:10.139) 0:01:10.490 ********** 2026-04-24 03:16:09.228041 | orchestrator | =============================================================================== 2026-04-24 03:16:09.228047 | orchestrator | placement : Running placement bootstrap container ---------------------- 14.34s 2026-04-24 03:16:09.228066 | orchestrator | placement : Restart placement-api container ---------------------------- 10.14s 2026-04-24 03:16:09.228073 | orchestrator | service-ks-register : placement | Creating endpoints -------------------- 6.48s 2026-04-24 03:16:09.228080 | orchestrator | service-ks-register : placement | Granting user roles ------------------- 4.24s 2026-04-24 03:16:09.228086 | orchestrator | service-ks-register : placement | Creating users ------------------------ 4.07s 2026-04-24 03:16:09.228093 | orchestrator | service-ks-register : placement | Creating projects --------------------- 3.83s 2026-04-24 03:16:09.228100 | orchestrator | service-ks-register : placement | Creating services --------------------- 3.80s 2026-04-24 03:16:09.228106 | orchestrator | service-ks-register : placement | Creating roles ------------------------ 3.27s 2026-04-24 03:16:09.228113 | orchestrator | placement : Creating placement databases -------------------------------- 2.30s 2026-04-24 03:16:09.228119 | orchestrator | placement : Copying over placement.conf --------------------------------- 2.28s 2026-04-24 03:16:09.228126 | orchestrator | placement : Creating placement databases user and setting permissions --- 2.17s 2026-04-24 03:16:09.228133 | orchestrator | service-cert-copy : placement | Copying over extra CA certificates ------ 1.68s 2026-04-24 03:16:09.228139 | orchestrator | placement : Copying over config.json files for services ----------------- 1.58s 2026-04-24 03:16:09.228146 | orchestrator | placement : Copying over placement-api wsgi configuration --------------- 1.48s 2026-04-24 03:16:09.228152 | orchestrator | placement : Copying over migrate-db.rc.j2 configuration ----------------- 1.38s 2026-04-24 03:16:09.228159 | orchestrator | placement : Check placement containers ---------------------------------- 1.08s 2026-04-24 03:16:09.228165 | orchestrator | placement : Ensuring config directories exist --------------------------- 1.06s 2026-04-24 03:16:09.228172 | orchestrator | placement : Copying over existing policy file --------------------------- 0.76s 2026-04-24 03:16:09.228178 | orchestrator | service-cert-copy : placement | Copying over backend internal TLS key --- 0.72s 2026-04-24 03:16:09.228185 | orchestrator | placement : include_tasks ----------------------------------------------- 0.56s 2026-04-24 03:16:11.559983 | orchestrator | 2026-04-24 03:16:11 | INFO  | Task b18e6bd7-d5fe-42c4-8de9-5a7867e41824 (neutron) was prepared for execution. 2026-04-24 03:16:11.560084 | orchestrator | 2026-04-24 03:16:11 | INFO  | It takes a moment until task b18e6bd7-d5fe-42c4-8de9-5a7867e41824 (neutron) has been started and output is visible here. 2026-04-24 03:17:00.457936 | orchestrator | 2026-04-24 03:17:00.458102 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:17:00.458119 | orchestrator | 2026-04-24 03:17:00.458130 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:17:00.458140 | orchestrator | Friday 24 April 2026 03:16:15 +0000 (0:00:00.259) 0:00:00.259 ********** 2026-04-24 03:17:00.458150 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:17:00.458160 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:17:00.458170 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:17:00.458179 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:17:00.458189 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:17:00.458198 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:17:00.458208 | orchestrator | 2026-04-24 03:17:00.458218 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:17:00.458227 | orchestrator | Friday 24 April 2026 03:16:16 +0000 (0:00:00.703) 0:00:00.963 ********** 2026-04-24 03:17:00.458237 | orchestrator | ok: [testbed-node-0] => (item=enable_neutron_True) 2026-04-24 03:17:00.458247 | orchestrator | ok: [testbed-node-1] => (item=enable_neutron_True) 2026-04-24 03:17:00.458257 | orchestrator | ok: [testbed-node-2] => (item=enable_neutron_True) 2026-04-24 03:17:00.458291 | orchestrator | ok: [testbed-node-3] => (item=enable_neutron_True) 2026-04-24 03:17:00.458370 | orchestrator | ok: [testbed-node-4] => (item=enable_neutron_True) 2026-04-24 03:17:00.458385 | orchestrator | ok: [testbed-node-5] => (item=enable_neutron_True) 2026-04-24 03:17:00.458400 | orchestrator | 2026-04-24 03:17:00.458415 | orchestrator | PLAY [Apply role neutron] ****************************************************** 2026-04-24 03:17:00.458432 | orchestrator | 2026-04-24 03:17:00.458450 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 03:17:00.458484 | orchestrator | Friday 24 April 2026 03:16:17 +0000 (0:00:00.609) 0:00:01.572 ********** 2026-04-24 03:17:00.458498 | orchestrator | included: /ansible/roles/neutron/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:17:00.458510 | orchestrator | 2026-04-24 03:17:00.458521 | orchestrator | TASK [neutron : Get container facts] ******************************************* 2026-04-24 03:17:00.458533 | orchestrator | Friday 24 April 2026 03:16:18 +0000 (0:00:01.259) 0:00:02.831 ********** 2026-04-24 03:17:00.458544 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:17:00.458555 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:17:00.458566 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:17:00.458578 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:17:00.458588 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:17:00.458599 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:17:00.458610 | orchestrator | 2026-04-24 03:17:00.458622 | orchestrator | TASK [neutron : Get container volume facts] ************************************ 2026-04-24 03:17:00.458633 | orchestrator | Friday 24 April 2026 03:16:19 +0000 (0:00:01.353) 0:00:04.185 ********** 2026-04-24 03:17:00.458644 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:17:00.458656 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:17:00.458667 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:17:00.458678 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:17:00.458689 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:17:00.458700 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:17:00.458711 | orchestrator | 2026-04-24 03:17:00.458722 | orchestrator | TASK [neutron : Check for ML2/OVN presence] ************************************ 2026-04-24 03:17:00.458733 | orchestrator | Friday 24 April 2026 03:16:20 +0000 (0:00:01.096) 0:00:05.281 ********** 2026-04-24 03:17:00.458744 | orchestrator | ok: [testbed-node-0] => { 2026-04-24 03:17:00.458756 | orchestrator |  "changed": false, 2026-04-24 03:17:00.458767 | orchestrator |  "msg": "All assertions passed" 2026-04-24 03:17:00.458778 | orchestrator | } 2026-04-24 03:17:00.458790 | orchestrator | ok: [testbed-node-1] => { 2026-04-24 03:17:00.458801 | orchestrator |  "changed": false, 2026-04-24 03:17:00.458812 | orchestrator |  "msg": "All assertions passed" 2026-04-24 03:17:00.458822 | orchestrator | } 2026-04-24 03:17:00.458833 | orchestrator | ok: [testbed-node-2] => { 2026-04-24 03:17:00.458845 | orchestrator |  "changed": false, 2026-04-24 03:17:00.458856 | orchestrator |  "msg": "All assertions passed" 2026-04-24 03:17:00.458867 | orchestrator | } 2026-04-24 03:17:00.458876 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 03:17:00.458886 | orchestrator |  "changed": false, 2026-04-24 03:17:00.458895 | orchestrator |  "msg": "All assertions passed" 2026-04-24 03:17:00.458904 | orchestrator | } 2026-04-24 03:17:00.458914 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 03:17:00.458924 | orchestrator |  "changed": false, 2026-04-24 03:17:00.458934 | orchestrator |  "msg": "All assertions passed" 2026-04-24 03:17:00.458943 | orchestrator | } 2026-04-24 03:17:00.458965 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 03:17:00.458975 | orchestrator |  "changed": false, 2026-04-24 03:17:00.458984 | orchestrator |  "msg": "All assertions passed" 2026-04-24 03:17:00.458994 | orchestrator | } 2026-04-24 03:17:00.459003 | orchestrator | 2026-04-24 03:17:00.459013 | orchestrator | TASK [neutron : Check for ML2/OVS presence] ************************************ 2026-04-24 03:17:00.459022 | orchestrator | Friday 24 April 2026 03:16:21 +0000 (0:00:01.025) 0:00:06.307 ********** 2026-04-24 03:17:00.459032 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:00.459051 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:00.459061 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:00.459070 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:00.459079 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:00.459088 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:00.459098 | orchestrator | 2026-04-24 03:17:00.459107 | orchestrator | TASK [service-ks-register : neutron | Creating services] *********************** 2026-04-24 03:17:00.459117 | orchestrator | Friday 24 April 2026 03:16:22 +0000 (0:00:00.644) 0:00:06.951 ********** 2026-04-24 03:17:00.459126 | orchestrator | changed: [testbed-node-0] => (item=neutron (network)) 2026-04-24 03:17:00.459136 | orchestrator | 2026-04-24 03:17:00.459145 | orchestrator | TASK [service-ks-register : neutron | Creating endpoints] ********************** 2026-04-24 03:17:00.459155 | orchestrator | Friday 24 April 2026 03:16:26 +0000 (0:00:03.993) 0:00:10.944 ********** 2026-04-24 03:17:00.459164 | orchestrator | changed: [testbed-node-0] => (item=neutron -> https://api-int.testbed.osism.xyz:9696 -> internal) 2026-04-24 03:17:00.459175 | orchestrator | changed: [testbed-node-0] => (item=neutron -> https://api.testbed.osism.xyz:9696 -> public) 2026-04-24 03:17:00.459185 | orchestrator | 2026-04-24 03:17:00.459212 | orchestrator | TASK [service-ks-register : neutron | Creating projects] *********************** 2026-04-24 03:17:00.459222 | orchestrator | Friday 24 April 2026 03:16:33 +0000 (0:00:06.607) 0:00:17.552 ********** 2026-04-24 03:17:00.459232 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:17:00.459242 | orchestrator | 2026-04-24 03:17:00.459251 | orchestrator | TASK [service-ks-register : neutron | Creating users] ************************** 2026-04-24 03:17:00.459261 | orchestrator | Friday 24 April 2026 03:16:36 +0000 (0:00:03.187) 0:00:20.739 ********** 2026-04-24 03:17:00.459270 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:17:00.459280 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service) 2026-04-24 03:17:00.459289 | orchestrator | 2026-04-24 03:17:00.459326 | orchestrator | TASK [service-ks-register : neutron | Creating roles] ************************** 2026-04-24 03:17:00.459336 | orchestrator | Friday 24 April 2026 03:16:40 +0000 (0:00:04.108) 0:00:24.848 ********** 2026-04-24 03:17:00.459346 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:17:00.459355 | orchestrator | 2026-04-24 03:17:00.459365 | orchestrator | TASK [service-ks-register : neutron | Granting user roles] ********************* 2026-04-24 03:17:00.459375 | orchestrator | Friday 24 April 2026 03:16:43 +0000 (0:00:03.249) 0:00:28.098 ********** 2026-04-24 03:17:00.459384 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service -> admin) 2026-04-24 03:17:00.459393 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service -> service) 2026-04-24 03:17:00.459403 | orchestrator | 2026-04-24 03:17:00.459412 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 03:17:00.459422 | orchestrator | Friday 24 April 2026 03:16:51 +0000 (0:00:07.887) 0:00:35.986 ********** 2026-04-24 03:17:00.459431 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:00.459441 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:00.459574 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:00.459584 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:00.459594 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:00.459603 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:00.459613 | orchestrator | 2026-04-24 03:17:00.459623 | orchestrator | TASK [Load and persist kernel modules] ***************************************** 2026-04-24 03:17:00.459632 | orchestrator | Friday 24 April 2026 03:16:52 +0000 (0:00:00.845) 0:00:36.832 ********** 2026-04-24 03:17:00.459642 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:00.459652 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:00.459661 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:00.459670 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:00.459680 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:00.459689 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:00.459699 | orchestrator | 2026-04-24 03:17:00.460028 | orchestrator | TASK [neutron : Check IPv6 support] ******************************************** 2026-04-24 03:17:00.460042 | orchestrator | Friday 24 April 2026 03:16:54 +0000 (0:00:02.146) 0:00:38.978 ********** 2026-04-24 03:17:00.460081 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:17:00.460094 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:17:00.460104 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:17:00.460114 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:17:00.460124 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:17:00.460134 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:17:00.460144 | orchestrator | 2026-04-24 03:17:00.460154 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-24 03:17:00.460164 | orchestrator | Friday 24 April 2026 03:16:55 +0000 (0:00:01.217) 0:00:40.195 ********** 2026-04-24 03:17:00.460174 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:00.460185 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:00.460195 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:00.460205 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:00.460214 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:00.460224 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:00.460234 | orchestrator | 2026-04-24 03:17:00.460244 | orchestrator | TASK [neutron : Ensuring config directories exist] ***************************** 2026-04-24 03:17:00.460254 | orchestrator | Friday 24 April 2026 03:16:57 +0000 (0:00:02.209) 0:00:42.404 ********** 2026-04-24 03:17:00.460267 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:00.460324 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:06.085800 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:06.085964 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:06.085993 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:06.086010 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:06.086112 | orchestrator | 2026-04-24 03:17:06.086132 | orchestrator | TASK [neutron : Check if extra ml2 plugins exists] ***************************** 2026-04-24 03:17:06.086150 | orchestrator | Friday 24 April 2026 03:17:00 +0000 (0:00:02.545) 0:00:44.950 ********** 2026-04-24 03:17:06.086165 | orchestrator | [WARNING]: Skipped 2026-04-24 03:17:06.086183 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' path 2026-04-24 03:17:06.086202 | orchestrator | due to this access issue: 2026-04-24 03:17:06.086220 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' is not 2026-04-24 03:17:06.086238 | orchestrator | a directory 2026-04-24 03:17:06.086255 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:17:06.086271 | orchestrator | 2026-04-24 03:17:06.086289 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 03:17:06.086345 | orchestrator | Friday 24 April 2026 03:17:01 +0000 (0:00:00.875) 0:00:45.825 ********** 2026-04-24 03:17:06.086363 | orchestrator | included: /ansible/roles/neutron/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:17:06.086380 | orchestrator | 2026-04-24 03:17:06.086397 | orchestrator | TASK [service-cert-copy : neutron | Copying over extra CA certificates] ******** 2026-04-24 03:17:06.086438 | orchestrator | Friday 24 April 2026 03:17:02 +0000 (0:00:01.279) 0:00:47.105 ********** 2026-04-24 03:17:06.086469 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:06.086504 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:06.086522 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:06.086539 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:06.086568 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:10.888656 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:10.888766 | orchestrator | 2026-04-24 03:17:10.888784 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS certificate] *** 2026-04-24 03:17:10.888797 | orchestrator | Friday 24 April 2026 03:17:06 +0000 (0:00:03.469) 0:00:50.574 ********** 2026-04-24 03:17:10.888811 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:10.888825 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:10.888838 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:10.888850 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:10.888861 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:10.888894 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:10.888921 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:10.888933 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:10.888951 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:10.888963 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:10.888974 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:10.888985 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:10.888996 | orchestrator | 2026-04-24 03:17:10.889008 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS key] ***** 2026-04-24 03:17:10.889018 | orchestrator | Friday 24 April 2026 03:17:08 +0000 (0:00:01.938) 0:00:52.513 ********** 2026-04-24 03:17:10.889030 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:10.889041 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:10.889059 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:16.244087 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:16.244220 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:16.244241 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:16.244255 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:16.244268 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:16.244280 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:16.244292 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:16.244364 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:16.244402 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:16.244415 | orchestrator | 2026-04-24 03:17:16.244427 | orchestrator | TASK [neutron : Creating TLS backend PEM File] ********************************* 2026-04-24 03:17:16.244440 | orchestrator | Friday 24 April 2026 03:17:10 +0000 (0:00:02.860) 0:00:55.374 ********** 2026-04-24 03:17:16.244452 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:16.244463 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:16.244475 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:16.244499 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:16.244510 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:16.244532 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:16.244544 | orchestrator | 2026-04-24 03:17:16.244555 | orchestrator | TASK [neutron : Check if policies shall be overwritten] ************************ 2026-04-24 03:17:16.244567 | orchestrator | Friday 24 April 2026 03:17:13 +0000 (0:00:02.311) 0:00:57.685 ********** 2026-04-24 03:17:16.244578 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:16.244589 | orchestrator | 2026-04-24 03:17:16.244601 | orchestrator | TASK [neutron : Set neutron policy file] *************************************** 2026-04-24 03:17:16.244632 | orchestrator | Friday 24 April 2026 03:17:13 +0000 (0:00:00.151) 0:00:57.836 ********** 2026-04-24 03:17:16.244647 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:16.244660 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:16.244672 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:16.244684 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:16.244697 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:16.244710 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:16.244722 | orchestrator | 2026-04-24 03:17:16.244735 | orchestrator | TASK [neutron : Copying over existing policy file] ***************************** 2026-04-24 03:17:16.244748 | orchestrator | Friday 24 April 2026 03:17:13 +0000 (0:00:00.618) 0:00:58.455 ********** 2026-04-24 03:17:16.244767 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:16.244781 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:16.244801 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:16.244813 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:16.244825 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:16.244837 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:16.244849 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:16.244861 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:16.244896 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:24.656235 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:24.656382 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:24.656402 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:24.656415 | orchestrator | 2026-04-24 03:17:24.656428 | orchestrator | TASK [neutron : Copying over config.json files for services] ******************* 2026-04-24 03:17:24.656441 | orchestrator | Friday 24 April 2026 03:17:16 +0000 (0:00:02.271) 0:01:00.727 ********** 2026-04-24 03:17:24.656454 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:24.656490 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:24.656503 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:24.656549 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:24.656563 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:24.656582 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:24.656594 | orchestrator | 2026-04-24 03:17:24.656606 | orchestrator | TASK [neutron : Copying over neutron.conf] ************************************* 2026-04-24 03:17:24.656617 | orchestrator | Friday 24 April 2026 03:17:19 +0000 (0:00:03.014) 0:01:03.741 ********** 2026-04-24 03:17:24.656629 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:24.656640 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:24.656666 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:29.567755 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:29.567892 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:29.567910 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:17:29.567923 | orchestrator | 2026-04-24 03:17:29.567936 | orchestrator | TASK [neutron : Copying over neutron_vpnaas.conf] ****************************** 2026-04-24 03:17:29.567949 | orchestrator | Friday 24 April 2026 03:17:24 +0000 (0:00:05.406) 0:01:09.148 ********** 2026-04-24 03:17:29.567975 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:29.567988 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:29.568022 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:29.568042 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:29.568055 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:29.568067 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:29.568079 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:29.568091 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:29.568103 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:29.568115 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:29.568133 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:29.568145 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:29.568164 | orchestrator | 2026-04-24 03:17:29.568175 | orchestrator | TASK [neutron : Copying over ssh key] ****************************************** 2026-04-24 03:17:29.568187 | orchestrator | Friday 24 April 2026 03:17:26 +0000 (0:00:02.123) 0:01:11.271 ********** 2026-04-24 03:17:29.568199 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:29.568210 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:29.568221 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:29.568233 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:17:29.568244 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:17:29.568262 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:17:48.909386 | orchestrator | 2026-04-24 03:17:48.909501 | orchestrator | TASK [neutron : Copying over ml2_conf.ini] ************************************* 2026-04-24 03:17:48.909535 | orchestrator | Friday 24 April 2026 03:17:29 +0000 (0:00:02.777) 0:01:14.048 ********** 2026-04-24 03:17:48.909563 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:48.909579 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:48.909593 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:48.909606 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:48.909618 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:48.909629 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:48.909656 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:48.909714 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:48.909727 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:17:48.909739 | orchestrator | 2026-04-24 03:17:48.909750 | orchestrator | TASK [neutron : Copying over linuxbridge_agent.ini] **************************** 2026-04-24 03:17:48.909761 | orchestrator | Friday 24 April 2026 03:17:33 +0000 (0:00:03.483) 0:01:17.532 ********** 2026-04-24 03:17:48.909772 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:48.909783 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:48.909794 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:48.909805 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:48.909815 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:48.909826 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:48.909836 | orchestrator | 2026-04-24 03:17:48.909848 | orchestrator | TASK [neutron : Copying over openvswitch_agent.ini] **************************** 2026-04-24 03:17:48.909858 | orchestrator | Friday 24 April 2026 03:17:35 +0000 (0:00:02.302) 0:01:19.835 ********** 2026-04-24 03:17:48.909869 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:48.909882 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:48.909894 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:48.909906 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:48.909918 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:48.909930 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:48.909942 | orchestrator | 2026-04-24 03:17:48.909954 | orchestrator | TASK [neutron : Copying over sriov_agent.ini] ********************************** 2026-04-24 03:17:48.909966 | orchestrator | Friday 24 April 2026 03:17:37 +0000 (0:00:02.290) 0:01:22.126 ********** 2026-04-24 03:17:48.909980 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:48.909992 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:48.910004 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:48.910072 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:48.910085 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:48.910106 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:48.910119 | orchestrator | 2026-04-24 03:17:48.910132 | orchestrator | TASK [neutron : Copying over mlnx_agent.ini] *********************************** 2026-04-24 03:17:48.910143 | orchestrator | Friday 24 April 2026 03:17:40 +0000 (0:00:02.384) 0:01:24.510 ********** 2026-04-24 03:17:48.910154 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:48.910164 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:48.910175 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:48.910186 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:48.910196 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:48.910207 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:48.910218 | orchestrator | 2026-04-24 03:17:48.910229 | orchestrator | TASK [neutron : Copying over eswitchd.conf] ************************************ 2026-04-24 03:17:48.910240 | orchestrator | Friday 24 April 2026 03:17:42 +0000 (0:00:02.168) 0:01:26.679 ********** 2026-04-24 03:17:48.910250 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:48.910261 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:48.910271 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:48.910282 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:48.910293 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:48.910304 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:48.910348 | orchestrator | 2026-04-24 03:17:48.910367 | orchestrator | TASK [neutron : Copying over dhcp_agent.ini] *********************************** 2026-04-24 03:17:48.910385 | orchestrator | Friday 24 April 2026 03:17:44 +0000 (0:00:02.186) 0:01:28.865 ********** 2026-04-24 03:17:48.910402 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:48.910428 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:48.910446 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:48.910463 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:48.910482 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:48.910499 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:48.910518 | orchestrator | 2026-04-24 03:17:48.910536 | orchestrator | TASK [neutron : Copying over dnsmasq.conf] ************************************* 2026-04-24 03:17:48.910556 | orchestrator | Friday 24 April 2026 03:17:46 +0000 (0:00:02.216) 0:01:31.082 ********** 2026-04-24 03:17:48.910576 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 03:17:48.910597 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:48.910617 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 03:17:48.910632 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:48.910643 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 03:17:48.910664 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:53.813104 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 03:17:53.813213 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:53.813229 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 03:17:53.813240 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:53.813251 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 03:17:53.813260 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:53.813270 | orchestrator | 2026-04-24 03:17:53.813281 | orchestrator | TASK [neutron : Copying over l3_agent.ini] ************************************* 2026-04-24 03:17:53.813292 | orchestrator | Friday 24 April 2026 03:17:48 +0000 (0:00:02.315) 0:01:33.398 ********** 2026-04-24 03:17:53.813305 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:53.813368 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:17:53.813381 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:53.813391 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:53.813403 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:53.813413 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:17:53.813454 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:53.813466 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:53.813477 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:53.813494 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:17:53.813505 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:17:53.813515 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:17:53.813525 | orchestrator | 2026-04-24 03:17:53.813535 | orchestrator | TASK [neutron : Copying over fwaas_driver.ini] ********************************* 2026-04-24 03:17:53.813544 | orchestrator | Friday 24 April 2026 03:17:51 +0000 (0:00:02.601) 0:01:36.000 ********** 2026-04-24 03:17:53.813555 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:53.813564 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:17:53.813579 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:17:53.813589 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:17:53.813607 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:18:19.602787 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.602906 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:18:19.602926 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.602939 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:18:19.602951 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.602963 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:18:19.602974 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.602985 | orchestrator | 2026-04-24 03:18:19.602997 | orchestrator | TASK [neutron : Copying over metadata_agent.ini] ******************************* 2026-04-24 03:18:19.603010 | orchestrator | Friday 24 April 2026 03:17:53 +0000 (0:00:02.305) 0:01:38.305 ********** 2026-04-24 03:18:19.603021 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603032 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603043 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603055 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.603082 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.603094 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.603105 | orchestrator | 2026-04-24 03:18:19.603116 | orchestrator | TASK [neutron : Copying over neutron_ovn_metadata_agent.ini] ******************* 2026-04-24 03:18:19.603127 | orchestrator | Friday 24 April 2026 03:17:56 +0000 (0:00:02.260) 0:01:40.566 ********** 2026-04-24 03:18:19.603138 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603149 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603159 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603170 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:18:19.603181 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:18:19.603192 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:18:19.603227 | orchestrator | 2026-04-24 03:18:19.603239 | orchestrator | TASK [neutron : Copying over metering_agent.ini] ******************************* 2026-04-24 03:18:19.603250 | orchestrator | Friday 24 April 2026 03:17:59 +0000 (0:00:03.685) 0:01:44.252 ********** 2026-04-24 03:18:19.603260 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603271 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603281 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.603292 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603302 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.603313 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.603325 | orchestrator | 2026-04-24 03:18:19.603368 | orchestrator | TASK [neutron : Copying over ironic_neutron_agent.ini] ************************* 2026-04-24 03:18:19.603382 | orchestrator | Friday 24 April 2026 03:18:01 +0000 (0:00:02.195) 0:01:46.448 ********** 2026-04-24 03:18:19.603394 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603407 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603419 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603430 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.603443 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.603455 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.603467 | orchestrator | 2026-04-24 03:18:19.603480 | orchestrator | TASK [neutron : Copying over bgp_dragent.ini] ********************************** 2026-04-24 03:18:19.603509 | orchestrator | Friday 24 April 2026 03:18:04 +0000 (0:00:02.277) 0:01:48.725 ********** 2026-04-24 03:18:19.603522 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603534 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603547 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603559 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.603571 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.603585 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.603603 | orchestrator | 2026-04-24 03:18:19.603621 | orchestrator | TASK [neutron : Copying over ovn_agent.ini] ************************************ 2026-04-24 03:18:19.603641 | orchestrator | Friday 24 April 2026 03:18:06 +0000 (0:00:02.141) 0:01:50.866 ********** 2026-04-24 03:18:19.603659 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603676 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603686 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603697 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.603708 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.603718 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.603729 | orchestrator | 2026-04-24 03:18:19.603740 | orchestrator | TASK [neutron : Copying over nsx.ini] ****************************************** 2026-04-24 03:18:19.603751 | orchestrator | Friday 24 April 2026 03:18:08 +0000 (0:00:02.184) 0:01:53.051 ********** 2026-04-24 03:18:19.603761 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603772 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603783 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603793 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.603804 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.603815 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.603825 | orchestrator | 2026-04-24 03:18:19.603836 | orchestrator | TASK [neutron : Copy neutron-l3-agent-wrapper script] ************************** 2026-04-24 03:18:19.603847 | orchestrator | Friday 24 April 2026 03:18:10 +0000 (0:00:02.091) 0:01:55.142 ********** 2026-04-24 03:18:19.603858 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603868 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603879 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603889 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.603900 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.603911 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.603921 | orchestrator | 2026-04-24 03:18:19.603932 | orchestrator | TASK [neutron : Copying over extra ml2 plugins] ******************************** 2026-04-24 03:18:19.603952 | orchestrator | Friday 24 April 2026 03:18:12 +0000 (0:00:02.108) 0:01:57.250 ********** 2026-04-24 03:18:19.603963 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.603974 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.603985 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.603995 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.604006 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.604016 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.604027 | orchestrator | 2026-04-24 03:18:19.604038 | orchestrator | TASK [neutron : Copying over neutron-tls-proxy.cfg] **************************** 2026-04-24 03:18:19.604049 | orchestrator | Friday 24 April 2026 03:18:15 +0000 (0:00:02.364) 0:01:59.615 ********** 2026-04-24 03:18:19.604060 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 03:18:19.604072 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:19.604083 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 03:18:19.604093 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:19.604104 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 03:18:19.604115 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.604126 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 03:18:19.604137 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:19.604147 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 03:18:19.604158 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:19.604175 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 03:18:19.604186 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:19.604197 | orchestrator | 2026-04-24 03:18:19.604207 | orchestrator | TASK [neutron : Copying over neutron_taas.conf] ******************************** 2026-04-24 03:18:19.604218 | orchestrator | Friday 24 April 2026 03:18:17 +0000 (0:00:01.951) 0:02:01.566 ********** 2026-04-24 03:18:19.604231 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:18:19.604243 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:18:19.604263 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:18:22.406113 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:18:22.406224 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-24 03:18:22.406249 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:18:22.406271 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:18:22.406291 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:18:22.406331 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:18:22.406420 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:18:22.406441 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 03:18:22.406461 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:18:22.406480 | orchestrator | 2026-04-24 03:18:22.406501 | orchestrator | TASK [neutron : Check neutron containers] ************************************** 2026-04-24 03:18:22.406522 | orchestrator | Friday 24 April 2026 03:18:19 +0000 (0:00:02.524) 0:02:04.091 ********** 2026-04-24 03:18:22.406567 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:18:22.406621 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:18:22.406654 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:18:22.406676 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-24 03:18:22.406697 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:18:22.406739 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 03:20:40.744565 | orchestrator | 2026-04-24 03:20:40.744683 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 03:20:40.744702 | orchestrator | Friday 24 April 2026 03:18:22 +0000 (0:00:02.804) 0:02:06.895 ********** 2026-04-24 03:20:40.744714 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:20:40.744727 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:20:40.744738 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:20:40.744749 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:20:40.744760 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:20:40.744771 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:20:40.744783 | orchestrator | 2026-04-24 03:20:40.744794 | orchestrator | TASK [neutron : Creating Neutron database] ************************************* 2026-04-24 03:20:40.744805 | orchestrator | Friday 24 April 2026 03:18:23 +0000 (0:00:00.857) 0:02:07.753 ********** 2026-04-24 03:20:40.744817 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:20:40.744828 | orchestrator | 2026-04-24 03:20:40.744839 | orchestrator | TASK [neutron : Creating Neutron database user and setting permissions] ******** 2026-04-24 03:20:40.744850 | orchestrator | Friday 24 April 2026 03:18:25 +0000 (0:00:02.140) 0:02:09.894 ********** 2026-04-24 03:20:40.744861 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:20:40.744872 | orchestrator | 2026-04-24 03:20:40.744883 | orchestrator | TASK [neutron : Running Neutron bootstrap container] *************************** 2026-04-24 03:20:40.744894 | orchestrator | Friday 24 April 2026 03:18:27 +0000 (0:00:02.200) 0:02:12.094 ********** 2026-04-24 03:20:40.744905 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:20:40.744916 | orchestrator | 2026-04-24 03:20:40.744928 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 03:20:40.744939 | orchestrator | Friday 24 April 2026 03:19:08 +0000 (0:00:40.921) 0:02:53.016 ********** 2026-04-24 03:20:40.744950 | orchestrator | 2026-04-24 03:20:40.744961 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 03:20:40.744972 | orchestrator | Friday 24 April 2026 03:19:08 +0000 (0:00:00.071) 0:02:53.087 ********** 2026-04-24 03:20:40.744983 | orchestrator | 2026-04-24 03:20:40.744994 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 03:20:40.745005 | orchestrator | Friday 24 April 2026 03:19:08 +0000 (0:00:00.070) 0:02:53.158 ********** 2026-04-24 03:20:40.745017 | orchestrator | 2026-04-24 03:20:40.745028 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 03:20:40.745055 | orchestrator | Friday 24 April 2026 03:19:08 +0000 (0:00:00.071) 0:02:53.230 ********** 2026-04-24 03:20:40.745067 | orchestrator | 2026-04-24 03:20:40.745080 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 03:20:40.745093 | orchestrator | Friday 24 April 2026 03:19:08 +0000 (0:00:00.071) 0:02:53.302 ********** 2026-04-24 03:20:40.745106 | orchestrator | 2026-04-24 03:20:40.745118 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 03:20:40.745131 | orchestrator | Friday 24 April 2026 03:19:08 +0000 (0:00:00.069) 0:02:53.371 ********** 2026-04-24 03:20:40.745143 | orchestrator | 2026-04-24 03:20:40.745180 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-server container] ******************* 2026-04-24 03:20:40.745194 | orchestrator | Friday 24 April 2026 03:19:08 +0000 (0:00:00.074) 0:02:53.446 ********** 2026-04-24 03:20:40.745206 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:20:40.745219 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:20:40.745232 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:20:40.745243 | orchestrator | 2026-04-24 03:20:40.745256 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-ovn-metadata-agent container] ******* 2026-04-24 03:20:40.745268 | orchestrator | Friday 24 April 2026 03:19:37 +0000 (0:00:28.379) 0:03:21.826 ********** 2026-04-24 03:20:40.745280 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:20:40.745292 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:20:40.745305 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:20:40.745317 | orchestrator | 2026-04-24 03:20:40.745330 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:20:40.745343 | orchestrator | testbed-node-0 : ok=26  changed=15  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-24 03:20:40.745357 | orchestrator | testbed-node-1 : ok=16  changed=8  unreachable=0 failed=0 skipped=31  rescued=0 ignored=0 2026-04-24 03:20:40.745370 | orchestrator | testbed-node-2 : ok=16  changed=8  unreachable=0 failed=0 skipped=31  rescued=0 ignored=0 2026-04-24 03:20:40.745382 | orchestrator | testbed-node-3 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-24 03:20:40.745395 | orchestrator | testbed-node-4 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-24 03:20:40.745408 | orchestrator | testbed-node-5 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-24 03:20:40.745420 | orchestrator | 2026-04-24 03:20:40.745433 | orchestrator | 2026-04-24 03:20:40.745444 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:20:40.745455 | orchestrator | Friday 24 April 2026 03:20:40 +0000 (0:01:02.922) 0:04:24.748 ********** 2026-04-24 03:20:40.745466 | orchestrator | =============================================================================== 2026-04-24 03:20:40.745477 | orchestrator | neutron : Restart neutron-ovn-metadata-agent container ----------------- 62.92s 2026-04-24 03:20:40.745488 | orchestrator | neutron : Running Neutron bootstrap container -------------------------- 40.92s 2026-04-24 03:20:40.745563 | orchestrator | neutron : Restart neutron-server container ----------------------------- 28.38s 2026-04-24 03:20:40.745592 | orchestrator | service-ks-register : neutron | Granting user roles --------------------- 7.89s 2026-04-24 03:20:40.745604 | orchestrator | service-ks-register : neutron | Creating endpoints ---------------------- 6.61s 2026-04-24 03:20:40.745615 | orchestrator | neutron : Copying over neutron.conf ------------------------------------- 5.41s 2026-04-24 03:20:40.745626 | orchestrator | service-ks-register : neutron | Creating users -------------------------- 4.11s 2026-04-24 03:20:40.745636 | orchestrator | service-ks-register : neutron | Creating services ----------------------- 3.99s 2026-04-24 03:20:40.745647 | orchestrator | neutron : Copying over neutron_ovn_metadata_agent.ini ------------------- 3.69s 2026-04-24 03:20:40.745658 | orchestrator | neutron : Copying over ml2_conf.ini ------------------------------------- 3.48s 2026-04-24 03:20:40.745672 | orchestrator | service-cert-copy : neutron | Copying over extra CA certificates -------- 3.47s 2026-04-24 03:20:40.745691 | orchestrator | service-ks-register : neutron | Creating roles -------------------------- 3.25s 2026-04-24 03:20:40.745707 | orchestrator | service-ks-register : neutron | Creating projects ----------------------- 3.19s 2026-04-24 03:20:40.745723 | orchestrator | neutron : Copying over config.json files for services ------------------- 3.01s 2026-04-24 03:20:40.745741 | orchestrator | service-cert-copy : neutron | Copying over backend internal TLS key ----- 2.86s 2026-04-24 03:20:40.745772 | orchestrator | neutron : Check neutron containers -------------------------------------- 2.80s 2026-04-24 03:20:40.745791 | orchestrator | neutron : Copying over ssh key ------------------------------------------ 2.78s 2026-04-24 03:20:40.745810 | orchestrator | neutron : Copying over l3_agent.ini ------------------------------------- 2.60s 2026-04-24 03:20:40.745821 | orchestrator | neutron : Ensuring config directories exist ----------------------------- 2.55s 2026-04-24 03:20:40.745832 | orchestrator | neutron : Copying over neutron_taas.conf -------------------------------- 2.52s 2026-04-24 03:20:43.128827 | orchestrator | 2026-04-24 03:20:43 | INFO  | Task 87b1f359-2c2b-49a0-86b3-1779f2680e11 (nova) was prepared for execution. 2026-04-24 03:20:43.128949 | orchestrator | 2026-04-24 03:20:43 | INFO  | It takes a moment until task 87b1f359-2c2b-49a0-86b3-1779f2680e11 (nova) has been started and output is visible here. 2026-04-24 03:22:42.182496 | orchestrator | 2026-04-24 03:22:42.182603 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:22:42.182618 | orchestrator | 2026-04-24 03:22:42.182629 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-24 03:22:42.182693 | orchestrator | Friday 24 April 2026 03:20:47 +0000 (0:00:00.281) 0:00:00.281 ********** 2026-04-24 03:22:42.182706 | orchestrator | changed: [testbed-manager] 2026-04-24 03:22:42.182717 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.182727 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:22:42.182737 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:22:42.182747 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:22:42.182756 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:22:42.182766 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:22:42.182776 | orchestrator | 2026-04-24 03:22:42.182786 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:22:42.182796 | orchestrator | Friday 24 April 2026 03:20:48 +0000 (0:00:00.891) 0:00:01.172 ********** 2026-04-24 03:22:42.182805 | orchestrator | changed: [testbed-manager] 2026-04-24 03:22:42.182815 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.182824 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:22:42.182834 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:22:42.182843 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:22:42.182853 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:22:42.182863 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:22:42.182872 | orchestrator | 2026-04-24 03:22:42.182882 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:22:42.182892 | orchestrator | Friday 24 April 2026 03:20:49 +0000 (0:00:00.890) 0:00:02.063 ********** 2026-04-24 03:22:42.182901 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-24 03:22:42.182912 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-24 03:22:42.182929 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-24 03:22:42.182947 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-24 03:22:42.182971 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-24 03:22:42.182990 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-24 03:22:42.183008 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-24 03:22:42.183024 | orchestrator | 2026-04-24 03:22:42.183043 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-24 03:22:42.183063 | orchestrator | 2026-04-24 03:22:42.183082 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-24 03:22:42.183099 | orchestrator | Friday 24 April 2026 03:20:50 +0000 (0:00:00.784) 0:00:02.848 ********** 2026-04-24 03:22:42.183111 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:22:42.183122 | orchestrator | 2026-04-24 03:22:42.183133 | orchestrator | TASK [nova : Creating Nova databases] ****************************************** 2026-04-24 03:22:42.183171 | orchestrator | Friday 24 April 2026 03:20:50 +0000 (0:00:00.778) 0:00:03.627 ********** 2026-04-24 03:22:42.183183 | orchestrator | changed: [testbed-node-0] => (item=nova_cell0) 2026-04-24 03:22:42.183194 | orchestrator | changed: [testbed-node-0] => (item=nova_api) 2026-04-24 03:22:42.183205 | orchestrator | 2026-04-24 03:22:42.183216 | orchestrator | TASK [nova : Creating Nova databases user and setting permissions] ************* 2026-04-24 03:22:42.183227 | orchestrator | Friday 24 April 2026 03:20:54 +0000 (0:00:04.148) 0:00:07.775 ********** 2026-04-24 03:22:42.183237 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 03:22:42.183247 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 03:22:42.183256 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.183266 | orchestrator | 2026-04-24 03:22:42.183276 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-24 03:22:42.183285 | orchestrator | Friday 24 April 2026 03:20:59 +0000 (0:00:04.205) 0:00:11.981 ********** 2026-04-24 03:22:42.183295 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.183305 | orchestrator | 2026-04-24 03:22:42.183314 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-24 03:22:42.183324 | orchestrator | Friday 24 April 2026 03:20:59 +0000 (0:00:00.666) 0:00:12.647 ********** 2026-04-24 03:22:42.183333 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.183343 | orchestrator | 2026-04-24 03:22:42.183352 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-24 03:22:42.183361 | orchestrator | Friday 24 April 2026 03:21:01 +0000 (0:00:01.355) 0:00:14.003 ********** 2026-04-24 03:22:42.183371 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.183380 | orchestrator | 2026-04-24 03:22:42.183390 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 03:22:42.183399 | orchestrator | Friday 24 April 2026 03:21:03 +0000 (0:00:02.635) 0:00:16.638 ********** 2026-04-24 03:22:42.183409 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:22:42.183418 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.183428 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.183437 | orchestrator | 2026-04-24 03:22:42.183447 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-24 03:22:42.183456 | orchestrator | Friday 24 April 2026 03:21:04 +0000 (0:00:00.289) 0:00:16.928 ********** 2026-04-24 03:22:42.183466 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:22:42.183475 | orchestrator | 2026-04-24 03:22:42.183485 | orchestrator | TASK [nova : Create cell0 mappings] ******************************************** 2026-04-24 03:22:42.183494 | orchestrator | Friday 24 April 2026 03:21:36 +0000 (0:00:32.364) 0:00:49.293 ********** 2026-04-24 03:22:42.183504 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.183513 | orchestrator | 2026-04-24 03:22:42.183522 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-24 03:22:42.183532 | orchestrator | Friday 24 April 2026 03:21:51 +0000 (0:00:14.638) 0:01:03.932 ********** 2026-04-24 03:22:42.183541 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:22:42.183551 | orchestrator | 2026-04-24 03:22:42.183560 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-24 03:22:42.183584 | orchestrator | Friday 24 April 2026 03:22:03 +0000 (0:00:12.067) 0:01:15.999 ********** 2026-04-24 03:22:42.183612 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:22:42.183623 | orchestrator | 2026-04-24 03:22:42.183633 | orchestrator | TASK [nova : Update cell0 mappings] ******************************************** 2026-04-24 03:22:42.183669 | orchestrator | Friday 24 April 2026 03:22:03 +0000 (0:00:00.699) 0:01:16.699 ********** 2026-04-24 03:22:42.183679 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:22:42.183689 | orchestrator | 2026-04-24 03:22:42.183699 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 03:22:42.183708 | orchestrator | Friday 24 April 2026 03:22:04 +0000 (0:00:00.481) 0:01:17.181 ********** 2026-04-24 03:22:42.183719 | orchestrator | included: /ansible/roles/nova/tasks/bootstrap_service.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:22:42.183737 | orchestrator | 2026-04-24 03:22:42.183746 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-24 03:22:42.183756 | orchestrator | Friday 24 April 2026 03:22:05 +0000 (0:00:00.716) 0:01:17.897 ********** 2026-04-24 03:22:42.183765 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:22:42.183775 | orchestrator | 2026-04-24 03:22:42.183784 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-24 03:22:42.183794 | orchestrator | Friday 24 April 2026 03:22:23 +0000 (0:00:17.946) 0:01:35.843 ********** 2026-04-24 03:22:42.183803 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:22:42.183813 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.183822 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.183832 | orchestrator | 2026-04-24 03:22:42.183841 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-24 03:22:42.183851 | orchestrator | 2026-04-24 03:22:42.183860 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-24 03:22:42.183870 | orchestrator | Friday 24 April 2026 03:22:23 +0000 (0:00:00.342) 0:01:36.186 ********** 2026-04-24 03:22:42.183879 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:22:42.183889 | orchestrator | 2026-04-24 03:22:42.183898 | orchestrator | TASK [nova-cell : Creating Nova cell database] ********************************* 2026-04-24 03:22:42.183908 | orchestrator | Friday 24 April 2026 03:22:24 +0000 (0:00:00.783) 0:01:36.970 ********** 2026-04-24 03:22:42.183917 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.183927 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.183936 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.183946 | orchestrator | 2026-04-24 03:22:42.183955 | orchestrator | TASK [nova-cell : Creating Nova cell database user and setting permissions] **** 2026-04-24 03:22:42.183965 | orchestrator | Friday 24 April 2026 03:22:26 +0000 (0:00:02.062) 0:01:39.032 ********** 2026-04-24 03:22:42.183974 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.183984 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.183993 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.184003 | orchestrator | 2026-04-24 03:22:42.184012 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-24 03:22:42.184022 | orchestrator | Friday 24 April 2026 03:22:28 +0000 (0:00:02.186) 0:01:41.219 ********** 2026-04-24 03:22:42.184031 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:22:42.184041 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.184050 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.184060 | orchestrator | 2026-04-24 03:22:42.184069 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-24 03:22:42.184078 | orchestrator | Friday 24 April 2026 03:22:29 +0000 (0:00:00.713) 0:01:41.933 ********** 2026-04-24 03:22:42.184088 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-24 03:22:42.184097 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.184107 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-24 03:22:42.184116 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.184126 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 03:22:42.184136 | orchestrator | ok: [testbed-node-0 -> {{ service_rabbitmq_delegate_host }}] 2026-04-24 03:22:42.184145 | orchestrator | 2026-04-24 03:22:42.184154 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-24 03:22:42.184164 | orchestrator | Friday 24 April 2026 03:22:36 +0000 (0:00:07.443) 0:01:49.377 ********** 2026-04-24 03:22:42.184174 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:22:42.184183 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.184193 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.184202 | orchestrator | 2026-04-24 03:22:42.184211 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-24 03:22:42.184221 | orchestrator | Friday 24 April 2026 03:22:36 +0000 (0:00:00.332) 0:01:49.710 ********** 2026-04-24 03:22:42.184230 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-24 03:22:42.184245 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:22:42.184255 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-24 03:22:42.184265 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.184274 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-24 03:22:42.184283 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.184293 | orchestrator | 2026-04-24 03:22:42.184302 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-24 03:22:42.184312 | orchestrator | Friday 24 April 2026 03:22:38 +0000 (0:00:01.287) 0:01:50.997 ********** 2026-04-24 03:22:42.184321 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.184331 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.184340 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.184350 | orchestrator | 2026-04-24 03:22:42.184359 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-24 03:22:42.184369 | orchestrator | Friday 24 April 2026 03:22:38 +0000 (0:00:00.472) 0:01:51.470 ********** 2026-04-24 03:22:42.184378 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.184388 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.184397 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:22:42.184407 | orchestrator | 2026-04-24 03:22:42.184416 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-24 03:22:42.184426 | orchestrator | Friday 24 April 2026 03:22:39 +0000 (0:00:01.022) 0:01:52.492 ********** 2026-04-24 03:22:42.184436 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:22:42.184445 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:22:42.184461 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:23:55.493531 | orchestrator | 2026-04-24 03:23:55.493643 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-24 03:23:55.493660 | orchestrator | Friday 24 April 2026 03:22:42 +0000 (0:00:02.464) 0:01:54.957 ********** 2026-04-24 03:23:55.493672 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:23:55.493684 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:23:55.493742 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:23:55.493757 | orchestrator | 2026-04-24 03:23:55.493769 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-24 03:23:55.493780 | orchestrator | Friday 24 April 2026 03:23:02 +0000 (0:00:20.571) 0:02:15.529 ********** 2026-04-24 03:23:55.493791 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:23:55.493802 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:23:55.493813 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:23:55.493824 | orchestrator | 2026-04-24 03:23:55.493835 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-24 03:23:55.493846 | orchestrator | Friday 24 April 2026 03:23:13 +0000 (0:00:10.814) 0:02:26.343 ********** 2026-04-24 03:23:55.493856 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:23:55.493867 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:23:55.493878 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:23:55.493888 | orchestrator | 2026-04-24 03:23:55.493899 | orchestrator | TASK [nova-cell : Create cell] ************************************************* 2026-04-24 03:23:55.493910 | orchestrator | Friday 24 April 2026 03:23:14 +0000 (0:00:01.151) 0:02:27.494 ********** 2026-04-24 03:23:55.493921 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:23:55.493932 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:23:55.493943 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:23:55.493954 | orchestrator | 2026-04-24 03:23:55.493964 | orchestrator | TASK [nova-cell : Update cell] ************************************************* 2026-04-24 03:23:55.493975 | orchestrator | Friday 24 April 2026 03:23:26 +0000 (0:00:11.699) 0:02:39.194 ********** 2026-04-24 03:23:55.493985 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:23:55.493996 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:23:55.494007 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:23:55.494074 | orchestrator | 2026-04-24 03:23:55.494091 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-24 03:23:55.494128 | orchestrator | Friday 24 April 2026 03:23:27 +0000 (0:00:01.104) 0:02:40.298 ********** 2026-04-24 03:23:55.494141 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:23:55.494153 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:23:55.494165 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:23:55.494177 | orchestrator | 2026-04-24 03:23:55.494189 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-24 03:23:55.494200 | orchestrator | 2026-04-24 03:23:55.494210 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 03:23:55.494221 | orchestrator | Friday 24 April 2026 03:23:27 +0000 (0:00:00.318) 0:02:40.617 ********** 2026-04-24 03:23:55.494231 | orchestrator | included: /ansible/roles/nova/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:23:55.494243 | orchestrator | 2026-04-24 03:23:55.494254 | orchestrator | TASK [service-ks-register : nova | Creating services] ************************** 2026-04-24 03:23:55.494264 | orchestrator | Friday 24 April 2026 03:23:28 +0000 (0:00:00.795) 0:02:41.412 ********** 2026-04-24 03:23:55.494275 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy (compute_legacy))  2026-04-24 03:23:55.494285 | orchestrator | changed: [testbed-node-0] => (item=nova (compute)) 2026-04-24 03:23:55.494296 | orchestrator | 2026-04-24 03:23:55.494307 | orchestrator | TASK [service-ks-register : nova | Creating endpoints] ************************* 2026-04-24 03:23:55.494318 | orchestrator | Friday 24 April 2026 03:23:31 +0000 (0:00:03.138) 0:02:44.551 ********** 2026-04-24 03:23:55.494329 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api-int.testbed.osism.xyz:8774/v2/%(tenant_id)s -> internal)  2026-04-24 03:23:55.494453 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api.testbed.osism.xyz:8774/v2/%(tenant_id)s -> public)  2026-04-24 03:23:55.494485 | orchestrator | changed: [testbed-node-0] => (item=nova -> https://api-int.testbed.osism.xyz:8774/v2.1 -> internal) 2026-04-24 03:23:55.494504 | orchestrator | changed: [testbed-node-0] => (item=nova -> https://api.testbed.osism.xyz:8774/v2.1 -> public) 2026-04-24 03:23:55.494525 | orchestrator | 2026-04-24 03:23:55.494544 | orchestrator | TASK [service-ks-register : nova | Creating projects] ************************** 2026-04-24 03:23:55.494565 | orchestrator | Friday 24 April 2026 03:23:37 +0000 (0:00:05.906) 0:02:50.457 ********** 2026-04-24 03:23:55.494587 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:23:55.494607 | orchestrator | 2026-04-24 03:23:55.494626 | orchestrator | TASK [service-ks-register : nova | Creating users] ***************************** 2026-04-24 03:23:55.494637 | orchestrator | Friday 24 April 2026 03:23:40 +0000 (0:00:02.948) 0:02:53.406 ********** 2026-04-24 03:23:55.494648 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:23:55.494659 | orchestrator | changed: [testbed-node-0] => (item=nova -> service) 2026-04-24 03:23:55.494669 | orchestrator | 2026-04-24 03:23:55.494680 | orchestrator | TASK [service-ks-register : nova | Creating roles] ***************************** 2026-04-24 03:23:55.494690 | orchestrator | Friday 24 April 2026 03:23:44 +0000 (0:00:03.675) 0:02:57.081 ********** 2026-04-24 03:23:55.494728 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:23:55.494739 | orchestrator | 2026-04-24 03:23:55.494750 | orchestrator | TASK [service-ks-register : nova | Granting user roles] ************************ 2026-04-24 03:23:55.494761 | orchestrator | Friday 24 April 2026 03:23:47 +0000 (0:00:02.966) 0:03:00.048 ********** 2026-04-24 03:23:55.494772 | orchestrator | changed: [testbed-node-0] => (item=nova -> service -> admin) 2026-04-24 03:23:55.494782 | orchestrator | changed: [testbed-node-0] => (item=nova -> service -> service) 2026-04-24 03:23:55.494793 | orchestrator | 2026-04-24 03:23:55.494810 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-24 03:23:55.494843 | orchestrator | Friday 24 April 2026 03:23:54 +0000 (0:00:06.963) 0:03:07.012 ********** 2026-04-24 03:23:55.494861 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:23:55.494893 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:23:55.494906 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:23:55.494933 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:00.004902 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:00.005021 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:00.005035 | orchestrator | 2026-04-24 03:24:00.005045 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-24 03:24:00.005054 | orchestrator | Friday 24 April 2026 03:23:55 +0000 (0:00:01.256) 0:03:08.269 ********** 2026-04-24 03:24:00.005061 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:00.005069 | orchestrator | 2026-04-24 03:24:00.005076 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-24 03:24:00.005082 | orchestrator | Friday 24 April 2026 03:23:55 +0000 (0:00:00.140) 0:03:08.409 ********** 2026-04-24 03:24:00.005089 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:00.005095 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:00.005102 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:00.005109 | orchestrator | 2026-04-24 03:24:00.005115 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-24 03:24:00.005122 | orchestrator | Friday 24 April 2026 03:23:55 +0000 (0:00:00.294) 0:03:08.704 ********** 2026-04-24 03:24:00.005129 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:24:00.005135 | orchestrator | 2026-04-24 03:24:00.005142 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-24 03:24:00.005149 | orchestrator | Friday 24 April 2026 03:23:56 +0000 (0:00:00.690) 0:03:09.394 ********** 2026-04-24 03:24:00.005155 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:00.005162 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:00.005168 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:00.005175 | orchestrator | 2026-04-24 03:24:00.005182 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 03:24:00.005188 | orchestrator | Friday 24 April 2026 03:23:57 +0000 (0:00:00.538) 0:03:09.932 ********** 2026-04-24 03:24:00.005196 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:24:00.005204 | orchestrator | 2026-04-24 03:24:00.005211 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-24 03:24:00.005217 | orchestrator | Friday 24 April 2026 03:23:57 +0000 (0:00:00.595) 0:03:10.528 ********** 2026-04-24 03:24:00.005242 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:00.005289 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:00.005298 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:00.005306 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:00.005314 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:00.005330 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:00.005338 | orchestrator | 2026-04-24 03:24:00.005349 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-24 03:24:01.658600 | orchestrator | Friday 24 April 2026 03:23:59 +0000 (0:00:02.249) 0:03:12.777 ********** 2026-04-24 03:24:01.658826 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:01.658872 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:01.658897 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:01.658919 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:01.658989 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:01.659012 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:01.659058 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:01.659081 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:01.659101 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:01.659121 | orchestrator | 2026-04-24 03:24:01.659141 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-24 03:24:01.659162 | orchestrator | Friday 24 April 2026 03:24:00 +0000 (0:00:00.858) 0:03:13.636 ********** 2026-04-24 03:24:01.659180 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:01.659213 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:01.659233 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:01.659278 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:03.853992 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:03.854163 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:03.854184 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:03.854224 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:03.854237 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:03.854249 | orchestrator | 2026-04-24 03:24:03.854261 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-24 03:24:03.854273 | orchestrator | Friday 24 April 2026 03:24:01 +0000 (0:00:00.799) 0:03:14.435 ********** 2026-04-24 03:24:03.854303 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:03.854351 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:03.854377 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:03.854414 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:03.854428 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:03.854448 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:10.049799 | orchestrator | 2026-04-24 03:24:10.049879 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-24 03:24:10.049887 | orchestrator | Friday 24 April 2026 03:24:03 +0000 (0:00:02.194) 0:03:16.630 ********** 2026-04-24 03:24:10.049895 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:10.049915 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:10.049929 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:10.049945 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:10.049951 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:10.049959 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:10.049963 | orchestrator | 2026-04-24 03:24:10.049967 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-24 03:24:10.049971 | orchestrator | Friday 24 April 2026 03:24:09 +0000 (0:00:05.610) 0:03:22.240 ********** 2026-04-24 03:24:10.049978 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:10.049982 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:10.049986 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:10.049996 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:14.255301 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:14.255404 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:14.255423 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-24 03:24:14.255454 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:24:14.255467 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:14.255479 | orchestrator | 2026-04-24 03:24:14.255491 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-24 03:24:14.255504 | orchestrator | Friday 24 April 2026 03:24:10 +0000 (0:00:00.589) 0:03:22.830 ********** 2026-04-24 03:24:14.255515 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:24:14.255526 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:24:14.255536 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:24:14.255547 | orchestrator | 2026-04-24 03:24:14.255558 | orchestrator | TASK [nova : Copying over vendordata file] ************************************* 2026-04-24 03:24:14.255569 | orchestrator | Friday 24 April 2026 03:24:11 +0000 (0:00:01.501) 0:03:24.332 ********** 2026-04-24 03:24:14.255580 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:14.255591 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:14.255601 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:14.255612 | orchestrator | 2026-04-24 03:24:14.255623 | orchestrator | TASK [nova : Check nova containers] ******************************************** 2026-04-24 03:24:14.255634 | orchestrator | Friday 24 April 2026 03:24:11 +0000 (0:00:00.332) 0:03:24.664 ********** 2026-04-24 03:24:14.255689 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:14.255704 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:14.255775 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-24 03:24:14.255788 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:14.255809 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:14.255829 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:53.439670 | orchestrator | 2026-04-24 03:24:53.439869 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 03:24:53.439895 | orchestrator | Friday 24 April 2026 03:24:13 +0000 (0:00:01.917) 0:03:26.582 ********** 2026-04-24 03:24:53.439912 | orchestrator | 2026-04-24 03:24:53.439929 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 03:24:53.439945 | orchestrator | Friday 24 April 2026 03:24:13 +0000 (0:00:00.143) 0:03:26.726 ********** 2026-04-24 03:24:53.439961 | orchestrator | 2026-04-24 03:24:53.439977 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 03:24:53.439993 | orchestrator | Friday 24 April 2026 03:24:14 +0000 (0:00:00.140) 0:03:26.866 ********** 2026-04-24 03:24:53.440006 | orchestrator | 2026-04-24 03:24:53.440015 | orchestrator | RUNNING HANDLER [nova : Restart nova-scheduler container] ********************** 2026-04-24 03:24:53.440024 | orchestrator | Friday 24 April 2026 03:24:14 +0000 (0:00:00.154) 0:03:27.021 ********** 2026-04-24 03:24:53.440033 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:24:53.440096 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:24:53.440107 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:24:53.440116 | orchestrator | 2026-04-24 03:24:53.440125 | orchestrator | RUNNING HANDLER [nova : Restart nova-api container] **************************** 2026-04-24 03:24:53.440134 | orchestrator | Friday 24 April 2026 03:24:31 +0000 (0:00:17.712) 0:03:44.733 ********** 2026-04-24 03:24:53.440143 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:24:53.440151 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:24:53.440160 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:24:53.440168 | orchestrator | 2026-04-24 03:24:53.440177 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-24 03:24:53.440186 | orchestrator | 2026-04-24 03:24:53.440194 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 03:24:53.440203 | orchestrator | Friday 24 April 2026 03:24:41 +0000 (0:00:09.986) 0:03:54.720 ********** 2026-04-24 03:24:53.440213 | orchestrator | included: /ansible/roles/nova-cell/tasks/deploy.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:24:53.440223 | orchestrator | 2026-04-24 03:24:53.440247 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 03:24:53.440256 | orchestrator | Friday 24 April 2026 03:24:43 +0000 (0:00:01.202) 0:03:55.923 ********** 2026-04-24 03:24:53.440265 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:24:53.440294 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:24:53.440303 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:24:53.440312 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:53.440321 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:53.440329 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:53.440338 | orchestrator | 2026-04-24 03:24:53.440346 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-24 03:24:53.440355 | orchestrator | Friday 24 April 2026 03:24:43 +0000 (0:00:00.772) 0:03:56.696 ********** 2026-04-24 03:24:53.440364 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:53.440372 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:53.440380 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:53.440389 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:24:53.440398 | orchestrator | 2026-04-24 03:24:53.440407 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-24 03:24:53.440415 | orchestrator | Friday 24 April 2026 03:24:44 +0000 (0:00:00.857) 0:03:57.554 ********** 2026-04-24 03:24:53.440424 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-24 03:24:53.440433 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-24 03:24:53.440442 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-24 03:24:53.440450 | orchestrator | 2026-04-24 03:24:53.440459 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-24 03:24:53.440467 | orchestrator | Friday 24 April 2026 03:24:45 +0000 (0:00:00.862) 0:03:58.416 ********** 2026-04-24 03:24:53.440476 | orchestrator | changed: [testbed-node-3] => (item=br_netfilter) 2026-04-24 03:24:53.440484 | orchestrator | changed: [testbed-node-4] => (item=br_netfilter) 2026-04-24 03:24:53.440493 | orchestrator | changed: [testbed-node-5] => (item=br_netfilter) 2026-04-24 03:24:53.440501 | orchestrator | 2026-04-24 03:24:53.440510 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-24 03:24:53.440519 | orchestrator | Friday 24 April 2026 03:24:46 +0000 (0:00:01.223) 0:03:59.640 ********** 2026-04-24 03:24:53.440527 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-24 03:24:53.440536 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:24:53.440544 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-24 03:24:53.440553 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:24:53.440561 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-24 03:24:53.440570 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:24:53.440578 | orchestrator | 2026-04-24 03:24:53.440586 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-24 03:24:53.440595 | orchestrator | Friday 24 April 2026 03:24:47 +0000 (0:00:00.612) 0:04:00.252 ********** 2026-04-24 03:24:53.440604 | orchestrator | changed: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 03:24:53.440612 | orchestrator | changed: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 03:24:53.440621 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 03:24:53.440629 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 03:24:53.440638 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:53.440646 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 03:24:53.440655 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 03:24:53.440663 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:53.440689 | orchestrator | changed: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 03:24:53.440698 | orchestrator | changed: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 03:24:53.440707 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 03:24:53.440722 | orchestrator | changed: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 03:24:53.440748 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 03:24:53.440757 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:53.440766 | orchestrator | changed: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 03:24:53.440774 | orchestrator | 2026-04-24 03:24:53.440783 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-24 03:24:53.440792 | orchestrator | Friday 24 April 2026 03:24:48 +0000 (0:00:01.296) 0:04:01.549 ********** 2026-04-24 03:24:53.440800 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:53.440809 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:53.440817 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:53.440825 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:24:53.440834 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:24:53.440842 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:24:53.440851 | orchestrator | 2026-04-24 03:24:53.440859 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-24 03:24:53.440868 | orchestrator | Friday 24 April 2026 03:24:49 +0000 (0:00:01.095) 0:04:02.644 ********** 2026-04-24 03:24:53.440876 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:24:53.440885 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:24:53.440893 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:24:53.440902 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:24:53.440910 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:24:53.440919 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:24:53.440927 | orchestrator | 2026-04-24 03:24:53.440936 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-24 03:24:53.440944 | orchestrator | Friday 24 April 2026 03:24:51 +0000 (0:00:01.702) 0:04:04.346 ********** 2026-04-24 03:24:53.440961 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:24:53.440976 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:24:53.440992 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282411 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282514 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282547 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282561 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282574 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282585 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282637 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282651 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282667 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282679 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282690 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282702 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:55.282721 | orchestrator | 2026-04-24 03:24:55.282801 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 03:24:55.282815 | orchestrator | Friday 24 April 2026 03:24:53 +0000 (0:00:02.407) 0:04:06.753 ********** 2026-04-24 03:24:55.282826 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:24:55.282839 | orchestrator | 2026-04-24 03:24:55.282851 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-24 03:24:55.282869 | orchestrator | Friday 24 April 2026 03:24:55 +0000 (0:00:01.307) 0:04:08.061 ********** 2026-04-24 03:24:58.588125 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588255 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588273 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588287 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588323 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588353 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588367 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588385 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588398 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588409 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588429 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588440 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:24:58.588461 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:00.215451 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:00.215559 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:00.215575 | orchestrator | 2026-04-24 03:25:00.215589 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-24 03:25:00.215601 | orchestrator | Friday 24 April 2026 03:24:58 +0000 (0:00:03.665) 0:04:11.727 ********** 2026-04-24 03:25:00.215637 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:00.215651 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:00.215664 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:00.215676 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:00.215711 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:00.215725 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:00.215794 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:00.215815 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:00.215826 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:00.215838 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:00.215860 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:02.042991 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:02.043116 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:25:02.043136 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:25:02.043171 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:02.043183 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:25:02.043196 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:25:02.043208 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:25:02.043220 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:25:02.043231 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:02.043242 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:02.043254 | orchestrator | 2026-04-24 03:25:02.043266 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-24 03:25:02.043279 | orchestrator | Friday 24 April 2026 03:25:00 +0000 (0:00:01.520) 0:04:13.247 ********** 2026-04-24 03:25:02.043315 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:02.043337 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:02.043350 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:02.043362 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:02.043374 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:02.043386 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:02.043411 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:08.982394 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:08.982532 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:08.982553 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:08.983381 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:08.983468 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:08.983497 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:25:08.983521 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:25:08.983542 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:08.983597 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:25:08.983635 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:25:08.983648 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:25:08.983660 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:25:08.983671 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:08.983683 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:08.983694 | orchestrator | 2026-04-24 03:25:08.983705 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 03:25:08.983717 | orchestrator | Friday 24 April 2026 03:25:02 +0000 (0:00:02.255) 0:04:15.503 ********** 2026-04-24 03:25:08.983728 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:08.983780 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:08.983792 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:08.983803 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:25:08.983814 | orchestrator | 2026-04-24 03:25:08.983826 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-24 03:25:08.983837 | orchestrator | Friday 24 April 2026 03:25:03 +0000 (0:00:00.891) 0:04:16.395 ********** 2026-04-24 03:25:08.983847 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:25:08.983858 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 03:25:08.983870 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 03:25:08.983881 | orchestrator | 2026-04-24 03:25:08.983892 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-24 03:25:08.983903 | orchestrator | Friday 24 April 2026 03:25:04 +0000 (0:00:01.186) 0:04:17.581 ********** 2026-04-24 03:25:08.983914 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:25:08.983925 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 03:25:08.983935 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 03:25:08.983946 | orchestrator | 2026-04-24 03:25:08.983957 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-24 03:25:08.983979 | orchestrator | Friday 24 April 2026 03:25:05 +0000 (0:00:00.877) 0:04:18.459 ********** 2026-04-24 03:25:08.983991 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:25:08.984002 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:25:08.984013 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:25:08.984023 | orchestrator | 2026-04-24 03:25:08.984034 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-24 03:25:08.984045 | orchestrator | Friday 24 April 2026 03:25:06 +0000 (0:00:00.473) 0:04:18.932 ********** 2026-04-24 03:25:08.984056 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:25:08.984067 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:25:08.984078 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:25:08.984088 | orchestrator | 2026-04-24 03:25:08.984099 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-24 03:25:08.984110 | orchestrator | Friday 24 April 2026 03:25:06 +0000 (0:00:00.457) 0:04:19.390 ********** 2026-04-24 03:25:08.984121 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-24 03:25:08.984132 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-24 03:25:08.984143 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-24 03:25:08.984154 | orchestrator | 2026-04-24 03:25:08.984171 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-24 03:25:08.984182 | orchestrator | Friday 24 April 2026 03:25:07 +0000 (0:00:01.228) 0:04:20.618 ********** 2026-04-24 03:25:08.984193 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-24 03:25:08.984204 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-24 03:25:08.984224 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-24 03:25:27.004143 | orchestrator | 2026-04-24 03:25:27.004258 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-24 03:25:27.004274 | orchestrator | Friday 24 April 2026 03:25:08 +0000 (0:00:01.141) 0:04:21.759 ********** 2026-04-24 03:25:27.004286 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-24 03:25:27.004298 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-24 03:25:27.004309 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-24 03:25:27.004320 | orchestrator | changed: [testbed-node-3] => (item=nova-libvirt) 2026-04-24 03:25:27.004331 | orchestrator | changed: [testbed-node-4] => (item=nova-libvirt) 2026-04-24 03:25:27.004342 | orchestrator | changed: [testbed-node-5] => (item=nova-libvirt) 2026-04-24 03:25:27.004353 | orchestrator | 2026-04-24 03:25:27.004364 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-24 03:25:27.004375 | orchestrator | Friday 24 April 2026 03:25:12 +0000 (0:00:03.465) 0:04:25.225 ********** 2026-04-24 03:25:27.004386 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:27.004397 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:27.004408 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:27.004418 | orchestrator | 2026-04-24 03:25:27.004429 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-24 03:25:27.004440 | orchestrator | Friday 24 April 2026 03:25:12 +0000 (0:00:00.331) 0:04:25.557 ********** 2026-04-24 03:25:27.004451 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:27.004461 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:27.004472 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:27.004483 | orchestrator | 2026-04-24 03:25:27.004494 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-24 03:25:27.004505 | orchestrator | Friday 24 April 2026 03:25:13 +0000 (0:00:00.574) 0:04:26.132 ********** 2026-04-24 03:25:27.004516 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:25:27.004526 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:25:27.004537 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:25:27.004548 | orchestrator | 2026-04-24 03:25:27.004558 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-24 03:25:27.004591 | orchestrator | Friday 24 April 2026 03:25:14 +0000 (0:00:01.223) 0:04:27.356 ********** 2026-04-24 03:25:27.004602 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-24 03:25:27.004614 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-24 03:25:27.004625 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-24 03:25:27.004635 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-24 03:25:27.004646 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-24 03:25:27.004657 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-24 03:25:27.004668 | orchestrator | 2026-04-24 03:25:27.004681 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-24 03:25:27.004694 | orchestrator | Friday 24 April 2026 03:25:17 +0000 (0:00:03.336) 0:04:30.692 ********** 2026-04-24 03:25:27.004706 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-24 03:25:27.004719 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-24 03:25:27.004731 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-24 03:25:27.004799 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-24 03:25:27.004813 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:25:27.004824 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-24 03:25:27.004836 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:25:27.004849 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-24 03:25:27.004861 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:25:27.004872 | orchestrator | 2026-04-24 03:25:27.004884 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-24 03:25:27.004896 | orchestrator | Friday 24 April 2026 03:25:21 +0000 (0:00:03.402) 0:04:34.094 ********** 2026-04-24 03:25:27.004909 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:27.004921 | orchestrator | 2026-04-24 03:25:27.004949 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-24 03:25:27.004963 | orchestrator | Friday 24 April 2026 03:25:21 +0000 (0:00:00.144) 0:04:34.239 ********** 2026-04-24 03:25:27.004975 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:27.004987 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:27.004999 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:27.005012 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:27.005024 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:27.005036 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:27.005046 | orchestrator | 2026-04-24 03:25:27.005057 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-24 03:25:27.005068 | orchestrator | Friday 24 April 2026 03:25:22 +0000 (0:00:00.858) 0:04:35.098 ********** 2026-04-24 03:25:27.005079 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:25:27.005089 | orchestrator | 2026-04-24 03:25:27.005116 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-24 03:25:27.005127 | orchestrator | Friday 24 April 2026 03:25:23 +0000 (0:00:00.762) 0:04:35.860 ********** 2026-04-24 03:25:27.005138 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:27.005149 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:27.005160 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:27.005170 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:27.005198 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:27.005210 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:27.005221 | orchestrator | 2026-04-24 03:25:27.005232 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-24 03:25:27.005251 | orchestrator | Friday 24 April 2026 03:25:23 +0000 (0:00:00.805) 0:04:36.665 ********** 2026-04-24 03:25:27.005265 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:25:27.005280 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:25:27.005292 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:25:27.005305 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:25:27.005330 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:25:31.864844 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:25:31.864962 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:25:31.864981 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:25:31.864992 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:25:31.865004 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:31.865016 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:31.865062 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:31.865100 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:31.865114 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:31.865125 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:31.865137 | orchestrator | 2026-04-24 03:25:31.865149 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-24 03:25:31.865162 | orchestrator | Friday 24 April 2026 03:25:27 +0000 (0:00:03.524) 0:04:40.190 ********** 2026-04-24 03:25:31.865174 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:31.865191 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:31.865219 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:34.082203 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:34.082309 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:34.082326 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:34.082340 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082389 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082421 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082435 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082447 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082459 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082471 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082499 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082511 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:25:34.082523 | orchestrator | 2026-04-24 03:25:34.082537 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-24 03:25:34.082556 | orchestrator | Friday 24 April 2026 03:25:34 +0000 (0:00:06.665) 0:04:46.855 ********** 2026-04-24 03:25:56.188717 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:56.188911 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:56.188931 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:56.188943 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:56.188955 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:56.188966 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:56.188978 | orchestrator | 2026-04-24 03:25:56.188990 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-24 03:25:56.189066 | orchestrator | Friday 24 April 2026 03:25:35 +0000 (0:00:01.387) 0:04:48.242 ********** 2026-04-24 03:25:56.189081 | orchestrator | changed: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 03:25:56.189094 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 03:25:56.189105 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 03:25:56.189116 | orchestrator | changed: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 03:25:56.189127 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 03:25:56.189138 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 03:25:56.189150 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:56.189161 | orchestrator | changed: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 03:25:56.189172 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 03:25:56.189183 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:56.189194 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 03:25:56.189205 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:56.189216 | orchestrator | changed: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 03:25:56.189249 | orchestrator | changed: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 03:25:56.189262 | orchestrator | changed: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 03:25:56.189276 | orchestrator | 2026-04-24 03:25:56.189289 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-24 03:25:56.189302 | orchestrator | Friday 24 April 2026 03:25:39 +0000 (0:00:03.790) 0:04:52.032 ********** 2026-04-24 03:25:56.189314 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:56.189326 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:56.189338 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:56.189351 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:56.189362 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:56.189375 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:56.189387 | orchestrator | 2026-04-24 03:25:56.189399 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-24 03:25:56.189412 | orchestrator | Friday 24 April 2026 03:25:39 +0000 (0:00:00.671) 0:04:52.703 ********** 2026-04-24 03:25:56.189428 | orchestrator | changed: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 03:25:56.189449 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 03:25:56.189472 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 03:25:56.189499 | orchestrator | changed: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 03:25:56.189518 | orchestrator | changed: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 03:25:56.189556 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 03:25:56.189574 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 03:25:56.189593 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 03:25:56.189612 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 03:25:56.189631 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 03:25:56.189648 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:56.189667 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 03:25:56.189684 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:56.189703 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 03:25:56.189721 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:56.189739 | orchestrator | changed: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 03:25:56.189787 | orchestrator | changed: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 03:25:56.189830 | orchestrator | changed: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 03:25:56.189851 | orchestrator | changed: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 03:25:56.189868 | orchestrator | changed: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 03:25:56.189886 | orchestrator | changed: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 03:25:56.189905 | orchestrator | 2026-04-24 03:25:56.189924 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-24 03:25:56.189958 | orchestrator | Friday 24 April 2026 03:25:45 +0000 (0:00:05.348) 0:04:58.052 ********** 2026-04-24 03:25:56.189978 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 03:25:56.189996 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 03:25:56.190015 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 03:25:56.190093 | orchestrator | changed: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 03:25:56.190114 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 03:25:56.190133 | orchestrator | changed: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 03:25:56.190154 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 03:25:56.190174 | orchestrator | changed: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 03:25:56.190195 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 03:25:56.190214 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 03:25:56.190234 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 03:25:56.190254 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 03:25:56.190273 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 03:25:56.190293 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:56.190313 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 03:25:56.190332 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:56.190352 | orchestrator | changed: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 03:25:56.190370 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 03:25:56.190387 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:56.190404 | orchestrator | changed: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 03:25:56.190422 | orchestrator | changed: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 03:25:56.190441 | orchestrator | changed: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 03:25:56.190459 | orchestrator | changed: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 03:25:56.190475 | orchestrator | changed: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 03:25:56.190491 | orchestrator | changed: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 03:25:56.190507 | orchestrator | changed: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 03:25:56.190536 | orchestrator | changed: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 03:25:56.190554 | orchestrator | 2026-04-24 03:25:56.190571 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-24 03:25:56.190589 | orchestrator | Friday 24 April 2026 03:25:52 +0000 (0:00:07.095) 0:05:05.148 ********** 2026-04-24 03:25:56.190606 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:56.190624 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:56.190642 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:56.190660 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:56.190677 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:56.190695 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:56.190715 | orchestrator | 2026-04-24 03:25:56.190734 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-24 03:25:56.190797 | orchestrator | Friday 24 April 2026 03:25:53 +0000 (0:00:00.882) 0:05:06.031 ********** 2026-04-24 03:25:56.190818 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:56.190836 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:56.190853 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:56.190869 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:56.190885 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:56.190903 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:56.190921 | orchestrator | 2026-04-24 03:25:56.190936 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-24 03:25:56.190953 | orchestrator | Friday 24 April 2026 03:25:53 +0000 (0:00:00.688) 0:05:06.719 ********** 2026-04-24 03:25:56.190970 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:25:56.190985 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:25:56.191003 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:25:56.191019 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:25:56.191037 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:25:56.191055 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:25:56.191073 | orchestrator | 2026-04-24 03:25:56.191111 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-24 03:25:57.509987 | orchestrator | Friday 24 April 2026 03:25:56 +0000 (0:00:02.233) 0:05:08.953 ********** 2026-04-24 03:25:57.510149 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:57.510172 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:57.510187 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:57.510199 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:25:57.510229 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:57.510279 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:57.510311 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 03:25:57.510324 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:57.510367 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 03:25:57.510379 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:25:57.510396 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 03:25:57.510416 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:25:57.510429 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:25:57.510449 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:26:00.903892 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:26:00.904001 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:26:00.904020 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:26:00.904033 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 03:26:00.904045 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 03:26:00.904082 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:26:00.904094 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:26:00.904106 | orchestrator | 2026-04-24 03:26:00.904118 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-24 03:26:00.904131 | orchestrator | Friday 24 April 2026 03:25:57 +0000 (0:00:01.419) 0:05:10.373 ********** 2026-04-24 03:26:00.904156 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-24 03:26:00.904176 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-24 03:26:00.904201 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:26:00.904227 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-24 03:26:00.904244 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-24 03:26:00.904261 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:26:00.904279 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-24 03:26:00.904296 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-24 03:26:00.904314 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:26:00.904332 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-24 03:26:00.904350 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-24 03:26:00.904368 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:26:00.904388 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-24 03:26:00.904408 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-24 03:26:00.904428 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:26:00.904447 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-24 03:26:00.904468 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-24 03:26:00.904488 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:26:00.904505 | orchestrator | 2026-04-24 03:26:00.904520 | orchestrator | TASK [nova-cell : Check nova-cell containers] ********************************** 2026-04-24 03:26:00.904533 | orchestrator | Friday 24 April 2026 03:25:58 +0000 (0:00:00.937) 0:05:11.310 ********** 2026-04-24 03:26:00.904567 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:26:00.904583 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:26:00.904609 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 03:26:00.904630 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:26:00.904644 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:26:00.904665 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511303 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511425 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511469 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511485 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511516 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511531 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511564 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511581 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511605 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 03:26:49.511619 | orchestrator | 2026-04-24 03:26:49.511634 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 03:26:49.511649 | orchestrator | Friday 24 April 2026 03:26:01 +0000 (0:00:02.646) 0:05:13.956 ********** 2026-04-24 03:26:49.511662 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:26:49.511675 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:26:49.511687 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:26:49.511700 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:26:49.511711 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:26:49.511723 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:26:49.511737 | orchestrator | 2026-04-24 03:26:49.511750 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 03:26:49.511803 | orchestrator | Friday 24 April 2026 03:26:01 +0000 (0:00:00.818) 0:05:14.775 ********** 2026-04-24 03:26:49.511816 | orchestrator | 2026-04-24 03:26:49.511829 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 03:26:49.511850 | orchestrator | Friday 24 April 2026 03:26:02 +0000 (0:00:00.142) 0:05:14.917 ********** 2026-04-24 03:26:49.511864 | orchestrator | 2026-04-24 03:26:49.511877 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 03:26:49.511890 | orchestrator | Friday 24 April 2026 03:26:02 +0000 (0:00:00.139) 0:05:15.057 ********** 2026-04-24 03:26:49.511902 | orchestrator | 2026-04-24 03:26:49.511915 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 03:26:49.511929 | orchestrator | Friday 24 April 2026 03:26:02 +0000 (0:00:00.171) 0:05:15.228 ********** 2026-04-24 03:26:49.511942 | orchestrator | 2026-04-24 03:26:49.511956 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 03:26:49.511968 | orchestrator | Friday 24 April 2026 03:26:02 +0000 (0:00:00.143) 0:05:15.371 ********** 2026-04-24 03:26:49.511979 | orchestrator | 2026-04-24 03:26:49.511991 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 03:26:49.512004 | orchestrator | Friday 24 April 2026 03:26:02 +0000 (0:00:00.306) 0:05:15.678 ********** 2026-04-24 03:26:49.512017 | orchestrator | 2026-04-24 03:26:49.512030 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-conductor container] ***************** 2026-04-24 03:26:49.512042 | orchestrator | Friday 24 April 2026 03:26:03 +0000 (0:00:00.139) 0:05:15.818 ********** 2026-04-24 03:26:49.512055 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:26:49.512067 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:26:49.512080 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:26:49.512093 | orchestrator | 2026-04-24 03:26:49.512106 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-novncproxy container] **************** 2026-04-24 03:26:49.512119 | orchestrator | Friday 24 April 2026 03:26:14 +0000 (0:00:11.517) 0:05:27.335 ********** 2026-04-24 03:26:49.512132 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:26:49.512144 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:26:49.512157 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:26:49.512181 | orchestrator | 2026-04-24 03:26:49.512194 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-ssh container] *********************** 2026-04-24 03:26:49.512207 | orchestrator | Friday 24 April 2026 03:26:28 +0000 (0:00:14.339) 0:05:41.675 ********** 2026-04-24 03:26:49.512219 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:26:49.512232 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:26:49.512244 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:26:49.512256 | orchestrator | 2026-04-24 03:26:49.512270 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-libvirt container] ******************* 2026-04-24 03:29:04.391685 | orchestrator | Friday 24 April 2026 03:26:49 +0000 (0:00:20.601) 0:06:02.276 ********** 2026-04-24 03:29:04.391808 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:29:04.391875 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:29:04.391888 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:29:04.391899 | orchestrator | 2026-04-24 03:29:04.391911 | orchestrator | RUNNING HANDLER [nova-cell : Checking libvirt container is ready] ************** 2026-04-24 03:29:04.391922 | orchestrator | Friday 24 April 2026 03:27:32 +0000 (0:00:42.646) 0:06:44.922 ********** 2026-04-24 03:29:04.391933 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:29:04.391944 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:29:04.391955 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:29:04.391966 | orchestrator | 2026-04-24 03:29:04.391977 | orchestrator | RUNNING HANDLER [nova-cell : Create libvirt SASL user] ************************* 2026-04-24 03:29:04.391988 | orchestrator | Friday 24 April 2026 03:27:32 +0000 (0:00:00.774) 0:06:45.697 ********** 2026-04-24 03:29:04.391999 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:29:04.392010 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:29:04.392020 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:29:04.392031 | orchestrator | 2026-04-24 03:29:04.392042 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-compute container] ******************* 2026-04-24 03:29:04.392053 | orchestrator | Friday 24 April 2026 03:27:33 +0000 (0:00:00.779) 0:06:46.477 ********** 2026-04-24 03:29:04.392064 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:29:04.392075 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:29:04.392086 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:29:04.392097 | orchestrator | 2026-04-24 03:29:04.392108 | orchestrator | RUNNING HANDLER [nova-cell : Wait for nova-compute services to update service versions] *** 2026-04-24 03:29:04.392119 | orchestrator | Friday 24 April 2026 03:27:58 +0000 (0:00:25.240) 0:07:11.717 ********** 2026-04-24 03:29:04.392130 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:29:04.392141 | orchestrator | 2026-04-24 03:29:04.392152 | orchestrator | TASK [nova-cell : Waiting for nova-compute services to register themselves] **** 2026-04-24 03:29:04.392163 | orchestrator | Friday 24 April 2026 03:27:59 +0000 (0:00:00.131) 0:07:11.849 ********** 2026-04-24 03:29:04.392173 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:29:04.392184 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:29:04.392195 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:04.392206 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:04.392217 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:04.392231 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for nova-compute services to register themselves (20 retries left). 2026-04-24 03:29:04.392245 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:29:04.392258 | orchestrator | 2026-04-24 03:29:04.392271 | orchestrator | TASK [nova-cell : Fail if nova-compute service failed to register] ************* 2026-04-24 03:29:04.392283 | orchestrator | Friday 24 April 2026 03:28:20 +0000 (0:00:21.162) 0:07:33.011 ********** 2026-04-24 03:29:04.392295 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:04.392308 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:29:04.392320 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:04.392333 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:29:04.392345 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:29:04.392358 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:04.392395 | orchestrator | 2026-04-24 03:29:04.392408 | orchestrator | TASK [nova-cell : Include discover_computes.yml] ******************************* 2026-04-24 03:29:04.392421 | orchestrator | Friday 24 April 2026 03:28:29 +0000 (0:00:09.117) 0:07:42.129 ********** 2026-04-24 03:29:04.392434 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:29:04.392447 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:29:04.392459 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:04.392470 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:04.392482 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:04.392506 | orchestrator | included: /ansible/roles/nova-cell/tasks/discover_computes.yml for testbed-node-3 2026-04-24 03:29:04.392517 | orchestrator | 2026-04-24 03:29:04.392528 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-24 03:29:04.392539 | orchestrator | Friday 24 April 2026 03:28:32 +0000 (0:00:03.613) 0:07:45.743 ********** 2026-04-24 03:29:04.392550 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:29:04.392561 | orchestrator | 2026-04-24 03:29:04.392572 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-24 03:29:04.392582 | orchestrator | Friday 24 April 2026 03:28:45 +0000 (0:00:12.354) 0:07:58.097 ********** 2026-04-24 03:29:04.392593 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:29:04.392604 | orchestrator | 2026-04-24 03:29:04.392614 | orchestrator | TASK [nova-cell : Fail if cell settings not found] ***************************** 2026-04-24 03:29:04.392625 | orchestrator | Friday 24 April 2026 03:28:46 +0000 (0:00:01.467) 0:07:59.565 ********** 2026-04-24 03:29:04.392636 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:29:04.392647 | orchestrator | 2026-04-24 03:29:04.392657 | orchestrator | TASK [nova-cell : Discover nova hosts] ***************************************** 2026-04-24 03:29:04.392668 | orchestrator | Friday 24 April 2026 03:28:48 +0000 (0:00:01.624) 0:08:01.189 ********** 2026-04-24 03:29:04.392679 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 03:29:04.392689 | orchestrator | 2026-04-24 03:29:04.392700 | orchestrator | TASK [nova-cell : Remove old nova_libvirt_secrets container volume] ************ 2026-04-24 03:29:04.392711 | orchestrator | Friday 24 April 2026 03:28:58 +0000 (0:00:10.396) 0:08:11.586 ********** 2026-04-24 03:29:04.392722 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:29:04.392733 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:29:04.392743 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:29:04.392754 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:04.392765 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:04.392776 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:04.392786 | orchestrator | 2026-04-24 03:29:04.392797 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-24 03:29:04.392808 | orchestrator | 2026-04-24 03:29:04.392855 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-24 03:29:04.392883 | orchestrator | Friday 24 April 2026 03:29:00 +0000 (0:00:01.762) 0:08:13.348 ********** 2026-04-24 03:29:04.392894 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:29:04.392905 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:29:04.392916 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:29:04.392927 | orchestrator | 2026-04-24 03:29:04.392938 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-24 03:29:04.392948 | orchestrator | 2026-04-24 03:29:04.392959 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-24 03:29:04.392970 | orchestrator | Friday 24 April 2026 03:29:01 +0000 (0:00:00.950) 0:08:14.298 ********** 2026-04-24 03:29:04.392981 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:04.392992 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:04.393003 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:04.393020 | orchestrator | 2026-04-24 03:29:04.393038 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-24 03:29:04.393057 | orchestrator | 2026-04-24 03:29:04.393088 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-24 03:29:04.393121 | orchestrator | Friday 24 April 2026 03:29:02 +0000 (0:00:00.727) 0:08:15.026 ********** 2026-04-24 03:29:04.393141 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-24 03:29:04.393158 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-24 03:29:04.393176 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-24 03:29:04.393195 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-24 03:29:04.393213 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-24 03:29:04.393230 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-24 03:29:04.393241 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:29:04.393252 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-24 03:29:04.393263 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-24 03:29:04.393273 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-24 03:29:04.393284 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-24 03:29:04.393294 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-24 03:29:04.393305 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-24 03:29:04.393315 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:29:04.393326 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-24 03:29:04.393337 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-24 03:29:04.393347 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-24 03:29:04.393358 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-24 03:29:04.393368 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-24 03:29:04.393379 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-24 03:29:04.393389 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:29:04.393408 | orchestrator | skipping: [testbed-node-0] => (item=nova-conductor)  2026-04-24 03:29:04.393435 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-24 03:29:04.393454 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-24 03:29:04.393471 | orchestrator | skipping: [testbed-node-0] => (item=nova-novncproxy)  2026-04-24 03:29:04.393488 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-24 03:29:04.393506 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-24 03:29:04.393521 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:04.393537 | orchestrator | skipping: [testbed-node-1] => (item=nova-conductor)  2026-04-24 03:29:04.393565 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-24 03:29:04.393583 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-24 03:29:04.393603 | orchestrator | skipping: [testbed-node-1] => (item=nova-novncproxy)  2026-04-24 03:29:04.393622 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-24 03:29:04.393640 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-24 03:29:04.393656 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:04.393667 | orchestrator | skipping: [testbed-node-2] => (item=nova-conductor)  2026-04-24 03:29:04.393678 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-24 03:29:04.393689 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-24 03:29:04.393699 | orchestrator | skipping: [testbed-node-2] => (item=nova-novncproxy)  2026-04-24 03:29:04.393710 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-24 03:29:04.393721 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-24 03:29:04.393731 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:04.393742 | orchestrator | 2026-04-24 03:29:04.393753 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-24 03:29:04.393773 | orchestrator | 2026-04-24 03:29:04.393784 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-24 03:29:04.393795 | orchestrator | Friday 24 April 2026 03:29:03 +0000 (0:00:01.570) 0:08:16.596 ********** 2026-04-24 03:29:04.393806 | orchestrator | skipping: [testbed-node-0] => (item=nova-scheduler)  2026-04-24 03:29:04.393852 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-24 03:29:04.393865 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:04.393875 | orchestrator | skipping: [testbed-node-1] => (item=nova-scheduler)  2026-04-24 03:29:04.393886 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-24 03:29:04.393897 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:04.393907 | orchestrator | skipping: [testbed-node-2] => (item=nova-scheduler)  2026-04-24 03:29:04.393918 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-24 03:29:04.393929 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:04.393940 | orchestrator | 2026-04-24 03:29:04.393962 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-24 03:29:06.185010 | orchestrator | 2026-04-24 03:29:06.185104 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-24 03:29:06.185118 | orchestrator | Friday 24 April 2026 03:29:04 +0000 (0:00:00.568) 0:08:17.165 ********** 2026-04-24 03:29:06.185128 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:06.185138 | orchestrator | 2026-04-24 03:29:06.185148 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-24 03:29:06.185157 | orchestrator | 2026-04-24 03:29:06.185166 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-24 03:29:06.185175 | orchestrator | Friday 24 April 2026 03:29:05 +0000 (0:00:00.901) 0:08:18.067 ********** 2026-04-24 03:29:06.185183 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:06.185192 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:06.185201 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:06.185209 | orchestrator | 2026-04-24 03:29:06.185218 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:29:06.185227 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:29:06.185238 | orchestrator | testbed-node-0 : ok=54  changed=35  unreachable=0 failed=0 skipped=44  rescued=0 ignored=0 2026-04-24 03:29:06.185247 | orchestrator | testbed-node-1 : ok=27  changed=19  unreachable=0 failed=0 skipped=51  rescued=0 ignored=0 2026-04-24 03:29:06.185256 | orchestrator | testbed-node-2 : ok=27  changed=19  unreachable=0 failed=0 skipped=51  rescued=0 ignored=0 2026-04-24 03:29:06.185265 | orchestrator | testbed-node-3 : ok=43  changed=27  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-24 03:29:06.185273 | orchestrator | testbed-node-4 : ok=37  changed=27  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-24 03:29:06.185282 | orchestrator | testbed-node-5 : ok=37  changed=27  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-24 03:29:06.185290 | orchestrator | 2026-04-24 03:29:06.185299 | orchestrator | 2026-04-24 03:29:06.185307 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:29:06.185316 | orchestrator | Friday 24 April 2026 03:29:05 +0000 (0:00:00.478) 0:08:18.545 ********** 2026-04-24 03:29:06.185325 | orchestrator | =============================================================================== 2026-04-24 03:29:06.185334 | orchestrator | nova-cell : Restart nova-libvirt container ----------------------------- 42.65s 2026-04-24 03:29:06.185342 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 32.36s 2026-04-24 03:29:06.185377 | orchestrator | nova-cell : Restart nova-compute container ----------------------------- 25.24s 2026-04-24 03:29:06.185386 | orchestrator | nova-cell : Waiting for nova-compute services to register themselves --- 21.16s 2026-04-24 03:29:06.185411 | orchestrator | nova-cell : Restart nova-ssh container --------------------------------- 20.60s 2026-04-24 03:29:06.185429 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 20.57s 2026-04-24 03:29:06.185451 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 17.95s 2026-04-24 03:29:06.185461 | orchestrator | nova : Restart nova-scheduler container -------------------------------- 17.71s 2026-04-24 03:29:06.185469 | orchestrator | nova : Create cell0 mappings ------------------------------------------- 14.64s 2026-04-24 03:29:06.185478 | orchestrator | nova-cell : Restart nova-novncproxy container -------------------------- 14.34s 2026-04-24 03:29:06.185486 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 12.35s 2026-04-24 03:29:06.185495 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 12.07s 2026-04-24 03:29:06.185504 | orchestrator | nova-cell : Create cell ------------------------------------------------ 11.70s 2026-04-24 03:29:06.185512 | orchestrator | nova-cell : Restart nova-conductor container --------------------------- 11.52s 2026-04-24 03:29:06.185521 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 10.81s 2026-04-24 03:29:06.185529 | orchestrator | nova-cell : Discover nova hosts ---------------------------------------- 10.40s 2026-04-24 03:29:06.185538 | orchestrator | nova : Restart nova-api container --------------------------------------- 9.99s 2026-04-24 03:29:06.185547 | orchestrator | nova-cell : Fail if nova-compute service failed to register ------------- 9.12s 2026-04-24 03:29:06.185555 | orchestrator | service-rabbitmq : nova | Ensure RabbitMQ users exist ------------------- 7.44s 2026-04-24 03:29:06.185564 | orchestrator | nova-cell : Copying files for nova-ssh ---------------------------------- 7.10s 2026-04-24 03:29:08.551127 | orchestrator | 2026-04-24 03:29:08 | INFO  | Task 7f248ea9-786c-4134-afc7-c5de9d2631dc (horizon) was prepared for execution. 2026-04-24 03:29:08.551225 | orchestrator | 2026-04-24 03:29:08 | INFO  | It takes a moment until task 7f248ea9-786c-4134-afc7-c5de9d2631dc (horizon) has been started and output is visible here. 2026-04-24 03:29:15.937651 | orchestrator | 2026-04-24 03:29:15.937785 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:29:15.937803 | orchestrator | 2026-04-24 03:29:15.937816 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:29:15.937888 | orchestrator | Friday 24 April 2026 03:29:12 +0000 (0:00:00.262) 0:00:00.262 ********** 2026-04-24 03:29:15.937901 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:15.937913 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:15.937924 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:15.937935 | orchestrator | 2026-04-24 03:29:15.937946 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:29:15.937957 | orchestrator | Friday 24 April 2026 03:29:13 +0000 (0:00:00.311) 0:00:00.573 ********** 2026-04-24 03:29:15.937968 | orchestrator | ok: [testbed-node-0] => (item=enable_horizon_True) 2026-04-24 03:29:15.937980 | orchestrator | ok: [testbed-node-1] => (item=enable_horizon_True) 2026-04-24 03:29:15.937991 | orchestrator | ok: [testbed-node-2] => (item=enable_horizon_True) 2026-04-24 03:29:15.938002 | orchestrator | 2026-04-24 03:29:15.938013 | orchestrator | PLAY [Apply role horizon] ****************************************************** 2026-04-24 03:29:15.938084 | orchestrator | 2026-04-24 03:29:15.938095 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 03:29:15.938106 | orchestrator | Friday 24 April 2026 03:29:13 +0000 (0:00:00.444) 0:00:01.018 ********** 2026-04-24 03:29:15.938118 | orchestrator | included: /ansible/roles/horizon/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:29:15.938130 | orchestrator | 2026-04-24 03:29:15.938141 | orchestrator | TASK [horizon : Ensuring config directories exist] ***************************** 2026-04-24 03:29:15.938186 | orchestrator | Friday 24 April 2026 03:29:14 +0000 (0:00:00.573) 0:00:01.591 ********** 2026-04-24 03:29:15.938222 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:29:15.938264 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:29:15.938295 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:29:15.938310 | orchestrator | 2026-04-24 03:29:15.938324 | orchestrator | TASK [horizon : Set empty custom policy] *************************************** 2026-04-24 03:29:15.938336 | orchestrator | Friday 24 April 2026 03:29:15 +0000 (0:00:01.190) 0:00:02.782 ********** 2026-04-24 03:29:15.938348 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:15.938361 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:15.938373 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:15.938385 | orchestrator | 2026-04-24 03:29:15.938398 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 03:29:15.938410 | orchestrator | Friday 24 April 2026 03:29:15 +0000 (0:00:00.493) 0:00:03.275 ********** 2026-04-24 03:29:15.938428 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-24 03:29:22.084447 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-24 03:29:22.084537 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'ironic', 'enabled': False})  2026-04-24 03:29:22.084548 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'masakari', 'enabled': False})  2026-04-24 03:29:22.084557 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'mistral', 'enabled': False})  2026-04-24 03:29:22.084564 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'tacker', 'enabled': False})  2026-04-24 03:29:22.084572 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'trove', 'enabled': False})  2026-04-24 03:29:22.084600 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'watcher', 'enabled': False})  2026-04-24 03:29:22.084608 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-24 03:29:22.084615 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-24 03:29:22.084622 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'ironic', 'enabled': False})  2026-04-24 03:29:22.084630 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'masakari', 'enabled': False})  2026-04-24 03:29:22.084637 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'mistral', 'enabled': False})  2026-04-24 03:29:22.084644 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'tacker', 'enabled': False})  2026-04-24 03:29:22.084651 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'trove', 'enabled': False})  2026-04-24 03:29:22.084659 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'watcher', 'enabled': False})  2026-04-24 03:29:22.084666 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-24 03:29:22.084673 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-24 03:29:22.084680 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'ironic', 'enabled': False})  2026-04-24 03:29:22.084687 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'masakari', 'enabled': False})  2026-04-24 03:29:22.084695 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'mistral', 'enabled': False})  2026-04-24 03:29:22.084702 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'tacker', 'enabled': False})  2026-04-24 03:29:22.084709 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'trove', 'enabled': False})  2026-04-24 03:29:22.084716 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'watcher', 'enabled': False})  2026-04-24 03:29:22.084725 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'ceilometer', 'enabled': 'yes'}) 2026-04-24 03:29:22.084734 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'cinder', 'enabled': 'yes'}) 2026-04-24 03:29:22.084742 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'designate', 'enabled': True}) 2026-04-24 03:29:22.084773 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'glance', 'enabled': True}) 2026-04-24 03:29:22.084781 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'keystone', 'enabled': True}) 2026-04-24 03:29:22.084789 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'magnum', 'enabled': True}) 2026-04-24 03:29:22.084796 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'manila', 'enabled': True}) 2026-04-24 03:29:22.084804 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'neutron', 'enabled': True}) 2026-04-24 03:29:22.084811 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova', 'enabled': True}) 2026-04-24 03:29:22.084820 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'octavia', 'enabled': True}) 2026-04-24 03:29:22.084827 | orchestrator | 2026-04-24 03:29:22.084893 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:22.084910 | orchestrator | Friday 24 April 2026 03:29:16 +0000 (0:00:00.750) 0:00:04.026 ********** 2026-04-24 03:29:22.084918 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:22.084937 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:22.084945 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:22.084952 | orchestrator | 2026-04-24 03:29:22.084960 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:22.084975 | orchestrator | Friday 24 April 2026 03:29:16 +0000 (0:00:00.333) 0:00:04.359 ********** 2026-04-24 03:29:22.084983 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.084993 | orchestrator | 2026-04-24 03:29:22.085017 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:22.085026 | orchestrator | Friday 24 April 2026 03:29:17 +0000 (0:00:00.301) 0:00:04.660 ********** 2026-04-24 03:29:22.085034 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085042 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:22.085050 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:22.085059 | orchestrator | 2026-04-24 03:29:22.085067 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:22.085076 | orchestrator | Friday 24 April 2026 03:29:17 +0000 (0:00:00.319) 0:00:04.980 ********** 2026-04-24 03:29:22.085084 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:22.085092 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:22.085100 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:22.085108 | orchestrator | 2026-04-24 03:29:22.085117 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:22.085125 | orchestrator | Friday 24 April 2026 03:29:17 +0000 (0:00:00.321) 0:00:05.302 ********** 2026-04-24 03:29:22.085133 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085141 | orchestrator | 2026-04-24 03:29:22.085150 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:22.085158 | orchestrator | Friday 24 April 2026 03:29:17 +0000 (0:00:00.136) 0:00:05.438 ********** 2026-04-24 03:29:22.085166 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085175 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:22.085183 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:22.085191 | orchestrator | 2026-04-24 03:29:22.085200 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:22.085208 | orchestrator | Friday 24 April 2026 03:29:18 +0000 (0:00:00.290) 0:00:05.728 ********** 2026-04-24 03:29:22.085217 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:22.085225 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:22.085233 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:22.085241 | orchestrator | 2026-04-24 03:29:22.085249 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:22.085257 | orchestrator | Friday 24 April 2026 03:29:18 +0000 (0:00:00.603) 0:00:06.332 ********** 2026-04-24 03:29:22.085266 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085274 | orchestrator | 2026-04-24 03:29:22.085282 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:22.085290 | orchestrator | Friday 24 April 2026 03:29:19 +0000 (0:00:00.140) 0:00:06.472 ********** 2026-04-24 03:29:22.085299 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085307 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:22.085316 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:22.085327 | orchestrator | 2026-04-24 03:29:22.085339 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:22.085351 | orchestrator | Friday 24 April 2026 03:29:19 +0000 (0:00:00.348) 0:00:06.821 ********** 2026-04-24 03:29:22.085363 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:22.085375 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:22.085386 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:22.085399 | orchestrator | 2026-04-24 03:29:22.085411 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:22.085423 | orchestrator | Friday 24 April 2026 03:29:19 +0000 (0:00:00.316) 0:00:07.138 ********** 2026-04-24 03:29:22.085444 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085457 | orchestrator | 2026-04-24 03:29:22.085465 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:22.085472 | orchestrator | Friday 24 April 2026 03:29:19 +0000 (0:00:00.136) 0:00:07.275 ********** 2026-04-24 03:29:22.085480 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085487 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:22.085494 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:22.085501 | orchestrator | 2026-04-24 03:29:22.085508 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:22.085521 | orchestrator | Friday 24 April 2026 03:29:20 +0000 (0:00:00.526) 0:00:07.801 ********** 2026-04-24 03:29:22.085528 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:22.085536 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:22.085543 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:22.085550 | orchestrator | 2026-04-24 03:29:22.085557 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:22.085564 | orchestrator | Friday 24 April 2026 03:29:20 +0000 (0:00:00.322) 0:00:08.123 ********** 2026-04-24 03:29:22.085572 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085579 | orchestrator | 2026-04-24 03:29:22.085586 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:22.085593 | orchestrator | Friday 24 April 2026 03:29:20 +0000 (0:00:00.146) 0:00:08.270 ********** 2026-04-24 03:29:22.085600 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085608 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:22.085615 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:22.085622 | orchestrator | 2026-04-24 03:29:22.085629 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:22.085636 | orchestrator | Friday 24 April 2026 03:29:21 +0000 (0:00:00.310) 0:00:08.580 ********** 2026-04-24 03:29:22.085644 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:22.085651 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:22.085658 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:22.085665 | orchestrator | 2026-04-24 03:29:22.085672 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:22.085679 | orchestrator | Friday 24 April 2026 03:29:21 +0000 (0:00:00.303) 0:00:08.884 ********** 2026-04-24 03:29:22.085687 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085694 | orchestrator | 2026-04-24 03:29:22.085701 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:22.085708 | orchestrator | Friday 24 April 2026 03:29:21 +0000 (0:00:00.328) 0:00:09.212 ********** 2026-04-24 03:29:22.085715 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:22.085722 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:22.085730 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:22.085737 | orchestrator | 2026-04-24 03:29:22.085744 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:22.085758 | orchestrator | Friday 24 April 2026 03:29:22 +0000 (0:00:00.307) 0:00:09.520 ********** 2026-04-24 03:29:35.823349 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:35.823448 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:35.823457 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:35.823464 | orchestrator | 2026-04-24 03:29:35.823471 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:35.823479 | orchestrator | Friday 24 April 2026 03:29:22 +0000 (0:00:00.320) 0:00:09.841 ********** 2026-04-24 03:29:35.823485 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.823491 | orchestrator | 2026-04-24 03:29:35.823497 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:35.823503 | orchestrator | Friday 24 April 2026 03:29:22 +0000 (0:00:00.149) 0:00:09.990 ********** 2026-04-24 03:29:35.823508 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.823514 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:35.823536 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:35.823542 | orchestrator | 2026-04-24 03:29:35.823548 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:35.823554 | orchestrator | Friday 24 April 2026 03:29:22 +0000 (0:00:00.293) 0:00:10.284 ********** 2026-04-24 03:29:35.823560 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:35.823565 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:35.823570 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:35.823576 | orchestrator | 2026-04-24 03:29:35.823581 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:35.823587 | orchestrator | Friday 24 April 2026 03:29:23 +0000 (0:00:00.514) 0:00:10.799 ********** 2026-04-24 03:29:35.823592 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.823598 | orchestrator | 2026-04-24 03:29:35.823603 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:35.823608 | orchestrator | Friday 24 April 2026 03:29:23 +0000 (0:00:00.141) 0:00:10.940 ********** 2026-04-24 03:29:35.823614 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.823619 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:35.823624 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:35.823629 | orchestrator | 2026-04-24 03:29:35.823635 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:35.823640 | orchestrator | Friday 24 April 2026 03:29:23 +0000 (0:00:00.373) 0:00:11.314 ********** 2026-04-24 03:29:35.823645 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:35.823651 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:35.823656 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:35.823661 | orchestrator | 2026-04-24 03:29:35.823667 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:35.823672 | orchestrator | Friday 24 April 2026 03:29:24 +0000 (0:00:00.353) 0:00:11.668 ********** 2026-04-24 03:29:35.823677 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.823683 | orchestrator | 2026-04-24 03:29:35.823688 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:35.823693 | orchestrator | Friday 24 April 2026 03:29:24 +0000 (0:00:00.149) 0:00:11.817 ********** 2026-04-24 03:29:35.823699 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.823704 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:35.823709 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:35.823715 | orchestrator | 2026-04-24 03:29:35.823720 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 03:29:35.823726 | orchestrator | Friday 24 April 2026 03:29:24 +0000 (0:00:00.497) 0:00:12.314 ********** 2026-04-24 03:29:35.823731 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:29:35.823736 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:29:35.823741 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:29:35.823747 | orchestrator | 2026-04-24 03:29:35.823752 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 03:29:35.823758 | orchestrator | Friday 24 April 2026 03:29:25 +0000 (0:00:00.338) 0:00:12.653 ********** 2026-04-24 03:29:35.823763 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.823768 | orchestrator | 2026-04-24 03:29:35.823773 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 03:29:35.823789 | orchestrator | Friday 24 April 2026 03:29:25 +0000 (0:00:00.140) 0:00:12.793 ********** 2026-04-24 03:29:35.823795 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.823800 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:35.823805 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:35.823811 | orchestrator | 2026-04-24 03:29:35.823816 | orchestrator | TASK [horizon : Copying over config.json files for services] ******************* 2026-04-24 03:29:35.823821 | orchestrator | Friday 24 April 2026 03:29:25 +0000 (0:00:00.303) 0:00:13.097 ********** 2026-04-24 03:29:35.823827 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:29:35.823832 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:29:35.823838 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:29:35.823848 | orchestrator | 2026-04-24 03:29:35.823887 | orchestrator | TASK [horizon : Copying over horizon.conf] ************************************* 2026-04-24 03:29:35.823894 | orchestrator | Friday 24 April 2026 03:29:27 +0000 (0:00:01.826) 0:00:14.923 ********** 2026-04-24 03:29:35.823899 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-24 03:29:35.823905 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-24 03:29:35.823911 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-24 03:29:35.823916 | orchestrator | 2026-04-24 03:29:35.823923 | orchestrator | TASK [horizon : Copying over kolla-settings.py] ******************************** 2026-04-24 03:29:35.823929 | orchestrator | Friday 24 April 2026 03:29:29 +0000 (0:00:01.800) 0:00:16.723 ********** 2026-04-24 03:29:35.823935 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-24 03:29:35.823942 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-24 03:29:35.823948 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-24 03:29:35.823954 | orchestrator | 2026-04-24 03:29:35.823960 | orchestrator | TASK [horizon : Copying over custom-settings.py] ******************************* 2026-04-24 03:29:35.823977 | orchestrator | Friday 24 April 2026 03:29:31 +0000 (0:00:01.752) 0:00:18.476 ********** 2026-04-24 03:29:35.823984 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-24 03:29:35.823990 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-24 03:29:35.823997 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-24 03:29:35.824003 | orchestrator | 2026-04-24 03:29:35.824009 | orchestrator | TASK [horizon : Copying over existing policy file] ***************************** 2026-04-24 03:29:35.824015 | orchestrator | Friday 24 April 2026 03:29:32 +0000 (0:00:01.478) 0:00:19.955 ********** 2026-04-24 03:29:35.824021 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.824028 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:35.824033 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:35.824040 | orchestrator | 2026-04-24 03:29:35.824046 | orchestrator | TASK [horizon : Copying over custom themes] ************************************ 2026-04-24 03:29:35.824052 | orchestrator | Friday 24 April 2026 03:29:33 +0000 (0:00:00.517) 0:00:20.472 ********** 2026-04-24 03:29:35.824058 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:35.824064 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:35.824070 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:35.824076 | orchestrator | 2026-04-24 03:29:35.824082 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 03:29:35.824088 | orchestrator | Friday 24 April 2026 03:29:33 +0000 (0:00:00.313) 0:00:20.786 ********** 2026-04-24 03:29:35.824094 | orchestrator | included: /ansible/roles/horizon/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:29:35.824100 | orchestrator | 2026-04-24 03:29:35.824106 | orchestrator | TASK [service-cert-copy : horizon | Copying over extra CA certificates] ******** 2026-04-24 03:29:35.824113 | orchestrator | Friday 24 April 2026 03:29:33 +0000 (0:00:00.603) 0:00:21.389 ********** 2026-04-24 03:29:35.824128 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:29:35.824148 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:29:36.481924 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:29:36.482106 | orchestrator | 2026-04-24 03:29:36.482126 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS certificate] *** 2026-04-24 03:29:36.482139 | orchestrator | Friday 24 April 2026 03:29:35 +0000 (0:00:01.861) 0:00:23.250 ********** 2026-04-24 03:29:36.482172 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 03:29:36.482211 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:36.482233 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 03:29:36.482246 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:36.482266 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 03:29:38.966417 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:38.966521 | orchestrator | 2026-04-24 03:29:38.966538 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS key] ***** 2026-04-24 03:29:38.966551 | orchestrator | Friday 24 April 2026 03:29:36 +0000 (0:00:00.667) 0:00:23.918 ********** 2026-04-24 03:29:38.966585 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 03:29:38.966603 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:29:38.966636 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 03:29:38.966672 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:29:38.966685 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 03:29:38.966696 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:29:38.966707 | orchestrator | 2026-04-24 03:29:38.966719 | orchestrator | TASK [horizon : Deploy horizon container] ************************************** 2026-04-24 03:29:38.966848 | orchestrator | Friday 24 April 2026 03:29:37 +0000 (0:00:00.920) 0:00:24.839 ********** 2026-04-24 03:29:38.966993 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:30:23.674687 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:30:23.674855 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 03:30:23.674874 | orchestrator | 2026-04-24 03:30:23.674887 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 03:30:23.674899 | orchestrator | Friday 24 April 2026 03:29:38 +0000 (0:00:01.561) 0:00:26.401 ********** 2026-04-24 03:30:23.674909 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:30:23.674919 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:30:23.674928 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:30:23.674981 | orchestrator | 2026-04-24 03:30:23.674992 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 03:30:23.675001 | orchestrator | Friday 24 April 2026 03:29:39 +0000 (0:00:00.346) 0:00:26.747 ********** 2026-04-24 03:30:23.675012 | orchestrator | included: /ansible/roles/horizon/tasks/bootstrap.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:30:23.675022 | orchestrator | 2026-04-24 03:30:23.675031 | orchestrator | TASK [horizon : Creating Horizon database] ************************************* 2026-04-24 03:30:23.675041 | orchestrator | Friday 24 April 2026 03:29:39 +0000 (0:00:00.556) 0:00:27.304 ********** 2026-04-24 03:30:23.675050 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:30:23.675060 | orchestrator | 2026-04-24 03:30:23.675069 | orchestrator | TASK [horizon : Creating Horizon database user and setting permissions] ******** 2026-04-24 03:30:23.675090 | orchestrator | Friday 24 April 2026 03:29:41 +0000 (0:00:02.112) 0:00:29.416 ********** 2026-04-24 03:30:23.675110 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:30:23.675120 | orchestrator | 2026-04-24 03:30:23.675130 | orchestrator | TASK [horizon : Running Horizon bootstrap container] *************************** 2026-04-24 03:30:23.675139 | orchestrator | Friday 24 April 2026 03:29:44 +0000 (0:00:02.574) 0:00:31.991 ********** 2026-04-24 03:30:23.675157 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:30:23.675167 | orchestrator | 2026-04-24 03:30:23.675176 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-24 03:30:23.675186 | orchestrator | Friday 24 April 2026 03:29:59 +0000 (0:00:15.160) 0:00:47.152 ********** 2026-04-24 03:30:23.675195 | orchestrator | 2026-04-24 03:30:23.675205 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-24 03:30:23.675215 | orchestrator | Friday 24 April 2026 03:29:59 +0000 (0:00:00.081) 0:00:47.233 ********** 2026-04-24 03:30:23.675226 | orchestrator | 2026-04-24 03:30:23.675237 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-24 03:30:23.675247 | orchestrator | Friday 24 April 2026 03:29:59 +0000 (0:00:00.069) 0:00:47.303 ********** 2026-04-24 03:30:23.675258 | orchestrator | 2026-04-24 03:30:23.675268 | orchestrator | RUNNING HANDLER [horizon : Restart horizon container] ************************** 2026-04-24 03:30:23.675278 | orchestrator | Friday 24 April 2026 03:29:59 +0000 (0:00:00.075) 0:00:47.378 ********** 2026-04-24 03:30:23.675289 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:30:23.675300 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:30:23.675310 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:30:23.675321 | orchestrator | 2026-04-24 03:30:23.675331 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:30:23.675343 | orchestrator | testbed-node-0 : ok=37  changed=11  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-24 03:30:23.675356 | orchestrator | testbed-node-1 : ok=34  changed=8  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-24 03:30:23.675367 | orchestrator | testbed-node-2 : ok=34  changed=8  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-24 03:30:23.675378 | orchestrator | 2026-04-24 03:30:23.675388 | orchestrator | 2026-04-24 03:30:23.675398 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:30:23.675409 | orchestrator | Friday 24 April 2026 03:30:23 +0000 (0:00:23.712) 0:01:11.091 ********** 2026-04-24 03:30:23.675419 | orchestrator | =============================================================================== 2026-04-24 03:30:23.675429 | orchestrator | horizon : Restart horizon container ------------------------------------ 23.71s 2026-04-24 03:30:23.675440 | orchestrator | horizon : Running Horizon bootstrap container -------------------------- 15.16s 2026-04-24 03:30:23.675450 | orchestrator | horizon : Creating Horizon database user and setting permissions -------- 2.57s 2026-04-24 03:30:23.675461 | orchestrator | horizon : Creating Horizon database ------------------------------------- 2.11s 2026-04-24 03:30:23.675477 | orchestrator | service-cert-copy : horizon | Copying over extra CA certificates -------- 1.86s 2026-04-24 03:30:23.675488 | orchestrator | horizon : Copying over config.json files for services ------------------- 1.83s 2026-04-24 03:30:23.675498 | orchestrator | horizon : Copying over horizon.conf ------------------------------------- 1.80s 2026-04-24 03:30:23.675510 | orchestrator | horizon : Copying over kolla-settings.py -------------------------------- 1.75s 2026-04-24 03:30:23.675520 | orchestrator | horizon : Deploy horizon container -------------------------------------- 1.56s 2026-04-24 03:30:23.675531 | orchestrator | horizon : Copying over custom-settings.py ------------------------------- 1.48s 2026-04-24 03:30:23.675541 | orchestrator | horizon : Ensuring config directories exist ----------------------------- 1.19s 2026-04-24 03:30:23.675552 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS key ----- 0.92s 2026-04-24 03:30:23.675563 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.75s 2026-04-24 03:30:23.675581 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS certificate --- 0.67s 2026-04-24 03:30:24.127041 | orchestrator | horizon : Update policy file name --------------------------------------- 0.60s 2026-04-24 03:30:24.127143 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.60s 2026-04-24 03:30:24.127187 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.57s 2026-04-24 03:30:24.127199 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.56s 2026-04-24 03:30:24.127210 | orchestrator | horizon : Update custom policy file name -------------------------------- 0.53s 2026-04-24 03:30:24.127221 | orchestrator | horizon : Copying over existing policy file ----------------------------- 0.52s 2026-04-24 03:30:26.611087 | orchestrator | 2026-04-24 03:30:26 | INFO  | Task 6d649770-059f-4a02-a75e-916c4e6b617c (skyline) was prepared for execution. 2026-04-24 03:30:26.611177 | orchestrator | 2026-04-24 03:30:26 | INFO  | It takes a moment until task 6d649770-059f-4a02-a75e-916c4e6b617c (skyline) has been started and output is visible here. 2026-04-24 03:30:57.009448 | orchestrator | 2026-04-24 03:30:57.009571 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:30:57.009592 | orchestrator | 2026-04-24 03:30:57.009602 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:30:57.009612 | orchestrator | Friday 24 April 2026 03:30:30 +0000 (0:00:00.265) 0:00:00.265 ********** 2026-04-24 03:30:57.009621 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:30:57.009631 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:30:57.009640 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:30:57.009649 | orchestrator | 2026-04-24 03:30:57.009658 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:30:57.009667 | orchestrator | Friday 24 April 2026 03:30:31 +0000 (0:00:00.320) 0:00:00.585 ********** 2026-04-24 03:30:57.009675 | orchestrator | ok: [testbed-node-0] => (item=enable_skyline_True) 2026-04-24 03:30:57.009685 | orchestrator | ok: [testbed-node-1] => (item=enable_skyline_True) 2026-04-24 03:30:57.009693 | orchestrator | ok: [testbed-node-2] => (item=enable_skyline_True) 2026-04-24 03:30:57.009702 | orchestrator | 2026-04-24 03:30:57.009711 | orchestrator | PLAY [Apply role skyline] ****************************************************** 2026-04-24 03:30:57.009719 | orchestrator | 2026-04-24 03:30:57.009728 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-24 03:30:57.009737 | orchestrator | Friday 24 April 2026 03:30:31 +0000 (0:00:00.479) 0:00:01.064 ********** 2026-04-24 03:30:57.009746 | orchestrator | included: /ansible/roles/skyline/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:30:57.009756 | orchestrator | 2026-04-24 03:30:57.009765 | orchestrator | TASK [service-ks-register : skyline | Creating services] *********************** 2026-04-24 03:30:57.009773 | orchestrator | Friday 24 April 2026 03:30:32 +0000 (0:00:00.551) 0:00:01.616 ********** 2026-04-24 03:30:57.009782 | orchestrator | changed: [testbed-node-0] => (item=skyline (panel)) 2026-04-24 03:30:57.009791 | orchestrator | 2026-04-24 03:30:57.009800 | orchestrator | TASK [service-ks-register : skyline | Creating endpoints] ********************** 2026-04-24 03:30:57.009808 | orchestrator | Friday 24 April 2026 03:30:35 +0000 (0:00:03.312) 0:00:04.929 ********** 2026-04-24 03:30:57.009817 | orchestrator | changed: [testbed-node-0] => (item=skyline -> https://api-int.testbed.osism.xyz:9998 -> internal) 2026-04-24 03:30:57.009826 | orchestrator | changed: [testbed-node-0] => (item=skyline -> https://api.testbed.osism.xyz:9998 -> public) 2026-04-24 03:30:57.009835 | orchestrator | 2026-04-24 03:30:57.009844 | orchestrator | TASK [service-ks-register : skyline | Creating projects] *********************** 2026-04-24 03:30:57.009852 | orchestrator | Friday 24 April 2026 03:30:41 +0000 (0:00:06.243) 0:00:11.172 ********** 2026-04-24 03:30:57.009861 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:30:57.009870 | orchestrator | 2026-04-24 03:30:57.009880 | orchestrator | TASK [service-ks-register : skyline | Creating users] ************************** 2026-04-24 03:30:57.009889 | orchestrator | Friday 24 April 2026 03:30:44 +0000 (0:00:03.097) 0:00:14.270 ********** 2026-04-24 03:30:57.009897 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:30:57.009906 | orchestrator | changed: [testbed-node-0] => (item=skyline -> service) 2026-04-24 03:30:57.009940 | orchestrator | 2026-04-24 03:30:57.009950 | orchestrator | TASK [service-ks-register : skyline | Creating roles] ************************** 2026-04-24 03:30:57.009958 | orchestrator | Friday 24 April 2026 03:30:48 +0000 (0:00:04.108) 0:00:18.378 ********** 2026-04-24 03:30:57.009967 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:30:57.009976 | orchestrator | 2026-04-24 03:30:57.009984 | orchestrator | TASK [service-ks-register : skyline | Granting user roles] ********************* 2026-04-24 03:30:57.010093 | orchestrator | Friday 24 April 2026 03:30:52 +0000 (0:00:03.093) 0:00:21.472 ********** 2026-04-24 03:30:57.010109 | orchestrator | changed: [testbed-node-0] => (item=skyline -> service -> admin) 2026-04-24 03:30:57.010119 | orchestrator | 2026-04-24 03:30:57.010130 | orchestrator | TASK [skyline : Ensuring config directories exist] ***************************** 2026-04-24 03:30:57.010140 | orchestrator | Friday 24 April 2026 03:30:55 +0000 (0:00:03.642) 0:00:25.115 ********** 2026-04-24 03:30:57.010154 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:30:57.010187 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:30:57.010199 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:30:57.010209 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:30:57.010232 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:30:57.010250 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:00.764657 | orchestrator | 2026-04-24 03:31:00.764765 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-24 03:31:00.764781 | orchestrator | Friday 24 April 2026 03:30:56 +0000 (0:00:01.268) 0:00:26.384 ********** 2026-04-24 03:31:00.764793 | orchestrator | included: /ansible/roles/skyline/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:31:00.764805 | orchestrator | 2026-04-24 03:31:00.764816 | orchestrator | TASK [service-cert-copy : skyline | Copying over extra CA certificates] ******** 2026-04-24 03:31:00.764827 | orchestrator | Friday 24 April 2026 03:30:57 +0000 (0:00:00.720) 0:00:27.104 ********** 2026-04-24 03:31:00.764841 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:00.764896 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:00.764910 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:00.764938 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:00.764952 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:00.764973 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:00.764984 | orchestrator | 2026-04-24 03:31:00.764996 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS certificate] *** 2026-04-24 03:31:00.765007 | orchestrator | Friday 24 April 2026 03:31:00 +0000 (0:00:02.420) 0:00:29.525 ********** 2026-04-24 03:31:00.765095 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 03:31:00.765110 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 03:31:00.765123 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:31:00.765144 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075489 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075592 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:31:02.075628 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075642 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075654 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:31:02.075666 | orchestrator | 2026-04-24 03:31:02.075678 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS key] ***** 2026-04-24 03:31:02.075691 | orchestrator | Friday 24 April 2026 03:31:00 +0000 (0:00:00.624) 0:00:30.150 ********** 2026-04-24 03:31:02.075702 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075755 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075768 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:31:02.075785 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075797 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075809 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:31:02.075821 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-24 03:31:02.075849 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-24 03:31:10.250696 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:31:10.250797 | orchestrator | 2026-04-24 03:31:10.250811 | orchestrator | TASK [skyline : Copying over skyline.yaml files for services] ****************** 2026-04-24 03:31:10.250822 | orchestrator | Friday 24 April 2026 03:31:02 +0000 (0:00:01.301) 0:00:31.452 ********** 2026-04-24 03:31:10.250858 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:10.250872 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:10.250881 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:10.250909 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:10.250935 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:10.250949 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:10.250958 | orchestrator | 2026-04-24 03:31:10.250966 | orchestrator | TASK [skyline : Copying over gunicorn.py files for services] ******************* 2026-04-24 03:31:10.250974 | orchestrator | Friday 24 April 2026 03:31:04 +0000 (0:00:02.413) 0:00:33.866 ********** 2026-04-24 03:31:10.250982 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-24 03:31:10.250990 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-24 03:31:10.250998 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-24 03:31:10.251006 | orchestrator | 2026-04-24 03:31:10.251014 | orchestrator | TASK [skyline : Copying over nginx.conf files for services] ******************** 2026-04-24 03:31:10.251021 | orchestrator | Friday 24 April 2026 03:31:05 +0000 (0:00:01.494) 0:00:35.361 ********** 2026-04-24 03:31:10.251029 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-24 03:31:10.251087 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-24 03:31:10.251096 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-24 03:31:10.251104 | orchestrator | 2026-04-24 03:31:10.251112 | orchestrator | TASK [skyline : Copying over config.json files for services] ******************* 2026-04-24 03:31:10.251120 | orchestrator | Friday 24 April 2026 03:31:07 +0000 (0:00:02.028) 0:00:37.389 ********** 2026-04-24 03:31:10.251128 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:10.251155 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.349768 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.349882 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.349930 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.349951 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.349970 | orchestrator | 2026-04-24 03:31:12.349991 | orchestrator | TASK [skyline : Copying over custom logos] ************************************* 2026-04-24 03:31:12.350012 | orchestrator | Friday 24 April 2026 03:31:10 +0000 (0:00:02.244) 0:00:39.634 ********** 2026-04-24 03:31:12.350130 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:31:12.350144 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:31:12.350155 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:31:12.350166 | orchestrator | 2026-04-24 03:31:12.350198 | orchestrator | TASK [skyline : Check skyline container] *************************************** 2026-04-24 03:31:12.350210 | orchestrator | Friday 24 April 2026 03:31:10 +0000 (0:00:00.341) 0:00:39.975 ********** 2026-04-24 03:31:12.350231 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.350245 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.350270 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.350284 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:12.350313 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:49.290978 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-24 03:31:49.291220 | orchestrator | 2026-04-24 03:31:49.291256 | orchestrator | TASK [skyline : Creating Skyline database] ************************************* 2026-04-24 03:31:49.291280 | orchestrator | Friday 24 April 2026 03:31:12 +0000 (0:00:01.753) 0:00:41.729 ********** 2026-04-24 03:31:49.291299 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:31:49.291321 | orchestrator | 2026-04-24 03:31:49.291341 | orchestrator | TASK [skyline : Creating Skyline database user and setting permissions] ******** 2026-04-24 03:31:49.291352 | orchestrator | Friday 24 April 2026 03:31:14 +0000 (0:00:02.037) 0:00:43.766 ********** 2026-04-24 03:31:49.291363 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:31:49.291374 | orchestrator | 2026-04-24 03:31:49.291384 | orchestrator | TASK [skyline : Running Skyline bootstrap container] *************************** 2026-04-24 03:31:49.291395 | orchestrator | Friday 24 April 2026 03:31:16 +0000 (0:00:02.170) 0:00:45.936 ********** 2026-04-24 03:31:49.291405 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:31:49.291416 | orchestrator | 2026-04-24 03:31:49.291428 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-24 03:31:49.291439 | orchestrator | Friday 24 April 2026 03:31:23 +0000 (0:00:07.088) 0:00:53.025 ********** 2026-04-24 03:31:49.291450 | orchestrator | 2026-04-24 03:31:49.291461 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-24 03:31:49.291471 | orchestrator | Friday 24 April 2026 03:31:23 +0000 (0:00:00.069) 0:00:53.094 ********** 2026-04-24 03:31:49.291484 | orchestrator | 2026-04-24 03:31:49.291496 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-24 03:31:49.291508 | orchestrator | Friday 24 April 2026 03:31:23 +0000 (0:00:00.082) 0:00:53.177 ********** 2026-04-24 03:31:49.291520 | orchestrator | 2026-04-24 03:31:49.291533 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-apiserver container] **************** 2026-04-24 03:31:49.291545 | orchestrator | Friday 24 April 2026 03:31:23 +0000 (0:00:00.070) 0:00:53.247 ********** 2026-04-24 03:31:49.291557 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:31:49.291569 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:31:49.291581 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:31:49.291593 | orchestrator | 2026-04-24 03:31:49.291606 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-console container] ****************** 2026-04-24 03:31:49.291618 | orchestrator | Friday 24 April 2026 03:31:35 +0000 (0:00:11.160) 0:01:04.407 ********** 2026-04-24 03:31:49.291631 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:31:49.291643 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:31:49.291655 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:31:49.291667 | orchestrator | 2026-04-24 03:31:49.291681 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:31:49.291701 | orchestrator | testbed-node-0 : ok=22  changed=16  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 03:31:49.291722 | orchestrator | testbed-node-1 : ok=13  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 03:31:49.291740 | orchestrator | testbed-node-2 : ok=13  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 03:31:49.291759 | orchestrator | 2026-04-24 03:31:49.291778 | orchestrator | 2026-04-24 03:31:49.291799 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:31:49.291817 | orchestrator | Friday 24 April 2026 03:31:48 +0000 (0:00:13.932) 0:01:18.340 ********** 2026-04-24 03:31:49.291849 | orchestrator | =============================================================================== 2026-04-24 03:31:49.291861 | orchestrator | skyline : Restart skyline-console container ---------------------------- 13.93s 2026-04-24 03:31:49.291871 | orchestrator | skyline : Restart skyline-apiserver container -------------------------- 11.16s 2026-04-24 03:31:49.291882 | orchestrator | skyline : Running Skyline bootstrap container --------------------------- 7.09s 2026-04-24 03:31:49.291906 | orchestrator | service-ks-register : skyline | Creating endpoints ---------------------- 6.24s 2026-04-24 03:31:49.291917 | orchestrator | service-ks-register : skyline | Creating users -------------------------- 4.11s 2026-04-24 03:31:49.291928 | orchestrator | service-ks-register : skyline | Granting user roles --------------------- 3.64s 2026-04-24 03:31:49.291939 | orchestrator | service-ks-register : skyline | Creating services ----------------------- 3.31s 2026-04-24 03:31:49.291949 | orchestrator | service-ks-register : skyline | Creating projects ----------------------- 3.10s 2026-04-24 03:31:49.291980 | orchestrator | service-ks-register : skyline | Creating roles -------------------------- 3.09s 2026-04-24 03:31:49.291991 | orchestrator | service-cert-copy : skyline | Copying over extra CA certificates -------- 2.42s 2026-04-24 03:31:49.292002 | orchestrator | skyline : Copying over skyline.yaml files for services ------------------ 2.41s 2026-04-24 03:31:49.292012 | orchestrator | skyline : Copying over config.json files for services ------------------- 2.24s 2026-04-24 03:31:49.292023 | orchestrator | skyline : Creating Skyline database user and setting permissions -------- 2.17s 2026-04-24 03:31:49.292034 | orchestrator | skyline : Creating Skyline database ------------------------------------- 2.04s 2026-04-24 03:31:49.292044 | orchestrator | skyline : Copying over nginx.conf files for services -------------------- 2.03s 2026-04-24 03:31:49.292055 | orchestrator | skyline : Check skyline container --------------------------------------- 1.75s 2026-04-24 03:31:49.292066 | orchestrator | skyline : Copying over gunicorn.py files for services ------------------- 1.49s 2026-04-24 03:31:49.292110 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS key ----- 1.30s 2026-04-24 03:31:49.292122 | orchestrator | skyline : Ensuring config directories exist ----------------------------- 1.27s 2026-04-24 03:31:49.292133 | orchestrator | skyline : include_tasks ------------------------------------------------- 0.72s 2026-04-24 03:31:51.672131 | orchestrator | 2026-04-24 03:31:51 | INFO  | Task f702c180-da54-4ad3-9247-16bd672a82c9 (glance) was prepared for execution. 2026-04-24 03:31:51.672233 | orchestrator | 2026-04-24 03:31:51 | INFO  | It takes a moment until task f702c180-da54-4ad3-9247-16bd672a82c9 (glance) has been started and output is visible here. 2026-04-24 03:32:23.944750 | orchestrator | 2026-04-24 03:32:23.944903 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:32:23.944935 | orchestrator | 2026-04-24 03:32:23.944956 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:32:23.944976 | orchestrator | Friday 24 April 2026 03:31:55 +0000 (0:00:00.254) 0:00:00.254 ********** 2026-04-24 03:32:23.944995 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:32:23.945013 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:32:23.945032 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:32:23.945050 | orchestrator | 2026-04-24 03:32:23.945068 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:32:23.945089 | orchestrator | Friday 24 April 2026 03:31:56 +0000 (0:00:00.327) 0:00:00.582 ********** 2026-04-24 03:32:23.945148 | orchestrator | ok: [testbed-node-0] => (item=enable_glance_True) 2026-04-24 03:32:23.945169 | orchestrator | ok: [testbed-node-1] => (item=enable_glance_True) 2026-04-24 03:32:23.945188 | orchestrator | ok: [testbed-node-2] => (item=enable_glance_True) 2026-04-24 03:32:23.945208 | orchestrator | 2026-04-24 03:32:23.945228 | orchestrator | PLAY [Apply role glance] ******************************************************* 2026-04-24 03:32:23.945246 | orchestrator | 2026-04-24 03:32:23.945265 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 03:32:23.945312 | orchestrator | Friday 24 April 2026 03:31:56 +0000 (0:00:00.473) 0:00:01.055 ********** 2026-04-24 03:32:23.945326 | orchestrator | included: /ansible/roles/glance/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:32:23.945339 | orchestrator | 2026-04-24 03:32:23.945351 | orchestrator | TASK [service-ks-register : glance | Creating services] ************************ 2026-04-24 03:32:23.945364 | orchestrator | Friday 24 April 2026 03:31:57 +0000 (0:00:00.549) 0:00:01.605 ********** 2026-04-24 03:32:23.945376 | orchestrator | changed: [testbed-node-0] => (item=glance (image)) 2026-04-24 03:32:23.945389 | orchestrator | 2026-04-24 03:32:23.945401 | orchestrator | TASK [service-ks-register : glance | Creating endpoints] *********************** 2026-04-24 03:32:23.945414 | orchestrator | Friday 24 April 2026 03:32:00 +0000 (0:00:03.219) 0:00:04.824 ********** 2026-04-24 03:32:23.945426 | orchestrator | changed: [testbed-node-0] => (item=glance -> https://api-int.testbed.osism.xyz:9292 -> internal) 2026-04-24 03:32:23.945438 | orchestrator | changed: [testbed-node-0] => (item=glance -> https://api.testbed.osism.xyz:9292 -> public) 2026-04-24 03:32:23.945452 | orchestrator | 2026-04-24 03:32:23.945464 | orchestrator | TASK [service-ks-register : glance | Creating projects] ************************ 2026-04-24 03:32:23.945476 | orchestrator | Friday 24 April 2026 03:32:06 +0000 (0:00:05.963) 0:00:10.787 ********** 2026-04-24 03:32:23.945489 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:32:23.945502 | orchestrator | 2026-04-24 03:32:23.945513 | orchestrator | TASK [service-ks-register : glance | Creating users] *************************** 2026-04-24 03:32:23.945525 | orchestrator | Friday 24 April 2026 03:32:09 +0000 (0:00:02.979) 0:00:13.767 ********** 2026-04-24 03:32:23.945537 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:32:23.945549 | orchestrator | changed: [testbed-node-0] => (item=glance -> service) 2026-04-24 03:32:23.945561 | orchestrator | 2026-04-24 03:32:23.945573 | orchestrator | TASK [service-ks-register : glance | Creating roles] *************************** 2026-04-24 03:32:23.945585 | orchestrator | Friday 24 April 2026 03:32:13 +0000 (0:00:03.804) 0:00:17.571 ********** 2026-04-24 03:32:23.945597 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:32:23.945609 | orchestrator | 2026-04-24 03:32:23.945636 | orchestrator | TASK [service-ks-register : glance | Granting user roles] ********************** 2026-04-24 03:32:23.945647 | orchestrator | Friday 24 April 2026 03:32:16 +0000 (0:00:03.002) 0:00:20.574 ********** 2026-04-24 03:32:23.945658 | orchestrator | changed: [testbed-node-0] => (item=glance -> service -> admin) 2026-04-24 03:32:23.945668 | orchestrator | 2026-04-24 03:32:23.945679 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-24 03:32:23.945690 | orchestrator | Friday 24 April 2026 03:32:19 +0000 (0:00:03.649) 0:00:24.224 ********** 2026-04-24 03:32:23.945732 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:32:23.945758 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:32:23.945777 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:32:23.945790 | orchestrator | 2026-04-24 03:32:23.945801 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 03:32:23.945812 | orchestrator | Friday 24 April 2026 03:32:23 +0000 (0:00:03.449) 0:00:27.674 ********** 2026-04-24 03:32:23.945830 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:32:23.945841 | orchestrator | 2026-04-24 03:32:23.945859 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-24 03:32:38.855736 | orchestrator | Friday 24 April 2026 03:32:23 +0000 (0:00:00.688) 0:00:28.362 ********** 2026-04-24 03:32:38.855841 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:32:38.855854 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:32:38.855864 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:32:38.855873 | orchestrator | 2026-04-24 03:32:38.855883 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-24 03:32:38.855893 | orchestrator | Friday 24 April 2026 03:32:27 +0000 (0:00:03.490) 0:00:31.853 ********** 2026-04-24 03:32:38.855903 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:32:38.855913 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:32:38.855923 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:32:38.855932 | orchestrator | 2026-04-24 03:32:38.855941 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-24 03:32:38.855951 | orchestrator | Friday 24 April 2026 03:32:28 +0000 (0:00:01.460) 0:00:33.314 ********** 2026-04-24 03:32:38.855960 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:32:38.855969 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:32:38.855978 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:32:38.855987 | orchestrator | 2026-04-24 03:32:38.855997 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-24 03:32:38.856006 | orchestrator | Friday 24 April 2026 03:32:30 +0000 (0:00:01.351) 0:00:34.665 ********** 2026-04-24 03:32:38.856015 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:32:38.856025 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:32:38.856034 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:32:38.856043 | orchestrator | 2026-04-24 03:32:38.856053 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-24 03:32:38.856062 | orchestrator | Friday 24 April 2026 03:32:30 +0000 (0:00:00.670) 0:00:35.335 ********** 2026-04-24 03:32:38.856071 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:32:38.856080 | orchestrator | 2026-04-24 03:32:38.856090 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-24 03:32:38.856161 | orchestrator | Friday 24 April 2026 03:32:31 +0000 (0:00:00.144) 0:00:35.480 ********** 2026-04-24 03:32:38.856170 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:32:38.856179 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:32:38.856188 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:32:38.856197 | orchestrator | 2026-04-24 03:32:38.856206 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 03:32:38.856214 | orchestrator | Friday 24 April 2026 03:32:31 +0000 (0:00:00.323) 0:00:35.803 ********** 2026-04-24 03:32:38.856223 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:32:38.856232 | orchestrator | 2026-04-24 03:32:38.856241 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-24 03:32:38.856250 | orchestrator | Friday 24 April 2026 03:32:32 +0000 (0:00:00.753) 0:00:36.557 ********** 2026-04-24 03:32:38.856279 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:32:38.856332 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:32:38.856350 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:32:38.856368 | orchestrator | 2026-04-24 03:32:38.856378 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-24 03:32:38.856388 | orchestrator | Friday 24 April 2026 03:32:35 +0000 (0:00:03.832) 0:00:40.389 ********** 2026-04-24 03:32:38.856407 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 03:32:42.356941 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:32:42.357070 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 03:32:42.357147 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:32:42.357162 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 03:32:42.357174 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:32:42.357186 | orchestrator | 2026-04-24 03:32:42.357198 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-24 03:32:42.357209 | orchestrator | Friday 24 April 2026 03:32:38 +0000 (0:00:02.886) 0:00:43.275 ********** 2026-04-24 03:32:42.357245 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 03:32:42.357267 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:32:42.357279 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 03:32:42.357292 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:32:42.357313 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 03:33:15.860761 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:33:15.860928 | orchestrator | 2026-04-24 03:33:15.860952 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-24 03:33:15.861000 | orchestrator | Friday 24 April 2026 03:32:42 +0000 (0:00:03.499) 0:00:46.775 ********** 2026-04-24 03:33:15.861016 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:33:15.861033 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:33:15.861049 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:33:15.861066 | orchestrator | 2026-04-24 03:33:15.861083 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-24 03:33:15.861099 | orchestrator | Friday 24 April 2026 03:32:45 +0000 (0:00:03.260) 0:00:50.035 ********** 2026-04-24 03:33:15.861213 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:33:15.861238 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:33:15.861293 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:33:15.861328 | orchestrator | 2026-04-24 03:33:15.861350 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-24 03:33:15.861371 | orchestrator | Friday 24 April 2026 03:32:49 +0000 (0:00:03.832) 0:00:53.867 ********** 2026-04-24 03:33:15.861391 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:33:15.861411 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:33:15.861430 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:33:15.861451 | orchestrator | 2026-04-24 03:33:15.861471 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-24 03:33:15.861492 | orchestrator | Friday 24 April 2026 03:32:54 +0000 (0:00:05.513) 0:00:59.381 ********** 2026-04-24 03:33:15.861513 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:33:15.861532 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:33:15.861552 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:33:15.861573 | orchestrator | 2026-04-24 03:33:15.861591 | orchestrator | TASK [glance : Copying over glance-swift.conf for glance_api] ****************** 2026-04-24 03:33:15.861610 | orchestrator | Friday 24 April 2026 03:32:58 +0000 (0:00:03.427) 0:01:02.809 ********** 2026-04-24 03:33:15.861628 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:33:15.861644 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:33:15.861659 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:33:15.861675 | orchestrator | 2026-04-24 03:33:15.861691 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-24 03:33:15.861707 | orchestrator | Friday 24 April 2026 03:33:01 +0000 (0:00:03.199) 0:01:06.009 ********** 2026-04-24 03:33:15.861722 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:33:15.861739 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:33:15.861754 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:33:15.861770 | orchestrator | 2026-04-24 03:33:15.861785 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-24 03:33:15.861801 | orchestrator | Friday 24 April 2026 03:33:04 +0000 (0:00:03.131) 0:01:09.140 ********** 2026-04-24 03:33:15.861818 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:33:15.861834 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:33:15.861850 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:33:15.861866 | orchestrator | 2026-04-24 03:33:15.861882 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-24 03:33:15.861898 | orchestrator | Friday 24 April 2026 03:33:07 +0000 (0:00:03.259) 0:01:12.400 ********** 2026-04-24 03:33:15.861928 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:33:15.861947 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:33:15.861964 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:33:15.861980 | orchestrator | 2026-04-24 03:33:15.861996 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-24 03:33:15.862014 | orchestrator | Friday 24 April 2026 03:33:08 +0000 (0:00:00.565) 0:01:12.965 ********** 2026-04-24 03:33:15.862161 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-24 03:33:15.862174 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:33:15.862184 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-24 03:33:15.862194 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:33:15.862203 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-24 03:33:15.862212 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:33:15.862222 | orchestrator | 2026-04-24 03:33:15.862231 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-24 03:33:15.862240 | orchestrator | Friday 24 April 2026 03:33:11 +0000 (0:00:03.170) 0:01:16.136 ********** 2026-04-24 03:33:15.862250 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:33:15.862259 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:33:15.862269 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:33:15.862278 | orchestrator | 2026-04-24 03:33:15.862287 | orchestrator | TASK [glance : Check glance containers] **************************************** 2026-04-24 03:33:15.862339 | orchestrator | Friday 24 April 2026 03:33:15 +0000 (0:00:04.137) 0:01:20.274 ********** 2026-04-24 03:34:23.497494 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:34:23.497614 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:34:23.497671 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 03:34:23.497720 | orchestrator | 2026-04-24 03:34:23.497733 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 03:34:23.497742 | orchestrator | Friday 24 April 2026 03:33:19 +0000 (0:00:03.619) 0:01:23.893 ********** 2026-04-24 03:34:23.497750 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:34:23.497759 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:34:23.497767 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:34:23.497774 | orchestrator | 2026-04-24 03:34:23.497782 | orchestrator | TASK [glance : Creating Glance database] *************************************** 2026-04-24 03:34:23.497789 | orchestrator | Friday 24 April 2026 03:33:19 +0000 (0:00:00.505) 0:01:24.399 ********** 2026-04-24 03:34:23.497796 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:34:23.497804 | orchestrator | 2026-04-24 03:34:23.497811 | orchestrator | TASK [glance : Creating Glance database user and setting permissions] ********** 2026-04-24 03:34:23.497818 | orchestrator | Friday 24 April 2026 03:33:22 +0000 (0:00:02.047) 0:01:26.446 ********** 2026-04-24 03:34:23.497827 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:34:23.497834 | orchestrator | 2026-04-24 03:34:23.497842 | orchestrator | TASK [glance : Enable log_bin_trust_function_creators function] **************** 2026-04-24 03:34:23.497857 | orchestrator | Friday 24 April 2026 03:33:24 +0000 (0:00:02.248) 0:01:28.695 ********** 2026-04-24 03:34:23.497865 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:34:23.497873 | orchestrator | 2026-04-24 03:34:23.497880 | orchestrator | TASK [glance : Running Glance bootstrap container] ***************************** 2026-04-24 03:34:23.497888 | orchestrator | Friday 24 April 2026 03:33:26 +0000 (0:00:01.999) 0:01:30.694 ********** 2026-04-24 03:34:23.497895 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:34:23.497903 | orchestrator | 2026-04-24 03:34:23.497910 | orchestrator | TASK [glance : Disable log_bin_trust_function_creators function] *************** 2026-04-24 03:34:23.497917 | orchestrator | Friday 24 April 2026 03:33:52 +0000 (0:00:26.029) 0:01:56.724 ********** 2026-04-24 03:34:23.497925 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:34:23.497932 | orchestrator | 2026-04-24 03:34:23.497940 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-24 03:34:23.497948 | orchestrator | Friday 24 April 2026 03:33:54 +0000 (0:00:01.990) 0:01:58.715 ********** 2026-04-24 03:34:23.497955 | orchestrator | 2026-04-24 03:34:23.497963 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-24 03:34:23.497970 | orchestrator | Friday 24 April 2026 03:33:54 +0000 (0:00:00.070) 0:01:58.786 ********** 2026-04-24 03:34:23.497978 | orchestrator | 2026-04-24 03:34:23.497985 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-24 03:34:23.497992 | orchestrator | Friday 24 April 2026 03:33:54 +0000 (0:00:00.074) 0:01:58.860 ********** 2026-04-24 03:34:23.498000 | orchestrator | 2026-04-24 03:34:23.498007 | orchestrator | RUNNING HANDLER [glance : Restart glance-api container] ************************ 2026-04-24 03:34:23.498053 | orchestrator | Friday 24 April 2026 03:33:54 +0000 (0:00:00.074) 0:01:58.935 ********** 2026-04-24 03:34:23.498064 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:34:23.498072 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:34:23.498081 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:34:23.498089 | orchestrator | 2026-04-24 03:34:23.498097 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:34:23.498107 | orchestrator | testbed-node-0 : ok=27  changed=19  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-24 03:34:23.498153 | orchestrator | testbed-node-1 : ok=16  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-24 03:34:23.498162 | orchestrator | testbed-node-2 : ok=16  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-24 03:34:23.498170 | orchestrator | 2026-04-24 03:34:23.498178 | orchestrator | 2026-04-24 03:34:23.498186 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:34:23.498194 | orchestrator | Friday 24 April 2026 03:34:23 +0000 (0:00:28.968) 0:02:27.903 ********** 2026-04-24 03:34:23.498201 | orchestrator | =============================================================================== 2026-04-24 03:34:23.498209 | orchestrator | glance : Restart glance-api container ---------------------------------- 28.97s 2026-04-24 03:34:23.498217 | orchestrator | glance : Running Glance bootstrap container ---------------------------- 26.03s 2026-04-24 03:34:23.498225 | orchestrator | service-ks-register : glance | Creating endpoints ----------------------- 5.96s 2026-04-24 03:34:23.498237 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 5.51s 2026-04-24 03:34:23.849197 | orchestrator | glance : Generating 'hostnqn' file for glance_api ----------------------- 4.14s 2026-04-24 03:34:23.849299 | orchestrator | glance : Copying over config.json files for services -------------------- 3.83s 2026-04-24 03:34:23.849314 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 3.83s 2026-04-24 03:34:23.849325 | orchestrator | service-ks-register : glance | Creating users --------------------------- 3.80s 2026-04-24 03:34:23.849336 | orchestrator | service-ks-register : glance | Granting user roles ---------------------- 3.65s 2026-04-24 03:34:23.849390 | orchestrator | glance : Check glance containers ---------------------------------------- 3.62s 2026-04-24 03:34:23.849402 | orchestrator | service-cert-copy : glance | Copying over backend internal TLS key ------ 3.50s 2026-04-24 03:34:23.849413 | orchestrator | glance : Ensuring glance service ceph config subdir exists -------------- 3.49s 2026-04-24 03:34:23.849424 | orchestrator | glance : Ensuring config directories exist ------------------------------ 3.45s 2026-04-24 03:34:23.849434 | orchestrator | glance : Copying over glance-cache.conf for glance_api ------------------ 3.43s 2026-04-24 03:34:23.849445 | orchestrator | glance : Creating TLS backend PEM File ---------------------------------- 3.26s 2026-04-24 03:34:23.849456 | orchestrator | glance : Copying over property-protections-rules.conf ------------------- 3.26s 2026-04-24 03:34:23.849467 | orchestrator | service-ks-register : glance | Creating services ------------------------ 3.22s 2026-04-24 03:34:23.849478 | orchestrator | glance : Copying over glance-swift.conf for glance_api ------------------ 3.20s 2026-04-24 03:34:23.849488 | orchestrator | glance : Copying over glance-haproxy-tls.cfg ---------------------------- 3.17s 2026-04-24 03:34:23.849500 | orchestrator | glance : Copying over glance-image-import.conf -------------------------- 3.13s 2026-04-24 03:34:26.231402 | orchestrator | 2026-04-24 03:34:26 | INFO  | Task 13dd663b-30e9-4b00-b366-5c61c1c36063 (cinder) was prepared for execution. 2026-04-24 03:34:26.231510 | orchestrator | 2026-04-24 03:34:26 | INFO  | It takes a moment until task 13dd663b-30e9-4b00-b366-5c61c1c36063 (cinder) has been started and output is visible here. 2026-04-24 03:34:59.768449 | orchestrator | 2026-04-24 03:34:59.768566 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:34:59.768584 | orchestrator | 2026-04-24 03:34:59.768597 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:34:59.768608 | orchestrator | Friday 24 April 2026 03:34:30 +0000 (0:00:00.260) 0:00:00.260 ********** 2026-04-24 03:34:59.768619 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:34:59.768631 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:34:59.768642 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:34:59.768653 | orchestrator | 2026-04-24 03:34:59.768664 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:34:59.768675 | orchestrator | Friday 24 April 2026 03:34:30 +0000 (0:00:00.321) 0:00:00.581 ********** 2026-04-24 03:34:59.768686 | orchestrator | ok: [testbed-node-0] => (item=enable_cinder_True) 2026-04-24 03:34:59.768697 | orchestrator | ok: [testbed-node-1] => (item=enable_cinder_True) 2026-04-24 03:34:59.768708 | orchestrator | ok: [testbed-node-2] => (item=enable_cinder_True) 2026-04-24 03:34:59.768718 | orchestrator | 2026-04-24 03:34:59.768729 | orchestrator | PLAY [Apply role cinder] ******************************************************* 2026-04-24 03:34:59.768740 | orchestrator | 2026-04-24 03:34:59.768751 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 03:34:59.768761 | orchestrator | Friday 24 April 2026 03:34:31 +0000 (0:00:00.454) 0:00:01.036 ********** 2026-04-24 03:34:59.768772 | orchestrator | included: /ansible/roles/cinder/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:34:59.768798 | orchestrator | 2026-04-24 03:34:59.768810 | orchestrator | TASK [service-ks-register : cinder | Creating services] ************************ 2026-04-24 03:34:59.768820 | orchestrator | Friday 24 April 2026 03:34:31 +0000 (0:00:00.558) 0:00:01.594 ********** 2026-04-24 03:34:59.768832 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 (volumev3)) 2026-04-24 03:34:59.768844 | orchestrator | 2026-04-24 03:34:59.768855 | orchestrator | TASK [service-ks-register : cinder | Creating endpoints] *********************** 2026-04-24 03:34:59.768866 | orchestrator | Friday 24 April 2026 03:34:34 +0000 (0:00:03.114) 0:00:04.709 ********** 2026-04-24 03:34:59.768877 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 -> https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s -> internal) 2026-04-24 03:34:59.768889 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 -> https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s -> public) 2026-04-24 03:34:59.768924 | orchestrator | 2026-04-24 03:34:59.768936 | orchestrator | TASK [service-ks-register : cinder | Creating projects] ************************ 2026-04-24 03:34:59.768947 | orchestrator | Friday 24 April 2026 03:34:40 +0000 (0:00:06.045) 0:00:10.754 ********** 2026-04-24 03:34:59.768967 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:34:59.768991 | orchestrator | 2026-04-24 03:34:59.769020 | orchestrator | TASK [service-ks-register : cinder | Creating users] *************************** 2026-04-24 03:34:59.769039 | orchestrator | Friday 24 April 2026 03:34:43 +0000 (0:00:03.032) 0:00:13.786 ********** 2026-04-24 03:34:59.769059 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:34:59.769079 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service) 2026-04-24 03:34:59.769098 | orchestrator | 2026-04-24 03:34:59.769118 | orchestrator | TASK [service-ks-register : cinder | Creating roles] *************************** 2026-04-24 03:34:59.769170 | orchestrator | Friday 24 April 2026 03:34:47 +0000 (0:00:03.851) 0:00:17.637 ********** 2026-04-24 03:34:59.769190 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:34:59.769209 | orchestrator | 2026-04-24 03:34:59.769228 | orchestrator | TASK [service-ks-register : cinder | Granting user roles] ********************** 2026-04-24 03:34:59.769247 | orchestrator | Friday 24 April 2026 03:34:50 +0000 (0:00:03.028) 0:00:20.666 ********** 2026-04-24 03:34:59.769265 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service -> admin) 2026-04-24 03:34:59.769285 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service -> service) 2026-04-24 03:34:59.769303 | orchestrator | 2026-04-24 03:34:59.769323 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-24 03:34:59.769343 | orchestrator | Friday 24 April 2026 03:34:57 +0000 (0:00:07.057) 0:00:27.723 ********** 2026-04-24 03:34:59.769384 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:34:59.769424 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:34:59.769437 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:34:59.769462 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:34:59.769475 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:34:59.769492 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:34:59.769505 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:34:59.769525 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:05.520105 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:05.520322 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:05.520343 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:05.520371 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:05.520384 | orchestrator | 2026-04-24 03:35:05.520398 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 03:35:05.520410 | orchestrator | Friday 24 April 2026 03:34:59 +0000 (0:00:01.974) 0:00:29.698 ********** 2026-04-24 03:35:05.520421 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:35:05.520433 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:35:05.520444 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:35:05.520454 | orchestrator | 2026-04-24 03:35:05.520465 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 03:35:05.520476 | orchestrator | Friday 24 April 2026 03:35:00 +0000 (0:00:00.520) 0:00:30.218 ********** 2026-04-24 03:35:05.520488 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:35:05.520499 | orchestrator | 2026-04-24 03:35:05.520509 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-24 03:35:05.520520 | orchestrator | Friday 24 April 2026 03:35:00 +0000 (0:00:00.550) 0:00:30.769 ********** 2026-04-24 03:35:05.520532 | orchestrator | changed: [testbed-node-0] => (item=cinder-volume) 2026-04-24 03:35:05.520543 | orchestrator | changed: [testbed-node-1] => (item=cinder-volume) 2026-04-24 03:35:05.520562 | orchestrator | changed: [testbed-node-2] => (item=cinder-volume) 2026-04-24 03:35:05.520573 | orchestrator | changed: [testbed-node-0] => (item=cinder-backup) 2026-04-24 03:35:05.520584 | orchestrator | changed: [testbed-node-1] => (item=cinder-backup) 2026-04-24 03:35:05.520594 | orchestrator | changed: [testbed-node-2] => (item=cinder-backup) 2026-04-24 03:35:05.520605 | orchestrator | 2026-04-24 03:35:05.520616 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-24 03:35:05.520626 | orchestrator | Friday 24 April 2026 03:35:02 +0000 (0:00:01.570) 0:00:32.340 ********** 2026-04-24 03:35:05.520657 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-24 03:35:05.520671 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-24 03:35:05.520689 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-24 03:35:05.520701 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-24 03:35:05.520721 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-24 03:35:16.050110 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-24 03:35:16.050233 | orchestrator | changed: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-24 03:35:16.050265 | orchestrator | changed: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-24 03:35:16.050276 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-24 03:35:16.050286 | orchestrator | changed: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-24 03:35:16.050332 | orchestrator | changed: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-24 03:35:16.050343 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-24 03:35:16.050352 | orchestrator | 2026-04-24 03:35:16.050362 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-24 03:35:16.050372 | orchestrator | Friday 24 April 2026 03:35:05 +0000 (0:00:03.308) 0:00:35.648 ********** 2026-04-24 03:35:16.050381 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:35:16.050390 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:35:16.050398 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-24 03:35:16.050406 | orchestrator | 2026-04-24 03:35:16.050415 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-24 03:35:16.050423 | orchestrator | Friday 24 April 2026 03:35:07 +0000 (0:00:01.575) 0:00:37.224 ********** 2026-04-24 03:35:16.050432 | orchestrator | changed: [testbed-node-0] => (item=ceph.client.cinder.keyring) 2026-04-24 03:35:16.050440 | orchestrator | changed: [testbed-node-1] => (item=ceph.client.cinder.keyring) 2026-04-24 03:35:16.050447 | orchestrator | changed: [testbed-node-2] => (item=ceph.client.cinder.keyring) 2026-04-24 03:35:16.050461 | orchestrator | changed: [testbed-node-0] => (item=ceph.client.cinder-backup.keyring) 2026-04-24 03:35:16.050468 | orchestrator | changed: [testbed-node-1] => (item=ceph.client.cinder-backup.keyring) 2026-04-24 03:35:16.050477 | orchestrator | changed: [testbed-node-2] => (item=ceph.client.cinder-backup.keyring) 2026-04-24 03:35:16.050485 | orchestrator | 2026-04-24 03:35:16.050494 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-24 03:35:16.050502 | orchestrator | Friday 24 April 2026 03:35:10 +0000 (0:00:02.631) 0:00:39.855 ********** 2026-04-24 03:35:16.050512 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-24 03:35:16.050540 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-24 03:35:16.050548 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-24 03:35:16.050557 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-24 03:35:16.050573 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-24 03:35:16.050582 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-24 03:35:16.050590 | orchestrator | 2026-04-24 03:35:16.050599 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-24 03:35:16.050609 | orchestrator | Friday 24 April 2026 03:35:11 +0000 (0:00:01.021) 0:00:40.877 ********** 2026-04-24 03:35:16.050620 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:35:16.050630 | orchestrator | 2026-04-24 03:35:16.050639 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-24 03:35:16.050649 | orchestrator | Friday 24 April 2026 03:35:11 +0000 (0:00:00.145) 0:00:41.022 ********** 2026-04-24 03:35:16.050658 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:35:16.050667 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:35:16.050675 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:35:16.050685 | orchestrator | 2026-04-24 03:35:16.050695 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 03:35:16.050704 | orchestrator | Friday 24 April 2026 03:35:11 +0000 (0:00:00.509) 0:00:41.532 ********** 2026-04-24 03:35:16.050714 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:35:16.050724 | orchestrator | 2026-04-24 03:35:16.050734 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-24 03:35:16.050742 | orchestrator | Friday 24 April 2026 03:35:12 +0000 (0:00:00.582) 0:00:42.115 ********** 2026-04-24 03:35:16.050761 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:16.894731 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:16.894889 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:16.894948 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.894964 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.894977 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.895009 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.895022 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.895040 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.895059 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.895071 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.895083 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:16.895095 | orchestrator | 2026-04-24 03:35:16.895108 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-24 03:35:16.895121 | orchestrator | Friday 24 April 2026 03:35:16 +0000 (0:00:03.865) 0:00:45.980 ********** 2026-04-24 03:35:16.895197 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:16.989343 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989463 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989480 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989493 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:35:16.989507 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:16.989520 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989551 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989591 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989604 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:35:16.989616 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:16.989627 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989639 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989650 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:16.989668 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:35:16.989680 | orchestrator | 2026-04-24 03:35:16.989692 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-24 03:35:16.989711 | orchestrator | Friday 24 April 2026 03:35:16 +0000 (0:00:00.854) 0:00:46.834 ********** 2026-04-24 03:35:17.550550 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:17.550652 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:17.550670 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:17.550683 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:17.550696 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:35:17.550710 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:17.550770 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:17.550790 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:17.550802 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:17.550813 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:35:17.550826 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:17.550837 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:17.550877 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:21.967668 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:21.967784 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:35:21.967803 | orchestrator | 2026-04-24 03:35:21.967816 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-24 03:35:21.967828 | orchestrator | Friday 24 April 2026 03:35:17 +0000 (0:00:00.854) 0:00:47.689 ********** 2026-04-24 03:35:21.967841 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:21.967855 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:21.967866 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:21.967932 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:21.967955 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:21.967967 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:21.967979 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:21.967992 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:21.968011 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:21.968029 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:34.544319 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:34.544407 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:34.544416 | orchestrator | 2026-04-24 03:35:34.544423 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-24 03:35:34.544430 | orchestrator | Friday 24 April 2026 03:35:22 +0000 (0:00:04.233) 0:00:51.922 ********** 2026-04-24 03:35:34.544435 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-24 03:35:34.544441 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-24 03:35:34.544446 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-24 03:35:34.544452 | orchestrator | 2026-04-24 03:35:34.544457 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-24 03:35:34.544462 | orchestrator | Friday 24 April 2026 03:35:23 +0000 (0:00:01.819) 0:00:53.741 ********** 2026-04-24 03:35:34.544468 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:34.544492 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:34.544513 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:34.544520 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:34.544526 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:34.544532 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:34.544542 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:34.544549 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:34.544562 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:36.911770 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:36.911877 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:36.911919 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:36.911933 | orchestrator | 2026-04-24 03:35:36.911946 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-24 03:35:36.911958 | orchestrator | Friday 24 April 2026 03:35:34 +0000 (0:00:10.735) 0:01:04.477 ********** 2026-04-24 03:35:36.911969 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:35:36.911981 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:35:36.911992 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:35:36.912002 | orchestrator | 2026-04-24 03:35:36.912013 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-24 03:35:36.912025 | orchestrator | Friday 24 April 2026 03:35:36 +0000 (0:00:01.502) 0:01:05.979 ********** 2026-04-24 03:35:36.912037 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:36.912066 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:36.912096 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:36.912110 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:36.912129 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:35:36.912209 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:36.912222 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:36.912234 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:36.912260 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:40.331101 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:35:40.331203 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-24 03:35:40.331247 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:35:40.331260 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 03:35:40.331273 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 03:35:40.331286 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:35:40.331298 | orchestrator | 2026-04-24 03:35:40.331310 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-24 03:35:40.331322 | orchestrator | Friday 24 April 2026 03:35:37 +0000 (0:00:00.873) 0:01:06.853 ********** 2026-04-24 03:35:40.331334 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:35:40.331345 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:35:40.331356 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:35:40.331366 | orchestrator | 2026-04-24 03:35:40.331377 | orchestrator | TASK [cinder : Check cinder containers] **************************************** 2026-04-24 03:35:40.331388 | orchestrator | Friday 24 April 2026 03:35:37 +0000 (0:00:00.597) 0:01:07.451 ********** 2026-04-24 03:35:40.331429 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:40.331451 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:40.331463 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-24 03:35:40.331475 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:40.331487 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:40.331504 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:35:40.331525 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:08.749260 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:08.749381 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:08.749398 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:08.749415 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:08.749455 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:08.749506 | orchestrator | 2026-04-24 03:37:08.749530 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 03:37:08.749552 | orchestrator | Friday 24 April 2026 03:35:40 +0000 (0:00:02.812) 0:01:10.263 ********** 2026-04-24 03:37:08.749571 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:37:08.749592 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:37:08.749612 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:37:08.749631 | orchestrator | 2026-04-24 03:37:08.749650 | orchestrator | TASK [cinder : Creating Cinder database] *************************************** 2026-04-24 03:37:08.749670 | orchestrator | Friday 24 April 2026 03:35:40 +0000 (0:00:00.321) 0:01:10.585 ********** 2026-04-24 03:37:08.749689 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:37:08.749710 | orchestrator | 2026-04-24 03:37:08.749752 | orchestrator | TASK [cinder : Creating Cinder database user and setting permissions] ********** 2026-04-24 03:37:08.749781 | orchestrator | Friday 24 April 2026 03:35:42 +0000 (0:00:02.025) 0:01:12.610 ********** 2026-04-24 03:37:08.749810 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:37:08.749834 | orchestrator | 2026-04-24 03:37:08.749861 | orchestrator | TASK [cinder : Running Cinder bootstrap container] ***************************** 2026-04-24 03:37:08.749889 | orchestrator | Friday 24 April 2026 03:35:44 +0000 (0:00:02.210) 0:01:14.821 ********** 2026-04-24 03:37:08.749919 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:37:08.749948 | orchestrator | 2026-04-24 03:37:08.749978 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-24 03:37:08.750004 | orchestrator | Friday 24 April 2026 03:36:02 +0000 (0:00:17.977) 0:01:32.799 ********** 2026-04-24 03:37:08.750113 | orchestrator | 2026-04-24 03:37:08.750135 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-24 03:37:08.750156 | orchestrator | Friday 24 April 2026 03:36:03 +0000 (0:00:00.083) 0:01:32.882 ********** 2026-04-24 03:37:08.750176 | orchestrator | 2026-04-24 03:37:08.750225 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-24 03:37:08.750245 | orchestrator | Friday 24 April 2026 03:36:03 +0000 (0:00:00.070) 0:01:32.952 ********** 2026-04-24 03:37:08.750265 | orchestrator | 2026-04-24 03:37:08.750284 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-api container] ************************ 2026-04-24 03:37:08.750303 | orchestrator | Friday 24 April 2026 03:36:03 +0000 (0:00:00.071) 0:01:33.024 ********** 2026-04-24 03:37:08.750323 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:37:08.750340 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:37:08.750352 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:37:08.750362 | orchestrator | 2026-04-24 03:37:08.750373 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-scheduler container] ****************** 2026-04-24 03:37:08.750384 | orchestrator | Friday 24 April 2026 03:36:28 +0000 (0:00:25.370) 0:01:58.395 ********** 2026-04-24 03:37:08.750395 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:37:08.750405 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:37:08.750416 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:37:08.750426 | orchestrator | 2026-04-24 03:37:08.750437 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-volume container] ********************* 2026-04-24 03:37:08.750448 | orchestrator | Friday 24 April 2026 03:36:33 +0000 (0:00:05.006) 0:02:03.402 ********** 2026-04-24 03:37:08.750459 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:37:08.750469 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:37:08.750480 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:37:08.750490 | orchestrator | 2026-04-24 03:37:08.750501 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-backup container] ********************* 2026-04-24 03:37:08.750512 | orchestrator | Friday 24 April 2026 03:36:57 +0000 (0:00:24.337) 0:02:27.740 ********** 2026-04-24 03:37:08.750522 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:37:08.750546 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:37:08.750557 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:37:08.750567 | orchestrator | 2026-04-24 03:37:08.750578 | orchestrator | RUNNING HANDLER [cinder : Wait for cinder services to update service versions] *** 2026-04-24 03:37:08.750589 | orchestrator | Friday 24 April 2026 03:37:08 +0000 (0:00:10.575) 0:02:38.315 ********** 2026-04-24 03:37:08.750600 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:37:08.750611 | orchestrator | 2026-04-24 03:37:08.750621 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:37:08.750633 | orchestrator | testbed-node-0 : ok=30  changed=22  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 03:37:08.750646 | orchestrator | testbed-node-1 : ok=21  changed=15  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 03:37:08.750657 | orchestrator | testbed-node-2 : ok=21  changed=15  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 03:37:08.750667 | orchestrator | 2026-04-24 03:37:08.750678 | orchestrator | 2026-04-24 03:37:08.750689 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:37:08.750700 | orchestrator | Friday 24 April 2026 03:37:08 +0000 (0:00:00.263) 0:02:38.578 ********** 2026-04-24 03:37:08.750711 | orchestrator | =============================================================================== 2026-04-24 03:37:08.750721 | orchestrator | cinder : Restart cinder-api container ---------------------------------- 25.37s 2026-04-24 03:37:08.750732 | orchestrator | cinder : Restart cinder-volume container ------------------------------- 24.34s 2026-04-24 03:37:08.750752 | orchestrator | cinder : Running Cinder bootstrap container ---------------------------- 17.98s 2026-04-24 03:37:08.750763 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 10.74s 2026-04-24 03:37:08.750773 | orchestrator | cinder : Restart cinder-backup container ------------------------------- 10.58s 2026-04-24 03:37:08.750784 | orchestrator | service-ks-register : cinder | Granting user roles ---------------------- 7.06s 2026-04-24 03:37:08.750795 | orchestrator | service-ks-register : cinder | Creating endpoints ----------------------- 6.05s 2026-04-24 03:37:08.750805 | orchestrator | cinder : Restart cinder-scheduler container ----------------------------- 5.01s 2026-04-24 03:37:08.750816 | orchestrator | cinder : Copying over config.json files for services -------------------- 4.23s 2026-04-24 03:37:08.750827 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 3.87s 2026-04-24 03:37:08.750837 | orchestrator | service-ks-register : cinder | Creating users --------------------------- 3.85s 2026-04-24 03:37:08.750848 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 3.31s 2026-04-24 03:37:08.750859 | orchestrator | service-ks-register : cinder | Creating services ------------------------ 3.11s 2026-04-24 03:37:08.750869 | orchestrator | service-ks-register : cinder | Creating projects ------------------------ 3.03s 2026-04-24 03:37:08.750890 | orchestrator | service-ks-register : cinder | Creating roles --------------------------- 3.03s 2026-04-24 03:37:09.143606 | orchestrator | cinder : Check cinder containers ---------------------------------------- 2.81s 2026-04-24 03:37:09.143716 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 2.63s 2026-04-24 03:37:09.143738 | orchestrator | cinder : Creating Cinder database user and setting permissions ---------- 2.21s 2026-04-24 03:37:09.143756 | orchestrator | cinder : Creating Cinder database --------------------------------------- 2.03s 2026-04-24 03:37:09.143774 | orchestrator | cinder : Ensuring config directories exist ------------------------------ 1.97s 2026-04-24 03:37:11.503411 | orchestrator | 2026-04-24 03:37:11 | INFO  | Task dab2cae4-7327-4eba-8af8-5ae407a064fe (barbican) was prepared for execution. 2026-04-24 03:37:11.504346 | orchestrator | 2026-04-24 03:37:11 | INFO  | It takes a moment until task dab2cae4-7327-4eba-8af8-5ae407a064fe (barbican) has been started and output is visible here. 2026-04-24 03:37:52.979577 | orchestrator | 2026-04-24 03:37:52.979729 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:37:52.979761 | orchestrator | 2026-04-24 03:37:52.979775 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:37:52.979787 | orchestrator | Friday 24 April 2026 03:37:15 +0000 (0:00:00.258) 0:00:00.259 ********** 2026-04-24 03:37:52.979799 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:37:52.979811 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:37:52.979823 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:37:52.979835 | orchestrator | 2026-04-24 03:37:52.979846 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:37:52.979857 | orchestrator | Friday 24 April 2026 03:37:15 +0000 (0:00:00.342) 0:00:00.601 ********** 2026-04-24 03:37:52.979868 | orchestrator | ok: [testbed-node-0] => (item=enable_barbican_True) 2026-04-24 03:37:52.979880 | orchestrator | ok: [testbed-node-1] => (item=enable_barbican_True) 2026-04-24 03:37:52.979890 | orchestrator | ok: [testbed-node-2] => (item=enable_barbican_True) 2026-04-24 03:37:52.979901 | orchestrator | 2026-04-24 03:37:52.979912 | orchestrator | PLAY [Apply role barbican] ***************************************************** 2026-04-24 03:37:52.979922 | orchestrator | 2026-04-24 03:37:52.979933 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-24 03:37:52.979944 | orchestrator | Friday 24 April 2026 03:37:16 +0000 (0:00:00.441) 0:00:01.042 ********** 2026-04-24 03:37:52.979955 | orchestrator | included: /ansible/roles/barbican/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:37:52.979967 | orchestrator | 2026-04-24 03:37:52.979978 | orchestrator | TASK [service-ks-register : barbican | Creating services] ********************** 2026-04-24 03:37:52.979989 | orchestrator | Friday 24 April 2026 03:37:16 +0000 (0:00:00.558) 0:00:01.600 ********** 2026-04-24 03:37:52.980000 | orchestrator | changed: [testbed-node-0] => (item=barbican (key-manager)) 2026-04-24 03:37:52.980011 | orchestrator | 2026-04-24 03:37:52.980022 | orchestrator | TASK [service-ks-register : barbican | Creating endpoints] ********************* 2026-04-24 03:37:52.980032 | orchestrator | Friday 24 April 2026 03:37:20 +0000 (0:00:03.264) 0:00:04.865 ********** 2026-04-24 03:37:52.980043 | orchestrator | changed: [testbed-node-0] => (item=barbican -> https://api-int.testbed.osism.xyz:9311 -> internal) 2026-04-24 03:37:52.980056 | orchestrator | changed: [testbed-node-0] => (item=barbican -> https://api.testbed.osism.xyz:9311 -> public) 2026-04-24 03:37:52.980069 | orchestrator | 2026-04-24 03:37:52.980081 | orchestrator | TASK [service-ks-register : barbican | Creating projects] ********************** 2026-04-24 03:37:52.980093 | orchestrator | Friday 24 April 2026 03:37:26 +0000 (0:00:06.028) 0:00:10.893 ********** 2026-04-24 03:37:52.980105 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:37:52.980118 | orchestrator | 2026-04-24 03:37:52.980130 | orchestrator | TASK [service-ks-register : barbican | Creating users] ************************* 2026-04-24 03:37:52.980143 | orchestrator | Friday 24 April 2026 03:37:29 +0000 (0:00:03.071) 0:00:13.964 ********** 2026-04-24 03:37:52.980155 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:37:52.980168 | orchestrator | changed: [testbed-node-0] => (item=barbican -> service) 2026-04-24 03:37:52.980180 | orchestrator | 2026-04-24 03:37:52.980192 | orchestrator | TASK [service-ks-register : barbican | Creating roles] ************************* 2026-04-24 03:37:52.980204 | orchestrator | Friday 24 April 2026 03:37:33 +0000 (0:00:03.797) 0:00:17.762 ********** 2026-04-24 03:37:52.980216 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:37:52.980318 | orchestrator | changed: [testbed-node-0] => (item=key-manager:service-admin) 2026-04-24 03:37:52.980336 | orchestrator | changed: [testbed-node-0] => (item=creator) 2026-04-24 03:37:52.980350 | orchestrator | changed: [testbed-node-0] => (item=observer) 2026-04-24 03:37:52.980362 | orchestrator | changed: [testbed-node-0] => (item=audit) 2026-04-24 03:37:52.980374 | orchestrator | 2026-04-24 03:37:52.980387 | orchestrator | TASK [service-ks-register : barbican | Granting user roles] ******************** 2026-04-24 03:37:52.980425 | orchestrator | Friday 24 April 2026 03:37:47 +0000 (0:00:14.697) 0:00:32.459 ********** 2026-04-24 03:37:52.980437 | orchestrator | changed: [testbed-node-0] => (item=barbican -> service -> admin) 2026-04-24 03:37:52.980447 | orchestrator | 2026-04-24 03:37:52.980458 | orchestrator | TASK [barbican : Ensuring config directories exist] **************************** 2026-04-24 03:37:52.980469 | orchestrator | Friday 24 April 2026 03:37:51 +0000 (0:00:03.519) 0:00:35.979 ********** 2026-04-24 03:37:52.980483 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:37:52.980521 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:37:52.980534 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:37:52.980553 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:52.980576 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:52.980588 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:52.980610 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:58.647042 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:58.647144 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:58.647159 | orchestrator | 2026-04-24 03:37:58.647171 | orchestrator | TASK [barbican : Ensuring vassals config directories exist] ******************** 2026-04-24 03:37:58.647181 | orchestrator | Friday 24 April 2026 03:37:52 +0000 (0:00:01.584) 0:00:37.563 ********** 2026-04-24 03:37:58.647191 | orchestrator | changed: [testbed-node-0] => (item=barbican-api/vassals) 2026-04-24 03:37:58.647200 | orchestrator | changed: [testbed-node-1] => (item=barbican-api/vassals) 2026-04-24 03:37:58.647208 | orchestrator | changed: [testbed-node-2] => (item=barbican-api/vassals) 2026-04-24 03:37:58.647217 | orchestrator | 2026-04-24 03:37:58.647226 | orchestrator | TASK [barbican : Check if policies shall be overwritten] *********************** 2026-04-24 03:37:58.647235 | orchestrator | Friday 24 April 2026 03:37:54 +0000 (0:00:01.120) 0:00:38.683 ********** 2026-04-24 03:37:58.647330 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:37:58.647343 | orchestrator | 2026-04-24 03:37:58.647352 | orchestrator | TASK [barbican : Set barbican policy file] ************************************* 2026-04-24 03:37:58.647361 | orchestrator | Friday 24 April 2026 03:37:54 +0000 (0:00:00.319) 0:00:39.003 ********** 2026-04-24 03:37:58.647370 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:37:58.647378 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:37:58.647387 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:37:58.647395 | orchestrator | 2026-04-24 03:37:58.647404 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-24 03:37:58.647424 | orchestrator | Friday 24 April 2026 03:37:54 +0000 (0:00:00.325) 0:00:39.328 ********** 2026-04-24 03:37:58.647434 | orchestrator | included: /ansible/roles/barbican/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:37:58.647443 | orchestrator | 2026-04-24 03:37:58.647452 | orchestrator | TASK [service-cert-copy : barbican | Copying over extra CA certificates] ******* 2026-04-24 03:37:58.647460 | orchestrator | Friday 24 April 2026 03:37:55 +0000 (0:00:00.577) 0:00:39.906 ********** 2026-04-24 03:37:58.647470 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:37:58.647497 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:37:58.647507 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:37:58.647524 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:58.647540 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:58.647549 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:58.647559 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:58.647576 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:59.970205 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:37:59.971346 | orchestrator | 2026-04-24 03:37:59.971401 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS certificate] *** 2026-04-24 03:37:59.971438 | orchestrator | Friday 24 April 2026 03:37:58 +0000 (0:00:03.317) 0:00:43.224 ********** 2026-04-24 03:37:59.971453 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:37:59.971482 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:37:59.971495 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:37:59.971507 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:37:59.971520 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:37:59.971556 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:37:59.971577 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:37:59.971588 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:37:59.971605 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:37:59.971618 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:37:59.971629 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:37:59.971640 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:37:59.971651 | orchestrator | 2026-04-24 03:37:59.971662 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS key] **** 2026-04-24 03:37:59.971674 | orchestrator | Friday 24 April 2026 03:37:59 +0000 (0:00:00.557) 0:00:43.781 ********** 2026-04-24 03:37:59.971695 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:38:03.275188 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:38:03.275388 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:38:03.275419 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:38:03.275466 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:38:03.275490 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:38:03.275514 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:38:03.275536 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:38:03.275581 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:38:03.275671 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:38:03.275704 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:38:03.275724 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:38:03.275741 | orchestrator | 2026-04-24 03:38:03.275755 | orchestrator | TASK [barbican : Copying over config.json files for services] ****************** 2026-04-24 03:38:03.275769 | orchestrator | Friday 24 April 2026 03:37:59 +0000 (0:00:00.782) 0:00:44.563 ********** 2026-04-24 03:38:03.275783 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:03.275798 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:03.275831 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:12.529950 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:12.531227 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:12.531386 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:12.531404 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:12.531442 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:12.531455 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:12.531467 | orchestrator | 2026-04-24 03:38:12.531481 | orchestrator | TASK [barbican : Copying over barbican-api.ini] ******************************** 2026-04-24 03:38:12.531493 | orchestrator | Friday 24 April 2026 03:38:03 +0000 (0:00:03.299) 0:00:47.863 ********** 2026-04-24 03:38:12.531504 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:38:12.531516 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:38:12.531527 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:38:12.531538 | orchestrator | 2026-04-24 03:38:12.531577 | orchestrator | TASK [barbican : Checking whether barbican-api-paste.ini file exists] ********** 2026-04-24 03:38:12.531589 | orchestrator | Friday 24 April 2026 03:38:04 +0000 (0:00:01.493) 0:00:49.356 ********** 2026-04-24 03:38:12.531600 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:38:12.531612 | orchestrator | 2026-04-24 03:38:12.531623 | orchestrator | TASK [barbican : Copying over barbican-api-paste.ini] ************************** 2026-04-24 03:38:12.531634 | orchestrator | Friday 24 April 2026 03:38:05 +0000 (0:00:00.923) 0:00:50.279 ********** 2026-04-24 03:38:12.531645 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:38:12.531656 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:38:12.531667 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:38:12.531677 | orchestrator | 2026-04-24 03:38:12.531688 | orchestrator | TASK [barbican : Copying over barbican.conf] *********************************** 2026-04-24 03:38:12.531700 | orchestrator | Friday 24 April 2026 03:38:06 +0000 (0:00:00.571) 0:00:50.851 ********** 2026-04-24 03:38:12.531745 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:12.531760 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:12.531781 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:12.531801 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:13.432504 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:13.432622 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:13.432640 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:13.432675 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:13.432688 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:13.432700 | orchestrator | 2026-04-24 03:38:13.432713 | orchestrator | TASK [barbican : Copying over existing policy file] **************************** 2026-04-24 03:38:13.432725 | orchestrator | Friday 24 April 2026 03:38:12 +0000 (0:00:06.268) 0:00:57.120 ********** 2026-04-24 03:38:13.432756 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:38:13.432775 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:38:13.432787 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:38:13.432799 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:38:13.432823 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:38:13.432836 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:38:13.432847 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:38:13.432858 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:38:13.432879 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-24 03:38:15.709195 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:38:15.709363 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:38:15.709408 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:38:15.709423 | orchestrator | 2026-04-24 03:38:15.709436 | orchestrator | TASK [barbican : Check barbican containers] ************************************ 2026-04-24 03:38:15.709448 | orchestrator | Friday 24 April 2026 03:38:13 +0000 (0:00:00.902) 0:00:58.022 ********** 2026-04-24 03:38:15.709460 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:15.709473 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:15.709510 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-24 03:38:15.709524 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:15.709544 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:15.709556 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:15.709567 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:15.709580 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:15.709591 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:38:15.709603 | orchestrator | 2026-04-24 03:38:15.709614 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-24 03:38:15.709632 | orchestrator | Friday 24 April 2026 03:38:15 +0000 (0:00:02.274) 0:01:00.297 ********** 2026-04-24 03:38:55.808827 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:38:55.808961 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:38:55.808978 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:38:55.809014 | orchestrator | 2026-04-24 03:38:55.809027 | orchestrator | TASK [barbican : Creating barbican database] *********************************** 2026-04-24 03:38:55.809039 | orchestrator | Friday 24 April 2026 03:38:16 +0000 (0:00:00.328) 0:01:00.625 ********** 2026-04-24 03:38:55.809050 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:38:55.809061 | orchestrator | 2026-04-24 03:38:55.809073 | orchestrator | TASK [barbican : Creating barbican database user and setting permissions] ****** 2026-04-24 03:38:55.809083 | orchestrator | Friday 24 April 2026 03:38:18 +0000 (0:00:02.007) 0:01:02.632 ********** 2026-04-24 03:38:55.809094 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:38:55.809105 | orchestrator | 2026-04-24 03:38:55.809116 | orchestrator | TASK [barbican : Running barbican bootstrap container] ************************* 2026-04-24 03:38:55.809127 | orchestrator | Friday 24 April 2026 03:38:20 +0000 (0:00:02.137) 0:01:04.770 ********** 2026-04-24 03:38:55.809138 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:38:55.809148 | orchestrator | 2026-04-24 03:38:55.809159 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-24 03:38:55.809170 | orchestrator | Friday 24 April 2026 03:38:31 +0000 (0:00:11.353) 0:01:16.124 ********** 2026-04-24 03:38:55.809181 | orchestrator | 2026-04-24 03:38:55.809192 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-24 03:38:55.809202 | orchestrator | Friday 24 April 2026 03:38:31 +0000 (0:00:00.068) 0:01:16.193 ********** 2026-04-24 03:38:55.809213 | orchestrator | 2026-04-24 03:38:55.809224 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-24 03:38:55.809302 | orchestrator | Friday 24 April 2026 03:38:31 +0000 (0:00:00.069) 0:01:16.263 ********** 2026-04-24 03:38:55.809314 | orchestrator | 2026-04-24 03:38:55.809325 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-api container] ******************** 2026-04-24 03:38:55.809336 | orchestrator | Friday 24 April 2026 03:38:31 +0000 (0:00:00.084) 0:01:16.347 ********** 2026-04-24 03:38:55.809347 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:38:55.809358 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:38:55.809371 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:38:55.809383 | orchestrator | 2026-04-24 03:38:55.809396 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-keystone-listener container] ****** 2026-04-24 03:38:55.809408 | orchestrator | Friday 24 April 2026 03:38:42 +0000 (0:00:11.104) 0:01:27.452 ********** 2026-04-24 03:38:55.809421 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:38:55.809433 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:38:55.809445 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:38:55.809457 | orchestrator | 2026-04-24 03:38:55.809470 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-worker container] ***************** 2026-04-24 03:38:55.809482 | orchestrator | Friday 24 April 2026 03:38:47 +0000 (0:00:04.498) 0:01:31.950 ********** 2026-04-24 03:38:55.809495 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:38:55.809508 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:38:55.809520 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:38:55.809532 | orchestrator | 2026-04-24 03:38:55.809545 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:38:55.809558 | orchestrator | testbed-node-0 : ok=24  changed=18  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 03:38:55.809572 | orchestrator | testbed-node-1 : ok=14  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 03:38:55.809584 | orchestrator | testbed-node-2 : ok=14  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 03:38:55.809597 | orchestrator | 2026-04-24 03:38:55.809610 | orchestrator | 2026-04-24 03:38:55.809622 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:38:55.809635 | orchestrator | Friday 24 April 2026 03:38:55 +0000 (0:00:08.107) 0:01:40.058 ********** 2026-04-24 03:38:55.809655 | orchestrator | =============================================================================== 2026-04-24 03:38:55.809668 | orchestrator | service-ks-register : barbican | Creating roles ------------------------ 14.70s 2026-04-24 03:38:55.809680 | orchestrator | barbican : Running barbican bootstrap container ------------------------ 11.35s 2026-04-24 03:38:55.809693 | orchestrator | barbican : Restart barbican-api container ------------------------------ 11.10s 2026-04-24 03:38:55.809705 | orchestrator | barbican : Restart barbican-worker container ---------------------------- 8.11s 2026-04-24 03:38:55.809718 | orchestrator | barbican : Copying over barbican.conf ----------------------------------- 6.27s 2026-04-24 03:38:55.809730 | orchestrator | service-ks-register : barbican | Creating endpoints --------------------- 6.03s 2026-04-24 03:38:55.809743 | orchestrator | barbican : Restart barbican-keystone-listener container ----------------- 4.50s 2026-04-24 03:38:55.809753 | orchestrator | service-ks-register : barbican | Creating users ------------------------- 3.80s 2026-04-24 03:38:55.809764 | orchestrator | service-ks-register : barbican | Granting user roles -------------------- 3.52s 2026-04-24 03:38:55.809775 | orchestrator | service-cert-copy : barbican | Copying over extra CA certificates ------- 3.32s 2026-04-24 03:38:55.809786 | orchestrator | barbican : Copying over config.json files for services ------------------ 3.30s 2026-04-24 03:38:55.809797 | orchestrator | service-ks-register : barbican | Creating services ---------------------- 3.26s 2026-04-24 03:38:55.809808 | orchestrator | service-ks-register : barbican | Creating projects ---------------------- 3.07s 2026-04-24 03:38:55.809819 | orchestrator | barbican : Check barbican containers ------------------------------------ 2.27s 2026-04-24 03:38:55.809830 | orchestrator | barbican : Creating barbican database user and setting permissions ------ 2.14s 2026-04-24 03:38:55.809858 | orchestrator | barbican : Creating barbican database ----------------------------------- 2.01s 2026-04-24 03:38:55.809876 | orchestrator | barbican : Ensuring config directories exist ---------------------------- 1.58s 2026-04-24 03:38:55.809887 | orchestrator | barbican : Copying over barbican-api.ini -------------------------------- 1.49s 2026-04-24 03:38:55.809898 | orchestrator | barbican : Ensuring vassals config directories exist -------------------- 1.12s 2026-04-24 03:38:55.809909 | orchestrator | barbican : Checking whether barbican-api-paste.ini file exists ---------- 0.92s 2026-04-24 03:38:58.099539 | orchestrator | 2026-04-24 03:38:58 | INFO  | Task 98588322-b4de-42ca-bfc3-a9dd09b63f17 (designate) was prepared for execution. 2026-04-24 03:38:58.099640 | orchestrator | 2026-04-24 03:38:58 | INFO  | It takes a moment until task 98588322-b4de-42ca-bfc3-a9dd09b63f17 (designate) has been started and output is visible here. 2026-04-24 03:39:28.747819 | orchestrator | 2026-04-24 03:39:28.747933 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:39:28.747950 | orchestrator | 2026-04-24 03:39:28.747963 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:39:28.747975 | orchestrator | Friday 24 April 2026 03:39:02 +0000 (0:00:00.278) 0:00:00.278 ********** 2026-04-24 03:39:28.747986 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:39:28.747998 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:39:28.748009 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:39:28.748020 | orchestrator | 2026-04-24 03:39:28.748031 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:39:28.748042 | orchestrator | Friday 24 April 2026 03:39:02 +0000 (0:00:00.303) 0:00:00.581 ********** 2026-04-24 03:39:28.748054 | orchestrator | ok: [testbed-node-0] => (item=enable_designate_True) 2026-04-24 03:39:28.748071 | orchestrator | ok: [testbed-node-1] => (item=enable_designate_True) 2026-04-24 03:39:28.748090 | orchestrator | ok: [testbed-node-2] => (item=enable_designate_True) 2026-04-24 03:39:28.748108 | orchestrator | 2026-04-24 03:39:28.748129 | orchestrator | PLAY [Apply role designate] **************************************************** 2026-04-24 03:39:28.748151 | orchestrator | 2026-04-24 03:39:28.748172 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-24 03:39:28.748263 | orchestrator | Friday 24 April 2026 03:39:03 +0000 (0:00:00.440) 0:00:01.022 ********** 2026-04-24 03:39:28.748300 | orchestrator | included: /ansible/roles/designate/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:39:28.748313 | orchestrator | 2026-04-24 03:39:28.748324 | orchestrator | TASK [service-ks-register : designate | Creating services] ********************* 2026-04-24 03:39:28.748335 | orchestrator | Friday 24 April 2026 03:39:03 +0000 (0:00:00.562) 0:00:01.584 ********** 2026-04-24 03:39:28.748352 | orchestrator | changed: [testbed-node-0] => (item=designate (dns)) 2026-04-24 03:39:28.748370 | orchestrator | 2026-04-24 03:39:28.748389 | orchestrator | TASK [service-ks-register : designate | Creating endpoints] ******************** 2026-04-24 03:39:28.748409 | orchestrator | Friday 24 April 2026 03:39:07 +0000 (0:00:03.416) 0:00:05.001 ********** 2026-04-24 03:39:28.748430 | orchestrator | changed: [testbed-node-0] => (item=designate -> https://api-int.testbed.osism.xyz:9001 -> internal) 2026-04-24 03:39:28.748451 | orchestrator | changed: [testbed-node-0] => (item=designate -> https://api.testbed.osism.xyz:9001 -> public) 2026-04-24 03:39:28.748469 | orchestrator | 2026-04-24 03:39:28.748487 | orchestrator | TASK [service-ks-register : designate | Creating projects] ********************* 2026-04-24 03:39:28.748506 | orchestrator | Friday 24 April 2026 03:39:13 +0000 (0:00:06.063) 0:00:11.065 ********** 2026-04-24 03:39:28.748525 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:39:28.748544 | orchestrator | 2026-04-24 03:39:28.748562 | orchestrator | TASK [service-ks-register : designate | Creating users] ************************ 2026-04-24 03:39:28.748574 | orchestrator | Friday 24 April 2026 03:39:16 +0000 (0:00:03.096) 0:00:14.161 ********** 2026-04-24 03:39:28.748584 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:39:28.748595 | orchestrator | changed: [testbed-node-0] => (item=designate -> service) 2026-04-24 03:39:28.748606 | orchestrator | 2026-04-24 03:39:28.748617 | orchestrator | TASK [service-ks-register : designate | Creating roles] ************************ 2026-04-24 03:39:28.748628 | orchestrator | Friday 24 April 2026 03:39:20 +0000 (0:00:03.912) 0:00:18.074 ********** 2026-04-24 03:39:28.748639 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:39:28.748650 | orchestrator | 2026-04-24 03:39:28.748661 | orchestrator | TASK [service-ks-register : designate | Granting user roles] ******************* 2026-04-24 03:39:28.748672 | orchestrator | Friday 24 April 2026 03:39:23 +0000 (0:00:03.083) 0:00:21.158 ********** 2026-04-24 03:39:28.748682 | orchestrator | changed: [testbed-node-0] => (item=designate -> service -> admin) 2026-04-24 03:39:28.748693 | orchestrator | 2026-04-24 03:39:28.748704 | orchestrator | TASK [designate : Ensuring config directories exist] *************************** 2026-04-24 03:39:28.748714 | orchestrator | Friday 24 April 2026 03:39:26 +0000 (0:00:03.484) 0:00:24.643 ********** 2026-04-24 03:39:28.748743 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:28.748784 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:28.748808 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:28.748820 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:28.748833 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:28.748844 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:28.748861 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:28.748888 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758606 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758703 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758716 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758724 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758731 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758754 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758794 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758803 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758810 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758817 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:34.758824 | orchestrator | 2026-04-24 03:39:34.758832 | orchestrator | TASK [designate : Check if policies shall be overwritten] ********************** 2026-04-24 03:39:34.758840 | orchestrator | Friday 24 April 2026 03:39:29 +0000 (0:00:02.671) 0:00:27.314 ********** 2026-04-24 03:39:34.758848 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:39:34.758856 | orchestrator | 2026-04-24 03:39:34.758862 | orchestrator | TASK [designate : Set designate policy file] *********************************** 2026-04-24 03:39:34.758869 | orchestrator | Friday 24 April 2026 03:39:29 +0000 (0:00:00.170) 0:00:27.485 ********** 2026-04-24 03:39:34.758875 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:39:34.758882 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:39:34.758889 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:39:34.758896 | orchestrator | 2026-04-24 03:39:34.758903 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-24 03:39:34.758909 | orchestrator | Friday 24 April 2026 03:39:30 +0000 (0:00:00.500) 0:00:27.985 ********** 2026-04-24 03:39:34.758917 | orchestrator | included: /ansible/roles/designate/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:39:34.758929 | orchestrator | 2026-04-24 03:39:34.758936 | orchestrator | TASK [service-cert-copy : designate | Copying over extra CA certificates] ****** 2026-04-24 03:39:34.758942 | orchestrator | Friday 24 April 2026 03:39:30 +0000 (0:00:00.569) 0:00:28.555 ********** 2026-04-24 03:39:34.758954 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:34.758968 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:36.421855 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:36.421959 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:36.421975 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422094 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422120 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422160 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422237 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422259 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422279 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422316 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422344 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422357 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:36.422380 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:37.260615 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:37.260737 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:37.260754 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:37.260794 | orchestrator | 2026-04-24 03:39:37.260818 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS certificate] *** 2026-04-24 03:39:37.260832 | orchestrator | Friday 24 April 2026 03:39:36 +0000 (0:00:05.711) 0:00:34.266 ********** 2026-04-24 03:39:37.260860 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:39:37.260873 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:39:37.260902 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.260916 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.260927 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.260949 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.260961 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:39:37.260978 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:39:37.260991 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:39:37.261002 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.261021 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.992351 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.992479 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.992497 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:39:37.992526 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:39:37.992540 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:39:37.992552 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.992564 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.992592 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.992619 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.992631 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:39:37.992642 | orchestrator | 2026-04-24 03:39:37.992655 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS key] *** 2026-04-24 03:39:37.992668 | orchestrator | Friday 24 April 2026 03:39:37 +0000 (0:00:00.953) 0:00:35.220 ********** 2026-04-24 03:39:37.992685 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:39:37.992698 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:39:37.992709 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:39:37.992728 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308351 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308472 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308499 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:39:38.308543 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:39:38.308568 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:39:38.308587 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308607 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308684 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308709 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308728 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:39:38.308755 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:39:38.308773 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:39:38.308792 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308810 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:39:38.308870 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:39:42.504603 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:39:42.504685 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:39:42.504694 | orchestrator | 2026-04-24 03:39:42.504700 | orchestrator | TASK [designate : Copying over config.json files for services] ***************** 2026-04-24 03:39:42.504707 | orchestrator | Friday 24 April 2026 03:39:38 +0000 (0:00:00.935) 0:00:36.155 ********** 2026-04-24 03:39:42.504727 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:42.504734 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:42.504740 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:42.504771 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:42.504782 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:42.504794 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:42.504804 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:42.504812 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:42.504820 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:42.504834 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:42.504850 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031598 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031708 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031722 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031731 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031758 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031768 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031791 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031800 | orchestrator | 2026-04-24 03:39:54.031810 | orchestrator | TASK [designate : Copying over designate.conf] ********************************* 2026-04-24 03:39:54.031820 | orchestrator | Friday 24 April 2026 03:39:44 +0000 (0:00:05.996) 0:00:42.152 ********** 2026-04-24 03:39:54.031833 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:54.031843 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:54.031857 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:39:54.031866 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:39:54.031882 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404335 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404482 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404501 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404537 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404549 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404563 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404594 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404612 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404625 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404644 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404655 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404667 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404679 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:02.404690 | orchestrator | 2026-04-24 03:40:02.404703 | orchestrator | TASK [designate : Copying over pools.yaml] ************************************* 2026-04-24 03:40:02.404716 | orchestrator | Friday 24 April 2026 03:39:58 +0000 (0:00:14.240) 0:00:56.393 ********** 2026-04-24 03:40:02.404734 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-24 03:40:06.566536 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-24 03:40:06.566604 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-24 03:40:06.566613 | orchestrator | 2026-04-24 03:40:06.566622 | orchestrator | TASK [designate : Copying over named.conf] ************************************* 2026-04-24 03:40:06.566629 | orchestrator | Friday 24 April 2026 03:40:02 +0000 (0:00:03.858) 0:01:00.251 ********** 2026-04-24 03:40:06.566637 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-24 03:40:06.566644 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-24 03:40:06.566651 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-24 03:40:06.566658 | orchestrator | 2026-04-24 03:40:06.566677 | orchestrator | TASK [designate : Copying over rndc.conf] ************************************** 2026-04-24 03:40:06.566685 | orchestrator | Friday 24 April 2026 03:40:04 +0000 (0:00:02.366) 0:01:02.618 ********** 2026-04-24 03:40:06.566708 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:06.566719 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:06.566727 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:06.566747 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:06.566759 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:06.566773 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:06.566781 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:06.566789 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:06.566797 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:06.566805 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:06.566818 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:09.130485 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:09.130596 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:09.130612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:09.130624 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:09.130636 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:09.130648 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:09.130675 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:09.130695 | orchestrator | 2026-04-24 03:40:09.130708 | orchestrator | TASK [designate : Copying over rndc.key] *************************************** 2026-04-24 03:40:09.130720 | orchestrator | Friday 24 April 2026 03:40:07 +0000 (0:00:02.811) 0:01:05.430 ********** 2026-04-24 03:40:09.130737 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:09.130750 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:09.130761 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:09.130773 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:09.130790 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.101716 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.101821 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.101848 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:10.101869 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.101889 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.101910 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.101983 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:10.101998 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.102010 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.102080 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:10.102093 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:10.102105 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:10.102167 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:10.102181 | orchestrator | 2026-04-24 03:40:10.102195 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-24 03:40:10.102215 | orchestrator | Friday 24 April 2026 03:40:10 +0000 (0:00:02.509) 0:01:07.940 ********** 2026-04-24 03:40:11.237293 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:40:11.237414 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:40:11.237430 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:40:11.237442 | orchestrator | 2026-04-24 03:40:11.237468 | orchestrator | TASK [designate : Copying over existing policy file] *************************** 2026-04-24 03:40:11.237488 | orchestrator | Friday 24 April 2026 03:40:10 +0000 (0:00:00.290) 0:01:08.230 ********** 2026-04-24 03:40:11.237502 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:11.237517 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:40:11.237530 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:11.237542 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:11.237573 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:11.237603 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:40:11.237621 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:40:11.237633 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:11.237645 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:40:11.237657 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:11.237668 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:11.237688 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:11.237718 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:40:14.251714 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:40:14.251841 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-24 03:40:14.251864 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 03:40:14.251878 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 03:40:14.251891 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 03:40:14.251925 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 03:40:14.251939 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:40:14.251951 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:40:14.251962 | orchestrator | 2026-04-24 03:40:14.251991 | orchestrator | TASK [designate : Check designate containers] ********************************** 2026-04-24 03:40:14.252010 | orchestrator | Friday 24 April 2026 03:40:11 +0000 (0:00:00.962) 0:01:09.192 ********** 2026-04-24 03:40:14.252023 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:40:14.252036 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:40:14.252048 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-24 03:40:14.252068 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:14.252088 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:16.018682 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 03:40:16.018784 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.018802 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.018816 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.018876 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.018905 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.018959 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.018982 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.019002 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.019014 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.019035 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.019047 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.019060 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:40:16.019075 | orchestrator | 2026-04-24 03:40:16.019097 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-24 03:40:16.019150 | orchestrator | Friday 24 April 2026 03:40:15 +0000 (0:00:04.369) 0:01:13.561 ********** 2026-04-24 03:40:16.019170 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:40:16.019201 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:41:32.019506 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:41:32.019673 | orchestrator | 2026-04-24 03:41:32.019713 | orchestrator | TASK [designate : Creating Designate databases] ******************************** 2026-04-24 03:41:32.019731 | orchestrator | Friday 24 April 2026 03:40:16 +0000 (0:00:00.302) 0:01:13.864 ********** 2026-04-24 03:41:32.019758 | orchestrator | changed: [testbed-node-0] => (item=designate) 2026-04-24 03:41:32.019780 | orchestrator | 2026-04-24 03:41:32.019798 | orchestrator | TASK [designate : Creating Designate databases user and setting permissions] *** 2026-04-24 03:41:32.019816 | orchestrator | Friday 24 April 2026 03:40:18 +0000 (0:00:02.041) 0:01:15.906 ********** 2026-04-24 03:41:32.019834 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-24 03:41:32.019853 | orchestrator | changed: [testbed-node-0 -> {{ groups['designate-central'][0] }}] 2026-04-24 03:41:32.019871 | orchestrator | 2026-04-24 03:41:32.019888 | orchestrator | TASK [designate : Running Designate bootstrap container] *********************** 2026-04-24 03:41:32.019906 | orchestrator | Friday 24 April 2026 03:40:20 +0000 (0:00:02.190) 0:01:18.096 ********** 2026-04-24 03:41:32.019923 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:41:32.019939 | orchestrator | 2026-04-24 03:41:32.019956 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-24 03:41:32.019975 | orchestrator | Friday 24 April 2026 03:40:35 +0000 (0:00:14.947) 0:01:33.043 ********** 2026-04-24 03:41:32.020092 | orchestrator | 2026-04-24 03:41:32.020111 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-24 03:41:32.020193 | orchestrator | Friday 24 April 2026 03:40:35 +0000 (0:00:00.070) 0:01:33.113 ********** 2026-04-24 03:41:32.020216 | orchestrator | 2026-04-24 03:41:32.020235 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-24 03:41:32.020254 | orchestrator | Friday 24 April 2026 03:40:35 +0000 (0:00:00.071) 0:01:33.185 ********** 2026-04-24 03:41:32.020274 | orchestrator | 2026-04-24 03:41:32.020294 | orchestrator | RUNNING HANDLER [designate : Restart designate-backend-bind9 container] ******** 2026-04-24 03:41:32.020315 | orchestrator | Friday 24 April 2026 03:40:35 +0000 (0:00:00.099) 0:01:33.285 ********** 2026-04-24 03:41:32.020332 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:41:32.020351 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:41:32.020371 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:41:32.020390 | orchestrator | 2026-04-24 03:41:32.020411 | orchestrator | RUNNING HANDLER [designate : Restart designate-api container] ****************** 2026-04-24 03:41:32.020429 | orchestrator | Friday 24 April 2026 03:40:47 +0000 (0:00:11.840) 0:01:45.126 ********** 2026-04-24 03:41:32.020450 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:41:32.020469 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:41:32.020489 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:41:32.020508 | orchestrator | 2026-04-24 03:41:32.020519 | orchestrator | RUNNING HANDLER [designate : Restart designate-central container] ************** 2026-04-24 03:41:32.020530 | orchestrator | Friday 24 April 2026 03:40:52 +0000 (0:00:05.258) 0:01:50.384 ********** 2026-04-24 03:41:32.020541 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:41:32.020552 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:41:32.020562 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:41:32.020573 | orchestrator | 2026-04-24 03:41:32.020584 | orchestrator | RUNNING HANDLER [designate : Restart designate-producer container] ************* 2026-04-24 03:41:32.020594 | orchestrator | Friday 24 April 2026 03:40:57 +0000 (0:00:05.422) 0:01:55.807 ********** 2026-04-24 03:41:32.020605 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:41:32.020616 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:41:32.020626 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:41:32.020637 | orchestrator | 2026-04-24 03:41:32.020648 | orchestrator | RUNNING HANDLER [designate : Restart designate-mdns container] ***************** 2026-04-24 03:41:32.020658 | orchestrator | Friday 24 April 2026 03:41:08 +0000 (0:00:10.320) 0:02:06.127 ********** 2026-04-24 03:41:32.020669 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:41:32.020679 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:41:32.020690 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:41:32.020700 | orchestrator | 2026-04-24 03:41:32.020711 | orchestrator | RUNNING HANDLER [designate : Restart designate-worker container] *************** 2026-04-24 03:41:32.020722 | orchestrator | Friday 24 April 2026 03:41:18 +0000 (0:00:10.622) 0:02:16.750 ********** 2026-04-24 03:41:32.020732 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:41:32.020743 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:41:32.020754 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:41:32.020764 | orchestrator | 2026-04-24 03:41:32.020775 | orchestrator | TASK [designate : Non-destructive DNS pools update] **************************** 2026-04-24 03:41:32.020786 | orchestrator | Friday 24 April 2026 03:41:24 +0000 (0:00:05.487) 0:02:22.238 ********** 2026-04-24 03:41:32.020796 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:41:32.020807 | orchestrator | 2026-04-24 03:41:32.020818 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:41:32.020830 | orchestrator | testbed-node-0 : ok=29  changed=23  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 03:41:32.020842 | orchestrator | testbed-node-1 : ok=19  changed=15  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 03:41:32.020853 | orchestrator | testbed-node-2 : ok=19  changed=15  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 03:41:32.020864 | orchestrator | 2026-04-24 03:41:32.020888 | orchestrator | 2026-04-24 03:41:32.020907 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:41:32.020925 | orchestrator | Friday 24 April 2026 03:41:31 +0000 (0:00:07.235) 0:02:29.473 ********** 2026-04-24 03:41:32.020943 | orchestrator | =============================================================================== 2026-04-24 03:41:32.020961 | orchestrator | designate : Running Designate bootstrap container ---------------------- 14.95s 2026-04-24 03:41:32.021010 | orchestrator | designate : Copying over designate.conf -------------------------------- 14.24s 2026-04-24 03:41:32.021060 | orchestrator | designate : Restart designate-backend-bind9 container ------------------ 11.84s 2026-04-24 03:41:32.021092 | orchestrator | designate : Restart designate-mdns container --------------------------- 10.62s 2026-04-24 03:41:32.021105 | orchestrator | designate : Restart designate-producer container ----------------------- 10.32s 2026-04-24 03:41:32.021116 | orchestrator | designate : Non-destructive DNS pools update ---------------------------- 7.24s 2026-04-24 03:41:32.021127 | orchestrator | service-ks-register : designate | Creating endpoints -------------------- 6.06s 2026-04-24 03:41:32.021137 | orchestrator | designate : Copying over config.json files for services ----------------- 6.00s 2026-04-24 03:41:32.021148 | orchestrator | service-cert-copy : designate | Copying over extra CA certificates ------ 5.71s 2026-04-24 03:41:32.021159 | orchestrator | designate : Restart designate-worker container -------------------------- 5.49s 2026-04-24 03:41:32.021169 | orchestrator | designate : Restart designate-central container ------------------------- 5.42s 2026-04-24 03:41:32.021180 | orchestrator | designate : Restart designate-api container ----------------------------- 5.26s 2026-04-24 03:41:32.021190 | orchestrator | designate : Check designate containers ---------------------------------- 4.37s 2026-04-24 03:41:32.021201 | orchestrator | service-ks-register : designate | Creating users ------------------------ 3.91s 2026-04-24 03:41:32.021212 | orchestrator | designate : Copying over pools.yaml ------------------------------------- 3.86s 2026-04-24 03:41:32.021222 | orchestrator | service-ks-register : designate | Granting user roles ------------------- 3.48s 2026-04-24 03:41:32.021233 | orchestrator | service-ks-register : designate | Creating services --------------------- 3.42s 2026-04-24 03:41:32.021244 | orchestrator | service-ks-register : designate | Creating projects --------------------- 3.10s 2026-04-24 03:41:32.021254 | orchestrator | service-ks-register : designate | Creating roles ------------------------ 3.08s 2026-04-24 03:41:32.021265 | orchestrator | designate : Copying over rndc.conf -------------------------------------- 2.81s 2026-04-24 03:41:34.550957 | orchestrator | 2026-04-24 03:41:34 | INFO  | Task a7eb7cca-8ccb-4a95-89a6-766e81a57d80 (octavia) was prepared for execution. 2026-04-24 03:41:34.551128 | orchestrator | 2026-04-24 03:41:34 | INFO  | It takes a moment until task a7eb7cca-8ccb-4a95-89a6-766e81a57d80 (octavia) has been started and output is visible here. 2026-04-24 03:43:35.427057 | orchestrator | 2026-04-24 03:43:35.427182 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:43:35.427201 | orchestrator | 2026-04-24 03:43:35.427213 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:43:35.427226 | orchestrator | Friday 24 April 2026 03:41:38 +0000 (0:00:00.269) 0:00:00.269 ********** 2026-04-24 03:43:35.427237 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:43:35.427249 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:43:35.427260 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:43:35.427271 | orchestrator | 2026-04-24 03:43:35.427282 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:43:35.427293 | orchestrator | Friday 24 April 2026 03:41:39 +0000 (0:00:00.318) 0:00:00.587 ********** 2026-04-24 03:43:35.427304 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-24 03:43:35.427315 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-24 03:43:35.427326 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-24 03:43:35.427338 | orchestrator | 2026-04-24 03:43:35.427349 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-24 03:43:35.427383 | orchestrator | 2026-04-24 03:43:35.427395 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 03:43:35.427405 | orchestrator | Friday 24 April 2026 03:41:39 +0000 (0:00:00.488) 0:00:01.075 ********** 2026-04-24 03:43:35.427417 | orchestrator | included: /ansible/roles/octavia/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:43:35.427428 | orchestrator | 2026-04-24 03:43:35.427439 | orchestrator | TASK [service-ks-register : octavia | Creating services] *********************** 2026-04-24 03:43:35.427450 | orchestrator | Friday 24 April 2026 03:41:40 +0000 (0:00:00.590) 0:00:01.665 ********** 2026-04-24 03:43:35.427461 | orchestrator | changed: [testbed-node-0] => (item=octavia (load-balancer)) 2026-04-24 03:43:35.427471 | orchestrator | 2026-04-24 03:43:35.427482 | orchestrator | TASK [service-ks-register : octavia | Creating endpoints] ********************** 2026-04-24 03:43:35.427493 | orchestrator | Friday 24 April 2026 03:41:43 +0000 (0:00:03.334) 0:00:05.000 ********** 2026-04-24 03:43:35.427504 | orchestrator | changed: [testbed-node-0] => (item=octavia -> https://api-int.testbed.osism.xyz:9876 -> internal) 2026-04-24 03:43:35.427515 | orchestrator | changed: [testbed-node-0] => (item=octavia -> https://api.testbed.osism.xyz:9876 -> public) 2026-04-24 03:43:35.427526 | orchestrator | 2026-04-24 03:43:35.427536 | orchestrator | TASK [service-ks-register : octavia | Creating projects] *********************** 2026-04-24 03:43:35.427547 | orchestrator | Friday 24 April 2026 03:41:49 +0000 (0:00:06.422) 0:00:11.423 ********** 2026-04-24 03:43:35.427560 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:43:35.427573 | orchestrator | 2026-04-24 03:43:35.427585 | orchestrator | TASK [service-ks-register : octavia | Creating users] ************************** 2026-04-24 03:43:35.427597 | orchestrator | Friday 24 April 2026 03:41:53 +0000 (0:00:03.197) 0:00:14.620 ********** 2026-04-24 03:43:35.427610 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:43:35.427622 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service) 2026-04-24 03:43:35.427635 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service) 2026-04-24 03:43:35.427647 | orchestrator | 2026-04-24 03:43:35.427660 | orchestrator | TASK [service-ks-register : octavia | Creating roles] ************************** 2026-04-24 03:43:35.427672 | orchestrator | Friday 24 April 2026 03:42:01 +0000 (0:00:08.041) 0:00:22.661 ********** 2026-04-24 03:43:35.427684 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:43:35.427697 | orchestrator | 2026-04-24 03:43:35.427724 | orchestrator | TASK [service-ks-register : octavia | Granting user roles] ********************* 2026-04-24 03:43:35.427737 | orchestrator | Friday 24 April 2026 03:42:04 +0000 (0:00:03.054) 0:00:25.716 ********** 2026-04-24 03:43:35.427750 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service -> admin) 2026-04-24 03:43:35.427762 | orchestrator | ok: [testbed-node-0] => (item=octavia -> service -> admin) 2026-04-24 03:43:35.427804 | orchestrator | 2026-04-24 03:43:35.427817 | orchestrator | TASK [octavia : Adding octavia related roles] ********************************** 2026-04-24 03:43:35.427829 | orchestrator | Friday 24 April 2026 03:42:11 +0000 (0:00:06.904) 0:00:32.621 ********** 2026-04-24 03:43:35.427840 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_observer) 2026-04-24 03:43:35.427853 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_global_observer) 2026-04-24 03:43:35.427864 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_member) 2026-04-24 03:43:35.427876 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_admin) 2026-04-24 03:43:35.427888 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_quota_admin) 2026-04-24 03:43:35.427900 | orchestrator | 2026-04-24 03:43:35.427913 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 03:43:35.427925 | orchestrator | Friday 24 April 2026 03:42:26 +0000 (0:00:15.157) 0:00:47.778 ********** 2026-04-24 03:43:35.427937 | orchestrator | included: /ansible/roles/octavia/tasks/prepare.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:43:35.427956 | orchestrator | 2026-04-24 03:43:35.427967 | orchestrator | TASK [octavia : Create amphora flavor] ***************************************** 2026-04-24 03:43:35.427978 | orchestrator | Friday 24 April 2026 03:42:26 +0000 (0:00:00.761) 0:00:48.540 ********** 2026-04-24 03:43:35.427989 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.427999 | orchestrator | 2026-04-24 03:43:35.428010 | orchestrator | TASK [octavia : Create nova keypair for amphora] ******************************* 2026-04-24 03:43:35.428021 | orchestrator | Friday 24 April 2026 03:42:31 +0000 (0:00:04.563) 0:00:53.104 ********** 2026-04-24 03:43:35.428032 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.428043 | orchestrator | 2026-04-24 03:43:35.428075 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-24 03:43:35.428122 | orchestrator | Friday 24 April 2026 03:42:35 +0000 (0:00:03.926) 0:00:57.030 ********** 2026-04-24 03:43:35.428147 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:43:35.428165 | orchestrator | 2026-04-24 03:43:35.428183 | orchestrator | TASK [octavia : Create security groups for octavia] **************************** 2026-04-24 03:43:35.428200 | orchestrator | Friday 24 April 2026 03:42:38 +0000 (0:00:03.067) 0:01:00.097 ********** 2026-04-24 03:43:35.428216 | orchestrator | changed: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-24 03:43:35.428235 | orchestrator | changed: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-24 03:43:35.428254 | orchestrator | 2026-04-24 03:43:35.428272 | orchestrator | TASK [octavia : Add rules for security groups] ********************************* 2026-04-24 03:43:35.428291 | orchestrator | Friday 24 April 2026 03:42:48 +0000 (0:00:10.107) 0:01:10.205 ********** 2026-04-24 03:43:35.428310 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'icmp'}]) 2026-04-24 03:43:35.428329 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'tcp', 'src_port': 22, 'dst_port': 22}]) 2026-04-24 03:43:35.428348 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'tcp', 'src_port': '9443', 'dst_port': '9443'}]) 2026-04-24 03:43:35.428361 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-health-mgr-sec-grp', 'enabled': True}, {'protocol': 'udp', 'src_port': '5555', 'dst_port': '5555'}]) 2026-04-24 03:43:35.428371 | orchestrator | 2026-04-24 03:43:35.428382 | orchestrator | TASK [octavia : Create loadbalancer management network] ************************ 2026-04-24 03:43:35.428399 | orchestrator | Friday 24 April 2026 03:43:03 +0000 (0:00:15.062) 0:01:25.268 ********** 2026-04-24 03:43:35.428418 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.428437 | orchestrator | 2026-04-24 03:43:35.428454 | orchestrator | TASK [octavia : Create loadbalancer management subnet] ************************* 2026-04-24 03:43:35.428472 | orchestrator | Friday 24 April 2026 03:43:08 +0000 (0:00:04.541) 0:01:29.809 ********** 2026-04-24 03:43:35.428491 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.428510 | orchestrator | 2026-04-24 03:43:35.428530 | orchestrator | TASK [octavia : Create loadbalancer management router for IPv6] **************** 2026-04-24 03:43:35.428549 | orchestrator | Friday 24 April 2026 03:43:13 +0000 (0:00:04.900) 0:01:34.710 ********** 2026-04-24 03:43:35.428571 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:43:35.428585 | orchestrator | 2026-04-24 03:43:35.428596 | orchestrator | TASK [octavia : Update loadbalancer management subnet] ************************* 2026-04-24 03:43:35.428607 | orchestrator | Friday 24 April 2026 03:43:13 +0000 (0:00:00.224) 0:01:34.934 ********** 2026-04-24 03:43:35.428617 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:43:35.428628 | orchestrator | 2026-04-24 03:43:35.428639 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 03:43:35.428649 | orchestrator | Friday 24 April 2026 03:43:17 +0000 (0:00:04.169) 0:01:39.103 ********** 2026-04-24 03:43:35.428673 | orchestrator | included: /ansible/roles/octavia/tasks/hm-interface.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:43:35.428684 | orchestrator | 2026-04-24 03:43:35.428694 | orchestrator | TASK [octavia : Create ports for Octavia health-manager nodes] ***************** 2026-04-24 03:43:35.428716 | orchestrator | Friday 24 April 2026 03:43:18 +0000 (0:00:01.098) 0:01:40.202 ********** 2026-04-24 03:43:35.428727 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:43:35.428737 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.428748 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:43:35.428759 | orchestrator | 2026-04-24 03:43:35.428823 | orchestrator | TASK [octavia : Update Octavia health manager port host_id] ******************** 2026-04-24 03:43:35.428836 | orchestrator | Friday 24 April 2026 03:43:23 +0000 (0:00:04.847) 0:01:45.049 ********** 2026-04-24 03:43:35.428847 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:43:35.428858 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.428868 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:43:35.428879 | orchestrator | 2026-04-24 03:43:35.428890 | orchestrator | TASK [octavia : Add Octavia port to openvswitch br-int] ************************ 2026-04-24 03:43:35.428901 | orchestrator | Friday 24 April 2026 03:43:28 +0000 (0:00:04.604) 0:01:49.654 ********** 2026-04-24 03:43:35.428911 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.428922 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:43:35.428933 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:43:35.428943 | orchestrator | 2026-04-24 03:43:35.428954 | orchestrator | TASK [octavia : Install isc-dhcp-client package] ******************************* 2026-04-24 03:43:35.428965 | orchestrator | Friday 24 April 2026 03:43:29 +0000 (0:00:00.998) 0:01:50.652 ********** 2026-04-24 03:43:35.428975 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:43:35.428986 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:43:35.428997 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:43:35.429007 | orchestrator | 2026-04-24 03:43:35.429018 | orchestrator | TASK [octavia : Create octavia dhclient conf] ********************************** 2026-04-24 03:43:35.429029 | orchestrator | Friday 24 April 2026 03:43:30 +0000 (0:00:01.666) 0:01:52.319 ********** 2026-04-24 03:43:35.429039 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.429050 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:43:35.429061 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:43:35.429071 | orchestrator | 2026-04-24 03:43:35.429082 | orchestrator | TASK [octavia : Create octavia-interface service] ****************************** 2026-04-24 03:43:35.429093 | orchestrator | Friday 24 April 2026 03:43:32 +0000 (0:00:01.260) 0:01:53.580 ********** 2026-04-24 03:43:35.429103 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.429114 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:43:35.429125 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:43:35.429135 | orchestrator | 2026-04-24 03:43:35.429146 | orchestrator | TASK [octavia : Restart octavia-interface.service if required] ***************** 2026-04-24 03:43:35.429157 | orchestrator | Friday 24 April 2026 03:43:33 +0000 (0:00:01.177) 0:01:54.757 ********** 2026-04-24 03:43:35.429168 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:43:35.429178 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:43:35.429189 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:43:35.429199 | orchestrator | 2026-04-24 03:43:35.429221 | orchestrator | TASK [octavia : Enable and start octavia-interface.service] ******************** 2026-04-24 03:44:00.396715 | orchestrator | Friday 24 April 2026 03:43:35 +0000 (0:00:02.196) 0:01:56.954 ********** 2026-04-24 03:44:00.396858 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:44:00.396875 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:44:00.396887 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:44:00.396897 | orchestrator | 2026-04-24 03:44:00.396908 | orchestrator | TASK [octavia : Wait for interface ohm0 ip appear] ***************************** 2026-04-24 03:44:00.396918 | orchestrator | Friday 24 April 2026 03:43:36 +0000 (0:00:01.515) 0:01:58.469 ********** 2026-04-24 03:44:00.396928 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:44:00.396939 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:44:00.396973 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:44:00.396984 | orchestrator | 2026-04-24 03:44:00.396994 | orchestrator | TASK [octavia : Gather facts] ************************************************** 2026-04-24 03:44:00.397004 | orchestrator | Friday 24 April 2026 03:43:37 +0000 (0:00:00.638) 0:01:59.108 ********** 2026-04-24 03:44:00.397035 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:44:00.397045 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:44:00.397055 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:44:00.397067 | orchestrator | 2026-04-24 03:44:00.397083 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 03:44:00.397104 | orchestrator | Friday 24 April 2026 03:43:40 +0000 (0:00:02.933) 0:02:02.041 ********** 2026-04-24 03:44:00.397129 | orchestrator | included: /ansible/roles/octavia/tasks/get_resources_info.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:44:00.397145 | orchestrator | 2026-04-24 03:44:00.397161 | orchestrator | TASK [octavia : Get amphora flavor info] *************************************** 2026-04-24 03:44:00.397177 | orchestrator | Friday 24 April 2026 03:43:41 +0000 (0:00:00.550) 0:02:02.592 ********** 2026-04-24 03:44:00.397192 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:44:00.397208 | orchestrator | 2026-04-24 03:44:00.397224 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-24 03:44:00.397241 | orchestrator | Friday 24 April 2026 03:43:45 +0000 (0:00:04.133) 0:02:06.725 ********** 2026-04-24 03:44:00.397258 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:44:00.397275 | orchestrator | 2026-04-24 03:44:00.397292 | orchestrator | TASK [octavia : Get security groups for octavia] ******************************* 2026-04-24 03:44:00.397311 | orchestrator | Friday 24 April 2026 03:43:48 +0000 (0:00:03.061) 0:02:09.787 ********** 2026-04-24 03:44:00.397347 | orchestrator | ok: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-24 03:44:00.397370 | orchestrator | ok: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-24 03:44:00.397382 | orchestrator | 2026-04-24 03:44:00.397394 | orchestrator | TASK [octavia : Get loadbalancer management network] *************************** 2026-04-24 03:44:00.397406 | orchestrator | Friday 24 April 2026 03:43:54 +0000 (0:00:06.462) 0:02:16.249 ********** 2026-04-24 03:44:00.397417 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:44:00.397428 | orchestrator | 2026-04-24 03:44:00.397439 | orchestrator | TASK [octavia : Set octavia resources facts] *********************************** 2026-04-24 03:44:00.397451 | orchestrator | Friday 24 April 2026 03:43:57 +0000 (0:00:03.256) 0:02:19.505 ********** 2026-04-24 03:44:00.397462 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:44:00.397474 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:44:00.397485 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:44:00.397496 | orchestrator | 2026-04-24 03:44:00.397507 | orchestrator | TASK [octavia : Ensuring config directories exist] ***************************** 2026-04-24 03:44:00.397519 | orchestrator | Friday 24 April 2026 03:43:58 +0000 (0:00:00.519) 0:02:20.024 ********** 2026-04-24 03:44:00.397549 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:00.397584 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:00.397608 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:00.397620 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:00.397631 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:00.397646 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:00.397658 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:00.397670 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:00.397695 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:01.847413 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:01.847511 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:01.847526 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:01.847557 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:01.847572 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:01.847623 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:01.847645 | orchestrator | 2026-04-24 03:44:01.847666 | orchestrator | TASK [octavia : Check if policies shall be overwritten] ************************ 2026-04-24 03:44:01.847686 | orchestrator | Friday 24 April 2026 03:44:00 +0000 (0:00:02.336) 0:02:22.361 ********** 2026-04-24 03:44:01.847706 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:44:01.847726 | orchestrator | 2026-04-24 03:44:01.847821 | orchestrator | TASK [octavia : Set octavia policy file] *************************************** 2026-04-24 03:44:01.847832 | orchestrator | Friday 24 April 2026 03:44:00 +0000 (0:00:00.134) 0:02:22.495 ********** 2026-04-24 03:44:01.847843 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:44:01.847872 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:44:01.847884 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:44:01.847895 | orchestrator | 2026-04-24 03:44:01.847906 | orchestrator | TASK [octavia : Copying over existing policy file] ***************************** 2026-04-24 03:44:01.847917 | orchestrator | Friday 24 April 2026 03:44:01 +0000 (0:00:00.299) 0:02:22.795 ********** 2026-04-24 03:44:01.847930 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:01.847944 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:01.847966 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:01.847981 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:01.848005 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:01.848018 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:44:01.848041 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:06.538117 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:06.538229 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:06.538263 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:06.538299 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:06.538313 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:44:06.538328 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:06.538341 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:06.538372 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:06.538413 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:06.538432 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:06.538453 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:44:06.538465 | orchestrator | 2026-04-24 03:44:06.538477 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 03:44:06.538490 | orchestrator | Friday 24 April 2026 03:44:01 +0000 (0:00:00.683) 0:02:23.479 ********** 2026-04-24 03:44:06.538501 | orchestrator | included: /ansible/roles/octavia/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:44:06.538512 | orchestrator | 2026-04-24 03:44:06.538524 | orchestrator | TASK [service-cert-copy : octavia | Copying over extra CA certificates] ******** 2026-04-24 03:44:06.538537 | orchestrator | Friday 24 April 2026 03:44:02 +0000 (0:00:00.720) 0:02:24.199 ********** 2026-04-24 03:44:06.538551 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:06.538567 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:06.538589 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:08.015421 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:08.015578 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:08.015597 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:08.015610 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015624 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015635 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015665 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015683 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015702 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015714 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015760 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015772 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:08.015785 | orchestrator | 2026-04-24 03:44:08.015798 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS certificate] *** 2026-04-24 03:44:08.015810 | orchestrator | Friday 24 April 2026 03:44:07 +0000 (0:00:04.766) 0:02:28.966 ********** 2026-04-24 03:44:08.015831 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:08.123311 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:08.123439 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.123466 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.123486 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:08.123506 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:44:08.123521 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:08.123533 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:08.123584 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.123601 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.123612 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:08.123622 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:44:08.123632 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:08.123643 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:08.123653 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.123676 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.945608 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:08.946642 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:44:08.946684 | orchestrator | 2026-04-24 03:44:08.946698 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS key] ***** 2026-04-24 03:44:08.946711 | orchestrator | Friday 24 April 2026 03:44:08 +0000 (0:00:00.690) 0:02:29.656 ********** 2026-04-24 03:44:08.946753 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:08.946775 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:08.946795 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.946858 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.946908 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:08.946922 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:44:08.946944 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:08.946956 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:08.946968 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.946979 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:08.946999 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:08.947011 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:44:08.947044 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 03:44:13.345429 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 03:44:13.345558 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 03:44:13.345577 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 03:44:13.345590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 03:44:13.345629 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:44:13.345643 | orchestrator | 2026-04-24 03:44:13.345655 | orchestrator | TASK [octavia : Copying over config.json files for services] ******************* 2026-04-24 03:44:13.345667 | orchestrator | Friday 24 April 2026 03:44:09 +0000 (0:00:01.353) 0:02:31.010 ********** 2026-04-24 03:44:13.345679 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:13.345753 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:13.345770 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:13.345781 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:13.345793 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:13.345813 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:13.345825 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:13.345848 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:29.290551 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:29.290667 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:29.290685 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:29.290806 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:29.290830 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:29.290851 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:29.290909 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:29.290924 | orchestrator | 2026-04-24 03:44:29.290938 | orchestrator | TASK [octavia : Copying over octavia-wsgi.conf] ******************************** 2026-04-24 03:44:29.290951 | orchestrator | Friday 24 April 2026 03:44:14 +0000 (0:00:04.811) 0:02:35.821 ********** 2026-04-24 03:44:29.290962 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-24 03:44:29.290975 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-24 03:44:29.290985 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-24 03:44:29.290996 | orchestrator | 2026-04-24 03:44:29.291007 | orchestrator | TASK [octavia : Copying over octavia.conf] ************************************* 2026-04-24 03:44:29.291018 | orchestrator | Friday 24 April 2026 03:44:15 +0000 (0:00:01.628) 0:02:37.449 ********** 2026-04-24 03:44:29.291030 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:29.291052 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:29.291064 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:29.291091 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:44.032662 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:44.032844 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:44.032908 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:44.032932 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:44.032952 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:44.032971 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:44.033039 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:44.033063 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:44.033086 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:44.033116 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:44.033128 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:44:44.033140 | orchestrator | 2026-04-24 03:44:44.033153 | orchestrator | TASK [octavia : Copying over Octavia SSH key] ********************************** 2026-04-24 03:44:44.033167 | orchestrator | Friday 24 April 2026 03:44:32 +0000 (0:00:16.513) 0:02:53.962 ********** 2026-04-24 03:44:44.033178 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:44:44.033192 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:44:44.033205 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:44:44.033216 | orchestrator | 2026-04-24 03:44:44.033230 | orchestrator | TASK [octavia : Copying certificate files for octavia-worker] ****************** 2026-04-24 03:44:44.033242 | orchestrator | Friday 24 April 2026 03:44:34 +0000 (0:00:01.773) 0:02:55.736 ********** 2026-04-24 03:44:44.033255 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-24 03:44:44.033267 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-24 03:44:44.033280 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-24 03:44:44.033292 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-24 03:44:44.033304 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-24 03:44:44.033317 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-24 03:44:44.033330 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-24 03:44:44.033343 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-24 03:44:44.033355 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-24 03:44:44.033367 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-24 03:44:44.033380 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-24 03:44:44.033392 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-24 03:44:44.033405 | orchestrator | 2026-04-24 03:44:44.033423 | orchestrator | TASK [octavia : Copying certificate files for octavia-housekeeping] ************ 2026-04-24 03:44:44.033436 | orchestrator | Friday 24 April 2026 03:44:38 +0000 (0:00:04.776) 0:03:00.513 ********** 2026-04-24 03:44:44.033448 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-24 03:44:44.033461 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-24 03:44:44.033489 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-24 03:44:52.228348 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-24 03:44:52.228466 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-24 03:44:52.228483 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-24 03:44:52.228496 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-24 03:44:52.228507 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-24 03:44:52.228518 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-24 03:44:52.228529 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-24 03:44:52.228541 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-24 03:44:52.228552 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-24 03:44:52.228564 | orchestrator | 2026-04-24 03:44:52.228577 | orchestrator | TASK [octavia : Copying certificate files for octavia-health-manager] ********** 2026-04-24 03:44:52.228589 | orchestrator | Friday 24 April 2026 03:44:44 +0000 (0:00:05.044) 0:03:05.557 ********** 2026-04-24 03:44:52.228599 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-24 03:44:52.228610 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-24 03:44:52.228624 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-24 03:44:52.228644 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-24 03:44:52.228751 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-24 03:44:52.228776 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-24 03:44:52.228795 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-24 03:44:52.228813 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-24 03:44:52.228832 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-24 03:44:52.228850 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-24 03:44:52.228870 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-24 03:44:52.228889 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-24 03:44:52.228907 | orchestrator | 2026-04-24 03:44:52.228927 | orchestrator | TASK [octavia : Check octavia containers] ************************************** 2026-04-24 03:44:52.228947 | orchestrator | Friday 24 April 2026 03:44:49 +0000 (0:00:05.089) 0:03:10.646 ********** 2026-04-24 03:44:52.228968 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:52.228987 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:52.229097 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 03:44:52.229124 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:52.229143 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:52.229161 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 03:44:52.229179 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:52.229198 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:52.229239 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 03:44:52.229273 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:46:10.661160 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:46:10.661306 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 03:46:10.661336 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:10.661357 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:10.661409 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:10.661432 | orchestrator | 2026-04-24 03:46:10.661454 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 03:46:10.661476 | orchestrator | Friday 24 April 2026 03:44:53 +0000 (0:00:03.938) 0:03:14.585 ********** 2026-04-24 03:46:10.661494 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:10.661533 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:10.661552 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:10.661571 | orchestrator | 2026-04-24 03:46:10.661589 | orchestrator | TASK [octavia : Creating Octavia database] ************************************* 2026-04-24 03:46:10.661609 | orchestrator | Friday 24 April 2026 03:44:53 +0000 (0:00:00.314) 0:03:14.899 ********** 2026-04-24 03:46:10.661688 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.661712 | orchestrator | 2026-04-24 03:46:10.661732 | orchestrator | TASK [octavia : Creating Octavia persistence database] ************************* 2026-04-24 03:46:10.661752 | orchestrator | Friday 24 April 2026 03:44:55 +0000 (0:00:02.056) 0:03:16.955 ********** 2026-04-24 03:46:10.661772 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.661790 | orchestrator | 2026-04-24 03:46:10.661810 | orchestrator | TASK [octavia : Creating Octavia database user and setting permissions] ******** 2026-04-24 03:46:10.661829 | orchestrator | Friday 24 April 2026 03:44:57 +0000 (0:00:02.082) 0:03:19.037 ********** 2026-04-24 03:46:10.661848 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.661942 | orchestrator | 2026-04-24 03:46:10.661957 | orchestrator | TASK [octavia : Creating Octavia persistence database user and setting permissions] *** 2026-04-24 03:46:10.661971 | orchestrator | Friday 24 April 2026 03:44:59 +0000 (0:00:02.270) 0:03:21.308 ********** 2026-04-24 03:46:10.662010 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.662105 | orchestrator | 2026-04-24 03:46:10.662124 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-24 03:46:10.662143 | orchestrator | Friday 24 April 2026 03:45:02 +0000 (0:00:02.257) 0:03:23.566 ********** 2026-04-24 03:46:10.662160 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.662178 | orchestrator | 2026-04-24 03:46:10.662196 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-24 03:46:10.662215 | orchestrator | Friday 24 April 2026 03:45:23 +0000 (0:00:21.070) 0:03:44.636 ********** 2026-04-24 03:46:10.662231 | orchestrator | 2026-04-24 03:46:10.662249 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-24 03:46:10.662267 | orchestrator | Friday 24 April 2026 03:45:23 +0000 (0:00:00.071) 0:03:44.708 ********** 2026-04-24 03:46:10.662285 | orchestrator | 2026-04-24 03:46:10.662304 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-24 03:46:10.662322 | orchestrator | Friday 24 April 2026 03:45:23 +0000 (0:00:00.068) 0:03:44.776 ********** 2026-04-24 03:46:10.662340 | orchestrator | 2026-04-24 03:46:10.662359 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-api container] ********************** 2026-04-24 03:46:10.662378 | orchestrator | Friday 24 April 2026 03:45:23 +0000 (0:00:00.069) 0:03:44.846 ********** 2026-04-24 03:46:10.662396 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.662415 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:46:10.662433 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:46:10.662453 | orchestrator | 2026-04-24 03:46:10.662473 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-driver-agent container] ************* 2026-04-24 03:46:10.662511 | orchestrator | Friday 24 April 2026 03:45:34 +0000 (0:00:11.162) 0:03:56.008 ********** 2026-04-24 03:46:10.662531 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:46:10.662549 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.662568 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:46:10.662588 | orchestrator | 2026-04-24 03:46:10.662608 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-health-manager container] *********** 2026-04-24 03:46:10.662649 | orchestrator | Friday 24 April 2026 03:45:45 +0000 (0:00:11.085) 0:04:07.094 ********** 2026-04-24 03:46:10.662669 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.662687 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:46:10.662707 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:46:10.662725 | orchestrator | 2026-04-24 03:46:10.662744 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-housekeeping container] ************* 2026-04-24 03:46:10.662762 | orchestrator | Friday 24 April 2026 03:45:55 +0000 (0:00:09.794) 0:04:16.888 ********** 2026-04-24 03:46:10.662779 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.662799 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:46:10.662818 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:46:10.662837 | orchestrator | 2026-04-24 03:46:10.662855 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-worker container] ******************* 2026-04-24 03:46:10.662874 | orchestrator | Friday 24 April 2026 03:46:05 +0000 (0:00:09.898) 0:04:26.787 ********** 2026-04-24 03:46:10.662893 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:46:10.662911 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:46:10.662930 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:46:10.662947 | orchestrator | 2026-04-24 03:46:10.662966 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:46:10.662985 | orchestrator | testbed-node-0 : ok=57  changed=38  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 03:46:10.663005 | orchestrator | testbed-node-1 : ok=33  changed=22  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 03:46:10.663024 | orchestrator | testbed-node-2 : ok=33  changed=22  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 03:46:10.663043 | orchestrator | 2026-04-24 03:46:10.663061 | orchestrator | 2026-04-24 03:46:10.663080 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:46:10.663099 | orchestrator | Friday 24 April 2026 03:46:10 +0000 (0:00:05.391) 0:04:32.178 ********** 2026-04-24 03:46:10.663118 | orchestrator | =============================================================================== 2026-04-24 03:46:10.663137 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 21.07s 2026-04-24 03:46:10.663155 | orchestrator | octavia : Copying over octavia.conf ------------------------------------ 16.51s 2026-04-24 03:46:10.663174 | orchestrator | octavia : Adding octavia related roles --------------------------------- 15.16s 2026-04-24 03:46:10.663193 | orchestrator | octavia : Add rules for security groups -------------------------------- 15.06s 2026-04-24 03:46:10.663223 | orchestrator | octavia : Restart octavia-api container -------------------------------- 11.16s 2026-04-24 03:46:10.663242 | orchestrator | octavia : Restart octavia-driver-agent container ----------------------- 11.09s 2026-04-24 03:46:10.663261 | orchestrator | octavia : Create security groups for octavia --------------------------- 10.11s 2026-04-24 03:46:10.663278 | orchestrator | octavia : Restart octavia-housekeeping container ------------------------ 9.90s 2026-04-24 03:46:10.663297 | orchestrator | octavia : Restart octavia-health-manager container ---------------------- 9.79s 2026-04-24 03:46:10.663315 | orchestrator | service-ks-register : octavia | Creating users -------------------------- 8.04s 2026-04-24 03:46:10.663334 | orchestrator | service-ks-register : octavia | Granting user roles --------------------- 6.90s 2026-04-24 03:46:10.663353 | orchestrator | octavia : Get security groups for octavia ------------------------------- 6.46s 2026-04-24 03:46:10.663384 | orchestrator | service-ks-register : octavia | Creating endpoints ---------------------- 6.42s 2026-04-24 03:46:10.663404 | orchestrator | octavia : Restart octavia-worker container ------------------------------ 5.39s 2026-04-24 03:46:10.663438 | orchestrator | octavia : Copying certificate files for octavia-health-manager ---------- 5.09s 2026-04-24 03:46:10.997741 | orchestrator | octavia : Copying certificate files for octavia-housekeeping ------------ 5.04s 2026-04-24 03:46:10.998744 | orchestrator | octavia : Create loadbalancer management subnet ------------------------- 4.90s 2026-04-24 03:46:10.998790 | orchestrator | octavia : Create ports for Octavia health-manager nodes ----------------- 4.85s 2026-04-24 03:46:10.998803 | orchestrator | octavia : Copying over config.json files for services ------------------- 4.81s 2026-04-24 03:46:10.998815 | orchestrator | octavia : Copying certificate files for octavia-worker ------------------ 4.78s 2026-04-24 03:46:13.299449 | orchestrator | 2026-04-24 03:46:13 | INFO  | Task 93279c56-70b8-459b-9efe-cac1c3b59e1a (ceilometer) was prepared for execution. 2026-04-24 03:46:13.299549 | orchestrator | 2026-04-24 03:46:13 | INFO  | It takes a moment until task 93279c56-70b8-459b-9efe-cac1c3b59e1a (ceilometer) has been started and output is visible here. 2026-04-24 03:46:34.800213 | orchestrator | 2026-04-24 03:46:34.800331 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:46:34.800350 | orchestrator | 2026-04-24 03:46:34.800363 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:46:34.800374 | orchestrator | Friday 24 April 2026 03:46:17 +0000 (0:00:00.261) 0:00:00.261 ********** 2026-04-24 03:46:34.800386 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:46:34.800399 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:46:34.800410 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:46:34.800421 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:46:34.800431 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:46:34.800442 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:46:34.800453 | orchestrator | 2026-04-24 03:46:34.800483 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:46:34.800506 | orchestrator | Friday 24 April 2026 03:46:18 +0000 (0:00:00.708) 0:00:00.970 ********** 2026-04-24 03:46:34.800518 | orchestrator | ok: [testbed-node-0] => (item=enable_ceilometer_True) 2026-04-24 03:46:34.800529 | orchestrator | ok: [testbed-node-1] => (item=enable_ceilometer_True) 2026-04-24 03:46:34.800540 | orchestrator | ok: [testbed-node-2] => (item=enable_ceilometer_True) 2026-04-24 03:46:34.800551 | orchestrator | ok: [testbed-node-3] => (item=enable_ceilometer_True) 2026-04-24 03:46:34.800562 | orchestrator | ok: [testbed-node-4] => (item=enable_ceilometer_True) 2026-04-24 03:46:34.800573 | orchestrator | ok: [testbed-node-5] => (item=enable_ceilometer_True) 2026-04-24 03:46:34.800584 | orchestrator | 2026-04-24 03:46:34.800595 | orchestrator | PLAY [Apply role ceilometer] *************************************************** 2026-04-24 03:46:34.800606 | orchestrator | 2026-04-24 03:46:34.800617 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-24 03:46:34.800628 | orchestrator | Friday 24 April 2026 03:46:18 +0000 (0:00:00.633) 0:00:01.603 ********** 2026-04-24 03:46:34.800731 | orchestrator | included: /ansible/roles/ceilometer/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:46:34.800745 | orchestrator | 2026-04-24 03:46:34.800758 | orchestrator | TASK [service-ks-register : ceilometer | Creating services] ******************** 2026-04-24 03:46:34.800771 | orchestrator | Friday 24 April 2026 03:46:20 +0000 (0:00:01.247) 0:00:02.850 ********** 2026-04-24 03:46:34.800784 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:34.800795 | orchestrator | 2026-04-24 03:46:34.800808 | orchestrator | TASK [service-ks-register : ceilometer | Creating endpoints] ******************* 2026-04-24 03:46:34.800820 | orchestrator | Friday 24 April 2026 03:46:20 +0000 (0:00:00.146) 0:00:02.996 ********** 2026-04-24 03:46:34.800832 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:34.800868 | orchestrator | 2026-04-24 03:46:34.800880 | orchestrator | TASK [service-ks-register : ceilometer | Creating projects] ******************** 2026-04-24 03:46:34.800893 | orchestrator | Friday 24 April 2026 03:46:20 +0000 (0:00:00.129) 0:00:03.126 ********** 2026-04-24 03:46:34.800905 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:46:34.800917 | orchestrator | 2026-04-24 03:46:34.800929 | orchestrator | TASK [service-ks-register : ceilometer | Creating users] *********************** 2026-04-24 03:46:34.800941 | orchestrator | Friday 24 April 2026 03:46:23 +0000 (0:00:03.327) 0:00:06.454 ********** 2026-04-24 03:46:34.800953 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:46:34.800966 | orchestrator | changed: [testbed-node-0] => (item=ceilometer -> service) 2026-04-24 03:46:34.800978 | orchestrator | 2026-04-24 03:46:34.800990 | orchestrator | TASK [service-ks-register : ceilometer | Creating roles] *********************** 2026-04-24 03:46:34.801002 | orchestrator | Friday 24 April 2026 03:46:27 +0000 (0:00:03.392) 0:00:09.846 ********** 2026-04-24 03:46:34.801014 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:46:34.801026 | orchestrator | 2026-04-24 03:46:34.801053 | orchestrator | TASK [service-ks-register : ceilometer | Granting user roles] ****************** 2026-04-24 03:46:34.801066 | orchestrator | Friday 24 April 2026 03:46:29 +0000 (0:00:02.815) 0:00:12.661 ********** 2026-04-24 03:46:34.801079 | orchestrator | changed: [testbed-node-0] => (item=ceilometer -> service -> admin) 2026-04-24 03:46:34.801091 | orchestrator | 2026-04-24 03:46:34.801102 | orchestrator | TASK [ceilometer : Associate the ResellerAdmin role and ceilometer user] ******* 2026-04-24 03:46:34.801113 | orchestrator | Friday 24 April 2026 03:46:33 +0000 (0:00:03.478) 0:00:16.140 ********** 2026-04-24 03:46:34.801124 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:34.801134 | orchestrator | 2026-04-24 03:46:34.801145 | orchestrator | TASK [ceilometer : Ensuring config directories exist] ************************** 2026-04-24 03:46:34.801155 | orchestrator | Friday 24 April 2026 03:46:33 +0000 (0:00:00.127) 0:00:16.267 ********** 2026-04-24 03:46:34.801170 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:34.801204 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:34.801218 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:34.801230 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:34.801267 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:34.801280 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:46:34.801292 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:46:34.801310 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:46:39.377428 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:39.377561 | orchestrator | 2026-04-24 03:46:39.377580 | orchestrator | TASK [ceilometer : Check if the folder for custom meter definitions exist] ***** 2026-04-24 03:46:39.377594 | orchestrator | Friday 24 April 2026 03:46:34 +0000 (0:00:01.359) 0:00:17.627 ********** 2026-04-24 03:46:39.377605 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:46:39.377617 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 03:46:39.377627 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 03:46:39.377710 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 03:46:39.377722 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:46:39.377733 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 03:46:39.377744 | orchestrator | 2026-04-24 03:46:39.377755 | orchestrator | TASK [ceilometer : Set variable that indicates if we have a folder for custom meter YAML files] *** 2026-04-24 03:46:39.377768 | orchestrator | Friday 24 April 2026 03:46:36 +0000 (0:00:01.510) 0:00:19.137 ********** 2026-04-24 03:46:39.377779 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:46:39.377791 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:46:39.377802 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:46:39.377812 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:46:39.377823 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:46:39.377834 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:46:39.377845 | orchestrator | 2026-04-24 03:46:39.377856 | orchestrator | TASK [ceilometer : Find all *.yaml files in custom meter definitions folder (if the folder exist)] *** 2026-04-24 03:46:39.377867 | orchestrator | Friday 24 April 2026 03:46:36 +0000 (0:00:00.608) 0:00:19.746 ********** 2026-04-24 03:46:39.377878 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:39.377889 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:39.377900 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:39.377911 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:39.377922 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:39.377933 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:39.377944 | orchestrator | 2026-04-24 03:46:39.377955 | orchestrator | TASK [ceilometer : Set the variable that control the copy of custom meter definitions] *** 2026-04-24 03:46:39.377969 | orchestrator | Friday 24 April 2026 03:46:37 +0000 (0:00:00.804) 0:00:20.550 ********** 2026-04-24 03:46:39.377981 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:46:39.377994 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:46:39.378006 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:46:39.378076 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:46:39.378175 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:46:39.378235 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:46:39.378249 | orchestrator | 2026-04-24 03:46:39.378267 | orchestrator | TASK [ceilometer : Create default folder for custom meter definitions] ********* 2026-04-24 03:46:39.378280 | orchestrator | Friday 24 April 2026 03:46:38 +0000 (0:00:00.603) 0:00:21.154 ********** 2026-04-24 03:46:39.378295 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:39.378310 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:39.378335 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:39.378368 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:39.378381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:39.378392 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:39.378404 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:39.378415 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:39.378432 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:39.378444 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:39.378455 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:39.378466 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:39.378485 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:39.378504 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:44.005554 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:44.005632 | orchestrator | 2026-04-24 03:46:44.005676 | orchestrator | TASK [ceilometer : Copying custom meter definitions to Ceilometer] ************* 2026-04-24 03:46:44.005682 | orchestrator | Friday 24 April 2026 03:46:39 +0000 (0:00:01.055) 0:00:22.209 ********** 2026-04-24 03:46:44.005688 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:44.005695 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:44.005701 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:44.005715 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:44.005720 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:44.005738 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:44.005742 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:44.005746 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:44.005750 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:44.005765 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:44.005770 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:44.005774 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:44.005778 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:44.005785 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:44.005789 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:44.005797 | orchestrator | 2026-04-24 03:46:44.005802 | orchestrator | TASK [ceilometer : Check if the folder ["/opt/configuration/environments/kolla/files/overlays/ceilometer/pollsters.d"] for dynamic pollsters definitions exist] *** 2026-04-24 03:46:44.005807 | orchestrator | Friday 24 April 2026 03:46:40 +0000 (0:00:00.815) 0:00:23.024 ********** 2026-04-24 03:46:44.005812 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:46:44.005816 | orchestrator | 2026-04-24 03:46:44.005819 | orchestrator | TASK [ceilometer : Set the variable that control the copy of dynamic pollsters definitions] *** 2026-04-24 03:46:44.005824 | orchestrator | Friday 24 April 2026 03:46:40 +0000 (0:00:00.672) 0:00:23.697 ********** 2026-04-24 03:46:44.005828 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:46:44.005832 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:46:44.005836 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:46:44.005840 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:46:44.005843 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:46:44.005847 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:46:44.005851 | orchestrator | 2026-04-24 03:46:44.005854 | orchestrator | TASK [ceilometer : Clean default folder for dynamic pollsters definitions] ***** 2026-04-24 03:46:44.005858 | orchestrator | Friday 24 April 2026 03:46:41 +0000 (0:00:00.808) 0:00:24.505 ********** 2026-04-24 03:46:44.005862 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:46:44.005866 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:46:44.005869 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:46:44.005873 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:46:44.005877 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:46:44.005894 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:46:44.005898 | orchestrator | 2026-04-24 03:46:44.005902 | orchestrator | TASK [ceilometer : Create default folder for dynamic pollsters definitions] **** 2026-04-24 03:46:44.005906 | orchestrator | Friday 24 April 2026 03:46:42 +0000 (0:00:00.915) 0:00:25.421 ********** 2026-04-24 03:46:44.005909 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:44.005913 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:44.005917 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:44.005921 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:44.005924 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:44.005928 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:44.005932 | orchestrator | 2026-04-24 03:46:44.005936 | orchestrator | TASK [ceilometer : Copying dynamic pollsters definitions] ********************** 2026-04-24 03:46:44.005939 | orchestrator | Friday 24 April 2026 03:46:43 +0000 (0:00:00.776) 0:00:26.197 ********** 2026-04-24 03:46:44.005943 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:44.005947 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:44.005951 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:44.005955 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:44.005959 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:44.005962 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:44.005966 | orchestrator | 2026-04-24 03:46:48.935691 | orchestrator | TASK [ceilometer : Check if custom polling.yaml exists] ************************ 2026-04-24 03:46:48.935808 | orchestrator | Friday 24 April 2026 03:46:43 +0000 (0:00:00.644) 0:00:26.842 ********** 2026-04-24 03:46:48.935824 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:46:48.935837 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 03:46:48.935849 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 03:46:48.935860 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:46:48.935871 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 03:46:48.935886 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 03:46:48.935905 | orchestrator | 2026-04-24 03:46:48.935918 | orchestrator | TASK [ceilometer : Copying over polling.yaml] ********************************** 2026-04-24 03:46:48.935929 | orchestrator | Friday 24 April 2026 03:46:45 +0000 (0:00:01.471) 0:00:28.314 ********** 2026-04-24 03:46:48.935975 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:48.936018 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:48.936032 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:48.936058 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:48.936071 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:48.936082 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:48.936113 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:48.936125 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:48.936136 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:48.936148 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:48.936170 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:48.936188 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:48.936206 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:48.936224 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:48.936238 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:48.936250 | orchestrator | 2026-04-24 03:46:48.936263 | orchestrator | TASK [ceilometer : Set ceilometer polling file's path] ************************* 2026-04-24 03:46:48.936275 | orchestrator | Friday 24 April 2026 03:46:46 +0000 (0:00:00.815) 0:00:29.130 ********** 2026-04-24 03:46:48.936287 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:48.936299 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:48.936311 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:48.936324 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:48.936336 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:48.936348 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:48.936360 | orchestrator | 2026-04-24 03:46:48.936372 | orchestrator | TASK [ceilometer : Check custom gnocchi_resources.yaml exists] ***************** 2026-04-24 03:46:48.936385 | orchestrator | Friday 24 April 2026 03:46:47 +0000 (0:00:00.791) 0:00:29.922 ********** 2026-04-24 03:46:48.936396 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:46:48.936408 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 03:46:48.936421 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 03:46:48.936433 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:46:48.936445 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 03:46:48.936457 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 03:46:48.936468 | orchestrator | 2026-04-24 03:46:48.936481 | orchestrator | TASK [ceilometer : Copying over gnocchi_resources.yaml] ************************ 2026-04-24 03:46:48.936495 | orchestrator | Friday 24 April 2026 03:46:48 +0000 (0:00:01.300) 0:00:31.222 ********** 2026-04-24 03:46:48.936517 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:54.485455 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:54.485569 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:54.485604 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:54.485618 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:54.485633 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:54.485692 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:54.485706 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:54.485718 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:54.485751 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:54.485763 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:54.485794 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:54.485806 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:54.485817 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:54.485829 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:54.485840 | orchestrator | 2026-04-24 03:46:54.485852 | orchestrator | TASK [ceilometer : Set ceilometer gnocchi_resources file's path] *************** 2026-04-24 03:46:54.485864 | orchestrator | Friday 24 April 2026 03:46:49 +0000 (0:00:01.078) 0:00:32.301 ********** 2026-04-24 03:46:54.485875 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:54.485885 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:54.485902 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:54.485913 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:54.485924 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:54.485935 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:54.485945 | orchestrator | 2026-04-24 03:46:54.485956 | orchestrator | TASK [ceilometer : Check if policies shall be overwritten] ********************* 2026-04-24 03:46:54.485967 | orchestrator | Friday 24 April 2026 03:46:50 +0000 (0:00:00.782) 0:00:33.083 ********** 2026-04-24 03:46:54.485978 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:54.485989 | orchestrator | 2026-04-24 03:46:54.486000 | orchestrator | TASK [ceilometer : Set ceilometer policy file] ********************************* 2026-04-24 03:46:54.486010 | orchestrator | Friday 24 April 2026 03:46:50 +0000 (0:00:00.145) 0:00:33.229 ********** 2026-04-24 03:46:54.486077 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:54.486089 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:54.486100 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:54.486111 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:54.486121 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:54.486132 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:54.486142 | orchestrator | 2026-04-24 03:46:54.486153 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-24 03:46:54.486173 | orchestrator | Friday 24 April 2026 03:46:50 +0000 (0:00:00.603) 0:00:33.833 ********** 2026-04-24 03:46:54.486186 | orchestrator | included: /ansible/roles/ceilometer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:46:54.486198 | orchestrator | 2026-04-24 03:46:54.486209 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over extra CA certificates] ***** 2026-04-24 03:46:54.486219 | orchestrator | Friday 24 April 2026 03:46:52 +0000 (0:00:01.316) 0:00:35.150 ********** 2026-04-24 03:46:54.486231 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:54.486253 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:55.016229 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:55.016338 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:55.016373 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:55.016410 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:46:55.016424 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:46:55.016437 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:46:55.016467 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:46:55.016479 | orchestrator | 2026-04-24 03:46:55.016493 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS certificate] *** 2026-04-24 03:46:55.016506 | orchestrator | Friday 24 April 2026 03:46:54 +0000 (0:00:02.168) 0:00:37.319 ********** 2026-04-24 03:46:55.016518 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:55.016535 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:55.016556 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:55.016569 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:55.016580 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:55.016592 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:55.016603 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:55.016622 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:56.881167 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:56.881271 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:56.881289 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:56.881318 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:56.881353 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:56.881365 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:56.881376 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:46:56.881387 | orchestrator | 2026-04-24 03:46:56.881399 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS key] *** 2026-04-24 03:46:56.881411 | orchestrator | Friday 24 April 2026 03:46:55 +0000 (0:00:00.894) 0:00:38.213 ********** 2026-04-24 03:46:56.881423 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:56.881435 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:56.881465 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:56.881478 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:56.881502 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:46:56.881515 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:46:56.881526 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:46:56.881537 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:46:56.881548 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:46:56.881560 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:56.881572 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:46:56.881583 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:46:56.881595 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:46:56.881614 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:47:04.171553 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:47:04.171790 | orchestrator | 2026-04-24 03:47:04.171815 | orchestrator | TASK [ceilometer : Copying over config.json files for services] **************** 2026-04-24 03:47:04.171829 | orchestrator | Friday 24 April 2026 03:46:56 +0000 (0:00:01.495) 0:00:39.708 ********** 2026-04-24 03:47:04.171858 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:04.171875 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:04.171887 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:04.171899 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:04.171912 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:04.171944 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:04.171985 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:04.171999 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:04.172011 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:04.172022 | orchestrator | 2026-04-24 03:47:04.172033 | orchestrator | TASK [ceilometer : Copying over ceilometer.conf] ******************************* 2026-04-24 03:47:04.172044 | orchestrator | Friday 24 April 2026 03:46:59 +0000 (0:00:02.554) 0:00:42.263 ********** 2026-04-24 03:47:04.172056 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:04.172067 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:04.172094 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:13.285375 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:13.285484 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:13.285500 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:13.285513 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:13.285526 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:13.285560 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:13.285573 | orchestrator | 2026-04-24 03:47:13.285587 | orchestrator | TASK [ceilometer : Check custom event_definitions.yaml exists] ***************** 2026-04-24 03:47:13.285616 | orchestrator | Friday 24 April 2026 03:47:04 +0000 (0:00:04.742) 0:00:47.006 ********** 2026-04-24 03:47:13.285628 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:47:13.285640 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 03:47:13.285705 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 03:47:13.285718 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:47:13.285728 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 03:47:13.285739 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 03:47:13.285750 | orchestrator | 2026-04-24 03:47:13.285761 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml] ************************ 2026-04-24 03:47:13.285772 | orchestrator | Friday 24 April 2026 03:47:05 +0000 (0:00:01.552) 0:00:48.559 ********** 2026-04-24 03:47:13.285783 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:47:13.285793 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:47:13.285811 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:47:13.285822 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:47:13.285833 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:47:13.285844 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:47:13.285855 | orchestrator | 2026-04-24 03:47:13.285866 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml for notification service] *** 2026-04-24 03:47:13.285877 | orchestrator | Friday 24 April 2026 03:47:06 +0000 (0:00:00.610) 0:00:49.169 ********** 2026-04-24 03:47:13.285889 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:47:13.285901 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:47:13.285913 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:47:13.285925 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:47:13.285936 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:47:13.285948 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:47:13.285960 | orchestrator | 2026-04-24 03:47:13.285971 | orchestrator | TASK [ceilometer : Copying over event_pipeline.yaml] *************************** 2026-04-24 03:47:13.285983 | orchestrator | Friday 24 April 2026 03:47:07 +0000 (0:00:01.570) 0:00:50.740 ********** 2026-04-24 03:47:13.285995 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:47:13.286007 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:47:13.286070 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:47:13.286085 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:47:13.286097 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:47:13.286109 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:47:13.286121 | orchestrator | 2026-04-24 03:47:13.286133 | orchestrator | TASK [ceilometer : Check custom pipeline.yaml exists] ************************** 2026-04-24 03:47:13.286145 | orchestrator | Friday 24 April 2026 03:47:09 +0000 (0:00:01.334) 0:00:52.075 ********** 2026-04-24 03:47:13.286157 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:47:13.286169 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 03:47:13.286181 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:47:13.286192 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 03:47:13.286204 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 03:47:13.286216 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 03:47:13.286230 | orchestrator | 2026-04-24 03:47:13.286251 | orchestrator | TASK [ceilometer : Copying over custom pipeline.yaml file] ********************* 2026-04-24 03:47:13.286263 | orchestrator | Friday 24 April 2026 03:47:10 +0000 (0:00:01.603) 0:00:53.679 ********** 2026-04-24 03:47:13.286275 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:13.286288 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:13.286300 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:13.286326 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:14.102218 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:14.102344 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:14.102390 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:14.102405 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:14.102417 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:14.102429 | orchestrator | 2026-04-24 03:47:14.102443 | orchestrator | TASK [ceilometer : Copying over pipeline.yaml file] **************************** 2026-04-24 03:47:14.102456 | orchestrator | Friday 24 April 2026 03:47:13 +0000 (0:00:02.434) 0:00:56.113 ********** 2026-04-24 03:47:14.102484 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:47:14.102517 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:47:14.102531 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:47:14.102543 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:47:14.102563 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:47:14.102574 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:47:14.102586 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:47:14.102597 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:47:14.102609 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:47:14.102621 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:47:14.102638 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:47:14.102686 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:47:17.384978 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:47:17.385068 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:47:17.385083 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:47:17.385088 | orchestrator | 2026-04-24 03:47:17.385093 | orchestrator | TASK [ceilometer : Copying VMware vCenter CA file] ***************************** 2026-04-24 03:47:17.385099 | orchestrator | Friday 24 April 2026 03:47:14 +0000 (0:00:00.821) 0:00:56.935 ********** 2026-04-24 03:47:17.385103 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:47:17.385107 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:47:17.385111 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:47:17.385115 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:47:17.385119 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:47:17.385123 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:47:17.385127 | orchestrator | 2026-04-24 03:47:17.385132 | orchestrator | TASK [ceilometer : Copying over existing policy file] ************************** 2026-04-24 03:47:17.385136 | orchestrator | Friday 24 April 2026 03:47:14 +0000 (0:00:00.761) 0:00:57.696 ********** 2026-04-24 03:47:17.385142 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:47:17.385147 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:47:17.385152 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:47:17.385156 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:47:17.385173 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:47:17.385195 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:47:17.385215 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 03:47:17.385222 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 03:47:17.385230 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:47:17.385237 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:47:17.385244 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:47:17.385251 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:47:17.385259 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:47:17.385270 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-24 03:47:17.385279 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:47:17.385283 | orchestrator | 2026-04-24 03:47:17.385287 | orchestrator | TASK [ceilometer : Check ceilometer containers] ******************************** 2026-04-24 03:47:17.385291 | orchestrator | Friday 24 April 2026 03:47:15 +0000 (0:00:00.894) 0:00:58.591 ********** 2026-04-24 03:47:17.385305 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:49.368608 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:49.369527 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:49.369572 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:49.369595 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:49.369663 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:49.369720 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:49.369767 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 03:47:49.369788 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-24 03:47:49.369808 | orchestrator | 2026-04-24 03:47:49.369822 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-24 03:47:49.369835 | orchestrator | Friday 24 April 2026 03:47:17 +0000 (0:00:01.625) 0:01:00.217 ********** 2026-04-24 03:47:49.369846 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:47:49.369858 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:47:49.369869 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:47:49.369879 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:47:49.369890 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:47:49.369900 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:47:49.369911 | orchestrator | 2026-04-24 03:47:49.369922 | orchestrator | TASK [ceilometer : Running Ceilometer bootstrap container] ********************* 2026-04-24 03:47:49.369933 | orchestrator | Friday 24 April 2026 03:47:17 +0000 (0:00:00.587) 0:01:00.804 ********** 2026-04-24 03:47:49.369944 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:47:49.369954 | orchestrator | 2026-04-24 03:47:49.369965 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 03:47:49.369976 | orchestrator | Friday 24 April 2026 03:47:22 +0000 (0:00:04.210) 0:01:05.015 ********** 2026-04-24 03:47:49.369986 | orchestrator | 2026-04-24 03:47:49.369997 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 03:47:49.370008 | orchestrator | Friday 24 April 2026 03:47:22 +0000 (0:00:00.079) 0:01:05.094 ********** 2026-04-24 03:47:49.370080 | orchestrator | 2026-04-24 03:47:49.370092 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 03:47:49.370103 | orchestrator | Friday 24 April 2026 03:47:22 +0000 (0:00:00.079) 0:01:05.174 ********** 2026-04-24 03:47:49.370114 | orchestrator | 2026-04-24 03:47:49.370125 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 03:47:49.370136 | orchestrator | Friday 24 April 2026 03:47:22 +0000 (0:00:00.247) 0:01:05.422 ********** 2026-04-24 03:47:49.370147 | orchestrator | 2026-04-24 03:47:49.370157 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 03:47:49.370168 | orchestrator | Friday 24 April 2026 03:47:22 +0000 (0:00:00.074) 0:01:05.497 ********** 2026-04-24 03:47:49.370186 | orchestrator | 2026-04-24 03:47:49.370204 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 03:47:49.370216 | orchestrator | Friday 24 April 2026 03:47:22 +0000 (0:00:00.069) 0:01:05.566 ********** 2026-04-24 03:47:49.370226 | orchestrator | 2026-04-24 03:47:49.370237 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-notification container] ******* 2026-04-24 03:47:49.370248 | orchestrator | Friday 24 April 2026 03:47:22 +0000 (0:00:00.075) 0:01:05.641 ********** 2026-04-24 03:47:49.370258 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:47:49.370269 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:47:49.370279 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:47:49.370290 | orchestrator | 2026-04-24 03:47:49.370300 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-central container] ************ 2026-04-24 03:47:49.370318 | orchestrator | Friday 24 April 2026 03:47:33 +0000 (0:00:10.248) 0:01:15.890 ********** 2026-04-24 03:47:49.370329 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:47:49.370340 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:47:49.370350 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:47:49.370361 | orchestrator | 2026-04-24 03:47:49.370372 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-compute container] ************ 2026-04-24 03:47:49.370382 | orchestrator | Friday 24 April 2026 03:47:42 +0000 (0:00:09.644) 0:01:25.534 ********** 2026-04-24 03:47:49.370393 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:47:49.370404 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:47:49.370414 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:47:49.370425 | orchestrator | 2026-04-24 03:47:49.370435 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:47:49.370449 | orchestrator | testbed-node-0 : ok=29  changed=13  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-24 03:47:49.370470 | orchestrator | testbed-node-1 : ok=23  changed=10  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 03:47:49.370511 | orchestrator | testbed-node-2 : ok=23  changed=10  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 03:47:49.821491 | orchestrator | testbed-node-3 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-24 03:47:49.821587 | orchestrator | testbed-node-4 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-24 03:47:49.821602 | orchestrator | testbed-node-5 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-24 03:47:49.821615 | orchestrator | 2026-04-24 03:47:49.821627 | orchestrator | 2026-04-24 03:47:49.821639 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:47:49.821652 | orchestrator | Friday 24 April 2026 03:47:49 +0000 (0:00:06.663) 0:01:32.197 ********** 2026-04-24 03:47:49.821662 | orchestrator | =============================================================================== 2026-04-24 03:47:49.821761 | orchestrator | ceilometer : Restart ceilometer-notification container ----------------- 10.25s 2026-04-24 03:47:49.821775 | orchestrator | ceilometer : Restart ceilometer-central container ----------------------- 9.64s 2026-04-24 03:47:49.821786 | orchestrator | ceilometer : Restart ceilometer-compute container ----------------------- 6.66s 2026-04-24 03:47:49.821797 | orchestrator | ceilometer : Copying over ceilometer.conf ------------------------------- 4.74s 2026-04-24 03:47:49.821807 | orchestrator | ceilometer : Running Ceilometer bootstrap container --------------------- 4.21s 2026-04-24 03:47:49.821818 | orchestrator | service-ks-register : ceilometer | Granting user roles ------------------ 3.48s 2026-04-24 03:47:49.821829 | orchestrator | service-ks-register : ceilometer | Creating users ----------------------- 3.39s 2026-04-24 03:47:49.821839 | orchestrator | service-ks-register : ceilometer | Creating projects -------------------- 3.33s 2026-04-24 03:47:49.821850 | orchestrator | service-ks-register : ceilometer | Creating roles ----------------------- 2.82s 2026-04-24 03:47:49.821861 | orchestrator | ceilometer : Copying over config.json files for services ---------------- 2.55s 2026-04-24 03:47:49.821872 | orchestrator | ceilometer : Copying over custom pipeline.yaml file --------------------- 2.43s 2026-04-24 03:47:49.821882 | orchestrator | service-cert-copy : ceilometer | Copying over extra CA certificates ----- 2.17s 2026-04-24 03:47:49.821893 | orchestrator | ceilometer : Check ceilometer containers -------------------------------- 1.63s 2026-04-24 03:47:49.821903 | orchestrator | ceilometer : Check custom pipeline.yaml exists -------------------------- 1.60s 2026-04-24 03:47:49.821914 | orchestrator | ceilometer : Copying over event_definitions.yaml for notification service --- 1.57s 2026-04-24 03:47:49.821926 | orchestrator | ceilometer : Check custom event_definitions.yaml exists ----------------- 1.55s 2026-04-24 03:47:49.821937 | orchestrator | ceilometer : Check if the folder for custom meter definitions exist ----- 1.51s 2026-04-24 03:47:49.821947 | orchestrator | service-cert-copy : ceilometer | Copying over backend internal TLS key --- 1.50s 2026-04-24 03:47:49.821958 | orchestrator | ceilometer : Check if custom polling.yaml exists ------------------------ 1.47s 2026-04-24 03:47:49.821969 | orchestrator | ceilometer : Ensuring config directories exist -------------------------- 1.36s 2026-04-24 03:47:52.172920 | orchestrator | 2026-04-24 03:47:52 | INFO  | Task 491cfdfc-5158-416b-8871-dc3626f20b52 (aodh) was prepared for execution. 2026-04-24 03:47:52.173095 | orchestrator | 2026-04-24 03:47:52 | INFO  | It takes a moment until task 491cfdfc-5158-416b-8871-dc3626f20b52 (aodh) has been started and output is visible here. 2026-04-24 03:48:23.064295 | orchestrator | 2026-04-24 03:48:23.064403 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:48:23.064417 | orchestrator | 2026-04-24 03:48:23.064427 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:48:23.064438 | orchestrator | Friday 24 April 2026 03:47:56 +0000 (0:00:00.257) 0:00:00.257 ********** 2026-04-24 03:48:23.064452 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:48:23.064467 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:48:23.064482 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:48:23.064496 | orchestrator | 2026-04-24 03:48:23.064510 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:48:23.064542 | orchestrator | Friday 24 April 2026 03:47:56 +0000 (0:00:00.324) 0:00:00.582 ********** 2026-04-24 03:48:23.064558 | orchestrator | ok: [testbed-node-0] => (item=enable_aodh_True) 2026-04-24 03:48:23.064572 | orchestrator | ok: [testbed-node-1] => (item=enable_aodh_True) 2026-04-24 03:48:23.064602 | orchestrator | ok: [testbed-node-2] => (item=enable_aodh_True) 2026-04-24 03:48:23.064616 | orchestrator | 2026-04-24 03:48:23.064628 | orchestrator | PLAY [Apply role aodh] ********************************************************* 2026-04-24 03:48:23.064642 | orchestrator | 2026-04-24 03:48:23.064656 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-24 03:48:23.064671 | orchestrator | Friday 24 April 2026 03:47:57 +0000 (0:00:00.452) 0:00:01.035 ********** 2026-04-24 03:48:23.064687 | orchestrator | included: /ansible/roles/aodh/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:48:23.064801 | orchestrator | 2026-04-24 03:48:23.064813 | orchestrator | TASK [service-ks-register : aodh | Creating services] ************************** 2026-04-24 03:48:23.064822 | orchestrator | Friday 24 April 2026 03:47:57 +0000 (0:00:00.627) 0:00:01.663 ********** 2026-04-24 03:48:23.064831 | orchestrator | changed: [testbed-node-0] => (item=aodh (alarming)) 2026-04-24 03:48:23.064841 | orchestrator | 2026-04-24 03:48:23.064851 | orchestrator | TASK [service-ks-register : aodh | Creating endpoints] ************************* 2026-04-24 03:48:23.064862 | orchestrator | Friday 24 April 2026 03:48:01 +0000 (0:00:03.332) 0:00:04.996 ********** 2026-04-24 03:48:23.064872 | orchestrator | changed: [testbed-node-0] => (item=aodh -> https://api-int.testbed.osism.xyz:8042 -> internal) 2026-04-24 03:48:23.064884 | orchestrator | changed: [testbed-node-0] => (item=aodh -> https://api.testbed.osism.xyz:8042 -> public) 2026-04-24 03:48:23.064893 | orchestrator | 2026-04-24 03:48:23.064903 | orchestrator | TASK [service-ks-register : aodh | Creating projects] ************************** 2026-04-24 03:48:23.064913 | orchestrator | Friday 24 April 2026 03:48:07 +0000 (0:00:06.113) 0:00:11.110 ********** 2026-04-24 03:48:23.064924 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:48:23.064935 | orchestrator | 2026-04-24 03:48:23.064945 | orchestrator | TASK [service-ks-register : aodh | Creating users] ***************************** 2026-04-24 03:48:23.064954 | orchestrator | Friday 24 April 2026 03:48:10 +0000 (0:00:03.252) 0:00:14.362 ********** 2026-04-24 03:48:23.064964 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:48:23.064974 | orchestrator | changed: [testbed-node-0] => (item=aodh -> service) 2026-04-24 03:48:23.064984 | orchestrator | 2026-04-24 03:48:23.064994 | orchestrator | TASK [service-ks-register : aodh | Creating roles] ***************************** 2026-04-24 03:48:23.065004 | orchestrator | Friday 24 April 2026 03:48:14 +0000 (0:00:03.791) 0:00:18.153 ********** 2026-04-24 03:48:23.065014 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:48:23.065023 | orchestrator | 2026-04-24 03:48:23.065034 | orchestrator | TASK [service-ks-register : aodh | Granting user roles] ************************ 2026-04-24 03:48:23.065043 | orchestrator | Friday 24 April 2026 03:48:17 +0000 (0:00:03.077) 0:00:21.231 ********** 2026-04-24 03:48:23.065054 | orchestrator | changed: [testbed-node-0] => (item=aodh -> service -> admin) 2026-04-24 03:48:23.065063 | orchestrator | 2026-04-24 03:48:23.065073 | orchestrator | TASK [aodh : Ensuring config directories exist] ******************************** 2026-04-24 03:48:23.065083 | orchestrator | Friday 24 April 2026 03:48:21 +0000 (0:00:03.786) 0:00:25.017 ********** 2026-04-24 03:48:23.065097 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:23.065131 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:23.065157 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:23.065169 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:23.065181 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:23.065192 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:23.065202 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:23.065218 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:24.355026 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:24.356080 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:24.356170 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:24.356187 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:24.356199 | orchestrator | 2026-04-24 03:48:24.356213 | orchestrator | TASK [aodh : Check if policies shall be overwritten] *************************** 2026-04-24 03:48:24.356226 | orchestrator | Friday 24 April 2026 03:48:23 +0000 (0:00:01.939) 0:00:26.956 ********** 2026-04-24 03:48:24.356237 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:48:24.356250 | orchestrator | 2026-04-24 03:48:24.356261 | orchestrator | TASK [aodh : Set aodh policy file] ********************************************* 2026-04-24 03:48:24.356272 | orchestrator | Friday 24 April 2026 03:48:23 +0000 (0:00:00.126) 0:00:27.083 ********** 2026-04-24 03:48:24.356283 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:48:24.356294 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:48:24.356305 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:48:24.356315 | orchestrator | 2026-04-24 03:48:24.356326 | orchestrator | TASK [aodh : Copying over existing policy file] ******************************** 2026-04-24 03:48:24.356337 | orchestrator | Friday 24 April 2026 03:48:23 +0000 (0:00:00.505) 0:00:27.588 ********** 2026-04-24 03:48:24.356349 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:24.356414 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:24.356440 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:24.356453 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:24.356465 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:48:24.356476 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:24.356487 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:24.356499 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:24.356529 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:29.175070 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:48:29.175191 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:29.175209 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:29.175222 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:29.175233 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:29.175243 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:48:29.175254 | orchestrator | 2026-04-24 03:48:29.175265 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-24 03:48:29.175296 | orchestrator | Friday 24 April 2026 03:48:24 +0000 (0:00:00.663) 0:00:28.252 ********** 2026-04-24 03:48:29.175306 | orchestrator | included: /ansible/roles/aodh/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:48:29.175317 | orchestrator | 2026-04-24 03:48:29.175327 | orchestrator | TASK [service-cert-copy : aodh | Copying over extra CA certificates] *********** 2026-04-24 03:48:29.175337 | orchestrator | Friday 24 April 2026 03:48:25 +0000 (0:00:00.743) 0:00:28.995 ********** 2026-04-24 03:48:29.175348 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:29.175380 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:29.175392 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:29.175402 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:29.175413 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:29.175432 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:29.175443 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:29.175465 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:29.877232 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:29.877336 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:29.877352 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:29.877390 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:29.877403 | orchestrator | 2026-04-24 03:48:29.877417 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS certificate] *** 2026-04-24 03:48:29.877430 | orchestrator | Friday 24 April 2026 03:48:29 +0000 (0:00:04.071) 0:00:33.067 ********** 2026-04-24 03:48:29.877444 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:29.877490 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:29.877505 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:29.877516 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:29.877560 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:29.877583 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:29.877603 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:29.877622 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:29.877640 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:48:29.877660 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:48:29.877729 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:30.969094 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:30.969199 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:30.969241 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:30.969255 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:48:30.969269 | orchestrator | 2026-04-24 03:48:30.969281 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS key] ******** 2026-04-24 03:48:30.969294 | orchestrator | Friday 24 April 2026 03:48:29 +0000 (0:00:00.704) 0:00:33.772 ********** 2026-04-24 03:48:30.969306 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:30.969335 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:30.969348 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:30.969379 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:30.969399 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:48:30.969411 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:30.969423 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:30.969435 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:30.969446 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:30.969464 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:48:30.969482 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-24 03:48:34.933657 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 03:48:34.933837 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 03:48:34.933859 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 03:48:34.933874 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:48:34.933889 | orchestrator | 2026-04-24 03:48:34.933903 | orchestrator | TASK [aodh : Copying over config.json files for services] ********************** 2026-04-24 03:48:34.933919 | orchestrator | Friday 24 April 2026 03:48:30 +0000 (0:00:01.088) 0:00:34.860 ********** 2026-04-24 03:48:34.933933 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:34.933963 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:34.933999 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:34.934077 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:34.934089 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:34.934097 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:34.934105 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:34.934117 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:34.934125 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:34.934146 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281089 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281215 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281244 | orchestrator | 2026-04-24 03:48:43.281267 | orchestrator | TASK [aodh : Copying over aodh.conf] ******************************************* 2026-04-24 03:48:43.281282 | orchestrator | Friday 24 April 2026 03:48:34 +0000 (0:00:03.963) 0:00:38.824 ********** 2026-04-24 03:48:43.281296 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:43.281327 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:43.281383 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:43.281416 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281441 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281453 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281464 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281481 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281493 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281513 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:43.281534 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110466 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110581 | orchestrator | 2026-04-24 03:48:48.110599 | orchestrator | TASK [aodh : Copying over wsgi-aodh files for services] ************************ 2026-04-24 03:48:48.110612 | orchestrator | Friday 24 April 2026 03:48:43 +0000 (0:00:08.347) 0:00:47.171 ********** 2026-04-24 03:48:48.110624 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:48:48.110635 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:48:48.110646 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:48:48.110657 | orchestrator | 2026-04-24 03:48:48.110669 | orchestrator | TASK [aodh : Check aodh containers] ******************************************** 2026-04-24 03:48:48.110679 | orchestrator | Friday 24 April 2026 03:48:44 +0000 (0:00:01.728) 0:00:48.900 ********** 2026-04-24 03:48:48.110692 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:48.110802 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:48.110843 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-24 03:48:48.110875 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110889 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110901 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110912 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110936 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110949 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110960 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:48:48.110982 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:49:41.996453 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 03:49:41.997460 | orchestrator | 2026-04-24 03:49:41.997516 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-24 03:49:41.997537 | orchestrator | Friday 24 April 2026 03:48:48 +0000 (0:00:03.103) 0:00:52.003 ********** 2026-04-24 03:49:41.997548 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:49:41.997560 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:49:41.997571 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:49:41.997581 | orchestrator | 2026-04-24 03:49:41.997592 | orchestrator | TASK [aodh : Creating aodh database] ******************************************* 2026-04-24 03:49:41.997604 | orchestrator | Friday 24 April 2026 03:48:48 +0000 (0:00:00.305) 0:00:52.309 ********** 2026-04-24 03:49:41.997614 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:49:41.997625 | orchestrator | 2026-04-24 03:49:41.997636 | orchestrator | TASK [aodh : Creating aodh database user and setting permissions] ************** 2026-04-24 03:49:41.997647 | orchestrator | Friday 24 April 2026 03:48:50 +0000 (0:00:02.054) 0:00:54.363 ********** 2026-04-24 03:49:41.997720 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:49:41.997732 | orchestrator | 2026-04-24 03:49:41.997744 | orchestrator | TASK [aodh : Running aodh bootstrap container] ********************************* 2026-04-24 03:49:41.997754 | orchestrator | Friday 24 April 2026 03:48:52 +0000 (0:00:02.188) 0:00:56.552 ********** 2026-04-24 03:49:41.997765 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:49:41.997776 | orchestrator | 2026-04-24 03:49:41.997786 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-24 03:49:41.997797 | orchestrator | Friday 24 April 2026 03:49:05 +0000 (0:00:12.718) 0:01:09.271 ********** 2026-04-24 03:49:41.997807 | orchestrator | 2026-04-24 03:49:41.997818 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-24 03:49:41.997829 | orchestrator | Friday 24 April 2026 03:49:05 +0000 (0:00:00.070) 0:01:09.341 ********** 2026-04-24 03:49:41.997839 | orchestrator | 2026-04-24 03:49:41.997850 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-24 03:49:41.997861 | orchestrator | Friday 24 April 2026 03:49:05 +0000 (0:00:00.071) 0:01:09.413 ********** 2026-04-24 03:49:41.997871 | orchestrator | 2026-04-24 03:49:41.997882 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-api container] **************************** 2026-04-24 03:49:41.997909 | orchestrator | Friday 24 April 2026 03:49:05 +0000 (0:00:00.256) 0:01:09.669 ********** 2026-04-24 03:49:41.997920 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:49:41.997932 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:49:41.997942 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:49:41.997953 | orchestrator | 2026-04-24 03:49:41.997964 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-evaluator container] ********************** 2026-04-24 03:49:41.997974 | orchestrator | Friday 24 April 2026 03:49:16 +0000 (0:00:10.340) 0:01:20.010 ********** 2026-04-24 03:49:41.997985 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:49:41.997995 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:49:41.998006 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:49:41.998070 | orchestrator | 2026-04-24 03:49:41.998082 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-listener container] *********************** 2026-04-24 03:49:41.998093 | orchestrator | Friday 24 April 2026 03:49:25 +0000 (0:00:09.834) 0:01:29.844 ********** 2026-04-24 03:49:41.998104 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:49:41.998114 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:49:41.998125 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:49:41.998136 | orchestrator | 2026-04-24 03:49:41.998146 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-notifier container] *********************** 2026-04-24 03:49:41.998157 | orchestrator | Friday 24 April 2026 03:49:31 +0000 (0:00:05.420) 0:01:35.264 ********** 2026-04-24 03:49:41.998167 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:49:41.998178 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:49:41.998189 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:49:41.998199 | orchestrator | 2026-04-24 03:49:41.998210 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:49:41.998222 | orchestrator | testbed-node-0 : ok=23  changed=17  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 03:49:41.998235 | orchestrator | testbed-node-1 : ok=14  changed=10  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 03:49:41.998246 | orchestrator | testbed-node-2 : ok=14  changed=10  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 03:49:41.998256 | orchestrator | 2026-04-24 03:49:41.998267 | orchestrator | 2026-04-24 03:49:41.998278 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:49:41.998289 | orchestrator | Friday 24 April 2026 03:49:41 +0000 (0:00:10.093) 0:01:45.358 ********** 2026-04-24 03:49:41.998299 | orchestrator | =============================================================================== 2026-04-24 03:49:41.998318 | orchestrator | aodh : Running aodh bootstrap container -------------------------------- 12.72s 2026-04-24 03:49:41.998330 | orchestrator | aodh : Restart aodh-api container -------------------------------------- 10.34s 2026-04-24 03:49:41.998362 | orchestrator | aodh : Restart aodh-notifier container --------------------------------- 10.09s 2026-04-24 03:49:41.998374 | orchestrator | aodh : Restart aodh-evaluator container --------------------------------- 9.83s 2026-04-24 03:49:41.998385 | orchestrator | aodh : Copying over aodh.conf ------------------------------------------- 8.35s 2026-04-24 03:49:41.998395 | orchestrator | service-ks-register : aodh | Creating endpoints ------------------------- 6.11s 2026-04-24 03:49:41.998406 | orchestrator | aodh : Restart aodh-listener container ---------------------------------- 5.42s 2026-04-24 03:49:41.998417 | orchestrator | service-cert-copy : aodh | Copying over extra CA certificates ----------- 4.07s 2026-04-24 03:49:41.998427 | orchestrator | aodh : Copying over config.json files for services ---------------------- 3.96s 2026-04-24 03:49:41.998438 | orchestrator | service-ks-register : aodh | Creating users ----------------------------- 3.79s 2026-04-24 03:49:41.998449 | orchestrator | service-ks-register : aodh | Granting user roles ------------------------ 3.79s 2026-04-24 03:49:41.998459 | orchestrator | service-ks-register : aodh | Creating services -------------------------- 3.33s 2026-04-24 03:49:41.998470 | orchestrator | service-ks-register : aodh | Creating projects -------------------------- 3.25s 2026-04-24 03:49:41.998480 | orchestrator | aodh : Check aodh containers -------------------------------------------- 3.10s 2026-04-24 03:49:41.998491 | orchestrator | service-ks-register : aodh | Creating roles ----------------------------- 3.08s 2026-04-24 03:49:41.998502 | orchestrator | aodh : Creating aodh database user and setting permissions -------------- 2.19s 2026-04-24 03:49:41.998512 | orchestrator | aodh : Creating aodh database ------------------------------------------- 2.05s 2026-04-24 03:49:41.998523 | orchestrator | aodh : Ensuring config directories exist -------------------------------- 1.94s 2026-04-24 03:49:41.998533 | orchestrator | aodh : Copying over wsgi-aodh files for services ------------------------ 1.73s 2026-04-24 03:49:41.998544 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS key -------- 1.09s 2026-04-24 03:49:44.352446 | orchestrator | 2026-04-24 03:49:44 | INFO  | Task 7a317200-a81b-468d-b765-26d93db005ab (kolla-ceph-rgw) was prepared for execution. 2026-04-24 03:49:44.352551 | orchestrator | 2026-04-24 03:49:44 | INFO  | It takes a moment until task 7a317200-a81b-468d-b765-26d93db005ab (kolla-ceph-rgw) has been started and output is visible here. 2026-04-24 03:50:19.418632 | orchestrator | 2026-04-24 03:50:19.418797 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:50:19.418814 | orchestrator | 2026-04-24 03:50:19.418827 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:50:19.418839 | orchestrator | Friday 24 April 2026 03:49:48 +0000 (0:00:00.277) 0:00:00.277 ********** 2026-04-24 03:50:19.418850 | orchestrator | ok: [testbed-manager] 2026-04-24 03:50:19.418862 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:50:19.418872 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:50:19.418900 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:50:19.418912 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:50:19.418923 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:50:19.418934 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:50:19.418945 | orchestrator | 2026-04-24 03:50:19.418956 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:50:19.418967 | orchestrator | Friday 24 April 2026 03:49:49 +0000 (0:00:00.891) 0:00:01.168 ********** 2026-04-24 03:50:19.418979 | orchestrator | ok: [testbed-manager] => (item=enable_ceph_rgw_True) 2026-04-24 03:50:19.418990 | orchestrator | ok: [testbed-node-0] => (item=enable_ceph_rgw_True) 2026-04-24 03:50:19.419001 | orchestrator | ok: [testbed-node-1] => (item=enable_ceph_rgw_True) 2026-04-24 03:50:19.419012 | orchestrator | ok: [testbed-node-2] => (item=enable_ceph_rgw_True) 2026-04-24 03:50:19.419023 | orchestrator | ok: [testbed-node-3] => (item=enable_ceph_rgw_True) 2026-04-24 03:50:19.419056 | orchestrator | ok: [testbed-node-4] => (item=enable_ceph_rgw_True) 2026-04-24 03:50:19.419068 | orchestrator | ok: [testbed-node-5] => (item=enable_ceph_rgw_True) 2026-04-24 03:50:19.419079 | orchestrator | 2026-04-24 03:50:19.419089 | orchestrator | PLAY [Apply role ceph-rgw] ***************************************************** 2026-04-24 03:50:19.419100 | orchestrator | 2026-04-24 03:50:19.419111 | orchestrator | TASK [ceph-rgw : include_tasks] ************************************************ 2026-04-24 03:50:19.419122 | orchestrator | Friday 24 April 2026 03:49:50 +0000 (0:00:00.730) 0:00:01.899 ********** 2026-04-24 03:50:19.419133 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:50:19.419145 | orchestrator | 2026-04-24 03:50:19.419156 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating services] ********************** 2026-04-24 03:50:19.419168 | orchestrator | Friday 24 April 2026 03:49:51 +0000 (0:00:01.565) 0:00:03.464 ********** 2026-04-24 03:50:19.419181 | orchestrator | changed: [testbed-manager] => (item=swift (object-store)) 2026-04-24 03:50:19.419193 | orchestrator | 2026-04-24 03:50:19.419206 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating endpoints] ********************* 2026-04-24 03:50:19.419218 | orchestrator | Friday 24 April 2026 03:49:55 +0000 (0:00:03.625) 0:00:07.090 ********** 2026-04-24 03:50:19.419230 | orchestrator | changed: [testbed-manager] => (item=swift -> https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s -> internal) 2026-04-24 03:50:19.419245 | orchestrator | changed: [testbed-manager] => (item=swift -> https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s -> public) 2026-04-24 03:50:19.419258 | orchestrator | 2026-04-24 03:50:19.419271 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating projects] ********************** 2026-04-24 03:50:19.419283 | orchestrator | Friday 24 April 2026 03:50:01 +0000 (0:00:06.177) 0:00:13.267 ********** 2026-04-24 03:50:19.419296 | orchestrator | ok: [testbed-manager] => (item=service) 2026-04-24 03:50:19.419309 | orchestrator | 2026-04-24 03:50:19.419321 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating users] ************************* 2026-04-24 03:50:19.419334 | orchestrator | Friday 24 April 2026 03:50:04 +0000 (0:00:03.068) 0:00:16.336 ********** 2026-04-24 03:50:19.419346 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:50:19.419358 | orchestrator | changed: [testbed-manager] => (item=ceph_rgw -> service) 2026-04-24 03:50:19.419370 | orchestrator | 2026-04-24 03:50:19.419383 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating roles] ************************* 2026-04-24 03:50:19.419395 | orchestrator | Friday 24 April 2026 03:50:08 +0000 (0:00:03.551) 0:00:19.888 ********** 2026-04-24 03:50:19.419407 | orchestrator | ok: [testbed-manager] => (item=admin) 2026-04-24 03:50:19.419420 | orchestrator | changed: [testbed-manager] => (item=ResellerAdmin) 2026-04-24 03:50:19.419432 | orchestrator | 2026-04-24 03:50:19.419446 | orchestrator | TASK [service-ks-register : ceph-rgw | Granting user roles] ******************** 2026-04-24 03:50:19.419457 | orchestrator | Friday 24 April 2026 03:50:14 +0000 (0:00:06.092) 0:00:25.981 ********** 2026-04-24 03:50:19.419468 | orchestrator | changed: [testbed-manager] => (item=ceph_rgw -> service -> admin) 2026-04-24 03:50:19.419479 | orchestrator | 2026-04-24 03:50:19.419490 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:50:19.419501 | orchestrator | testbed-manager : ok=9  changed=5  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:19.419512 | orchestrator | testbed-node-0 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:19.419523 | orchestrator | testbed-node-1 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:19.419534 | orchestrator | testbed-node-2 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:19.419545 | orchestrator | testbed-node-3 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:19.419581 | orchestrator | testbed-node-4 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:19.419594 | orchestrator | testbed-node-5 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:19.419605 | orchestrator | 2026-04-24 03:50:19.419616 | orchestrator | 2026-04-24 03:50:19.419627 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:50:19.419638 | orchestrator | Friday 24 April 2026 03:50:18 +0000 (0:00:04.688) 0:00:30.670 ********** 2026-04-24 03:50:19.419674 | orchestrator | =============================================================================== 2026-04-24 03:50:19.419685 | orchestrator | service-ks-register : ceph-rgw | Creating endpoints --------------------- 6.18s 2026-04-24 03:50:19.419696 | orchestrator | service-ks-register : ceph-rgw | Creating roles ------------------------- 6.09s 2026-04-24 03:50:19.419707 | orchestrator | service-ks-register : ceph-rgw | Granting user roles -------------------- 4.69s 2026-04-24 03:50:19.419718 | orchestrator | service-ks-register : ceph-rgw | Creating services ---------------------- 3.63s 2026-04-24 03:50:19.419729 | orchestrator | service-ks-register : ceph-rgw | Creating users ------------------------- 3.55s 2026-04-24 03:50:19.419739 | orchestrator | service-ks-register : ceph-rgw | Creating projects ---------------------- 3.07s 2026-04-24 03:50:19.419750 | orchestrator | ceph-rgw : include_tasks ------------------------------------------------ 1.57s 2026-04-24 03:50:19.419761 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.89s 2026-04-24 03:50:19.419772 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.73s 2026-04-24 03:50:21.822424 | orchestrator | 2026-04-24 03:50:21 | INFO  | Task fa0d941e-0dea-42bd-9f2b-89dda57cbd1c (gnocchi) was prepared for execution. 2026-04-24 03:50:21.822520 | orchestrator | 2026-04-24 03:50:21 | INFO  | It takes a moment until task fa0d941e-0dea-42bd-9f2b-89dda57cbd1c (gnocchi) has been started and output is visible here. 2026-04-24 03:50:27.010294 | orchestrator | 2026-04-24 03:50:27.010405 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:50:27.010422 | orchestrator | 2026-04-24 03:50:27.010435 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:50:27.010447 | orchestrator | Friday 24 April 2026 03:50:25 +0000 (0:00:00.259) 0:00:00.259 ********** 2026-04-24 03:50:27.010458 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:50:27.010470 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:50:27.010481 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:50:27.010492 | orchestrator | 2026-04-24 03:50:27.010503 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:50:27.010513 | orchestrator | Friday 24 April 2026 03:50:26 +0000 (0:00:00.322) 0:00:00.582 ********** 2026-04-24 03:50:27.010524 | orchestrator | ok: [testbed-node-0] => (item=enable_gnocchi_False) 2026-04-24 03:50:27.010536 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: enable_gnocchi_True 2026-04-24 03:50:27.010547 | orchestrator | ok: [testbed-node-1] => (item=enable_gnocchi_False) 2026-04-24 03:50:27.010558 | orchestrator | ok: [testbed-node-2] => (item=enable_gnocchi_False) 2026-04-24 03:50:27.010569 | orchestrator | 2026-04-24 03:50:27.010579 | orchestrator | PLAY [Apply role gnocchi] ****************************************************** 2026-04-24 03:50:27.010590 | orchestrator | skipping: no hosts matched 2026-04-24 03:50:27.010602 | orchestrator | 2026-04-24 03:50:27.010613 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:50:27.010624 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:27.010761 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:27.010809 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:50:27.010821 | orchestrator | 2026-04-24 03:50:27.010832 | orchestrator | 2026-04-24 03:50:27.010845 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:50:27.010858 | orchestrator | Friday 24 April 2026 03:50:26 +0000 (0:00:00.381) 0:00:00.963 ********** 2026-04-24 03:50:27.010871 | orchestrator | =============================================================================== 2026-04-24 03:50:27.010884 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.38s 2026-04-24 03:50:27.010896 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.32s 2026-04-24 03:50:29.345729 | orchestrator | 2026-04-24 03:50:29 | INFO  | Task 0a05df57-3b80-48f0-9479-94e776069dd4 (manila) was prepared for execution. 2026-04-24 03:50:29.345828 | orchestrator | 2026-04-24 03:50:29 | INFO  | It takes a moment until task 0a05df57-3b80-48f0-9479-94e776069dd4 (manila) has been started and output is visible here. 2026-04-24 03:51:09.842560 | orchestrator | 2026-04-24 03:51:09.842665 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:51:09.842676 | orchestrator | 2026-04-24 03:51:09.842683 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:51:09.842689 | orchestrator | Friday 24 April 2026 03:50:33 +0000 (0:00:00.267) 0:00:00.267 ********** 2026-04-24 03:51:09.842695 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:51:09.842701 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:51:09.842707 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:51:09.842712 | orchestrator | 2026-04-24 03:51:09.842718 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:51:09.842723 | orchestrator | Friday 24 April 2026 03:50:33 +0000 (0:00:00.319) 0:00:00.586 ********** 2026-04-24 03:51:09.842729 | orchestrator | ok: [testbed-node-0] => (item=enable_manila_True) 2026-04-24 03:51:09.842735 | orchestrator | ok: [testbed-node-1] => (item=enable_manila_True) 2026-04-24 03:51:09.842740 | orchestrator | ok: [testbed-node-2] => (item=enable_manila_True) 2026-04-24 03:51:09.842746 | orchestrator | 2026-04-24 03:51:09.842751 | orchestrator | PLAY [Apply role manila] ******************************************************* 2026-04-24 03:51:09.842756 | orchestrator | 2026-04-24 03:51:09.842762 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-24 03:51:09.842778 | orchestrator | Friday 24 April 2026 03:50:34 +0000 (0:00:00.447) 0:00:01.034 ********** 2026-04-24 03:51:09.842784 | orchestrator | included: /ansible/roles/manila/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:51:09.842790 | orchestrator | 2026-04-24 03:51:09.842796 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-24 03:51:09.842801 | orchestrator | Friday 24 April 2026 03:50:34 +0000 (0:00:00.563) 0:00:01.598 ********** 2026-04-24 03:51:09.842807 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:51:09.842814 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:51:09.842819 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:51:09.842824 | orchestrator | 2026-04-24 03:51:09.842830 | orchestrator | TASK [service-ks-register : manila | Creating services] ************************ 2026-04-24 03:51:09.842835 | orchestrator | Friday 24 April 2026 03:50:35 +0000 (0:00:00.458) 0:00:02.056 ********** 2026-04-24 03:51:09.842841 | orchestrator | changed: [testbed-node-0] => (item=manila (share)) 2026-04-24 03:51:09.842846 | orchestrator | changed: [testbed-node-0] => (item=manilav2 (sharev2)) 2026-04-24 03:51:09.842851 | orchestrator | 2026-04-24 03:51:09.842857 | orchestrator | TASK [service-ks-register : manila | Creating endpoints] *********************** 2026-04-24 03:51:09.842862 | orchestrator | Friday 24 April 2026 03:50:41 +0000 (0:00:06.311) 0:00:08.368 ********** 2026-04-24 03:51:09.842868 | orchestrator | changed: [testbed-node-0] => (item=manila -> https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s -> internal) 2026-04-24 03:51:09.842891 | orchestrator | changed: [testbed-node-0] => (item=manila -> https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s -> public) 2026-04-24 03:51:09.842897 | orchestrator | changed: [testbed-node-0] => (item=manilav2 -> https://api-int.testbed.osism.xyz:8786/v2 -> internal) 2026-04-24 03:51:09.842902 | orchestrator | changed: [testbed-node-0] => (item=manilav2 -> https://api.testbed.osism.xyz:8786/v2 -> public) 2026-04-24 03:51:09.842908 | orchestrator | 2026-04-24 03:51:09.842913 | orchestrator | TASK [service-ks-register : manila | Creating projects] ************************ 2026-04-24 03:51:09.842919 | orchestrator | Friday 24 April 2026 03:50:54 +0000 (0:00:12.391) 0:00:20.759 ********** 2026-04-24 03:51:09.842924 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 03:51:09.842929 | orchestrator | 2026-04-24 03:51:09.842935 | orchestrator | TASK [service-ks-register : manila | Creating users] *************************** 2026-04-24 03:51:09.842940 | orchestrator | Friday 24 April 2026 03:50:57 +0000 (0:00:03.137) 0:00:23.897 ********** 2026-04-24 03:51:09.842945 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 03:51:09.842951 | orchestrator | changed: [testbed-node-0] => (item=manila -> service) 2026-04-24 03:51:09.842956 | orchestrator | 2026-04-24 03:51:09.842961 | orchestrator | TASK [service-ks-register : manila | Creating roles] *************************** 2026-04-24 03:51:09.842967 | orchestrator | Friday 24 April 2026 03:51:00 +0000 (0:00:03.735) 0:00:27.632 ********** 2026-04-24 03:51:09.842972 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 03:51:09.842977 | orchestrator | 2026-04-24 03:51:09.842983 | orchestrator | TASK [service-ks-register : manila | Granting user roles] ********************** 2026-04-24 03:51:09.842988 | orchestrator | Friday 24 April 2026 03:51:03 +0000 (0:00:03.001) 0:00:30.634 ********** 2026-04-24 03:51:09.842993 | orchestrator | changed: [testbed-node-0] => (item=manila -> service -> admin) 2026-04-24 03:51:09.842999 | orchestrator | 2026-04-24 03:51:09.843004 | orchestrator | TASK [manila : Ensuring config directories exist] ****************************** 2026-04-24 03:51:09.843009 | orchestrator | Friday 24 April 2026 03:51:07 +0000 (0:00:03.801) 0:00:34.436 ********** 2026-04-24 03:51:09.843028 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:09.843041 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:09.843047 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:09.843058 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:09.843066 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:09.843071 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:09.843082 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:20.265571 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:20.265762 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:20.265822 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:20.265845 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:20.265866 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:20.265884 | orchestrator | 2026-04-24 03:51:20.265898 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-24 03:51:20.265911 | orchestrator | Friday 24 April 2026 03:51:09 +0000 (0:00:02.185) 0:00:36.621 ********** 2026-04-24 03:51:20.265923 | orchestrator | included: /ansible/roles/manila/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:51:20.265934 | orchestrator | 2026-04-24 03:51:20.265945 | orchestrator | TASK [manila : Ensuring manila service ceph config subdir exists] ************** 2026-04-24 03:51:20.265956 | orchestrator | Friday 24 April 2026 03:51:10 +0000 (0:00:00.561) 0:00:37.183 ********** 2026-04-24 03:51:20.265967 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:51:20.265979 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:51:20.265989 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:51:20.266000 | orchestrator | 2026-04-24 03:51:20.266010 | orchestrator | TASK [manila : Copy over multiple ceph configs for Manila] ********************* 2026-04-24 03:51:20.266099 | orchestrator | Friday 24 April 2026 03:51:11 +0000 (0:00:00.997) 0:00:38.181 ********** 2026-04-24 03:51:20.266119 | orchestrator | changed: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 03:51:20.266155 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 03:51:20.266168 | orchestrator | changed: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 03:51:20.266192 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 03:51:20.266212 | orchestrator | changed: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 03:51:20.266224 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 03:51:20.266236 | orchestrator | 2026-04-24 03:51:20.266248 | orchestrator | TASK [manila : Copy over ceph Manila keyrings] ********************************* 2026-04-24 03:51:20.266260 | orchestrator | Friday 24 April 2026 03:51:13 +0000 (0:00:01.787) 0:00:39.968 ********** 2026-04-24 03:51:20.266272 | orchestrator | changed: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 03:51:20.266285 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 03:51:20.266297 | orchestrator | changed: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 03:51:20.266310 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 03:51:20.266322 | orchestrator | changed: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 03:51:20.266334 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 03:51:20.266346 | orchestrator | 2026-04-24 03:51:20.266358 | orchestrator | TASK [manila : Ensuring config directory has correct owner and permission] ***** 2026-04-24 03:51:20.266370 | orchestrator | Friday 24 April 2026 03:51:14 +0000 (0:00:01.234) 0:00:41.203 ********** 2026-04-24 03:51:20.266383 | orchestrator | ok: [testbed-node-0] => (item=manila-share) 2026-04-24 03:51:20.266395 | orchestrator | ok: [testbed-node-1] => (item=manila-share) 2026-04-24 03:51:20.266407 | orchestrator | ok: [testbed-node-2] => (item=manila-share) 2026-04-24 03:51:20.266419 | orchestrator | 2026-04-24 03:51:20.266430 | orchestrator | TASK [manila : Check if policies shall be overwritten] ************************* 2026-04-24 03:51:20.266441 | orchestrator | Friday 24 April 2026 03:51:15 +0000 (0:00:00.672) 0:00:41.876 ********** 2026-04-24 03:51:20.266452 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:51:20.266463 | orchestrator | 2026-04-24 03:51:20.266473 | orchestrator | TASK [manila : Set manila policy file] ***************************************** 2026-04-24 03:51:20.266484 | orchestrator | Friday 24 April 2026 03:51:15 +0000 (0:00:00.153) 0:00:42.029 ********** 2026-04-24 03:51:20.266495 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:51:20.266505 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:51:20.266516 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:51:20.266527 | orchestrator | 2026-04-24 03:51:20.266537 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-24 03:51:20.266548 | orchestrator | Friday 24 April 2026 03:51:15 +0000 (0:00:00.499) 0:00:42.528 ********** 2026-04-24 03:51:20.266559 | orchestrator | included: /ansible/roles/manila/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:51:20.266570 | orchestrator | 2026-04-24 03:51:20.266581 | orchestrator | TASK [service-cert-copy : manila | Copying over extra CA certificates] ********* 2026-04-24 03:51:20.266625 | orchestrator | Friday 24 April 2026 03:51:16 +0000 (0:00:00.574) 0:00:43.102 ********** 2026-04-24 03:51:20.266647 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:21.230706 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:21.230809 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:21.230826 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230840 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230873 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230902 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230921 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230933 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230945 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230957 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230968 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:21.230987 | orchestrator | 2026-04-24 03:51:21.231000 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS certificate] *** 2026-04-24 03:51:21.231013 | orchestrator | Friday 24 April 2026 03:51:20 +0000 (0:00:03.953) 0:00:47.056 ********** 2026-04-24 03:51:21.231033 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:21.870755 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.870863 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.870881 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.870895 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:51:21.870909 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:21.870948 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.870962 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.871000 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.871014 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:51:21.871026 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:21.871038 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.871057 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.871069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:21.871081 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:51:21.871093 | orchestrator | 2026-04-24 03:51:21.871105 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS key] ****** 2026-04-24 03:51:21.871145 | orchestrator | Friday 24 April 2026 03:51:21 +0000 (0:00:00.961) 0:00:48.018 ********** 2026-04-24 03:51:21.871171 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:26.229362 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229469 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229487 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229529 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:51:26.229544 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:26.229557 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229584 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229675 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229688 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:51:26.229700 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:26.229721 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229733 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229745 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:26.229756 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:51:26.229768 | orchestrator | 2026-04-24 03:51:26.229781 | orchestrator | TASK [manila : Copying over config.json files for services] ******************** 2026-04-24 03:51:26.229794 | orchestrator | Friday 24 April 2026 03:51:22 +0000 (0:00:00.862) 0:00:48.881 ********** 2026-04-24 03:51:26.229820 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:32.910203 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:32.910331 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:32.910348 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910361 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910371 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910411 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910424 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910442 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910452 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910463 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910473 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:32.910484 | orchestrator | 2026-04-24 03:51:32.910495 | orchestrator | TASK [manila : Copying over manila.conf] *************************************** 2026-04-24 03:51:32.910507 | orchestrator | Friday 24 April 2026 03:51:26 +0000 (0:00:04.338) 0:00:53.220 ********** 2026-04-24 03:51:32.910528 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:37.104777 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:37.104871 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:51:37.104885 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:37.104896 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:37.104920 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:37.104943 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:37.104971 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:37.104980 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:37.104989 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:37.104998 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:37.105006 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:51:37.105015 | orchestrator | 2026-04-24 03:51:37.105025 | orchestrator | TASK [manila : Copying over manila-share.conf] ********************************* 2026-04-24 03:51:37.105040 | orchestrator | Friday 24 April 2026 03:51:33 +0000 (0:00:06.486) 0:00:59.706 ********** 2026-04-24 03:51:37.105049 | orchestrator | changed: [testbed-node-0] => (item=manila-share) 2026-04-24 03:51:37.105057 | orchestrator | changed: [testbed-node-2] => (item=manila-share) 2026-04-24 03:51:37.105065 | orchestrator | changed: [testbed-node-1] => (item=manila-share) 2026-04-24 03:51:37.105079 | orchestrator | 2026-04-24 03:51:37.105087 | orchestrator | TASK [manila : Copying over existing policy file] ****************************** 2026-04-24 03:51:37.105095 | orchestrator | Friday 24 April 2026 03:51:36 +0000 (0:00:03.490) 0:01:03.197 ********** 2026-04-24 03:51:37.105110 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:40.451313 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451438 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451457 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451472 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:51:40.451487 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:40.451546 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451557 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451629 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451640 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:51:40.451649 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-24 03:51:40.451657 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451666 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451686 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 03:51:40.451695 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:51:40.451703 | orchestrator | 2026-04-24 03:51:40.451712 | orchestrator | TASK [manila : Check manila containers] **************************************** 2026-04-24 03:51:40.451721 | orchestrator | Friday 24 April 2026 03:51:37 +0000 (0:00:00.697) 0:01:03.894 ********** 2026-04-24 03:51:40.451736 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:52:19.125136 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:52:19.125231 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-24 03:52:19.125244 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125286 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125295 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125314 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125322 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125329 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125336 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125353 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125360 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 03:52:19.125368 | orchestrator | 2026-04-24 03:52:19.125376 | orchestrator | TASK [manila : Creating Manila database] *************************************** 2026-04-24 03:52:19.125385 | orchestrator | Friday 24 April 2026 03:51:40 +0000 (0:00:03.361) 0:01:07.255 ********** 2026-04-24 03:52:19.125392 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:52:19.125400 | orchestrator | 2026-04-24 03:52:19.125407 | orchestrator | TASK [manila : Creating Manila database user and setting permissions] ********** 2026-04-24 03:52:19.125414 | orchestrator | Friday 24 April 2026 03:51:42 +0000 (0:00:02.076) 0:01:09.331 ********** 2026-04-24 03:52:19.125420 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:52:19.125427 | orchestrator | 2026-04-24 03:52:19.125434 | orchestrator | TASK [manila : Running Manila bootstrap container] ***************************** 2026-04-24 03:52:19.125440 | orchestrator | Friday 24 April 2026 03:51:44 +0000 (0:00:02.076) 0:01:11.408 ********** 2026-04-24 03:52:19.125447 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:52:19.125453 | orchestrator | 2026-04-24 03:52:19.125460 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-24 03:52:19.125467 | orchestrator | Friday 24 April 2026 03:52:18 +0000 (0:00:34.184) 0:01:45.592 ********** 2026-04-24 03:52:19.125473 | orchestrator | 2026-04-24 03:52:19.125484 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-24 03:53:04.163663 | orchestrator | Friday 24 April 2026 03:52:18 +0000 (0:00:00.072) 0:01:45.665 ********** 2026-04-24 03:53:04.163808 | orchestrator | 2026-04-24 03:53:04.163839 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-24 03:53:04.163859 | orchestrator | Friday 24 April 2026 03:52:19 +0000 (0:00:00.076) 0:01:45.741 ********** 2026-04-24 03:53:04.163878 | orchestrator | 2026-04-24 03:53:04.163899 | orchestrator | RUNNING HANDLER [manila : Restart manila-api container] ************************ 2026-04-24 03:53:04.163919 | orchestrator | Friday 24 April 2026 03:52:19 +0000 (0:00:00.071) 0:01:45.813 ********** 2026-04-24 03:53:04.163940 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:53:04.163962 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:53:04.163983 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:53:04.164001 | orchestrator | 2026-04-24 03:53:04.164012 | orchestrator | RUNNING HANDLER [manila : Restart manila-data container] *********************** 2026-04-24 03:53:04.164023 | orchestrator | Friday 24 April 2026 03:52:29 +0000 (0:00:10.131) 0:01:55.945 ********** 2026-04-24 03:53:04.164035 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:53:04.164046 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:53:04.164090 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:53:04.164101 | orchestrator | 2026-04-24 03:53:04.164112 | orchestrator | RUNNING HANDLER [manila : Restart manila-scheduler container] ****************** 2026-04-24 03:53:04.164123 | orchestrator | Friday 24 April 2026 03:52:35 +0000 (0:00:05.958) 0:02:01.903 ********** 2026-04-24 03:53:04.164134 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:53:04.164145 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:53:04.164155 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:53:04.164166 | orchestrator | 2026-04-24 03:53:04.164177 | orchestrator | RUNNING HANDLER [manila : Restart manila-share container] ********************** 2026-04-24 03:53:04.164187 | orchestrator | Friday 24 April 2026 03:52:45 +0000 (0:00:10.089) 0:02:11.993 ********** 2026-04-24 03:53:04.164198 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:53:04.164209 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:53:04.164219 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:53:04.164230 | orchestrator | 2026-04-24 03:53:04.164241 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:53:04.164253 | orchestrator | testbed-node-0 : ok=28  changed=20  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 03:53:04.164266 | orchestrator | testbed-node-1 : ok=19  changed=13  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 03:53:04.164276 | orchestrator | testbed-node-2 : ok=19  changed=13  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 03:53:04.164287 | orchestrator | 2026-04-24 03:53:04.164298 | orchestrator | 2026-04-24 03:53:04.164309 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:53:04.164320 | orchestrator | Friday 24 April 2026 03:53:03 +0000 (0:00:18.432) 0:02:30.425 ********** 2026-04-24 03:53:04.164331 | orchestrator | =============================================================================== 2026-04-24 03:53:04.164341 | orchestrator | manila : Running Manila bootstrap container ---------------------------- 34.18s 2026-04-24 03:53:04.164352 | orchestrator | manila : Restart manila-share container -------------------------------- 18.43s 2026-04-24 03:53:04.164363 | orchestrator | service-ks-register : manila | Creating endpoints ---------------------- 12.39s 2026-04-24 03:53:04.164374 | orchestrator | manila : Restart manila-api container ---------------------------------- 10.13s 2026-04-24 03:53:04.164400 | orchestrator | manila : Restart manila-scheduler container ---------------------------- 10.09s 2026-04-24 03:53:04.164411 | orchestrator | manila : Copying over manila.conf --------------------------------------- 6.49s 2026-04-24 03:53:04.164422 | orchestrator | service-ks-register : manila | Creating services ------------------------ 6.31s 2026-04-24 03:53:04.164433 | orchestrator | manila : Restart manila-data container ---------------------------------- 5.96s 2026-04-24 03:53:04.164444 | orchestrator | manila : Copying over config.json files for services -------------------- 4.34s 2026-04-24 03:53:04.164454 | orchestrator | service-cert-copy : manila | Copying over extra CA certificates --------- 3.95s 2026-04-24 03:53:04.164465 | orchestrator | service-ks-register : manila | Granting user roles ---------------------- 3.80s 2026-04-24 03:53:04.164476 | orchestrator | service-ks-register : manila | Creating users --------------------------- 3.74s 2026-04-24 03:53:04.164487 | orchestrator | manila : Copying over manila-share.conf --------------------------------- 3.49s 2026-04-24 03:53:04.164498 | orchestrator | manila : Check manila containers ---------------------------------------- 3.36s 2026-04-24 03:53:04.164509 | orchestrator | service-ks-register : manila | Creating projects ------------------------ 3.14s 2026-04-24 03:53:04.164581 | orchestrator | service-ks-register : manila | Creating roles --------------------------- 3.00s 2026-04-24 03:53:04.164608 | orchestrator | manila : Ensuring config directories exist ------------------------------ 2.19s 2026-04-24 03:53:04.164620 | orchestrator | manila : Creating Manila database user and setting permissions ---------- 2.08s 2026-04-24 03:53:04.164631 | orchestrator | manila : Creating Manila database --------------------------------------- 2.08s 2026-04-24 03:53:04.164663 | orchestrator | manila : Copy over multiple ceph configs for Manila --------------------- 1.79s 2026-04-24 03:53:04.485429 | orchestrator | + sh -c /opt/configuration/scripts/deploy/400-monitoring.sh 2026-04-24 03:53:16.565474 | orchestrator | 2026-04-24 03:53:16 | INFO  | Task e6d895c7-d631-400e-8a4e-58fc03157348 (netdata) was prepared for execution. 2026-04-24 03:53:16.565665 | orchestrator | 2026-04-24 03:53:16 | INFO  | It takes a moment until task e6d895c7-d631-400e-8a4e-58fc03157348 (netdata) has been started and output is visible here. 2026-04-24 03:54:34.589786 | orchestrator | 2026-04-24 03:54:34.589925 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:54:34.589943 | orchestrator | 2026-04-24 03:54:34.589956 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:54:34.589968 | orchestrator | Friday 24 April 2026 03:53:21 +0000 (0:00:00.250) 0:00:00.250 ********** 2026-04-24 03:54:34.589980 | orchestrator | changed: [testbed-manager] => (item=enable_netdata_True) 2026-04-24 03:54:34.590801 | orchestrator | changed: [testbed-node-0] => (item=enable_netdata_True) 2026-04-24 03:54:34.590826 | orchestrator | changed: [testbed-node-1] => (item=enable_netdata_True) 2026-04-24 03:54:34.590839 | orchestrator | changed: [testbed-node-2] => (item=enable_netdata_True) 2026-04-24 03:54:34.590850 | orchestrator | changed: [testbed-node-3] => (item=enable_netdata_True) 2026-04-24 03:54:34.590861 | orchestrator | changed: [testbed-node-4] => (item=enable_netdata_True) 2026-04-24 03:54:34.590872 | orchestrator | changed: [testbed-node-5] => (item=enable_netdata_True) 2026-04-24 03:54:34.590883 | orchestrator | 2026-04-24 03:54:34.590895 | orchestrator | PLAY [Apply role netdata] ****************************************************** 2026-04-24 03:54:34.590906 | orchestrator | 2026-04-24 03:54:34.590917 | orchestrator | TASK [osism.services.netdata : Include distribution specific install tasks] **** 2026-04-24 03:54:34.590928 | orchestrator | Friday 24 April 2026 03:53:21 +0000 (0:00:00.865) 0:00:01.116 ********** 2026-04-24 03:54:34.590941 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:54:34.590955 | orchestrator | 2026-04-24 03:54:34.590967 | orchestrator | TASK [osism.services.netdata : Remove old architecture-dependent repository] *** 2026-04-24 03:54:34.590978 | orchestrator | Friday 24 April 2026 03:53:23 +0000 (0:00:01.322) 0:00:02.438 ********** 2026-04-24 03:54:34.590989 | orchestrator | ok: [testbed-manager] 2026-04-24 03:54:34.591002 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:54:34.591014 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:54:34.591025 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:54:34.591036 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:54:34.591046 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:54:34.591057 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:54:34.591068 | orchestrator | 2026-04-24 03:54:34.591079 | orchestrator | TASK [osism.services.netdata : Install apt-transport-https package] ************ 2026-04-24 03:54:34.591090 | orchestrator | Friday 24 April 2026 03:53:25 +0000 (0:00:01.815) 0:00:04.254 ********** 2026-04-24 03:54:34.591101 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:54:34.591112 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:54:34.591123 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:54:34.591134 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:54:34.591144 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:54:34.591155 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:54:34.591166 | orchestrator | ok: [testbed-manager] 2026-04-24 03:54:34.591177 | orchestrator | 2026-04-24 03:54:34.591188 | orchestrator | TASK [osism.services.netdata : Add repository gpg key] ************************* 2026-04-24 03:54:34.591199 | orchestrator | Friday 24 April 2026 03:53:27 +0000 (0:00:02.263) 0:00:06.517 ********** 2026-04-24 03:54:34.591210 | orchestrator | changed: [testbed-manager] 2026-04-24 03:54:34.591221 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:54:34.591232 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:54:34.591270 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:54:34.591281 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:54:34.591292 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:54:34.591302 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:54:34.591313 | orchestrator | 2026-04-24 03:54:34.591338 | orchestrator | TASK [osism.services.netdata : Add repository] ********************************* 2026-04-24 03:54:34.591349 | orchestrator | Friday 24 April 2026 03:53:28 +0000 (0:00:01.488) 0:00:08.006 ********** 2026-04-24 03:54:34.591360 | orchestrator | changed: [testbed-manager] 2026-04-24 03:54:34.591371 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:54:34.591382 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:54:34.591392 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:54:34.591403 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:54:34.591414 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:54:34.591424 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:54:34.591435 | orchestrator | 2026-04-24 03:54:34.591446 | orchestrator | TASK [osism.services.netdata : Install package netdata] ************************ 2026-04-24 03:54:34.591456 | orchestrator | Friday 24 April 2026 03:53:44 +0000 (0:00:15.194) 0:00:23.200 ********** 2026-04-24 03:54:34.591528 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:54:34.591541 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:54:34.591552 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:54:34.591562 | orchestrator | changed: [testbed-manager] 2026-04-24 03:54:34.591573 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:54:34.591584 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:54:34.591594 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:54:34.591605 | orchestrator | 2026-04-24 03:54:34.591616 | orchestrator | TASK [osism.services.netdata : Include config tasks] *************************** 2026-04-24 03:54:34.591627 | orchestrator | Friday 24 April 2026 03:54:08 +0000 (0:00:24.428) 0:00:47.629 ********** 2026-04-24 03:54:34.591639 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/config.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:54:34.591652 | orchestrator | 2026-04-24 03:54:34.591663 | orchestrator | TASK [osism.services.netdata : Copy configuration files] *********************** 2026-04-24 03:54:34.591674 | orchestrator | Friday 24 April 2026 03:54:10 +0000 (0:00:01.621) 0:00:49.250 ********** 2026-04-24 03:54:34.591685 | orchestrator | changed: [testbed-manager] => (item=netdata.conf) 2026-04-24 03:54:34.591696 | orchestrator | changed: [testbed-node-2] => (item=netdata.conf) 2026-04-24 03:54:34.591706 | orchestrator | changed: [testbed-node-0] => (item=netdata.conf) 2026-04-24 03:54:34.591717 | orchestrator | changed: [testbed-node-1] => (item=netdata.conf) 2026-04-24 03:54:34.591748 | orchestrator | changed: [testbed-node-3] => (item=netdata.conf) 2026-04-24 03:54:34.591759 | orchestrator | changed: [testbed-node-4] => (item=netdata.conf) 2026-04-24 03:54:34.591770 | orchestrator | changed: [testbed-node-5] => (item=netdata.conf) 2026-04-24 03:54:34.591781 | orchestrator | changed: [testbed-manager] => (item=stream.conf) 2026-04-24 03:54:34.591792 | orchestrator | changed: [testbed-node-2] => (item=stream.conf) 2026-04-24 03:54:34.591803 | orchestrator | changed: [testbed-node-3] => (item=stream.conf) 2026-04-24 03:54:34.591814 | orchestrator | changed: [testbed-node-1] => (item=stream.conf) 2026-04-24 03:54:34.591824 | orchestrator | changed: [testbed-node-0] => (item=stream.conf) 2026-04-24 03:54:34.591835 | orchestrator | changed: [testbed-node-5] => (item=stream.conf) 2026-04-24 03:54:34.591846 | orchestrator | changed: [testbed-node-4] => (item=stream.conf) 2026-04-24 03:54:34.591856 | orchestrator | 2026-04-24 03:54:34.591867 | orchestrator | TASK [osism.services.netdata : Retrieve /etc/netdata/.opt-out-from-anonymous-statistics status] *** 2026-04-24 03:54:34.591879 | orchestrator | Friday 24 April 2026 03:54:13 +0000 (0:00:03.297) 0:00:52.547 ********** 2026-04-24 03:54:34.591890 | orchestrator | ok: [testbed-manager] 2026-04-24 03:54:34.591901 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:54:34.591923 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:54:34.591933 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:54:34.591944 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:54:34.591955 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:54:34.591965 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:54:34.591976 | orchestrator | 2026-04-24 03:54:34.591987 | orchestrator | TASK [osism.services.netdata : Opt out from anonymous statistics] ************** 2026-04-24 03:54:34.591998 | orchestrator | Friday 24 April 2026 03:54:14 +0000 (0:00:01.263) 0:00:53.810 ********** 2026-04-24 03:54:34.592008 | orchestrator | changed: [testbed-manager] 2026-04-24 03:54:34.592019 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:54:34.592030 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:54:34.592041 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:54:34.592052 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:54:34.592063 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:54:34.592073 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:54:34.592084 | orchestrator | 2026-04-24 03:54:34.592095 | orchestrator | TASK [osism.services.netdata : Add netdata user to docker group] *************** 2026-04-24 03:54:34.592106 | orchestrator | Friday 24 April 2026 03:54:15 +0000 (0:00:01.278) 0:00:55.089 ********** 2026-04-24 03:54:34.592116 | orchestrator | ok: [testbed-manager] 2026-04-24 03:54:34.592127 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:54:34.592138 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:54:34.592149 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:54:34.592160 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:54:34.592170 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:54:34.592181 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:54:34.592192 | orchestrator | 2026-04-24 03:54:34.592202 | orchestrator | TASK [osism.services.netdata : Manage service netdata] ************************* 2026-04-24 03:54:34.592214 | orchestrator | Friday 24 April 2026 03:54:17 +0000 (0:00:01.184) 0:00:56.273 ********** 2026-04-24 03:54:34.592224 | orchestrator | ok: [testbed-manager] 2026-04-24 03:54:34.592235 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:54:34.592246 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:54:34.592256 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:54:34.592267 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:54:34.592278 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:54:34.592288 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:54:34.592299 | orchestrator | 2026-04-24 03:54:34.592310 | orchestrator | TASK [osism.services.netdata : Include host type specific tasks] *************** 2026-04-24 03:54:34.592321 | orchestrator | Friday 24 April 2026 03:54:18 +0000 (0:00:01.585) 0:00:57.859 ********** 2026-04-24 03:54:34.592337 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/server.yml for testbed-manager 2026-04-24 03:54:34.592350 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/client.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:54:34.592361 | orchestrator | 2026-04-24 03:54:34.592372 | orchestrator | TASK [osism.services.netdata : Set sysctl vm.max_map_count parameter] ********** 2026-04-24 03:54:34.592383 | orchestrator | Friday 24 April 2026 03:54:20 +0000 (0:00:01.391) 0:00:59.250 ********** 2026-04-24 03:54:34.592394 | orchestrator | changed: [testbed-manager] 2026-04-24 03:54:34.592405 | orchestrator | 2026-04-24 03:54:34.592415 | orchestrator | RUNNING HANDLER [osism.services.netdata : Restart service netdata] ************* 2026-04-24 03:54:34.592426 | orchestrator | Friday 24 April 2026 03:54:23 +0000 (0:00:03.212) 0:01:02.463 ********** 2026-04-24 03:54:34.592437 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:54:34.592448 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:54:34.592458 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:54:34.592490 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:54:34.592501 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:54:34.592511 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:54:34.592522 | orchestrator | changed: [testbed-manager] 2026-04-24 03:54:34.592540 | orchestrator | 2026-04-24 03:54:34.592551 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:54:34.592562 | orchestrator | testbed-manager : ok=16  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:54:34.592573 | orchestrator | testbed-node-0 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:54:34.592584 | orchestrator | testbed-node-1 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:54:34.592595 | orchestrator | testbed-node-2 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:54:34.592613 | orchestrator | testbed-node-3 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:54:35.027947 | orchestrator | testbed-node-4 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:54:35.028046 | orchestrator | testbed-node-5 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 03:54:35.028062 | orchestrator | 2026-04-24 03:54:35.028075 | orchestrator | 2026-04-24 03:54:35.028087 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:54:35.028100 | orchestrator | Friday 24 April 2026 03:54:34 +0000 (0:00:11.302) 0:01:13.766 ********** 2026-04-24 03:54:35.028112 | orchestrator | =============================================================================== 2026-04-24 03:54:35.028123 | orchestrator | osism.services.netdata : Install package netdata ----------------------- 24.43s 2026-04-24 03:54:35.028134 | orchestrator | osism.services.netdata : Add repository -------------------------------- 15.19s 2026-04-24 03:54:35.028145 | orchestrator | osism.services.netdata : Restart service netdata ----------------------- 11.30s 2026-04-24 03:54:35.028157 | orchestrator | osism.services.netdata : Copy configuration files ----------------------- 3.30s 2026-04-24 03:54:35.028168 | orchestrator | osism.services.netdata : Set sysctl vm.max_map_count parameter ---------- 3.21s 2026-04-24 03:54:35.028179 | orchestrator | osism.services.netdata : Install apt-transport-https package ------------ 2.26s 2026-04-24 03:54:35.028190 | orchestrator | osism.services.netdata : Remove old architecture-dependent repository --- 1.82s 2026-04-24 03:54:35.028201 | orchestrator | osism.services.netdata : Include config tasks --------------------------- 1.62s 2026-04-24 03:54:35.028213 | orchestrator | osism.services.netdata : Manage service netdata ------------------------- 1.59s 2026-04-24 03:54:35.028224 | orchestrator | osism.services.netdata : Add repository gpg key ------------------------- 1.49s 2026-04-24 03:54:35.028235 | orchestrator | osism.services.netdata : Include host type specific tasks --------------- 1.39s 2026-04-24 03:54:35.028248 | orchestrator | osism.services.netdata : Include distribution specific install tasks ---- 1.32s 2026-04-24 03:54:35.028266 | orchestrator | osism.services.netdata : Opt out from anonymous statistics -------------- 1.28s 2026-04-24 03:54:35.028283 | orchestrator | osism.services.netdata : Retrieve /etc/netdata/.opt-out-from-anonymous-statistics status --- 1.26s 2026-04-24 03:54:35.028300 | orchestrator | osism.services.netdata : Add netdata user to docker group --------------- 1.18s 2026-04-24 03:54:35.028318 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.87s 2026-04-24 03:54:40.401981 | orchestrator | 2026-04-24 03:54:40 | INFO  | Task 895d0dff-fe09-47d4-88cb-4714fb9978a9 (prometheus) was prepared for execution. 2026-04-24 03:54:40.402144 | orchestrator | 2026-04-24 03:54:40 | INFO  | It takes a moment until task 895d0dff-fe09-47d4-88cb-4714fb9978a9 (prometheus) has been started and output is visible here. 2026-04-24 03:54:49.564561 | orchestrator | 2026-04-24 03:54:49.564667 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:54:49.564704 | orchestrator | 2026-04-24 03:54:49.564715 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:54:49.564737 | orchestrator | Friday 24 April 2026 03:54:44 +0000 (0:00:00.281) 0:00:00.281 ********** 2026-04-24 03:54:49.564747 | orchestrator | ok: [testbed-manager] 2026-04-24 03:54:49.564757 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:54:49.564765 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:54:49.564774 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:54:49.564782 | orchestrator | ok: [testbed-node-3] 2026-04-24 03:54:49.564792 | orchestrator | ok: [testbed-node-4] 2026-04-24 03:54:49.564801 | orchestrator | ok: [testbed-node-5] 2026-04-24 03:54:49.564809 | orchestrator | 2026-04-24 03:54:49.564818 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:54:49.564827 | orchestrator | Friday 24 April 2026 03:54:45 +0000 (0:00:00.865) 0:00:01.146 ********** 2026-04-24 03:54:49.564836 | orchestrator | ok: [testbed-manager] => (item=enable_prometheus_True) 2026-04-24 03:54:49.564845 | orchestrator | ok: [testbed-node-0] => (item=enable_prometheus_True) 2026-04-24 03:54:49.564854 | orchestrator | ok: [testbed-node-1] => (item=enable_prometheus_True) 2026-04-24 03:54:49.564863 | orchestrator | ok: [testbed-node-2] => (item=enable_prometheus_True) 2026-04-24 03:54:49.564871 | orchestrator | ok: [testbed-node-3] => (item=enable_prometheus_True) 2026-04-24 03:54:49.564880 | orchestrator | ok: [testbed-node-4] => (item=enable_prometheus_True) 2026-04-24 03:54:49.564888 | orchestrator | ok: [testbed-node-5] => (item=enable_prometheus_True) 2026-04-24 03:54:49.564897 | orchestrator | 2026-04-24 03:54:49.564905 | orchestrator | PLAY [Apply role prometheus] *************************************************** 2026-04-24 03:54:49.564914 | orchestrator | 2026-04-24 03:54:49.564923 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-24 03:54:49.564931 | orchestrator | Friday 24 April 2026 03:54:46 +0000 (0:00:00.919) 0:00:02.066 ********** 2026-04-24 03:54:49.564940 | orchestrator | included: /ansible/roles/prometheus/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:54:49.564951 | orchestrator | 2026-04-24 03:54:49.564959 | orchestrator | TASK [prometheus : Ensuring config directories exist] ************************** 2026-04-24 03:54:49.564968 | orchestrator | Friday 24 April 2026 03:54:47 +0000 (0:00:01.431) 0:00:03.498 ********** 2026-04-24 03:54:49.564981 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-24 03:54:49.564994 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:49.565004 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:49.565022 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:49.565053 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:49.565064 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:49.565075 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:49.565086 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:49.565097 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:49.565108 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:49.565124 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:49.565141 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:50.468443 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:50.468609 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:50.468629 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-24 03:54:50.468646 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:50.468659 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:50.468693 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:50.468724 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:54:50.468743 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:50.468756 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:50.468768 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:50.468779 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:54:50.468790 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:50.468809 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:50.468820 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:50.468845 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:55.355802 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:54:55.355907 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:55.355925 | orchestrator | 2026-04-24 03:54:55.355948 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-24 03:54:55.355970 | orchestrator | Friday 24 April 2026 03:54:50 +0000 (0:00:02.671) 0:00:06.169 ********** 2026-04-24 03:54:55.355991 | orchestrator | included: /ansible/roles/prometheus/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 03:54:55.356011 | orchestrator | 2026-04-24 03:54:55.356031 | orchestrator | TASK [service-cert-copy : prometheus | Copying over extra CA certificates] ***** 2026-04-24 03:54:55.356049 | orchestrator | Friday 24 April 2026 03:54:52 +0000 (0:00:01.673) 0:00:07.842 ********** 2026-04-24 03:54:55.356071 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:55.356123 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-24 03:54:55.356144 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:55.356157 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:55.356203 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:55.356216 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:55.356228 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:55.356239 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:54:55.356260 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:55.356271 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:55.356283 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:55.356300 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:55.356322 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444110 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444263 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444311 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:57.444324 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:57.444334 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:57.444345 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444374 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444403 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444416 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-24 03:54:57.444436 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444446 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444476 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:54:57.444487 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:57.444498 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:57.444518 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:58.403625 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:54:58.403808 | orchestrator | 2026-04-24 03:54:58.403826 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS certificate] *** 2026-04-24 03:54:58.403840 | orchestrator | Friday 24 April 2026 03:54:57 +0000 (0:00:05.299) 0:00:13.142 ********** 2026-04-24 03:54:58.403855 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-24 03:54:58.403869 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:54:58.403881 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:54:58.403951 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-24 03:54:58.403987 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:58.404000 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:54:58.404021 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:54:58.404033 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:58.404046 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:58.404059 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:54:58.404073 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:58.404092 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:54:58.404106 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:58.404127 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:59.281207 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:54:59.281330 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:54:59.281346 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:59.281356 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:54:59.281364 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:54:59.281372 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:59.281381 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:59.281408 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:54:59.281417 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:54:59.281447 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:54:59.281518 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:54:59.281527 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:54:59.281535 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 03:54:59.281543 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:54:59.281551 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:54:59.281559 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:54:59.281572 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 03:54:59.281580 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:54:59.281587 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:54:59.281606 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:55:00.278450 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 03:55:00.278641 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:55:00.278657 | orchestrator | 2026-04-24 03:55:00.278669 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS key] *** 2026-04-24 03:55:00.278681 | orchestrator | Friday 24 April 2026 03:54:59 +0000 (0:00:01.839) 0:00:14.982 ********** 2026-04-24 03:55:00.278692 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:55:00.278703 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:00.278715 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:00.278765 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-24 03:55:00.278804 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:55:00.278841 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:55:00.278853 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:55:00.278865 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:00.278877 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:00.278889 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:55:00.278901 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:00.278926 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:55:00.278951 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-24 03:55:01.539683 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:01.539806 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:01.539823 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:55:01.539837 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:55:01.539848 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:55:01.539860 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:55:01.539873 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:01.539906 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:01.539933 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:55:01.539946 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 03:55:01.539958 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:55:01.540016 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:55:01.540031 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:55:01.540043 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 03:55:01.540054 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:55:01.540066 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:55:01.540086 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:55:01.540103 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 03:55:01.540115 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:55:01.540126 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 03:55:01.540146 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 03:55:04.927834 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 03:55:04.927946 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:55:04.927966 | orchestrator | 2026-04-24 03:55:04.927982 | orchestrator | TASK [prometheus : Copying over config.json files] ***************************** 2026-04-24 03:55:04.927997 | orchestrator | Friday 24 April 2026 03:55:01 +0000 (0:00:02.249) 0:00:17.231 ********** 2026-04-24 03:55:04.928013 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-24 03:55:04.928029 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:55:04.928071 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:55:04.928103 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:55:04.928118 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:55:04.928153 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:55:04.928169 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:55:04.928183 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:55:04.928197 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:04.928221 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:04.928235 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:04.928256 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:55:04.928272 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:55:04.928297 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:55:07.332147 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:55:07.332261 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:07.332311 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:07.332325 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:55:07.332349 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:07.332364 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-24 03:55:07.332395 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:55:07.332408 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:55:07.332420 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:55:07.332440 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:55:07.332498 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:55:07.332518 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:07.332530 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:07.332541 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:07.332563 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:55:10.335696 | orchestrator | 2026-04-24 03:55:10.335796 | orchestrator | TASK [prometheus : Find custom prometheus alert rules files] ******************* 2026-04-24 03:55:10.335834 | orchestrator | Friday 24 April 2026 03:55:07 +0000 (0:00:05.793) 0:00:23.024 ********** 2026-04-24 03:55:10.335858 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 03:55:10.335906 | orchestrator | 2026-04-24 03:55:10.335928 | orchestrator | TASK [prometheus : Copying over custom prometheus alert rules files] *********** 2026-04-24 03:55:10.335949 | orchestrator | Friday 24 April 2026 03:55:08 +0000 (0:00:00.778) 0:00:23.803 ********** 2026-04-24 03:55:10.335971 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1311749, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1936154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.335996 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1311749, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1936154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336014 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1311749, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1936154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336039 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1311749, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1936154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336051 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1311791, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2026157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336063 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1311791, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2026157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336094 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1311791, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2026157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336114 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1311740, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1922874, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336125 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1311740, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1922874, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336136 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1311749, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1936154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336152 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1311740, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1922874, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336164 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1311749, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1936154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336175 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1311773, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2006192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:10.336200 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1311791, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2026157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672431 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1311749, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1936154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:11.672560 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1311773, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2006192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672578 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1311773, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2006192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672605 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1311740, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1922874, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672618 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1311736, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1901202, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672630 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1311791, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2026157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672666 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1311791, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2026157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672695 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1311736, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1901202, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672707 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1311751, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1945946, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672719 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1311736, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1901202, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672735 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1311773, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2006192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672747 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1311740, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1922874, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672758 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1311751, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1945946, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672777 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1311736, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1901202, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:11.672796 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1311740, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1922874, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401073 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1311751, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1945946, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401170 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1311768, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.198238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401200 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1311773, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2006192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401213 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1311751, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1945946, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401224 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1311768, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.198238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401272 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1311791, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2026157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:13.401285 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1311773, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2006192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401322 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1311768, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.198238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401335 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1311736, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1901202, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401351 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1311768, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.198238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401363 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1311736, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1901202, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401383 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1311755, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1954236, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401394 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1311755, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1954236, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401406 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1311755, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1954236, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:13.401424 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1311751, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1945946, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.739877 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1311751, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1945946, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.739984 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1311755, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1954236, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740002 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1311746, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1926155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740034 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1311746, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1926155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740046 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1311746, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1926155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740058 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1311768, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.198238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740070 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1311740, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1922874, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:14.740099 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1311768, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.198238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740116 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311788, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740128 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311788, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740146 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1311746, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1926155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740158 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311788, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740169 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1311755, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1954236, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740181 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1311755, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1954236, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:14.740200 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311731, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1894677, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197434 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311731, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1894677, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197630 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311731, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1894677, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197662 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1311746, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1926155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197684 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311788, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197705 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1311807, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197726 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1311773, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2006192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:16.197748 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1311807, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197803 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1311746, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1926155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197840 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311731, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1894677, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197862 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1311784, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197884 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1311807, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197907 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1311807, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197925 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311788, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197944 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1311784, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:16.197981 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311788, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512209 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1311784, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512296 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311739, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1906154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512312 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311731, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1894677, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512324 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1311784, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512335 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311739, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1906154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512347 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1311736, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1901202, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:17.512392 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1311807, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512422 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311731, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1894677, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512434 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1311733, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1897595, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512474 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311739, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1906154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512488 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1311733, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1897595, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512500 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311739, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1906154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512511 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1311784, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512535 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1311763, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1966155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:17.512554 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1311807, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695791 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1311733, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1897595, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695847 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311739, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1906154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695855 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1311763, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1966155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695860 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1311733, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1897595, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695865 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1311751, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1945946, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:18.695888 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1311763, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1966155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695893 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1311758, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1957192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695907 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1311758, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1957192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695913 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1311784, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695918 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1311733, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1897595, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695923 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1311763, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1966155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695928 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1311805, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695937 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:55:18.695945 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1311758, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1957192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695951 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1311805, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:18.695959 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:55:22.415863 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311739, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1906154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.415961 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1311763, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1966155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.415977 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1311758, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1957192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.415989 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1311758, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1957192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.416023 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1311805, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.416036 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:55:22.416063 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1311805, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.416075 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:55:22.416103 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1311733, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1897595, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.416116 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1311805, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.416128 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:55:22.416139 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1311768, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.198238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:22.416151 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1311763, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1966155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.416162 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1311758, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1957192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.416180 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1311805, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-24 03:55:22.416200 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:55:22.416226 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1311755, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1954236, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:22.416256 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1311746, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1926155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.859682 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311788, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.859843 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311731, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1894677, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.859884 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1311807, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.859921 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1311784, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2020483, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.859935 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1311739, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1906154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.859961 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1311733, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1897595, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.859974 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1311763, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1966155, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.860005 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1311758, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1957192, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.860017 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1311805, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.2088983, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-24 03:55:34.860029 | orchestrator | 2026-04-24 03:55:34.860043 | orchestrator | TASK [prometheus : Find prometheus common config overrides] ******************** 2026-04-24 03:55:34.860055 | orchestrator | Friday 24 April 2026 03:55:32 +0000 (0:00:24.266) 0:00:48.069 ********** 2026-04-24 03:55:34.860075 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 03:55:34.860087 | orchestrator | 2026-04-24 03:55:34.860098 | orchestrator | TASK [prometheus : Find prometheus host config overrides] ********************** 2026-04-24 03:55:34.860109 | orchestrator | Friday 24 April 2026 03:55:33 +0000 (0:00:00.728) 0:00:48.797 ********** 2026-04-24 03:55:34.860120 | orchestrator | [WARNING]: Skipped 2026-04-24 03:55:34.860132 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860143 | orchestrator | node-0/prometheus.yml.d' path due to this access issue: 2026-04-24 03:55:34.860154 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860164 | orchestrator | node-0/prometheus.yml.d' is not a directory 2026-04-24 03:55:34.860175 | orchestrator | [WARNING]: Skipped 2026-04-24 03:55:34.860186 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860198 | orchestrator | manager/prometheus.yml.d' path due to this access issue: 2026-04-24 03:55:34.860210 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860222 | orchestrator | manager/prometheus.yml.d' is not a directory 2026-04-24 03:55:34.860235 | orchestrator | [WARNING]: Skipped 2026-04-24 03:55:34.860247 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860259 | orchestrator | node-1/prometheus.yml.d' path due to this access issue: 2026-04-24 03:55:34.860272 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860284 | orchestrator | node-1/prometheus.yml.d' is not a directory 2026-04-24 03:55:34.860296 | orchestrator | [WARNING]: Skipped 2026-04-24 03:55:34.860308 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860320 | orchestrator | node-2/prometheus.yml.d' path due to this access issue: 2026-04-24 03:55:34.860332 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860345 | orchestrator | node-2/prometheus.yml.d' is not a directory 2026-04-24 03:55:34.860357 | orchestrator | [WARNING]: Skipped 2026-04-24 03:55:34.860370 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860382 | orchestrator | node-3/prometheus.yml.d' path due to this access issue: 2026-04-24 03:55:34.860394 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860406 | orchestrator | node-3/prometheus.yml.d' is not a directory 2026-04-24 03:55:34.860419 | orchestrator | [WARNING]: Skipped 2026-04-24 03:55:34.860431 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860475 | orchestrator | node-4/prometheus.yml.d' path due to this access issue: 2026-04-24 03:55:34.860489 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860502 | orchestrator | node-4/prometheus.yml.d' is not a directory 2026-04-24 03:55:34.860514 | orchestrator | [WARNING]: Skipped 2026-04-24 03:55:34.860526 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860539 | orchestrator | node-5/prometheus.yml.d' path due to this access issue: 2026-04-24 03:55:34.860551 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 03:55:34.860563 | orchestrator | node-5/prometheus.yml.d' is not a directory 2026-04-24 03:55:34.860574 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:55:34.860584 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 03:55:34.860595 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 03:55:34.860606 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 03:55:34.860616 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 03:55:34.860627 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 03:55:34.860638 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 03:55:34.860655 | orchestrator | 2026-04-24 03:55:34.860672 | orchestrator | TASK [prometheus : Copying over prometheus config file] ************************ 2026-04-24 03:56:06.091919 | orchestrator | Friday 24 April 2026 03:55:34 +0000 (0:00:01.750) 0:00:50.548 ********** 2026-04-24 03:56:06.092054 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 03:56:06.092074 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 03:56:06.092088 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:56:06.092101 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:56:06.092127 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 03:56:06.092943 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:56:06.092966 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 03:56:06.092978 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:06.092989 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 03:56:06.093000 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:06.093012 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 03:56:06.093023 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:06.093035 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2) 2026-04-24 03:56:06.093046 | orchestrator | 2026-04-24 03:56:06.093058 | orchestrator | TASK [prometheus : Copying over prometheus web config file] ******************** 2026-04-24 03:56:06.093069 | orchestrator | Friday 24 April 2026 03:55:51 +0000 (0:00:16.851) 0:01:07.400 ********** 2026-04-24 03:56:06.093080 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 03:56:06.093091 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 03:56:06.093102 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:56:06.093113 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:56:06.093124 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 03:56:06.093135 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:06.093146 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 03:56:06.093157 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:56:06.093167 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 03:56:06.093178 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:06.093189 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 03:56:06.093200 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:06.093211 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2) 2026-04-24 03:56:06.093222 | orchestrator | 2026-04-24 03:56:06.093233 | orchestrator | TASK [prometheus : Copying over prometheus alertmanager config file] *********** 2026-04-24 03:56:06.093244 | orchestrator | Friday 24 April 2026 03:55:54 +0000 (0:00:02.721) 0:01:10.122 ********** 2026-04-24 03:56:06.093255 | orchestrator | skipping: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 03:56:06.093269 | orchestrator | skipping: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 03:56:06.093280 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:56:06.093291 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:56:06.093302 | orchestrator | skipping: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 03:56:06.093339 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:56:06.093350 | orchestrator | skipping: [testbed-node-3] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 03:56:06.093361 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:06.093372 | orchestrator | changed: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml) 2026-04-24 03:56:06.093397 | orchestrator | skipping: [testbed-node-4] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 03:56:06.093408 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:06.093419 | orchestrator | skipping: [testbed-node-5] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 03:56:06.093430 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:06.093463 | orchestrator | 2026-04-24 03:56:06.093474 | orchestrator | TASK [prometheus : Find custom Alertmanager alert notification templates] ****** 2026-04-24 03:56:06.093493 | orchestrator | Friday 24 April 2026 03:55:56 +0000 (0:00:02.098) 0:01:12.220 ********** 2026-04-24 03:56:06.093511 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 03:56:06.093530 | orchestrator | 2026-04-24 03:56:06.093546 | orchestrator | TASK [prometheus : Copying over custom Alertmanager alert notification templates] *** 2026-04-24 03:56:06.093565 | orchestrator | Friday 24 April 2026 03:55:57 +0000 (0:00:00.734) 0:01:12.955 ********** 2026-04-24 03:56:06.093583 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:56:06.093602 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:56:06.093620 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:56:06.093638 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:56:06.093667 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:06.093679 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:06.093690 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:06.093700 | orchestrator | 2026-04-24 03:56:06.093711 | orchestrator | TASK [prometheus : Copying over my.cnf for mysqld_exporter] ******************** 2026-04-24 03:56:06.093722 | orchestrator | Friday 24 April 2026 03:55:57 +0000 (0:00:00.730) 0:01:13.685 ********** 2026-04-24 03:56:06.093733 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:56:06.093758 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:06.093769 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:06.093780 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:06.093790 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:56:06.093801 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:56:06.093812 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:56:06.093822 | orchestrator | 2026-04-24 03:56:06.093833 | orchestrator | TASK [prometheus : Copying cloud config file for openstack exporter] *********** 2026-04-24 03:56:06.093844 | orchestrator | Friday 24 April 2026 03:56:00 +0000 (0:00:02.167) 0:01:15.853 ********** 2026-04-24 03:56:06.093855 | orchestrator | skipping: [testbed-manager] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 03:56:06.093866 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:56:06.093877 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 03:56:06.093887 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:56:06.093898 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 03:56:06.093909 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 03:56:06.093919 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 03:56:06.093930 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:56:06.093941 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:56:06.093951 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:06.093962 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 03:56:06.093972 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:06.093994 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 03:56:06.094006 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:06.094070 | orchestrator | 2026-04-24 03:56:06.094083 | orchestrator | TASK [prometheus : Copying config file for blackbox exporter] ****************** 2026-04-24 03:56:06.094094 | orchestrator | Friday 24 April 2026 03:56:01 +0000 (0:00:01.661) 0:01:17.514 ********** 2026-04-24 03:56:06.094105 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 03:56:06.094116 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:56:06.094127 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 03:56:06.094138 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:56:06.094149 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 03:56:06.094160 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:56:06.094170 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 03:56:06.094181 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:06.094192 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 03:56:06.094203 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:06.094214 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 03:56:06.094225 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:06.094236 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2) 2026-04-24 03:56:06.094247 | orchestrator | 2026-04-24 03:56:06.094257 | orchestrator | TASK [prometheus : Find extra prometheus server config files] ****************** 2026-04-24 03:56:06.094268 | orchestrator | Friday 24 April 2026 03:56:03 +0000 (0:00:01.607) 0:01:19.122 ********** 2026-04-24 03:56:06.094279 | orchestrator | [WARNING]: Skipped 2026-04-24 03:56:06.094291 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' path 2026-04-24 03:56:06.094302 | orchestrator | due to this access issue: 2026-04-24 03:56:06.094319 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' is 2026-04-24 03:56:06.094330 | orchestrator | not a directory 2026-04-24 03:56:06.094341 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 03:56:06.094352 | orchestrator | 2026-04-24 03:56:06.094363 | orchestrator | TASK [prometheus : Create subdirectories for extra config files] *************** 2026-04-24 03:56:06.094374 | orchestrator | Friday 24 April 2026 03:56:04 +0000 (0:00:01.165) 0:01:20.287 ********** 2026-04-24 03:56:06.094384 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:56:06.094395 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:56:06.094406 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:56:06.094416 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:56:06.094427 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:06.094479 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:06.094490 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:06.094501 | orchestrator | 2026-04-24 03:56:06.094512 | orchestrator | TASK [prometheus : Template extra prometheus server config files] ************** 2026-04-24 03:56:06.094523 | orchestrator | Friday 24 April 2026 03:56:05 +0000 (0:00:01.034) 0:01:21.322 ********** 2026-04-24 03:56:06.094534 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:56:06.094545 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:56:06.094556 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:56:06.094574 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:56:08.959298 | orchestrator | skipping: [testbed-node-3] 2026-04-24 03:56:08.959398 | orchestrator | skipping: [testbed-node-4] 2026-04-24 03:56:08.959413 | orchestrator | skipping: [testbed-node-5] 2026-04-24 03:56:08.959527 | orchestrator | 2026-04-24 03:56:08.959553 | orchestrator | TASK [prometheus : Check prometheus containers] ******************************** 2026-04-24 03:56:08.959574 | orchestrator | Friday 24 April 2026 03:56:06 +0000 (0:00:00.928) 0:01:22.250 ********** 2026-04-24 03:56:08.959596 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:56:08.959620 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:56:08.959642 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-24 03:56:08.959665 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:56:08.959686 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:56:08.959726 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:56:08.959759 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:56:08.959801 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:08.959814 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 03:56:08.959825 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:08.959839 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:08.959852 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:56:08.959872 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:56:08.959885 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:56:08.959916 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:56:12.608079 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:12.608186 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:12.608203 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:12.608216 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:56:12.608229 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:56:12.608258 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 03:56:12.608274 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-24 03:56:12.608327 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:56:12.608342 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:56:12.608354 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 03:56:12.608366 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:12.608379 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:12.608409 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:12.608518 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 03:56:12.608535 | orchestrator | 2026-04-24 03:56:12.608557 | orchestrator | TASK [prometheus : Creating prometheus database user and setting permissions] *** 2026-04-24 03:56:12.608581 | orchestrator | Friday 24 April 2026 03:56:10 +0000 (0:00:03.983) 0:01:26.233 ********** 2026-04-24 03:56:12.608593 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-24 03:56:12.608605 | orchestrator | skipping: [testbed-manager] 2026-04-24 03:56:12.608621 | orchestrator | 2026-04-24 03:56:12.608650 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 03:57:47.926607 | orchestrator | Friday 24 April 2026 03:56:11 +0000 (0:00:01.372) 0:01:27.606 ********** 2026-04-24 03:57:47.926710 | orchestrator | 2026-04-24 03:57:47.926724 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 03:57:47.926734 | orchestrator | Friday 24 April 2026 03:56:12 +0000 (0:00:00.256) 0:01:27.863 ********** 2026-04-24 03:57:47.926743 | orchestrator | 2026-04-24 03:57:47.926752 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 03:57:47.926761 | orchestrator | Friday 24 April 2026 03:56:12 +0000 (0:00:00.073) 0:01:27.936 ********** 2026-04-24 03:57:47.926770 | orchestrator | 2026-04-24 03:57:47.926779 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 03:57:47.926788 | orchestrator | Friday 24 April 2026 03:56:12 +0000 (0:00:00.070) 0:01:28.006 ********** 2026-04-24 03:57:47.926796 | orchestrator | 2026-04-24 03:57:47.926805 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 03:57:47.926814 | orchestrator | Friday 24 April 2026 03:56:12 +0000 (0:00:00.067) 0:01:28.074 ********** 2026-04-24 03:57:47.926823 | orchestrator | 2026-04-24 03:57:47.926831 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 03:57:47.926840 | orchestrator | Friday 24 April 2026 03:56:12 +0000 (0:00:00.070) 0:01:28.144 ********** 2026-04-24 03:57:47.926849 | orchestrator | 2026-04-24 03:57:47.926857 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 03:57:47.926866 | orchestrator | Friday 24 April 2026 03:56:12 +0000 (0:00:00.067) 0:01:28.211 ********** 2026-04-24 03:57:47.926875 | orchestrator | 2026-04-24 03:57:47.926883 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-server container] ************* 2026-04-24 03:57:47.926892 | orchestrator | Friday 24 April 2026 03:56:12 +0000 (0:00:00.091) 0:01:28.302 ********** 2026-04-24 03:57:47.926901 | orchestrator | changed: [testbed-manager] 2026-04-24 03:57:47.926911 | orchestrator | 2026-04-24 03:57:47.926920 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-node-exporter container] ****** 2026-04-24 03:57:47.926928 | orchestrator | Friday 24 April 2026 03:56:36 +0000 (0:00:23.545) 0:01:51.848 ********** 2026-04-24 03:57:47.926937 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:57:47.926946 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:57:47.926954 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:57:47.926963 | orchestrator | changed: [testbed-manager] 2026-04-24 03:57:47.926972 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:57:47.926981 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:57:47.926990 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:57:47.926999 | orchestrator | 2026-04-24 03:57:47.927008 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-mysqld-exporter container] **** 2026-04-24 03:57:47.927035 | orchestrator | Friday 24 April 2026 03:56:50 +0000 (0:00:13.891) 0:02:05.740 ********** 2026-04-24 03:57:47.927044 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:57:47.927053 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:57:47.927061 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:57:47.927070 | orchestrator | 2026-04-24 03:57:47.927078 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-memcached-exporter container] *** 2026-04-24 03:57:47.927088 | orchestrator | Friday 24 April 2026 03:56:56 +0000 (0:00:06.183) 0:02:11.924 ********** 2026-04-24 03:57:47.927096 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:57:47.927105 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:57:47.927113 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:57:47.927122 | orchestrator | 2026-04-24 03:57:47.927130 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-cadvisor container] *********** 2026-04-24 03:57:47.927139 | orchestrator | Friday 24 April 2026 03:57:07 +0000 (0:00:10.914) 0:02:22.838 ********** 2026-04-24 03:57:47.927148 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:57:47.927157 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:57:47.927167 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:57:47.927177 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:57:47.927186 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:57:47.927196 | orchestrator | changed: [testbed-manager] 2026-04-24 03:57:47.927205 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:57:47.927215 | orchestrator | 2026-04-24 03:57:47.927225 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-alertmanager container] ******* 2026-04-24 03:57:47.927235 | orchestrator | Friday 24 April 2026 03:57:21 +0000 (0:00:14.197) 0:02:37.036 ********** 2026-04-24 03:57:47.927261 | orchestrator | changed: [testbed-manager] 2026-04-24 03:57:47.927276 | orchestrator | 2026-04-24 03:57:47.927291 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-elasticsearch-exporter container] *** 2026-04-24 03:57:47.927301 | orchestrator | Friday 24 April 2026 03:57:30 +0000 (0:00:09.099) 0:02:46.135 ********** 2026-04-24 03:57:47.927312 | orchestrator | changed: [testbed-node-1] 2026-04-24 03:57:47.927322 | orchestrator | changed: [testbed-node-0] 2026-04-24 03:57:47.927331 | orchestrator | changed: [testbed-node-2] 2026-04-24 03:57:47.927341 | orchestrator | 2026-04-24 03:57:47.927351 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-blackbox-exporter container] *** 2026-04-24 03:57:47.927361 | orchestrator | Friday 24 April 2026 03:57:36 +0000 (0:00:05.739) 0:02:51.874 ********** 2026-04-24 03:57:47.927371 | orchestrator | changed: [testbed-manager] 2026-04-24 03:57:47.927381 | orchestrator | 2026-04-24 03:57:47.927390 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-libvirt-exporter container] *** 2026-04-24 03:57:47.927400 | orchestrator | Friday 24 April 2026 03:57:41 +0000 (0:00:05.773) 0:02:57.648 ********** 2026-04-24 03:57:47.927409 | orchestrator | changed: [testbed-node-3] 2026-04-24 03:57:47.927419 | orchestrator | changed: [testbed-node-5] 2026-04-24 03:57:47.927429 | orchestrator | changed: [testbed-node-4] 2026-04-24 03:57:47.927460 | orchestrator | 2026-04-24 03:57:47.927470 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 03:57:47.927482 | orchestrator | testbed-manager : ok=23  changed=14  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-24 03:57:47.927493 | orchestrator | testbed-node-0 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-24 03:57:47.927519 | orchestrator | testbed-node-1 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-24 03:57:47.927529 | orchestrator | testbed-node-2 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-24 03:57:47.927538 | orchestrator | testbed-node-3 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-24 03:57:47.927554 | orchestrator | testbed-node-4 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-24 03:57:47.927563 | orchestrator | testbed-node-5 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-24 03:57:47.927572 | orchestrator | 2026-04-24 03:57:47.927581 | orchestrator | 2026-04-24 03:57:47.927589 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 03:57:47.927598 | orchestrator | Friday 24 April 2026 03:57:47 +0000 (0:00:05.452) 0:03:03.101 ********** 2026-04-24 03:57:47.927607 | orchestrator | =============================================================================== 2026-04-24 03:57:47.927615 | orchestrator | prometheus : Copying over custom prometheus alert rules files ---------- 24.27s 2026-04-24 03:57:47.927624 | orchestrator | prometheus : Restart prometheus-server container ----------------------- 23.55s 2026-04-24 03:57:47.927632 | orchestrator | prometheus : Copying over prometheus config file ----------------------- 16.85s 2026-04-24 03:57:47.927641 | orchestrator | prometheus : Restart prometheus-cadvisor container --------------------- 14.20s 2026-04-24 03:57:47.927649 | orchestrator | prometheus : Restart prometheus-node-exporter container ---------------- 13.89s 2026-04-24 03:57:47.927658 | orchestrator | prometheus : Restart prometheus-memcached-exporter container ----------- 10.91s 2026-04-24 03:57:47.927666 | orchestrator | prometheus : Restart prometheus-alertmanager container ------------------ 9.10s 2026-04-24 03:57:47.927675 | orchestrator | prometheus : Restart prometheus-mysqld-exporter container --------------- 6.18s 2026-04-24 03:57:47.927683 | orchestrator | prometheus : Copying over config.json files ----------------------------- 5.79s 2026-04-24 03:57:47.927692 | orchestrator | prometheus : Restart prometheus-blackbox-exporter container ------------- 5.77s 2026-04-24 03:57:47.927700 | orchestrator | prometheus : Restart prometheus-elasticsearch-exporter container -------- 5.74s 2026-04-24 03:57:47.927709 | orchestrator | prometheus : Restart prometheus-libvirt-exporter container -------------- 5.45s 2026-04-24 03:57:47.927717 | orchestrator | service-cert-copy : prometheus | Copying over extra CA certificates ----- 5.30s 2026-04-24 03:57:47.927726 | orchestrator | prometheus : Check prometheus containers -------------------------------- 3.98s 2026-04-24 03:57:47.927734 | orchestrator | prometheus : Copying over prometheus web config file -------------------- 2.72s 2026-04-24 03:57:47.927743 | orchestrator | prometheus : Ensuring config directories exist -------------------------- 2.67s 2026-04-24 03:57:47.927752 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS key --- 2.25s 2026-04-24 03:57:47.927760 | orchestrator | prometheus : Copying over my.cnf for mysqld_exporter -------------------- 2.17s 2026-04-24 03:57:47.927769 | orchestrator | prometheus : Copying over prometheus alertmanager config file ----------- 2.10s 2026-04-24 03:57:47.927777 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS certificate --- 1.84s 2026-04-24 03:57:50.561249 | orchestrator | 2026-04-24 03:57:50 | INFO  | Task bf81c52b-8790-4f77-a207-878aed436ae1 (grafana) was prepared for execution. 2026-04-24 03:57:50.561362 | orchestrator | 2026-04-24 03:57:50 | INFO  | It takes a moment until task bf81c52b-8790-4f77-a207-878aed436ae1 (grafana) has been started and output is visible here. 2026-04-24 03:58:00.539970 | orchestrator | 2026-04-24 03:58:00.540078 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 03:58:00.540094 | orchestrator | 2026-04-24 03:58:00.540105 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 03:58:00.540118 | orchestrator | Friday 24 April 2026 03:57:54 +0000 (0:00:00.271) 0:00:00.271 ********** 2026-04-24 03:58:00.540128 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:58:00.540139 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:58:00.540148 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:58:00.540158 | orchestrator | 2026-04-24 03:58:00.540168 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 03:58:00.540202 | orchestrator | Friday 24 April 2026 03:57:55 +0000 (0:00:00.363) 0:00:00.634 ********** 2026-04-24 03:58:00.540213 | orchestrator | ok: [testbed-node-0] => (item=enable_grafana_True) 2026-04-24 03:58:00.540223 | orchestrator | ok: [testbed-node-1] => (item=enable_grafana_True) 2026-04-24 03:58:00.540233 | orchestrator | ok: [testbed-node-2] => (item=enable_grafana_True) 2026-04-24 03:58:00.540242 | orchestrator | 2026-04-24 03:58:00.540252 | orchestrator | PLAY [Apply role grafana] ****************************************************** 2026-04-24 03:58:00.540262 | orchestrator | 2026-04-24 03:58:00.540271 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-24 03:58:00.540281 | orchestrator | Friday 24 April 2026 03:57:55 +0000 (0:00:00.479) 0:00:01.113 ********** 2026-04-24 03:58:00.540291 | orchestrator | included: /ansible/roles/grafana/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:58:00.540302 | orchestrator | 2026-04-24 03:58:00.540312 | orchestrator | TASK [grafana : Ensuring config directories exist] ***************************** 2026-04-24 03:58:00.540322 | orchestrator | Friday 24 April 2026 03:57:56 +0000 (0:00:00.598) 0:00:01.712 ********** 2026-04-24 03:58:00.540334 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:00.540349 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:00.540359 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:00.540373 | orchestrator | 2026-04-24 03:58:00.540392 | orchestrator | TASK [grafana : Check if extra configuration file exists] ********************** 2026-04-24 03:58:00.540409 | orchestrator | Friday 24 April 2026 03:57:57 +0000 (0:00:00.917) 0:00:02.630 ********** 2026-04-24 03:58:00.540426 | orchestrator | [WARNING]: Skipped '/operations/prometheus/grafana' path due to this access 2026-04-24 03:58:00.540475 | orchestrator | issue: '/operations/prometheus/grafana' is not a directory 2026-04-24 03:58:00.540495 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:58:00.540511 | orchestrator | 2026-04-24 03:58:00.540523 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-24 03:58:00.540534 | orchestrator | Friday 24 April 2026 03:57:57 +0000 (0:00:00.829) 0:00:03.459 ********** 2026-04-24 03:58:00.540555 | orchestrator | included: /ansible/roles/grafana/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 03:58:00.540568 | orchestrator | 2026-04-24 03:58:00.540579 | orchestrator | TASK [service-cert-copy : grafana | Copying over extra CA certificates] ******** 2026-04-24 03:58:00.540605 | orchestrator | Friday 24 April 2026 03:57:58 +0000 (0:00:00.558) 0:00:04.017 ********** 2026-04-24 03:58:00.540635 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:00.540648 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:00.540660 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:00.540671 | orchestrator | 2026-04-24 03:58:00.540682 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS certificate] *** 2026-04-24 03:58:00.540693 | orchestrator | Friday 24 April 2026 03:57:59 +0000 (0:00:01.390) 0:00:05.408 ********** 2026-04-24 03:58:00.540705 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 03:58:00.540717 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:58:00.540729 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 03:58:00.540747 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:58:00.540772 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 03:58:07.337264 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:58:07.337378 | orchestrator | 2026-04-24 03:58:07.337396 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS key] ***** 2026-04-24 03:58:07.337410 | orchestrator | Friday 24 April 2026 03:58:00 +0000 (0:00:00.583) 0:00:05.991 ********** 2026-04-24 03:58:07.337423 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 03:58:07.337438 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:58:07.337501 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 03:58:07.337514 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:58:07.337526 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-24 03:58:07.337538 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:58:07.337549 | orchestrator | 2026-04-24 03:58:07.337560 | orchestrator | TASK [grafana : Copying over config.json files] ******************************** 2026-04-24 03:58:07.337571 | orchestrator | Friday 24 April 2026 03:58:01 +0000 (0:00:00.592) 0:00:06.583 ********** 2026-04-24 03:58:07.337582 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:07.337635 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:07.337666 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:07.337679 | orchestrator | 2026-04-24 03:58:07.337690 | orchestrator | TASK [grafana : Copying over grafana.ini] ************************************** 2026-04-24 03:58:07.337701 | orchestrator | Friday 24 April 2026 03:58:02 +0000 (0:00:01.215) 0:00:07.799 ********** 2026-04-24 03:58:07.337712 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:07.337724 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:07.337735 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 03:58:07.337754 | orchestrator | 2026-04-24 03:58:07.337766 | orchestrator | TASK [grafana : Copying over extra configuration file] ************************* 2026-04-24 03:58:07.337776 | orchestrator | Friday 24 April 2026 03:58:03 +0000 (0:00:01.618) 0:00:09.417 ********** 2026-04-24 03:58:07.337787 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:58:07.337800 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:58:07.337812 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:58:07.337825 | orchestrator | 2026-04-24 03:58:07.337838 | orchestrator | TASK [grafana : Configuring Prometheus as data source for Grafana] ************* 2026-04-24 03:58:07.337851 | orchestrator | Friday 24 April 2026 03:58:04 +0000 (0:00:00.309) 0:00:09.727 ********** 2026-04-24 03:58:07.337863 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-24 03:58:07.337874 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-24 03:58:07.337885 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-24 03:58:07.337896 | orchestrator | 2026-04-24 03:58:07.337907 | orchestrator | TASK [grafana : Configuring dashboards provisioning] *************************** 2026-04-24 03:58:07.337917 | orchestrator | Friday 24 April 2026 03:58:05 +0000 (0:00:01.278) 0:00:11.005 ********** 2026-04-24 03:58:07.337928 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-24 03:58:07.337945 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-24 03:58:07.337957 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-24 03:58:07.337968 | orchestrator | 2026-04-24 03:58:07.337979 | orchestrator | TASK [grafana : Find custom grafana dashboards] ******************************** 2026-04-24 03:58:07.337996 | orchestrator | Friday 24 April 2026 03:58:07 +0000 (0:00:01.778) 0:00:12.784 ********** 2026-04-24 03:58:13.791421 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 03:58:13.791553 | orchestrator | 2026-04-24 03:58:13.791571 | orchestrator | TASK [grafana : Find templated grafana dashboards] ***************************** 2026-04-24 03:58:13.791584 | orchestrator | Friday 24 April 2026 03:58:08 +0000 (0:00:00.825) 0:00:13.610 ********** 2026-04-24 03:58:13.791596 | orchestrator | [WARNING]: Skipped '/etc/kolla/grafana/dashboards' path due to this access 2026-04-24 03:58:13.791608 | orchestrator | issue: '/etc/kolla/grafana/dashboards' is not a directory 2026-04-24 03:58:13.791619 | orchestrator | ok: [testbed-node-0] 2026-04-24 03:58:13.791630 | orchestrator | ok: [testbed-node-1] 2026-04-24 03:58:13.791641 | orchestrator | ok: [testbed-node-2] 2026-04-24 03:58:13.791652 | orchestrator | 2026-04-24 03:58:13.791663 | orchestrator | TASK [grafana : Prune templated Grafana dashboards] **************************** 2026-04-24 03:58:13.791674 | orchestrator | Friday 24 April 2026 03:58:08 +0000 (0:00:00.748) 0:00:14.359 ********** 2026-04-24 03:58:13.791685 | orchestrator | skipping: [testbed-node-0] 2026-04-24 03:58:13.791696 | orchestrator | skipping: [testbed-node-1] 2026-04-24 03:58:13.791707 | orchestrator | skipping: [testbed-node-2] 2026-04-24 03:58:13.791718 | orchestrator | 2026-04-24 03:58:13.791729 | orchestrator | TASK [grafana : Copying over custom dashboards] ******************************** 2026-04-24 03:58:13.791740 | orchestrator | Friday 24 April 2026 03:58:09 +0000 (0:00:00.352) 0:00:14.711 ********** 2026-04-24 03:58:13.791753 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1311468, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.0982122, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791791 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1311468, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.0982122, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791804 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1311468, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.0982122, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791817 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1311604, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.13238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791860 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1311604, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.13238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791874 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1311604, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.13238, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791885 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1311506, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1086102, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791905 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1311506, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1086102, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791916 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1311506, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1086102, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791927 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1311607, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1352503, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791944 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1311607, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1352503, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:13.791965 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1311607, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1352503, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.535790 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1311526, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1136143, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.535922 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1311526, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1136143, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.535938 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1311526, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1136143, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.535949 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1311550, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1296146, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.535961 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1311550, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1296146, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.535985 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1311550, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1296146, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.536014 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1311466, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.0956793, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.536032 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1311466, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.0956793, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.536042 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1311466, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.0956793, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.536053 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1311478, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1065733, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.536063 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1311478, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1065733, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.536078 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1311478, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1065733, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:17.536095 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1311509, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1086144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246344 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1311509, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1086144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246509 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1311509, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1086144, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246528 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1311537, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1177502, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246541 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1311537, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1177502, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246569 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1311537, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1177502, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246582 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1311601, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1317673, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246611 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1311601, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1317673, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246644 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1311601, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1317673, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246656 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1311502, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1077251, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246668 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1311502, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1077251, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246679 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1311502, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1077251, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246695 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1311547, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1207044, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:21.246714 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1311547, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1207044, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.483992 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1311547, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1207044, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484110 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1311532, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1170008, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484127 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1311532, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1170008, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484139 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1311532, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1170008, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484168 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1311521, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1130478, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484183 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1311521, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1130478, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484234 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1311521, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1130478, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484247 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1311518, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1109629, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484259 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1311518, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1109629, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484270 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1311518, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1109629, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484281 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1311543, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1198714, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484298 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1311543, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1198714, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:25.484324 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1311543, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1198714, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.291992 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1311512, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1104286, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292105 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1311512, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1104286, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292121 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1311512, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1104286, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292134 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1311598, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1306148, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292163 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1311598, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1306148, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292198 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1311598, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1306148, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292229 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1311715, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1846154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292241 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1311715, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1846154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292252 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1311715, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1846154, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292264 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1311638, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1577382, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292281 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1311638, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1577382, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292302 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1311638, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1577382, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:29.292321 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1311627, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1381185, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309244 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1311627, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1381185, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309349 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1311627, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1381185, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309366 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1311662, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1613622, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309396 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1311662, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1613622, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309430 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1311616, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1359315, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309441 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1311662, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1613622, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309518 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1311616, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1359315, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309532 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1311681, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1728387, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309544 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1311616, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1359315, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309555 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1311681, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1728387, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309581 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1311664, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.168615, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309593 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1311681, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1728387, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:33.309613 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1311664, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.168615, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190413 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1311684, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1747942, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190630 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1311664, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.168615, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190648 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1311684, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1747942, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190697 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1311703, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1796153, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190710 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1311684, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1747942, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190751 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1311703, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1796153, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190781 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1311679, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1717305, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190794 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1311703, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1796153, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190805 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1311679, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1717305, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190830 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1311658, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1587398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190843 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1311658, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1587398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190855 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1311679, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1717305, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:37.190875 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1311632, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1416147, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.959962 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1311632, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1416147, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960092 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1311658, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1587398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960192 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1311656, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1577382, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960235 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1311656, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1577382, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960254 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1311632, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1416147, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960273 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1311630, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1401258, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960308 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1311630, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1401258, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960322 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1311656, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1577382, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960369 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1311657, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.159615, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960400 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1311657, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.159615, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960423 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1311630, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1401258, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960443 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1311697, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1786153, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:40.960576 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1311697, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1786153, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.747967 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1311657, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.159615, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748134 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1311690, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1766152, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748181 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1311690, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1766152, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748206 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1311697, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1786153, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748225 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1311620, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1371088, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748243 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1311620, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1371088, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748301 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1311690, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1766152, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748325 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1311623, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1381185, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748353 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1311623, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1381185, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748374 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1311620, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1371088, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748396 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1311675, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1710978, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748408 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1311675, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1710978, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 03:58:44.748439 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1311623, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1381185, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 04:00:27.862371 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1311687, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1755161, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 04:00:27.862540 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1311687, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1755161, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 04:00:27.862557 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1311675, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1710978, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 04:00:27.862569 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1311687, 'dev': 110, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1776995909.1755161, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-24 04:00:27.862580 | orchestrator | 2026-04-24 04:00:27.862592 | orchestrator | TASK [grafana : Check grafana containers] ************************************** 2026-04-24 04:00:27.862604 | orchestrator | Friday 24 April 2026 03:58:46 +0000 (0:00:37.645) 0:00:52.357 ********** 2026-04-24 04:00:27.862654 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 04:00:27.862704 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 04:00:27.862716 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-24 04:00:27.862726 | orchestrator | 2026-04-24 04:00:27.862736 | orchestrator | TASK [grafana : Creating grafana database] ************************************* 2026-04-24 04:00:27.862746 | orchestrator | Friday 24 April 2026 03:58:48 +0000 (0:00:01.164) 0:00:53.521 ********** 2026-04-24 04:00:27.862756 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:00:27.862767 | orchestrator | 2026-04-24 04:00:27.862782 | orchestrator | TASK [grafana : Creating grafana database user and setting permissions] ******** 2026-04-24 04:00:27.862792 | orchestrator | Friday 24 April 2026 03:58:50 +0000 (0:00:02.302) 0:00:55.824 ********** 2026-04-24 04:00:27.862802 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:00:27.862811 | orchestrator | 2026-04-24 04:00:27.862820 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-24 04:00:27.862830 | orchestrator | Friday 24 April 2026 03:58:52 +0000 (0:00:02.280) 0:00:58.105 ********** 2026-04-24 04:00:27.862839 | orchestrator | 2026-04-24 04:00:27.862849 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-24 04:00:27.862858 | orchestrator | Friday 24 April 2026 03:58:52 +0000 (0:00:00.086) 0:00:58.192 ********** 2026-04-24 04:00:27.862868 | orchestrator | 2026-04-24 04:00:27.862878 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-24 04:00:27.862887 | orchestrator | Friday 24 April 2026 03:58:52 +0000 (0:00:00.071) 0:00:58.263 ********** 2026-04-24 04:00:27.862896 | orchestrator | 2026-04-24 04:00:27.862906 | orchestrator | RUNNING HANDLER [grafana : Restart first grafana container] ******************** 2026-04-24 04:00:27.862918 | orchestrator | Friday 24 April 2026 03:58:52 +0000 (0:00:00.071) 0:00:58.334 ********** 2026-04-24 04:00:27.862930 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:00:27.862942 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:00:27.862953 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:00:27.862964 | orchestrator | 2026-04-24 04:00:27.862975 | orchestrator | RUNNING HANDLER [grafana : Waiting for grafana to start on first node] ********* 2026-04-24 04:00:27.862986 | orchestrator | Friday 24 April 2026 03:58:55 +0000 (0:00:02.320) 0:01:00.656 ********** 2026-04-24 04:00:27.862997 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:00:27.863007 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:00:27.863017 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (12 retries left). 2026-04-24 04:00:27.863035 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (11 retries left). 2026-04-24 04:00:27.863045 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (10 retries left). 2026-04-24 04:00:27.863054 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (9 retries left). 2026-04-24 04:00:27.863064 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:00:27.863074 | orchestrator | 2026-04-24 04:00:27.863084 | orchestrator | RUNNING HANDLER [grafana : Restart remaining grafana containers] *************** 2026-04-24 04:00:27.863094 | orchestrator | Friday 24 April 2026 03:59:45 +0000 (0:00:50.328) 0:01:50.984 ********** 2026-04-24 04:00:27.863103 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:00:27.863113 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:00:27.863122 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:00:27.863132 | orchestrator | 2026-04-24 04:00:27.863141 | orchestrator | TASK [grafana : Wait for grafana application ready] **************************** 2026-04-24 04:00:27.863151 | orchestrator | Friday 24 April 2026 04:00:22 +0000 (0:00:37.241) 0:02:28.225 ********** 2026-04-24 04:00:27.863160 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:00:27.863170 | orchestrator | 2026-04-24 04:00:27.863179 | orchestrator | TASK [grafana : Remove old grafana docker volume] ****************************** 2026-04-24 04:00:27.863189 | orchestrator | Friday 24 April 2026 04:00:25 +0000 (0:00:02.247) 0:02:30.473 ********** 2026-04-24 04:00:27.863198 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:00:27.863208 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:00:27.863217 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:00:27.863227 | orchestrator | 2026-04-24 04:00:27.863236 | orchestrator | TASK [grafana : Enable grafana datasources] ************************************ 2026-04-24 04:00:27.863246 | orchestrator | Friday 24 April 2026 04:00:25 +0000 (0:00:00.310) 0:02:30.783 ********** 2026-04-24 04:00:27.863257 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'influxdb', 'value': {'enabled': False, 'data': {'isDefault': True, 'database': 'telegraf', 'name': 'telegraf', 'type': 'influxdb', 'url': 'https://api-int.testbed.osism.xyz:8086', 'access': 'proxy', 'basicAuth': False}}})  2026-04-24 04:00:27.863276 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'data': {'name': 'opensearch', 'type': 'grafana-opensearch-datasource', 'access': 'proxy', 'url': 'https://api-int.testbed.osism.xyz:9200', 'jsonData': {'flavor': 'OpenSearch', 'database': 'flog-*', 'version': '2.11.1', 'timeField': '@timestamp', 'logLevelField': 'log_level'}}}}) 2026-04-24 04:00:28.512735 | orchestrator | 2026-04-24 04:00:28.512838 | orchestrator | TASK [grafana : Disable Getting Started panel] ********************************* 2026-04-24 04:00:28.512856 | orchestrator | Friday 24 April 2026 04:00:27 +0000 (0:00:02.523) 0:02:33.307 ********** 2026-04-24 04:00:28.512868 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:00:28.512881 | orchestrator | 2026-04-24 04:00:28.512892 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:00:28.512904 | orchestrator | testbed-node-0 : ok=21  changed=12  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 04:00:28.512917 | orchestrator | testbed-node-1 : ok=14  changed=9  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 04:00:28.512929 | orchestrator | testbed-node-2 : ok=14  changed=9  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 04:00:28.512940 | orchestrator | 2026-04-24 04:00:28.512951 | orchestrator | 2026-04-24 04:00:28.512963 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:00:28.512993 | orchestrator | Friday 24 April 2026 04:00:28 +0000 (0:00:00.281) 0:02:33.588 ********** 2026-04-24 04:00:28.513004 | orchestrator | =============================================================================== 2026-04-24 04:00:28.513038 | orchestrator | grafana : Waiting for grafana to start on first node ------------------- 50.33s 2026-04-24 04:00:28.513050 | orchestrator | grafana : Copying over custom dashboards ------------------------------- 37.65s 2026-04-24 04:00:28.513061 | orchestrator | grafana : Restart remaining grafana containers ------------------------- 37.24s 2026-04-24 04:00:28.513072 | orchestrator | grafana : Enable grafana datasources ------------------------------------ 2.52s 2026-04-24 04:00:28.513084 | orchestrator | grafana : Restart first grafana container ------------------------------- 2.32s 2026-04-24 04:00:28.513095 | orchestrator | grafana : Creating grafana database ------------------------------------- 2.30s 2026-04-24 04:00:28.513106 | orchestrator | grafana : Creating grafana database user and setting permissions -------- 2.28s 2026-04-24 04:00:28.513117 | orchestrator | grafana : Wait for grafana application ready ---------------------------- 2.25s 2026-04-24 04:00:28.513127 | orchestrator | grafana : Configuring dashboards provisioning --------------------------- 1.78s 2026-04-24 04:00:28.513138 | orchestrator | grafana : Copying over grafana.ini -------------------------------------- 1.62s 2026-04-24 04:00:28.513149 | orchestrator | service-cert-copy : grafana | Copying over extra CA certificates -------- 1.39s 2026-04-24 04:00:28.513160 | orchestrator | grafana : Configuring Prometheus as data source for Grafana ------------- 1.28s 2026-04-24 04:00:28.513171 | orchestrator | grafana : Copying over config.json files -------------------------------- 1.22s 2026-04-24 04:00:28.513182 | orchestrator | grafana : Check grafana containers -------------------------------------- 1.16s 2026-04-24 04:00:28.513193 | orchestrator | grafana : Ensuring config directories exist ----------------------------- 0.92s 2026-04-24 04:00:28.513204 | orchestrator | grafana : Check if extra configuration file exists ---------------------- 0.83s 2026-04-24 04:00:28.513215 | orchestrator | grafana : Find custom grafana dashboards -------------------------------- 0.83s 2026-04-24 04:00:28.513226 | orchestrator | grafana : Find templated grafana dashboards ----------------------------- 0.75s 2026-04-24 04:00:28.513237 | orchestrator | grafana : include_tasks ------------------------------------------------- 0.60s 2026-04-24 04:00:28.513248 | orchestrator | service-cert-copy : grafana | Copying over backend internal TLS key ----- 0.59s 2026-04-24 04:00:28.848561 | orchestrator | + sh -c /opt/configuration/scripts/deploy/510-clusterapi.sh 2026-04-24 04:00:28.855068 | orchestrator | + set -e 2026-04-24 04:00:28.855128 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 04:00:28.856178 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 04:00:28.856214 | orchestrator | ++ INTERACTIVE=false 2026-04-24 04:00:28.856225 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 04:00:28.856237 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 04:00:28.856248 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 04:00:28.857075 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 04:00:28.857097 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 04:00:28.857108 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 04:00:28.857119 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 04:00:28.857130 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 04:00:28.857142 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 04:00:28.857152 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 04:00:28.857165 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 04:00:28.857176 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 04:00:28.857187 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 04:00:28.857197 | orchestrator | ++ export ARA=false 2026-04-24 04:00:28.857208 | orchestrator | ++ ARA=false 2026-04-24 04:00:28.857219 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 04:00:28.857230 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 04:00:28.857241 | orchestrator | ++ export TEMPEST=false 2026-04-24 04:00:28.857251 | orchestrator | ++ TEMPEST=false 2026-04-24 04:00:28.857262 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 04:00:28.857272 | orchestrator | ++ IS_ZUUL=true 2026-04-24 04:00:28.857283 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:00:28.857294 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:00:28.857305 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 04:00:28.857316 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 04:00:28.857326 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 04:00:28.857337 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 04:00:28.857348 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 04:00:28.857389 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 04:00:28.857400 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 04:00:28.857411 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 04:00:28.858348 | orchestrator | ++ semver 9.5.0 8.0.0 2026-04-24 04:00:28.923546 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 04:00:28.923636 | orchestrator | + osism apply clusterapi 2026-04-24 04:00:31.169206 | orchestrator | 2026-04-24 04:00:31 | INFO  | Task ba1dae1f-478a-4c26-8e35-5b20ad53a764 (clusterapi) was prepared for execution. 2026-04-24 04:00:31.169299 | orchestrator | 2026-04-24 04:00:31 | INFO  | It takes a moment until task ba1dae1f-478a-4c26-8e35-5b20ad53a764 (clusterapi) has been started and output is visible here. 2026-04-24 04:01:54.614847 | orchestrator | 2026-04-24 04:01:54.614982 | orchestrator | PLAY [Apply cert_manager role] ************************************************* 2026-04-24 04:01:54.614997 | orchestrator | 2026-04-24 04:01:54.615008 | orchestrator | TASK [Include cert_manager role] *********************************************** 2026-04-24 04:01:54.615019 | orchestrator | Friday 24 April 2026 04:00:35 +0000 (0:00:00.193) 0:00:00.193 ********** 2026-04-24 04:01:54.615029 | orchestrator | included: cert_manager for testbed-manager 2026-04-24 04:01:54.615039 | orchestrator | 2026-04-24 04:01:54.615049 | orchestrator | TASK [cert_manager : Deploy cert-manager crds] ********************************* 2026-04-24 04:01:54.615058 | orchestrator | Friday 24 April 2026 04:00:35 +0000 (0:00:00.254) 0:00:00.447 ********** 2026-04-24 04:01:54.615068 | orchestrator | changed: [testbed-manager] 2026-04-24 04:01:54.615079 | orchestrator | 2026-04-24 04:01:54.615089 | orchestrator | TASK [cert_manager : Deploy cert-manager] ************************************** 2026-04-24 04:01:54.615098 | orchestrator | Friday 24 April 2026 04:00:41 +0000 (0:00:05.464) 0:00:05.911 ********** 2026-04-24 04:01:54.615108 | orchestrator | changed: [testbed-manager] 2026-04-24 04:01:54.615118 | orchestrator | 2026-04-24 04:01:54.615127 | orchestrator | PLAY [Initialize or upgrade the CAPI management cluster] *********************** 2026-04-24 04:01:54.615137 | orchestrator | 2026-04-24 04:01:54.615147 | orchestrator | TASK [Get capi-system namespace phase] ***************************************** 2026-04-24 04:01:54.615156 | orchestrator | Friday 24 April 2026 04:01:31 +0000 (0:00:50.365) 0:00:56.277 ********** 2026-04-24 04:01:54.615184 | orchestrator | ok: [testbed-manager] 2026-04-24 04:01:54.615195 | orchestrator | 2026-04-24 04:01:54.615205 | orchestrator | TASK [Set capi-system-phase fact] ********************************************** 2026-04-24 04:01:54.615214 | orchestrator | Friday 24 April 2026 04:01:32 +0000 (0:00:01.112) 0:00:57.389 ********** 2026-04-24 04:01:54.615224 | orchestrator | ok: [testbed-manager] 2026-04-24 04:01:54.615233 | orchestrator | 2026-04-24 04:01:54.615243 | orchestrator | TASK [Initialize the CAPI management cluster] ********************************** 2026-04-24 04:01:54.615254 | orchestrator | Friday 24 April 2026 04:01:32 +0000 (0:00:00.156) 0:00:57.546 ********** 2026-04-24 04:01:54.615264 | orchestrator | ok: [testbed-manager] 2026-04-24 04:01:54.615273 | orchestrator | 2026-04-24 04:01:54.615283 | orchestrator | TASK [Upgrade the CAPI management cluster] ************************************* 2026-04-24 04:01:54.615292 | orchestrator | Friday 24 April 2026 04:01:51 +0000 (0:00:18.359) 0:01:15.905 ********** 2026-04-24 04:01:54.615302 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:01:54.615311 | orchestrator | 2026-04-24 04:01:54.615321 | orchestrator | TASK [Install openstack-resource-controller] *********************************** 2026-04-24 04:01:54.615330 | orchestrator | Friday 24 April 2026 04:01:51 +0000 (0:00:00.152) 0:01:16.058 ********** 2026-04-24 04:01:54.615340 | orchestrator | changed: [testbed-manager] 2026-04-24 04:01:54.615350 | orchestrator | 2026-04-24 04:01:54.615359 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:01:54.615370 | orchestrator | testbed-manager : ok=7  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 04:01:54.615380 | orchestrator | 2026-04-24 04:01:54.615390 | orchestrator | 2026-04-24 04:01:54.615401 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:01:54.615413 | orchestrator | Friday 24 April 2026 04:01:54 +0000 (0:00:02.652) 0:01:18.711 ********** 2026-04-24 04:01:54.615448 | orchestrator | =============================================================================== 2026-04-24 04:01:54.615459 | orchestrator | cert_manager : Deploy cert-manager ------------------------------------- 50.37s 2026-04-24 04:01:54.615471 | orchestrator | Initialize the CAPI management cluster --------------------------------- 18.36s 2026-04-24 04:01:54.615482 | orchestrator | cert_manager : Deploy cert-manager crds --------------------------------- 5.46s 2026-04-24 04:01:54.615515 | orchestrator | Install openstack-resource-controller ----------------------------------- 2.65s 2026-04-24 04:01:54.615526 | orchestrator | Get capi-system namespace phase ----------------------------------------- 1.11s 2026-04-24 04:01:54.615537 | orchestrator | Include cert_manager role ----------------------------------------------- 0.25s 2026-04-24 04:01:54.615548 | orchestrator | Set capi-system-phase fact ---------------------------------------------- 0.16s 2026-04-24 04:01:54.615560 | orchestrator | Upgrade the CAPI management cluster ------------------------------------- 0.15s 2026-04-24 04:01:54.948407 | orchestrator | + osism apply magnum 2026-04-24 04:01:57.105371 | orchestrator | 2026-04-24 04:01:57 | INFO  | Task 88d7ec6e-c190-448e-b4bd-4c018a2afecb (magnum) was prepared for execution. 2026-04-24 04:01:57.105480 | orchestrator | 2026-04-24 04:01:57 | INFO  | It takes a moment until task 88d7ec6e-c190-448e-b4bd-4c018a2afecb (magnum) has been started and output is visible here. 2026-04-24 04:02:38.910450 | orchestrator | 2026-04-24 04:02:38.910566 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:02:38.910631 | orchestrator | 2026-04-24 04:02:38.910649 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:02:38.910661 | orchestrator | Friday 24 April 2026 04:02:01 +0000 (0:00:00.271) 0:00:00.271 ********** 2026-04-24 04:02:38.910673 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:02:38.910685 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:02:38.910696 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:02:38.910708 | orchestrator | 2026-04-24 04:02:38.910719 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:02:38.910730 | orchestrator | Friday 24 April 2026 04:02:01 +0000 (0:00:00.330) 0:00:00.601 ********** 2026-04-24 04:02:38.910741 | orchestrator | ok: [testbed-node-0] => (item=enable_magnum_True) 2026-04-24 04:02:38.910752 | orchestrator | ok: [testbed-node-1] => (item=enable_magnum_True) 2026-04-24 04:02:38.910763 | orchestrator | ok: [testbed-node-2] => (item=enable_magnum_True) 2026-04-24 04:02:38.910774 | orchestrator | 2026-04-24 04:02:38.910785 | orchestrator | PLAY [Apply role magnum] ******************************************************* 2026-04-24 04:02:38.910796 | orchestrator | 2026-04-24 04:02:38.910807 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-24 04:02:38.910818 | orchestrator | Friday 24 April 2026 04:02:02 +0000 (0:00:00.513) 0:00:01.115 ********** 2026-04-24 04:02:38.910829 | orchestrator | included: /ansible/roles/magnum/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:02:38.910841 | orchestrator | 2026-04-24 04:02:38.910853 | orchestrator | TASK [service-ks-register : magnum | Creating services] ************************ 2026-04-24 04:02:38.910864 | orchestrator | Friday 24 April 2026 04:02:02 +0000 (0:00:00.576) 0:00:01.692 ********** 2026-04-24 04:02:38.910875 | orchestrator | changed: [testbed-node-0] => (item=magnum (container-infra)) 2026-04-24 04:02:38.910886 | orchestrator | 2026-04-24 04:02:38.910897 | orchestrator | TASK [service-ks-register : magnum | Creating endpoints] *********************** 2026-04-24 04:02:38.910908 | orchestrator | Friday 24 April 2026 04:02:06 +0000 (0:00:03.546) 0:00:05.239 ********** 2026-04-24 04:02:38.910919 | orchestrator | changed: [testbed-node-0] => (item=magnum -> https://api-int.testbed.osism.xyz:9511/v1 -> internal) 2026-04-24 04:02:38.910932 | orchestrator | changed: [testbed-node-0] => (item=magnum -> https://api.testbed.osism.xyz:9511/v1 -> public) 2026-04-24 04:02:38.910951 | orchestrator | 2026-04-24 04:02:38.910971 | orchestrator | TASK [service-ks-register : magnum | Creating projects] ************************ 2026-04-24 04:02:38.911042 | orchestrator | Friday 24 April 2026 04:02:12 +0000 (0:00:06.355) 0:00:11.594 ********** 2026-04-24 04:02:38.911058 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 04:02:38.911072 | orchestrator | 2026-04-24 04:02:38.911085 | orchestrator | TASK [service-ks-register : magnum | Creating users] *************************** 2026-04-24 04:02:38.911097 | orchestrator | Friday 24 April 2026 04:02:16 +0000 (0:00:03.440) 0:00:15.034 ********** 2026-04-24 04:02:38.911110 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 04:02:38.911123 | orchestrator | changed: [testbed-node-0] => (item=magnum -> service) 2026-04-24 04:02:38.911135 | orchestrator | 2026-04-24 04:02:38.911147 | orchestrator | TASK [service-ks-register : magnum | Creating roles] *************************** 2026-04-24 04:02:38.911159 | orchestrator | Friday 24 April 2026 04:02:19 +0000 (0:00:03.830) 0:00:18.865 ********** 2026-04-24 04:02:38.911173 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 04:02:38.911186 | orchestrator | 2026-04-24 04:02:38.911198 | orchestrator | TASK [service-ks-register : magnum | Granting user roles] ********************** 2026-04-24 04:02:38.911210 | orchestrator | Friday 24 April 2026 04:02:23 +0000 (0:00:03.184) 0:00:22.049 ********** 2026-04-24 04:02:38.911223 | orchestrator | changed: [testbed-node-0] => (item=magnum -> service -> admin) 2026-04-24 04:02:38.911236 | orchestrator | 2026-04-24 04:02:38.911248 | orchestrator | TASK [magnum : Creating Magnum trustee domain] ********************************* 2026-04-24 04:02:38.911260 | orchestrator | Friday 24 April 2026 04:02:26 +0000 (0:00:03.793) 0:00:25.842 ********** 2026-04-24 04:02:38.911273 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:02:38.911285 | orchestrator | 2026-04-24 04:02:38.911297 | orchestrator | TASK [magnum : Creating Magnum trustee user] *********************************** 2026-04-24 04:02:38.911309 | orchestrator | Friday 24 April 2026 04:02:30 +0000 (0:00:03.371) 0:00:29.214 ********** 2026-04-24 04:02:38.911322 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:02:38.911335 | orchestrator | 2026-04-24 04:02:38.911347 | orchestrator | TASK [magnum : Creating Magnum trustee user role] ****************************** 2026-04-24 04:02:38.911357 | orchestrator | Friday 24 April 2026 04:02:34 +0000 (0:00:03.767) 0:00:32.982 ********** 2026-04-24 04:02:38.911368 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:02:38.911379 | orchestrator | 2026-04-24 04:02:38.911389 | orchestrator | TASK [magnum : Ensuring config directories exist] ****************************** 2026-04-24 04:02:38.911400 | orchestrator | Friday 24 April 2026 04:02:37 +0000 (0:00:03.335) 0:00:36.318 ********** 2026-04-24 04:02:38.911434 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:38.911451 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:38.911477 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:38.911490 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:38.911501 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:38.911520 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:46.271288 | orchestrator | 2026-04-24 04:02:46.271397 | orchestrator | TASK [magnum : Check if policies shall be overwritten] ************************* 2026-04-24 04:02:46.271414 | orchestrator | Friday 24 April 2026 04:02:38 +0000 (0:00:01.524) 0:00:37.842 ********** 2026-04-24 04:02:46.271426 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:02:46.271438 | orchestrator | 2026-04-24 04:02:46.271450 | orchestrator | TASK [magnum : Set magnum policy file] ***************************************** 2026-04-24 04:02:46.271461 | orchestrator | Friday 24 April 2026 04:02:39 +0000 (0:00:00.155) 0:00:37.998 ********** 2026-04-24 04:02:46.271509 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:02:46.271521 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:02:46.271532 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:02:46.271543 | orchestrator | 2026-04-24 04:02:46.271554 | orchestrator | TASK [magnum : Check if kubeconfig file is supplied] *************************** 2026-04-24 04:02:46.271565 | orchestrator | Friday 24 April 2026 04:02:39 +0000 (0:00:00.316) 0:00:38.314 ********** 2026-04-24 04:02:46.271576 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 04:02:46.271587 | orchestrator | 2026-04-24 04:02:46.271598 | orchestrator | TASK [magnum : Copying over kubeconfig file] *********************************** 2026-04-24 04:02:46.271609 | orchestrator | Friday 24 April 2026 04:02:40 +0000 (0:00:00.837) 0:00:39.152 ********** 2026-04-24 04:02:46.271702 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:46.271720 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:46.271732 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:46.271764 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:46.271786 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:46.271803 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:46.271815 | orchestrator | 2026-04-24 04:02:46.271827 | orchestrator | TASK [magnum : Set magnum kubeconfig file's path] ****************************** 2026-04-24 04:02:46.271838 | orchestrator | Friday 24 April 2026 04:02:42 +0000 (0:00:02.435) 0:00:41.587 ********** 2026-04-24 04:02:46.271849 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:02:46.271861 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:02:46.271872 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:02:46.271883 | orchestrator | 2026-04-24 04:02:46.271894 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-24 04:02:46.271904 | orchestrator | Friday 24 April 2026 04:02:43 +0000 (0:00:00.521) 0:00:42.109 ********** 2026-04-24 04:02:46.271916 | orchestrator | included: /ansible/roles/magnum/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:02:46.271927 | orchestrator | 2026-04-24 04:02:46.271938 | orchestrator | TASK [service-cert-copy : magnum | Copying over extra CA certificates] ********* 2026-04-24 04:02:46.271948 | orchestrator | Friday 24 April 2026 04:02:43 +0000 (0:00:00.574) 0:00:42.683 ********** 2026-04-24 04:02:46.271960 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:46.271980 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:47.177155 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:47.177266 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:47.177278 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:47.177287 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:47.177296 | orchestrator | 2026-04-24 04:02:47.177326 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS certificate] *** 2026-04-24 04:02:47.177336 | orchestrator | Friday 24 April 2026 04:02:46 +0000 (0:00:02.528) 0:00:45.212 ********** 2026-04-24 04:02:47.177361 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:47.177372 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:47.177380 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:02:47.177394 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:47.177402 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:47.177411 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:02:47.177419 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:47.177441 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:50.618621 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:02:50.618830 | orchestrator | 2026-04-24 04:02:50.618860 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS key] ****** 2026-04-24 04:02:50.618880 | orchestrator | Friday 24 April 2026 04:02:47 +0000 (0:00:00.897) 0:00:46.109 ********** 2026-04-24 04:02:50.618903 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:50.618947 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:50.618969 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:02:50.618990 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:50.619041 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:50.619055 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:02:50.619086 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:50.619099 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:50.619116 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:02:50.619128 | orchestrator | 2026-04-24 04:02:50.619139 | orchestrator | TASK [magnum : Copying over config.json files for services] ******************** 2026-04-24 04:02:50.619150 | orchestrator | Friday 24 April 2026 04:02:48 +0000 (0:00:00.870) 0:00:46.979 ********** 2026-04-24 04:02:50.619165 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:50.619194 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:50.619221 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:56.653854 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:56.653984 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:56.654001 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:56.654082 | orchestrator | 2026-04-24 04:02:56.654098 | orchestrator | TASK [magnum : Copying over magnum.conf] *************************************** 2026-04-24 04:02:56.654109 | orchestrator | Friday 24 April 2026 04:02:50 +0000 (0:00:02.580) 0:00:49.560 ********** 2026-04-24 04:02:56.654120 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:56.654181 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:56.654196 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:56.654211 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:56.654231 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:56.654241 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:56.654251 | orchestrator | 2026-04-24 04:02:56.654262 | orchestrator | TASK [magnum : Copying over existing policy file] ****************************** 2026-04-24 04:02:56.654272 | orchestrator | Friday 24 April 2026 04:02:55 +0000 (0:00:05.376) 0:00:54.937 ********** 2026-04-24 04:02:56.654291 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:58.583168 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:58.583290 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:02:58.583325 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:58.583364 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:58.583374 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:02:58.583384 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-24 04:02:58.583411 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:02:58.583421 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:02:58.583430 | orchestrator | 2026-04-24 04:02:58.583440 | orchestrator | TASK [magnum : Check magnum containers] **************************************** 2026-04-24 04:02:58.583451 | orchestrator | Friday 24 April 2026 04:02:56 +0000 (0:00:00.660) 0:00:55.598 ********** 2026-04-24 04:02:58.583467 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:58.583486 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:58.583496 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-24 04:02:58.583505 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:02:58.583522 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:03:53.996931 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 04:03:53.997113 | orchestrator | 2026-04-24 04:03:53.997135 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-24 04:03:53.997149 | orchestrator | Friday 24 April 2026 04:02:58 +0000 (0:00:01.923) 0:00:57.521 ********** 2026-04-24 04:03:53.997160 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:03:53.997173 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:03:53.997183 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:03:53.997194 | orchestrator | 2026-04-24 04:03:53.997206 | orchestrator | TASK [magnum : Creating Magnum database] *************************************** 2026-04-24 04:03:53.997216 | orchestrator | Friday 24 April 2026 04:02:59 +0000 (0:00:00.565) 0:00:58.087 ********** 2026-04-24 04:03:53.997227 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:03:53.997238 | orchestrator | 2026-04-24 04:03:53.997249 | orchestrator | TASK [magnum : Creating Magnum database user and setting permissions] ********** 2026-04-24 04:03:53.997260 | orchestrator | Friday 24 April 2026 04:03:01 +0000 (0:00:02.013) 0:01:00.100 ********** 2026-04-24 04:03:53.997270 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:03:53.997281 | orchestrator | 2026-04-24 04:03:53.997292 | orchestrator | TASK [magnum : Running Magnum bootstrap container] ***************************** 2026-04-24 04:03:53.997303 | orchestrator | Friday 24 April 2026 04:03:03 +0000 (0:00:02.210) 0:01:02.311 ********** 2026-04-24 04:03:53.997313 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:03:53.997324 | orchestrator | 2026-04-24 04:03:53.997335 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-24 04:03:53.997348 | orchestrator | Friday 24 April 2026 04:03:19 +0000 (0:00:15.757) 0:01:18.069 ********** 2026-04-24 04:03:53.997362 | orchestrator | 2026-04-24 04:03:53.997374 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-24 04:03:53.997386 | orchestrator | Friday 24 April 2026 04:03:19 +0000 (0:00:00.073) 0:01:18.142 ********** 2026-04-24 04:03:53.997398 | orchestrator | 2026-04-24 04:03:53.997411 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-24 04:03:53.997423 | orchestrator | Friday 24 April 2026 04:03:19 +0000 (0:00:00.087) 0:01:18.230 ********** 2026-04-24 04:03:53.997435 | orchestrator | 2026-04-24 04:03:53.997447 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-api container] ************************ 2026-04-24 04:03:53.997460 | orchestrator | Friday 24 April 2026 04:03:19 +0000 (0:00:00.073) 0:01:18.304 ********** 2026-04-24 04:03:53.997487 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:03:53.997499 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:03:53.997511 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:03:53.997524 | orchestrator | 2026-04-24 04:03:53.997536 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-conductor container] ****************** 2026-04-24 04:03:53.997549 | orchestrator | Friday 24 April 2026 04:03:38 +0000 (0:00:19.376) 0:01:37.681 ********** 2026-04-24 04:03:53.997562 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:03:53.997574 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:03:53.997586 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:03:53.997597 | orchestrator | 2026-04-24 04:03:53.997608 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:03:53.997620 | orchestrator | testbed-node-0 : ok=26  changed=18  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:03:53.997631 | orchestrator | testbed-node-1 : ok=13  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 04:03:53.997642 | orchestrator | testbed-node-2 : ok=13  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 04:03:53.997661 | orchestrator | 2026-04-24 04:03:53.997672 | orchestrator | 2026-04-24 04:03:53.997683 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:03:53.997694 | orchestrator | Friday 24 April 2026 04:03:53 +0000 (0:00:14.908) 0:01:52.589 ********** 2026-04-24 04:03:53.997704 | orchestrator | =============================================================================== 2026-04-24 04:03:53.997715 | orchestrator | magnum : Restart magnum-api container ---------------------------------- 19.38s 2026-04-24 04:03:53.997726 | orchestrator | magnum : Running Magnum bootstrap container ---------------------------- 15.76s 2026-04-24 04:03:53.997737 | orchestrator | magnum : Restart magnum-conductor container ---------------------------- 14.91s 2026-04-24 04:03:53.997748 | orchestrator | service-ks-register : magnum | Creating endpoints ----------------------- 6.36s 2026-04-24 04:03:53.997759 | orchestrator | magnum : Copying over magnum.conf --------------------------------------- 5.38s 2026-04-24 04:03:53.997790 | orchestrator | service-ks-register : magnum | Creating users --------------------------- 3.83s 2026-04-24 04:03:53.997801 | orchestrator | service-ks-register : magnum | Granting user roles ---------------------- 3.79s 2026-04-24 04:03:53.997832 | orchestrator | magnum : Creating Magnum trustee user ----------------------------------- 3.77s 2026-04-24 04:03:53.997844 | orchestrator | service-ks-register : magnum | Creating services ------------------------ 3.55s 2026-04-24 04:03:53.997854 | orchestrator | service-ks-register : magnum | Creating projects ------------------------ 3.44s 2026-04-24 04:03:53.997865 | orchestrator | magnum : Creating Magnum trustee domain --------------------------------- 3.37s 2026-04-24 04:03:53.997876 | orchestrator | magnum : Creating Magnum trustee user role ------------------------------ 3.34s 2026-04-24 04:03:53.997887 | orchestrator | service-ks-register : magnum | Creating roles --------------------------- 3.18s 2026-04-24 04:03:53.997906 | orchestrator | magnum : Copying over config.json files for services -------------------- 2.58s 2026-04-24 04:03:53.997917 | orchestrator | service-cert-copy : magnum | Copying over extra CA certificates --------- 2.53s 2026-04-24 04:03:53.997928 | orchestrator | magnum : Copying over kubeconfig file ----------------------------------- 2.44s 2026-04-24 04:03:53.997939 | orchestrator | magnum : Creating Magnum database user and setting permissions ---------- 2.21s 2026-04-24 04:03:53.997950 | orchestrator | magnum : Creating Magnum database --------------------------------------- 2.01s 2026-04-24 04:03:53.997961 | orchestrator | magnum : Check magnum containers ---------------------------------------- 1.92s 2026-04-24 04:03:53.997971 | orchestrator | magnum : Ensuring config directories exist ------------------------------ 1.52s 2026-04-24 04:03:54.843092 | orchestrator | ok: Runtime: 1:42:11.815790 2026-04-24 04:03:55.112557 | 2026-04-24 04:03:55.112723 | TASK [Deploy in a nutshell] 2026-04-24 04:03:55.648647 | orchestrator | skipping: Conditional result was False 2026-04-24 04:03:55.673471 | 2026-04-24 04:03:55.673631 | TASK [Bootstrap services] 2026-04-24 04:03:56.382925 | orchestrator | 2026-04-24 04:03:56.383048 | orchestrator | # BOOTSTRAP 2026-04-24 04:03:56.383057 | orchestrator | 2026-04-24 04:03:56.383063 | orchestrator | + set -e 2026-04-24 04:03:56.383067 | orchestrator | + echo 2026-04-24 04:03:56.383073 | orchestrator | + echo '# BOOTSTRAP' 2026-04-24 04:03:56.383080 | orchestrator | + echo 2026-04-24 04:03:56.383100 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap-services.sh 2026-04-24 04:03:56.392492 | orchestrator | + set -e 2026-04-24 04:03:56.393014 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap/300-openstack.sh 2026-04-24 04:03:58.650626 | orchestrator | 2026-04-24 04:03:58 | INFO  | It takes a moment until task e7e67940-a257-4e12-bfbf-853ba34e2668 (flavor-manager) has been started and output is visible here. 2026-04-24 04:04:06.963909 | orchestrator | 2026-04-24 04:04:02 | INFO  | Flavor SCS-1L-1 created 2026-04-24 04:04:06.964039 | orchestrator | 2026-04-24 04:04:02 | INFO  | Flavor SCS-1L-1-5 created 2026-04-24 04:04:06.964057 | orchestrator | 2026-04-24 04:04:02 | INFO  | Flavor SCS-1V-2 created 2026-04-24 04:04:06.964068 | orchestrator | 2026-04-24 04:04:03 | INFO  | Flavor SCS-1V-2-5 created 2026-04-24 04:04:06.964079 | orchestrator | 2026-04-24 04:04:03 | INFO  | Flavor SCS-1V-4 created 2026-04-24 04:04:06.964089 | orchestrator | 2026-04-24 04:04:03 | INFO  | Flavor SCS-1V-4-10 created 2026-04-24 04:04:06.964100 | orchestrator | 2026-04-24 04:04:03 | INFO  | Flavor SCS-1V-8 created 2026-04-24 04:04:06.964111 | orchestrator | 2026-04-24 04:04:03 | INFO  | Flavor SCS-1V-8-20 created 2026-04-24 04:04:06.964135 | orchestrator | 2026-04-24 04:04:03 | INFO  | Flavor SCS-2V-4 created 2026-04-24 04:04:06.964146 | orchestrator | 2026-04-24 04:04:03 | INFO  | Flavor SCS-2V-4-10 created 2026-04-24 04:04:06.964156 | orchestrator | 2026-04-24 04:04:04 | INFO  | Flavor SCS-2V-8 created 2026-04-24 04:04:06.964166 | orchestrator | 2026-04-24 04:04:04 | INFO  | Flavor SCS-2V-8-20 created 2026-04-24 04:04:06.964176 | orchestrator | 2026-04-24 04:04:04 | INFO  | Flavor SCS-2V-16 created 2026-04-24 04:04:06.964186 | orchestrator | 2026-04-24 04:04:04 | INFO  | Flavor SCS-2V-16-50 created 2026-04-24 04:04:06.964196 | orchestrator | 2026-04-24 04:04:04 | INFO  | Flavor SCS-4V-8 created 2026-04-24 04:04:06.964206 | orchestrator | 2026-04-24 04:04:04 | INFO  | Flavor SCS-4V-8-20 created 2026-04-24 04:04:06.964216 | orchestrator | 2026-04-24 04:04:05 | INFO  | Flavor SCS-4V-16 created 2026-04-24 04:04:06.964226 | orchestrator | 2026-04-24 04:04:05 | INFO  | Flavor SCS-4V-16-50 created 2026-04-24 04:04:06.964236 | orchestrator | 2026-04-24 04:04:05 | INFO  | Flavor SCS-4V-32 created 2026-04-24 04:04:06.964246 | orchestrator | 2026-04-24 04:04:05 | INFO  | Flavor SCS-4V-32-100 created 2026-04-24 04:04:06.964256 | orchestrator | 2026-04-24 04:04:05 | INFO  | Flavor SCS-8V-16 created 2026-04-24 04:04:06.964266 | orchestrator | 2026-04-24 04:04:05 | INFO  | Flavor SCS-8V-16-50 created 2026-04-24 04:04:06.964277 | orchestrator | 2026-04-24 04:04:05 | INFO  | Flavor SCS-8V-32 created 2026-04-24 04:04:06.964287 | orchestrator | 2026-04-24 04:04:06 | INFO  | Flavor SCS-8V-32-100 created 2026-04-24 04:04:06.964297 | orchestrator | 2026-04-24 04:04:06 | INFO  | Flavor SCS-16V-32 created 2026-04-24 04:04:06.964307 | orchestrator | 2026-04-24 04:04:06 | INFO  | Flavor SCS-16V-32-100 created 2026-04-24 04:04:06.964317 | orchestrator | 2026-04-24 04:04:06 | INFO  | Flavor SCS-2V-4-20s created 2026-04-24 04:04:06.964327 | orchestrator | 2026-04-24 04:04:06 | INFO  | Flavor SCS-4V-8-50s created 2026-04-24 04:04:06.964337 | orchestrator | 2026-04-24 04:04:06 | INFO  | Flavor SCS-8V-32-100s created 2026-04-24 04:04:09.325524 | orchestrator | 2026-04-24 04:04:09 | INFO  | Trying to run play bootstrap-basic in environment openstack 2026-04-24 04:04:19.406479 | orchestrator | 2026-04-24 04:04:19 | INFO  | Task 946b76e8-b589-4687-9f92-7cd0fd85b60c (bootstrap-basic) was prepared for execution. 2026-04-24 04:04:19.406608 | orchestrator | 2026-04-24 04:04:19 | INFO  | It takes a moment until task 946b76e8-b589-4687-9f92-7cd0fd85b60c (bootstrap-basic) has been started and output is visible here. 2026-04-24 04:05:02.514253 | orchestrator | 2026-04-24 04:05:02.514362 | orchestrator | PLAY [Bootstrap basic OpenStack services] ************************************** 2026-04-24 04:05:02.514374 | orchestrator | 2026-04-24 04:05:02.514382 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 04:05:02.514390 | orchestrator | Friday 24 April 2026 04:04:23 +0000 (0:00:00.071) 0:00:00.071 ********** 2026-04-24 04:05:02.514397 | orchestrator | ok: [localhost] 2026-04-24 04:05:02.514405 | orchestrator | 2026-04-24 04:05:02.514412 | orchestrator | TASK [Get volume type LUKS] **************************************************** 2026-04-24 04:05:02.514442 | orchestrator | Friday 24 April 2026 04:04:25 +0000 (0:00:01.851) 0:00:01.923 ********** 2026-04-24 04:05:02.514450 | orchestrator | ok: [localhost] 2026-04-24 04:05:02.514457 | orchestrator | 2026-04-24 04:05:02.514464 | orchestrator | TASK [Create volume type LUKS] ************************************************* 2026-04-24 04:05:02.514471 | orchestrator | Friday 24 April 2026 04:04:32 +0000 (0:00:07.178) 0:00:09.101 ********** 2026-04-24 04:05:02.514478 | orchestrator | changed: [localhost] 2026-04-24 04:05:02.514486 | orchestrator | 2026-04-24 04:05:02.514492 | orchestrator | TASK [Create public network] *************************************************** 2026-04-24 04:05:02.514500 | orchestrator | Friday 24 April 2026 04:04:39 +0000 (0:00:06.355) 0:00:15.457 ********** 2026-04-24 04:05:02.514507 | orchestrator | changed: [localhost] 2026-04-24 04:05:02.514514 | orchestrator | 2026-04-24 04:05:02.514521 | orchestrator | TASK [Set public network to default] ******************************************* 2026-04-24 04:05:02.514527 | orchestrator | Friday 24 April 2026 04:04:44 +0000 (0:00:05.215) 0:00:20.672 ********** 2026-04-24 04:05:02.514537 | orchestrator | changed: [localhost] 2026-04-24 04:05:02.514544 | orchestrator | 2026-04-24 04:05:02.514551 | orchestrator | TASK [Create public subnet] **************************************************** 2026-04-24 04:05:02.514558 | orchestrator | Friday 24 April 2026 04:04:50 +0000 (0:00:06.194) 0:00:26.866 ********** 2026-04-24 04:05:02.514565 | orchestrator | changed: [localhost] 2026-04-24 04:05:02.514572 | orchestrator | 2026-04-24 04:05:02.514579 | orchestrator | TASK [Create default IPv4 subnet pool] ***************************************** 2026-04-24 04:05:02.514586 | orchestrator | Friday 24 April 2026 04:04:54 +0000 (0:00:04.153) 0:00:31.019 ********** 2026-04-24 04:05:02.514593 | orchestrator | changed: [localhost] 2026-04-24 04:05:02.514599 | orchestrator | 2026-04-24 04:05:02.514606 | orchestrator | TASK [Create manager role] ***************************************************** 2026-04-24 04:05:02.514619 | orchestrator | Friday 24 April 2026 04:04:58 +0000 (0:00:03.932) 0:00:34.952 ********** 2026-04-24 04:05:02.514626 | orchestrator | ok: [localhost] 2026-04-24 04:05:02.514633 | orchestrator | 2026-04-24 04:05:02.514640 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:05:02.514647 | orchestrator | localhost : ok=8  changed=5  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 04:05:02.514656 | orchestrator | 2026-04-24 04:05:02.514662 | orchestrator | 2026-04-24 04:05:02.514670 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:05:02.514677 | orchestrator | Friday 24 April 2026 04:05:02 +0000 (0:00:03.544) 0:00:38.496 ********** 2026-04-24 04:05:02.514684 | orchestrator | =============================================================================== 2026-04-24 04:05:02.514690 | orchestrator | Get volume type LUKS ---------------------------------------------------- 7.18s 2026-04-24 04:05:02.514698 | orchestrator | Create volume type LUKS ------------------------------------------------- 6.36s 2026-04-24 04:05:02.514704 | orchestrator | Set public network to default ------------------------------------------- 6.19s 2026-04-24 04:05:02.514711 | orchestrator | Create public network --------------------------------------------------- 5.22s 2026-04-24 04:05:02.514733 | orchestrator | Create public subnet ---------------------------------------------------- 4.15s 2026-04-24 04:05:02.514740 | orchestrator | Create default IPv4 subnet pool ----------------------------------------- 3.93s 2026-04-24 04:05:02.514747 | orchestrator | Create manager role ----------------------------------------------------- 3.54s 2026-04-24 04:05:02.514754 | orchestrator | Gathering Facts --------------------------------------------------------- 1.85s 2026-04-24 04:05:05.039220 | orchestrator | 2026-04-24 04:05:05 | INFO  | It takes a moment until task e5690dda-eca1-4272-a81e-bc917997f99b (image-manager) has been started and output is visible here. 2026-04-24 04:05:46.156172 | orchestrator | 2026-04-24 04:05:07 | INFO  | Processing image 'Cirros 0.6.2' 2026-04-24 04:05:46.156286 | orchestrator | 2026-04-24 04:05:08 | INFO  | Tested URL https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img: 302 2026-04-24 04:05:46.156300 | orchestrator | 2026-04-24 04:05:08 | INFO  | Importing image Cirros 0.6.2 2026-04-24 04:05:46.156311 | orchestrator | 2026-04-24 04:05:08 | INFO  | Importing from URL https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img 2026-04-24 04:05:46.156326 | orchestrator | 2026-04-24 04:05:09 | INFO  | Waiting for image to leave queued state... 2026-04-24 04:05:46.156340 | orchestrator | 2026-04-24 04:05:12 | INFO  | Waiting for import to complete... 2026-04-24 04:05:46.156354 | orchestrator | 2026-04-24 04:05:22 | INFO  | Import of 'Cirros 0.6.2' successfully completed, reloading images 2026-04-24 04:05:46.156368 | orchestrator | 2026-04-24 04:05:22 | INFO  | Checking parameters of 'Cirros 0.6.2' 2026-04-24 04:05:46.156382 | orchestrator | 2026-04-24 04:05:22 | INFO  | Setting internal_version = 0.6.2 2026-04-24 04:05:46.156396 | orchestrator | 2026-04-24 04:05:22 | INFO  | Setting image_original_user = cirros 2026-04-24 04:05:46.156410 | orchestrator | 2026-04-24 04:05:22 | INFO  | Adding tag os:cirros 2026-04-24 04:05:46.156422 | orchestrator | 2026-04-24 04:05:22 | INFO  | Setting property architecture: x86_64 2026-04-24 04:05:46.156434 | orchestrator | 2026-04-24 04:05:23 | INFO  | Setting property hw_disk_bus: scsi 2026-04-24 04:05:46.156445 | orchestrator | 2026-04-24 04:05:23 | INFO  | Setting property hw_rng_model: virtio 2026-04-24 04:05:46.156456 | orchestrator | 2026-04-24 04:05:23 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-24 04:05:46.156468 | orchestrator | 2026-04-24 04:05:23 | INFO  | Setting property hw_watchdog_action: reset 2026-04-24 04:05:46.156479 | orchestrator | 2026-04-24 04:05:24 | INFO  | Setting property hypervisor_type: qemu 2026-04-24 04:05:46.156492 | orchestrator | 2026-04-24 04:05:24 | INFO  | Setting property os_distro: cirros 2026-04-24 04:05:46.156504 | orchestrator | 2026-04-24 04:05:24 | INFO  | Setting property os_purpose: minimal 2026-04-24 04:05:46.156515 | orchestrator | 2026-04-24 04:05:24 | INFO  | Setting property replace_frequency: never 2026-04-24 04:05:46.156528 | orchestrator | 2026-04-24 04:05:25 | INFO  | Setting property uuid_validity: none 2026-04-24 04:05:46.156541 | orchestrator | 2026-04-24 04:05:25 | INFO  | Setting property provided_until: none 2026-04-24 04:05:46.156555 | orchestrator | 2026-04-24 04:05:25 | INFO  | Setting property image_description: Cirros 2026-04-24 04:05:46.156566 | orchestrator | 2026-04-24 04:05:25 | INFO  | Setting property image_name: Cirros 2026-04-24 04:05:46.156579 | orchestrator | 2026-04-24 04:05:25 | INFO  | Setting property internal_version: 0.6.2 2026-04-24 04:05:46.156592 | orchestrator | 2026-04-24 04:05:26 | INFO  | Setting property image_original_user: cirros 2026-04-24 04:05:46.156631 | orchestrator | 2026-04-24 04:05:26 | INFO  | Setting property os_version: 0.6.2 2026-04-24 04:05:46.156655 | orchestrator | 2026-04-24 04:05:26 | INFO  | Setting property image_source: https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img 2026-04-24 04:05:46.156670 | orchestrator | 2026-04-24 04:05:27 | INFO  | Setting property image_build_date: 2023-05-30 2026-04-24 04:05:46.156682 | orchestrator | 2026-04-24 04:05:27 | INFO  | Checking status of 'Cirros 0.6.2' 2026-04-24 04:05:46.156694 | orchestrator | 2026-04-24 04:05:27 | INFO  | Checking visibility of 'Cirros 0.6.2' 2026-04-24 04:05:46.156709 | orchestrator | 2026-04-24 04:05:27 | INFO  | Setting visibility of 'Cirros 0.6.2' to 'public' 2026-04-24 04:05:46.156722 | orchestrator | 2026-04-24 04:05:27 | INFO  | Processing image 'Cirros 0.6.3' 2026-04-24 04:05:46.156740 | orchestrator | 2026-04-24 04:05:27 | INFO  | Tested URL https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img: 302 2026-04-24 04:05:46.156755 | orchestrator | 2026-04-24 04:05:27 | INFO  | Importing image Cirros 0.6.3 2026-04-24 04:05:46.156769 | orchestrator | 2026-04-24 04:05:27 | INFO  | Importing from URL https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img 2026-04-24 04:05:46.156781 | orchestrator | 2026-04-24 04:05:28 | INFO  | Waiting for image to leave queued state... 2026-04-24 04:05:46.156796 | orchestrator | 2026-04-24 04:05:30 | INFO  | Waiting for import to complete... 2026-04-24 04:05:46.156831 | orchestrator | 2026-04-24 04:05:40 | INFO  | Import of 'Cirros 0.6.3' successfully completed, reloading images 2026-04-24 04:05:46.156876 | orchestrator | 2026-04-24 04:05:40 | INFO  | Checking parameters of 'Cirros 0.6.3' 2026-04-24 04:05:46.156891 | orchestrator | 2026-04-24 04:05:40 | INFO  | Setting internal_version = 0.6.3 2026-04-24 04:05:46.156906 | orchestrator | 2026-04-24 04:05:40 | INFO  | Setting image_original_user = cirros 2026-04-24 04:05:46.156920 | orchestrator | 2026-04-24 04:05:40 | INFO  | Adding tag os:cirros 2026-04-24 04:05:46.156935 | orchestrator | 2026-04-24 04:05:41 | INFO  | Setting property architecture: x86_64 2026-04-24 04:05:46.156946 | orchestrator | 2026-04-24 04:05:41 | INFO  | Setting property hw_disk_bus: scsi 2026-04-24 04:05:46.156958 | orchestrator | 2026-04-24 04:05:41 | INFO  | Setting property hw_rng_model: virtio 2026-04-24 04:05:46.156970 | orchestrator | 2026-04-24 04:05:41 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-24 04:05:46.156981 | orchestrator | 2026-04-24 04:05:42 | INFO  | Setting property hw_watchdog_action: reset 2026-04-24 04:05:46.156993 | orchestrator | 2026-04-24 04:05:42 | INFO  | Setting property hypervisor_type: qemu 2026-04-24 04:05:46.157005 | orchestrator | 2026-04-24 04:05:42 | INFO  | Setting property os_distro: cirros 2026-04-24 04:05:46.157017 | orchestrator | 2026-04-24 04:05:42 | INFO  | Setting property os_purpose: minimal 2026-04-24 04:05:46.157029 | orchestrator | 2026-04-24 04:05:42 | INFO  | Setting property replace_frequency: never 2026-04-24 04:05:46.157041 | orchestrator | 2026-04-24 04:05:43 | INFO  | Setting property uuid_validity: none 2026-04-24 04:05:46.157053 | orchestrator | 2026-04-24 04:05:43 | INFO  | Setting property provided_until: none 2026-04-24 04:05:46.157066 | orchestrator | 2026-04-24 04:05:43 | INFO  | Setting property image_description: Cirros 2026-04-24 04:05:46.157078 | orchestrator | 2026-04-24 04:05:43 | INFO  | Setting property image_name: Cirros 2026-04-24 04:05:46.157092 | orchestrator | 2026-04-24 04:05:44 | INFO  | Setting property internal_version: 0.6.3 2026-04-24 04:05:46.157116 | orchestrator | 2026-04-24 04:05:44 | INFO  | Setting property image_original_user: cirros 2026-04-24 04:05:46.157129 | orchestrator | 2026-04-24 04:05:44 | INFO  | Setting property os_version: 0.6.3 2026-04-24 04:05:46.157141 | orchestrator | 2026-04-24 04:05:44 | INFO  | Setting property image_source: https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img 2026-04-24 04:05:46.157154 | orchestrator | 2026-04-24 04:05:45 | INFO  | Setting property image_build_date: 2024-09-26 2026-04-24 04:05:46.157167 | orchestrator | 2026-04-24 04:05:45 | INFO  | Checking status of 'Cirros 0.6.3' 2026-04-24 04:05:46.157180 | orchestrator | 2026-04-24 04:05:45 | INFO  | Checking visibility of 'Cirros 0.6.3' 2026-04-24 04:05:46.157191 | orchestrator | 2026-04-24 04:05:45 | INFO  | Setting visibility of 'Cirros 0.6.3' to 'public' 2026-04-24 04:05:46.561195 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap/301-openstack-octavia-amphora-image.sh 2026-04-24 04:05:48.912529 | orchestrator | 2026-04-24 04:05:48 | INFO  | date: 2026-04-24 2026-04-24 04:05:48.912630 | orchestrator | 2026-04-24 04:05:48 | INFO  | image: octavia-amphora-haproxy-2024.2.20260424.qcow2 2026-04-24 04:05:48.912668 | orchestrator | 2026-04-24 04:05:48 | INFO  | url: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260424.qcow2 2026-04-24 04:05:48.912700 | orchestrator | 2026-04-24 04:05:48 | INFO  | checksum_url: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260424.qcow2.CHECKSUM 2026-04-24 04:05:49.014320 | orchestrator | 2026-04-24 04:05:49 | INFO  | checksum: f6c999b144ac9deec063f519aadf8234fd6fbc01b0c5d89a344fcbaef987451b 2026-04-24 04:05:49.127789 | orchestrator | 2026-04-24 04:05:49 | INFO  | It takes a moment until task d9e490fd-45c3-42f6-a4b3-59f24d18987b (image-manager) has been started and output is visible here. 2026-04-24 04:07:01.757371 | orchestrator | 2026-04-24 04:05:51 | INFO  | Processing image 'OpenStack Octavia Amphora 2026-04-24' 2026-04-24 04:07:01.757475 | orchestrator | 2026-04-24 04:05:51 | INFO  | Tested URL https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260424.qcow2: 200 2026-04-24 04:07:01.757490 | orchestrator | 2026-04-24 04:05:51 | INFO  | Importing image OpenStack Octavia Amphora 2026-04-24 2026-04-24 04:07:01.757500 | orchestrator | 2026-04-24 04:05:51 | INFO  | Importing from URL https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260424.qcow2 2026-04-24 04:07:01.757511 | orchestrator | 2026-04-24 04:05:53 | INFO  | Waiting for image to leave queued state... 2026-04-24 04:07:01.757520 | orchestrator | 2026-04-24 04:05:55 | INFO  | Waiting for import to complete... 2026-04-24 04:07:01.757530 | orchestrator | 2026-04-24 04:06:05 | INFO  | Waiting for import to complete... 2026-04-24 04:07:01.757538 | orchestrator | 2026-04-24 04:06:15 | INFO  | Waiting for import to complete... 2026-04-24 04:07:01.757547 | orchestrator | 2026-04-24 04:06:25 | INFO  | Waiting for import to complete... 2026-04-24 04:07:01.757558 | orchestrator | 2026-04-24 04:06:35 | INFO  | Waiting for import to complete... 2026-04-24 04:07:01.757568 | orchestrator | 2026-04-24 04:06:45 | INFO  | Waiting for import to complete... 2026-04-24 04:07:01.757577 | orchestrator | 2026-04-24 04:06:56 | INFO  | Import of 'OpenStack Octavia Amphora 2026-04-24' successfully completed, reloading images 2026-04-24 04:07:01.757587 | orchestrator | 2026-04-24 04:06:56 | INFO  | Checking parameters of 'OpenStack Octavia Amphora 2026-04-24' 2026-04-24 04:07:01.757621 | orchestrator | 2026-04-24 04:06:56 | INFO  | Setting internal_version = 2026-04-24 2026-04-24 04:07:01.757630 | orchestrator | 2026-04-24 04:06:56 | INFO  | Setting image_original_user = ubuntu 2026-04-24 04:07:01.757640 | orchestrator | 2026-04-24 04:06:56 | INFO  | Adding tag amphora 2026-04-24 04:07:01.757649 | orchestrator | 2026-04-24 04:06:56 | INFO  | Adding tag os:ubuntu 2026-04-24 04:07:01.757658 | orchestrator | 2026-04-24 04:06:56 | INFO  | Setting property architecture: x86_64 2026-04-24 04:07:01.757667 | orchestrator | 2026-04-24 04:06:57 | INFO  | Setting property hw_disk_bus: scsi 2026-04-24 04:07:01.757676 | orchestrator | 2026-04-24 04:06:57 | INFO  | Setting property hw_rng_model: virtio 2026-04-24 04:07:01.757685 | orchestrator | 2026-04-24 04:06:57 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-24 04:07:01.757694 | orchestrator | 2026-04-24 04:06:57 | INFO  | Setting property hw_watchdog_action: reset 2026-04-24 04:07:01.757702 | orchestrator | 2026-04-24 04:06:58 | INFO  | Setting property hypervisor_type: qemu 2026-04-24 04:07:01.757711 | orchestrator | 2026-04-24 04:06:58 | INFO  | Setting property os_distro: ubuntu 2026-04-24 04:07:01.757720 | orchestrator | 2026-04-24 04:06:58 | INFO  | Setting property replace_frequency: quarterly 2026-04-24 04:07:01.757729 | orchestrator | 2026-04-24 04:06:58 | INFO  | Setting property uuid_validity: last-1 2026-04-24 04:07:01.757738 | orchestrator | 2026-04-24 04:06:59 | INFO  | Setting property provided_until: none 2026-04-24 04:07:01.757747 | orchestrator | 2026-04-24 04:06:59 | INFO  | Setting property os_purpose: network 2026-04-24 04:07:01.757768 | orchestrator | 2026-04-24 04:06:59 | INFO  | Setting property image_description: OpenStack Octavia Amphora 2026-04-24 04:07:01.757778 | orchestrator | 2026-04-24 04:06:59 | INFO  | Setting property image_name: OpenStack Octavia Amphora 2026-04-24 04:07:01.757787 | orchestrator | 2026-04-24 04:06:59 | INFO  | Setting property internal_version: 2026-04-24 2026-04-24 04:07:01.757796 | orchestrator | 2026-04-24 04:07:00 | INFO  | Setting property image_original_user: ubuntu 2026-04-24 04:07:01.757804 | orchestrator | 2026-04-24 04:07:00 | INFO  | Setting property os_version: 2026-04-24 2026-04-24 04:07:01.757814 | orchestrator | 2026-04-24 04:07:00 | INFO  | Setting property image_source: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260424.qcow2 2026-04-24 04:07:01.757823 | orchestrator | 2026-04-24 04:07:00 | INFO  | Setting property image_build_date: 2026-04-24 2026-04-24 04:07:01.757831 | orchestrator | 2026-04-24 04:07:01 | INFO  | Checking status of 'OpenStack Octavia Amphora 2026-04-24' 2026-04-24 04:07:01.757884 | orchestrator | 2026-04-24 04:07:01 | INFO  | Checking visibility of 'OpenStack Octavia Amphora 2026-04-24' 2026-04-24 04:07:01.757909 | orchestrator | 2026-04-24 04:07:01 | INFO  | Processing image 'Cirros 0.6.3' (removal candidate) 2026-04-24 04:07:01.757920 | orchestrator | 2026-04-24 04:07:01 | WARNING  | No image definition found for 'Cirros 0.6.3', image will be ignored 2026-04-24 04:07:01.757932 | orchestrator | 2026-04-24 04:07:01 | INFO  | Processing image 'Cirros 0.6.2' (removal candidate) 2026-04-24 04:07:01.757942 | orchestrator | 2026-04-24 04:07:01 | WARNING  | No image definition found for 'Cirros 0.6.2', image will be ignored 2026-04-24 04:07:02.356168 | orchestrator | ok: Runtime: 0:03:06.221452 2026-04-24 04:07:02.373391 | 2026-04-24 04:07:02.373560 | TASK [Run checks] 2026-04-24 04:07:03.125490 | orchestrator | + set -e 2026-04-24 04:07:03.126620 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 04:07:03.126667 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 04:07:03.126689 | orchestrator | ++ INTERACTIVE=false 2026-04-24 04:07:03.126703 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 04:07:03.126715 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 04:07:03.126771 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 04:07:03.126906 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 04:07:03.134551 | orchestrator | 2026-04-24 04:07:03.134630 | orchestrator | # CHECK 2026-04-24 04:07:03.134645 | orchestrator | 2026-04-24 04:07:03.134657 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 04:07:03.134674 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 04:07:03.134685 | orchestrator | + echo 2026-04-24 04:07:03.134696 | orchestrator | + echo '# CHECK' 2026-04-24 04:07:03.134707 | orchestrator | + echo 2026-04-24 04:07:03.134723 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-24 04:07:03.135383 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-24 04:07:03.209153 | orchestrator | 2026-04-24 04:07:03.209256 | orchestrator | ## Containers @ testbed-manager 2026-04-24 04:07:03.209274 | orchestrator | 2026-04-24 04:07:03.209291 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 04:07:03.209305 | orchestrator | + echo 2026-04-24 04:07:03.209319 | orchestrator | + echo '## Containers @ testbed-manager' 2026-04-24 04:07:03.209333 | orchestrator | + echo 2026-04-24 04:07:03.209346 | orchestrator | + osism container testbed-manager ps 2026-04-24 04:07:05.249781 | orchestrator | 2026-04-24 04:07:05 | INFO  | Creating empty known_hosts file: /share/known_hosts 2026-04-24 04:07:05.635933 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-24 04:07:05.636063 | orchestrator | d1a550ffa722 registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_blackbox_exporter 2026-04-24 04:07:05.636090 | orchestrator | dc87dbf1dad6 registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_alertmanager 2026-04-24 04:07:05.636104 | orchestrator | e823e2def92b registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_cadvisor 2026-04-24 04:07:05.636116 | orchestrator | 86eaabfe80b6 registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_node_exporter 2026-04-24 04:07:05.636128 | orchestrator | d1fe20140ce7 registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_server 2026-04-24 04:07:05.636144 | orchestrator | ded06adbc6d5 registry.osism.tech/osism/cephclient:18.2.7 "/usr/bin/dumb-init …" 57 minutes ago Up 57 minutes cephclient 2026-04-24 04:07:05.636157 | orchestrator | d8d6e54fc36e registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-24 04:07:05.636168 | orchestrator | e1ec53ab970c registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-24 04:07:05.636210 | orchestrator | 5284f5e36ada registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-24 04:07:05.636222 | orchestrator | 5a79d8ae5254 registry.osism.tech/osism/openstackclient:2024.2 "/usr/bin/dumb-init …" 2 hours ago Up 2 hours openstackclient 2026-04-24 04:07:05.636234 | orchestrator | d9d994b69a15 phpmyadmin/phpmyadmin:5.2 "/docker-entrypoint.…" 2 hours ago Up 2 hours (healthy) 80/tcp phpmyadmin 2026-04-24 04:07:05.636245 | orchestrator | 2d45fac1fbcc registry.osism.tech/osism/homer:v25.10.1 "/bin/sh /entrypoint…" 2 hours ago Up 2 hours (healthy) 8080/tcp homer 2026-04-24 04:07:05.636257 | orchestrator | ee71182ab23e registry.osism.tech/osism/cgit:1.2.3 "httpd-foreground" 2 hours ago Up 2 hours 80/tcp cgit 2026-04-24 04:07:05.636268 | orchestrator | 823702b5df8d registry.osism.tech/dockerhub/ubuntu/squid:6.1-23.10_beta "entrypoint.sh -f /e…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:3128->3128/tcp squid 2026-04-24 04:07:05.636301 | orchestrator | 5235cf82737e registry.osism.tech/osism/inventory-reconciler:0.20251130.0 "/sbin/tini -- /entr…" 2 hours ago Up 2 hours (healthy) manager-inventory_reconciler-1 2026-04-24 04:07:05.636323 | orchestrator | 3293f74fa5cd registry.osism.tech/osism/osism-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) osism-ansible 2026-04-24 04:07:05.636335 | orchestrator | 3f48e2b718c0 registry.osism.tech/osism/ceph-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) ceph-ansible 2026-04-24 04:07:05.636346 | orchestrator | 2c6cc418a7b6 registry.osism.tech/osism/kolla-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) kolla-ansible 2026-04-24 04:07:05.636358 | orchestrator | fcbc2608fcbf registry.osism.tech/osism/osism-kubernetes:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) osism-kubernetes 2026-04-24 04:07:05.636369 | orchestrator | 1e829c287255 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" 2 hours ago Up 2 hours (healthy) 8000/tcp manager-ara-server-1 2026-04-24 04:07:05.636380 | orchestrator | 4db9bda21d93 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" 2 hours ago Up 2 hours (healthy) 6379/tcp manager-redis-1 2026-04-24 04:07:05.636392 | orchestrator | d9e25df88dfa registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:8000->8000/tcp manager-api-1 2026-04-24 04:07:05.636411 | orchestrator | 834fa09bc579 registry.osism.tech/osism/osism-frontend:0.20251130.1 "docker-entrypoint.s…" 2 hours ago Up 2 hours 192.168.16.5:3000->3000/tcp osism-frontend 2026-04-24 04:07:05.636422 | orchestrator | d2a4bd8eb9a4 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-openstack-1 2026-04-24 04:07:05.636434 | orchestrator | 582ad6a48447 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-flower-1 2026-04-24 04:07:05.636445 | orchestrator | 3a1bc7dafb4f registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-listener-1 2026-04-24 04:07:05.636456 | orchestrator | b79e0c55e4d1 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" 2 hours ago Up 2 hours (healthy) 3306/tcp manager-mariadb-1 2026-04-24 04:07:05.636467 | orchestrator | 8bfae708f0bd registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-beat-1 2026-04-24 04:07:05.636478 | orchestrator | 4f5e7fc73a14 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- sleep…" 2 hours ago Up 2 hours (healthy) osismclient 2026-04-24 04:07:05.636494 | orchestrator | b38237654c04 registry.osism.tech/dockerhub/library/traefik:v3.5.0 "/entrypoint.sh trae…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:80->80/tcp, 192.168.16.5:443->443/tcp, 192.168.16.5:8122->8080/tcp traefik 2026-04-24 04:07:05.952313 | orchestrator | 2026-04-24 04:07:05.952420 | orchestrator | ## Images @ testbed-manager 2026-04-24 04:07:05.952436 | orchestrator | 2026-04-24 04:07:05.952448 | orchestrator | + echo 2026-04-24 04:07:05.952459 | orchestrator | + echo '## Images @ testbed-manager' 2026-04-24 04:07:05.952472 | orchestrator | + echo 2026-04-24 04:07:05.952487 | orchestrator | + osism container testbed-manager images 2026-04-24 04:07:08.298144 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-24 04:07:08.299238 | orchestrator | registry.osism.tech/osism/openstackclient 2024.2 80968bd64c90 24 hours ago 238MB 2026-04-24 04:07:08.299278 | orchestrator | registry.osism.tech/dockerhub/library/redis 7.4.7-alpine e08bd8d5a677 2 months ago 41.4MB 2026-04-24 04:07:08.299291 | orchestrator | registry.osism.tech/osism/homer v25.10.1 ea34b371c716 4 months ago 11.5MB 2026-04-24 04:07:08.299303 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20251130.0 0f140ec71e5f 4 months ago 608MB 2026-04-24 04:07:08.299315 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-24 04:07:08.299326 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-24 04:07:08.299337 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-24 04:07:08.299352 | orchestrator | registry.osism.tech/kolla/release/prometheus-blackbox-exporter 0.25.0.20251130 7bbb4f6f4831 4 months ago 308MB 2026-04-24 04:07:08.299363 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-24 04:07:08.299397 | orchestrator | registry.osism.tech/kolla/release/prometheus-alertmanager 0.28.0.20251130 ba994ea4acda 4 months ago 404MB 2026-04-24 04:07:08.299409 | orchestrator | registry.osism.tech/kolla/release/prometheus-v2-server 2.55.1.20251130 56b43d5c716a 4 months ago 839MB 2026-04-24 04:07:08.299420 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-24 04:07:08.299431 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20251130.0 1bfc1dadeee1 4 months ago 330MB 2026-04-24 04:07:08.299442 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20251130.0 42988b2d229c 4 months ago 613MB 2026-04-24 04:07:08.299453 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20251130.0 a212d8ca4a50 4 months ago 560MB 2026-04-24 04:07:08.299464 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20251130.0 9beff03cb77b 4 months ago 1.23GB 2026-04-24 04:07:08.299474 | orchestrator | registry.osism.tech/osism/osism 0.20251130.1 95213af683ec 4 months ago 383MB 2026-04-24 04:07:08.299485 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20251130.1 2cb6e7609620 4 months ago 238MB 2026-04-24 04:07:08.299496 | orchestrator | registry.osism.tech/dockerhub/library/mariadb 11.8.4 70745dd8f1d0 5 months ago 334MB 2026-04-24 04:07:08.299507 | orchestrator | phpmyadmin/phpmyadmin 5.2 e66b1f5a8c58 6 months ago 742MB 2026-04-24 04:07:08.299519 | orchestrator | registry.osism.tech/osism/ara-server 1.7.3 d1b687333f2f 8 months ago 275MB 2026-04-24 04:07:08.299530 | orchestrator | registry.osism.tech/dockerhub/library/traefik v3.5.0 11cc59587f6a 9 months ago 226MB 2026-04-24 04:07:08.299540 | orchestrator | registry.osism.tech/osism/cephclient 18.2.7 ae977aa79826 11 months ago 453MB 2026-04-24 04:07:08.299551 | orchestrator | registry.osism.tech/dockerhub/ubuntu/squid 6.1-23.10_beta 34b6bbbcf74b 22 months ago 146MB 2026-04-24 04:07:08.299562 | orchestrator | registry.osism.tech/osism/cgit 1.2.3 16e7285642b1 2 years ago 545MB 2026-04-24 04:07:08.616297 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-24 04:07:08.616510 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-24 04:07:08.669631 | orchestrator | 2026-04-24 04:07:08.669759 | orchestrator | ## Containers @ testbed-node-0 2026-04-24 04:07:08.669788 | orchestrator | 2026-04-24 04:07:08.669808 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 04:07:08.669820 | orchestrator | + echo 2026-04-24 04:07:08.669832 | orchestrator | + echo '## Containers @ testbed-node-0' 2026-04-24 04:07:08.669899 | orchestrator | + echo 2026-04-24 04:07:08.669921 | orchestrator | + osism container testbed-node-0 ps 2026-04-24 04:07:11.072582 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-24 04:07:11.072711 | orchestrator | 5487c19fe054 registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-24 04:07:11.072763 | orchestrator | 875a245e97ef registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-24 04:07:11.072784 | orchestrator | b381a4156be8 registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 8 minutes ago Up 8 minutes grafana 2026-04-24 04:07:11.072801 | orchestrator | 8626d735c8ca registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_elasticsearch_exporter 2026-04-24 04:07:11.072881 | orchestrator | 92ec131fab5b registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_cadvisor 2026-04-24 04:07:11.072906 | orchestrator | dd8468cd1b12 registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_memcached_exporter 2026-04-24 04:07:11.072935 | orchestrator | f0b4e2baa7b7 registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_mysqld_exporter 2026-04-24 04:07:11.072948 | orchestrator | 0c006864d4f2 registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_node_exporter 2026-04-24 04:07:11.072959 | orchestrator | f24807d1738f registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_share 2026-04-24 04:07:11.072971 | orchestrator | b312d9f8640a registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_scheduler 2026-04-24 04:07:11.073051 | orchestrator | 58b2914c946d registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_data 2026-04-24 04:07:11.073064 | orchestrator | b33695665d69 registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_api 2026-04-24 04:07:11.073075 | orchestrator | d136c374d9b1 registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_notifier 2026-04-24 04:07:11.073086 | orchestrator | 64d83ae762e5 registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_listener 2026-04-24 04:07:11.073097 | orchestrator | 379acda81410 registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_evaluator 2026-04-24 04:07:11.073108 | orchestrator | a7d276d58d16 registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_api 2026-04-24 04:07:11.073119 | orchestrator | ff6fedc130c8 registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes ceilometer_central 2026-04-24 04:07:11.073130 | orchestrator | 74064420db16 registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) ceilometer_notification 2026-04-24 04:07:11.073141 | orchestrator | 86ab16440708 registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_worker 2026-04-24 04:07:11.073180 | orchestrator | 0a1ccdd0a1d0 registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_housekeeping 2026-04-24 04:07:11.073193 | orchestrator | e937c83dece9 registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_health_manager 2026-04-24 04:07:11.073204 | orchestrator | 749f176d8fc4 registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes octavia_driver_agent 2026-04-24 04:07:11.073224 | orchestrator | 076e8129107c registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_api 2026-04-24 04:07:11.073235 | orchestrator | 358037ba0df7 registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_worker 2026-04-24 04:07:11.073246 | orchestrator | 456d9b6a78ab registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 25 minutes (healthy) designate_mdns 2026-04-24 04:07:11.073264 | orchestrator | 4405b85a185c registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_producer 2026-04-24 04:07:11.073284 | orchestrator | 4df0bee3497e registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_central 2026-04-24 04:07:11.073302 | orchestrator | d6b512f28bce registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-24 04:07:11.073319 | orchestrator | 13fd727337ba registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-24 04:07:11.073337 | orchestrator | 4e72b417c722 registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-24 04:07:11.073355 | orchestrator | 9bc996fdaf2f registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-24 04:07:11.073880 | orchestrator | 749513d0cd5b registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-24 04:07:11.073903 | orchestrator | b05b3885f888 registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_backup 2026-04-24 04:07:11.073915 | orchestrator | 7c54fc3dca1c registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_volume 2026-04-24 04:07:11.073925 | orchestrator | 1ca20d875bfb registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_scheduler 2026-04-24 04:07:11.073936 | orchestrator | 5ce732c582c7 registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 31 minutes ago Up 31 minutes (healthy) cinder_api 2026-04-24 04:07:11.073947 | orchestrator | 32fb0e6e92c8 registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) glance_api 2026-04-24 04:07:11.073958 | orchestrator | 35a7d6bafe62 registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_console 2026-04-24 04:07:11.073969 | orchestrator | fed824d05d16 registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_apiserver 2026-04-24 04:07:11.073980 | orchestrator | 7a65e996e2e4 registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 37 minutes ago Up 37 minutes (healthy) horizon 2026-04-24 04:07:11.074002 | orchestrator | 92d5f2e399e2 registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 40 minutes ago Up 40 minutes (healthy) nova_novncproxy 2026-04-24 04:07:11.074013 | orchestrator | dc52f8e06ef2 registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) nova_conductor 2026-04-24 04:07:11.074146 | orchestrator | 9991d3c5be88 registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_api 2026-04-24 04:07:11.074159 | orchestrator | 57127124562d registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_scheduler 2026-04-24 04:07:11.074169 | orchestrator | a7b6d7083093 registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 47 minutes ago Up 47 minutes (healthy) neutron_server 2026-04-24 04:07:11.074180 | orchestrator | 0483a90c1083 registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 51 minutes ago Up 51 minutes (healthy) placement_api 2026-04-24 04:07:11.074191 | orchestrator | 67381e6f18e2 registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone 2026-04-24 04:07:11.074201 | orchestrator | f43b473e76b4 registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_fernet 2026-04-24 04:07:11.074212 | orchestrator | 4da02b972404 registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 54 minutes ago Up 54 minutes (healthy) keystone_ssh 2026-04-24 04:07:11.074223 | orchestrator | 50efed2cee33 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 55 minutes ago Up 55 minutes ceph-mgr-testbed-node-0 2026-04-24 04:07:11.074234 | orchestrator | 935064a67691 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-0 2026-04-24 04:07:11.074261 | orchestrator | a3168a73d7f5 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-0 2026-04-24 04:07:11.074273 | orchestrator | 467d3480e1ab registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-24 04:07:11.074284 | orchestrator | 29105d06d04e registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-24 04:07:11.074294 | orchestrator | fe98d6e8db30 registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-24 04:07:11.074305 | orchestrator | 57659ec87220 registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-24 04:07:11.074321 | orchestrator | 8f0324fffc85 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-24 04:07:11.074333 | orchestrator | 0592b1b186bd registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-24 04:07:11.074351 | orchestrator | b49237adbad1 registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-24 04:07:11.074362 | orchestrator | 9b11284cbe67 registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-24 04:07:11.074373 | orchestrator | 584b2d8eddfc registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis_sentinel 2026-04-24 04:07:11.074384 | orchestrator | 78d0a95882a1 registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis 2026-04-24 04:07:11.074395 | orchestrator | 4149b7ac44ec registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) memcached 2026-04-24 04:07:11.074405 | orchestrator | 2f58573e7f6c registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch_dashboards 2026-04-24 04:07:11.074416 | orchestrator | 00f08ec3b968 registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch 2026-04-24 04:07:11.074427 | orchestrator | 243b2a10d00f registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" About an hour ago Up About an hour keepalived 2026-04-24 04:07:11.074438 | orchestrator | ba1ae2056f9f registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) proxysql 2026-04-24 04:07:11.074449 | orchestrator | 73225d01711f registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) haproxy 2026-04-24 04:07:11.074459 | orchestrator | 981c4445baf1 registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-24 04:07:11.074472 | orchestrator | f4dc93e712e0 registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-24 04:07:11.074493 | orchestrator | 7809c28eb5b8 registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-24 04:07:11.402084 | orchestrator | 2026-04-24 04:07:11.402214 | orchestrator | ## Images @ testbed-node-0 2026-04-24 04:07:11.402234 | orchestrator | 2026-04-24 04:07:11.402247 | orchestrator | + echo 2026-04-24 04:07:11.402259 | orchestrator | + echo '## Images @ testbed-node-0' 2026-04-24 04:07:11.402272 | orchestrator | + echo 2026-04-24 04:07:11.402283 | orchestrator | + osism container testbed-node-0 images 2026-04-24 04:07:13.837322 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-24 04:07:13.837492 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-24 04:07:13.837520 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-24 04:07:13.837533 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-24 04:07:13.837545 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-24 04:07:13.837578 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-24 04:07:13.837590 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-24 04:07:13.837601 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-24 04:07:13.837612 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-24 04:07:13.837623 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-24 04:07:13.837634 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-24 04:07:13.837644 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-24 04:07:13.837655 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-24 04:07:13.837666 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-24 04:07:13.837677 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-24 04:07:13.837687 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-24 04:07:13.837698 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-24 04:07:13.837709 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-24 04:07:13.837720 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-24 04:07:13.837730 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-24 04:07:13.837741 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-24 04:07:13.837752 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-24 04:07:13.837762 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-24 04:07:13.837773 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-24 04:07:13.837784 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-24 04:07:13.837802 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-24 04:07:13.837813 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-24 04:07:13.837826 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-24 04:07:13.837875 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-24 04:07:13.837889 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-24 04:07:13.837901 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-24 04:07:13.837923 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-24 04:07:13.837954 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-24 04:07:13.837965 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-24 04:07:13.837977 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-24 04:07:13.837987 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-24 04:07:13.837998 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-24 04:07:13.838009 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-24 04:07:13.838080 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-24 04:07:13.838091 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-24 04:07:13.838102 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-24 04:07:13.838113 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-24 04:07:13.838124 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-24 04:07:13.838134 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-24 04:07:13.838145 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-24 04:07:13.838155 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-24 04:07:13.838166 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-24 04:07:13.838177 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-24 04:07:13.838188 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-24 04:07:13.838199 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-24 04:07:13.838210 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-24 04:07:13.838220 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-24 04:07:13.838231 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-24 04:07:13.838242 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-24 04:07:13.838253 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-24 04:07:13.838263 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-24 04:07:13.838274 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-24 04:07:13.838292 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-24 04:07:13.838303 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-24 04:07:13.838320 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-24 04:07:13.838331 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-24 04:07:13.838341 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-24 04:07:13.838352 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-24 04:07:13.838363 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-24 04:07:13.838383 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-24 04:07:13.838395 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-24 04:07:13.838406 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-24 04:07:13.838416 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-24 04:07:13.838427 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-24 04:07:13.838438 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-24 04:07:14.144018 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-24 04:07:14.144632 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-24 04:07:14.202209 | orchestrator | 2026-04-24 04:07:14.202324 | orchestrator | ## Containers @ testbed-node-1 2026-04-24 04:07:14.202348 | orchestrator | 2026-04-24 04:07:14.202361 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 04:07:14.202372 | orchestrator | + echo 2026-04-24 04:07:14.202384 | orchestrator | + echo '## Containers @ testbed-node-1' 2026-04-24 04:07:14.202396 | orchestrator | + echo 2026-04-24 04:07:14.202408 | orchestrator | + osism container testbed-node-1 ps 2026-04-24 04:07:16.625564 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-24 04:07:16.625664 | orchestrator | 3a0b0d97c8f8 registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-24 04:07:16.625681 | orchestrator | f55026f50da6 registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-24 04:07:16.625693 | orchestrator | ca6b375c6028 registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 7 minutes ago Up 6 minutes grafana 2026-04-24 04:07:16.625705 | orchestrator | e558c7a7f520 registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_elasticsearch_exporter 2026-04-24 04:07:16.625717 | orchestrator | ac7e7f01fa4e registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_cadvisor 2026-04-24 04:07:16.625728 | orchestrator | 728c263cca1f registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_memcached_exporter 2026-04-24 04:07:16.625827 | orchestrator | dea2adb3947f registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_mysqld_exporter 2026-04-24 04:07:16.625909 | orchestrator | 4e8f520c9551 registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_node_exporter 2026-04-24 04:07:16.625932 | orchestrator | 365b95edefda registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_share 2026-04-24 04:07:16.625945 | orchestrator | eab272c504e2 registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_scheduler 2026-04-24 04:07:16.625956 | orchestrator | ffd97f735f86 registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_data 2026-04-24 04:07:16.625967 | orchestrator | f606bb407d93 registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_api 2026-04-24 04:07:16.625997 | orchestrator | de433d8ea186 registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_notifier 2026-04-24 04:07:16.626008 | orchestrator | fae2a5cf68dc registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_listener 2026-04-24 04:07:16.626154 | orchestrator | dd20bb592702 registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_evaluator 2026-04-24 04:07:16.626181 | orchestrator | 17ca73127ba5 registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_api 2026-04-24 04:07:16.626203 | orchestrator | 0570ac558396 registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes ceilometer_central 2026-04-24 04:07:16.626222 | orchestrator | b12b91c2e889 registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) ceilometer_notification 2026-04-24 04:07:16.626240 | orchestrator | 8ca83f36a1f8 registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_worker 2026-04-24 04:07:16.626276 | orchestrator | cba8039a6f6e registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_housekeeping 2026-04-24 04:07:16.626289 | orchestrator | 7f229389b782 registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_health_manager 2026-04-24 04:07:16.626302 | orchestrator | b8dc22f7c22c registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes octavia_driver_agent 2026-04-24 04:07:16.626315 | orchestrator | 9f5732e9057f registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_api 2026-04-24 04:07:16.626340 | orchestrator | b020613d6310 registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_worker 2026-04-24 04:07:16.626354 | orchestrator | 04fd102ad27a registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_mdns 2026-04-24 04:07:16.626366 | orchestrator | 80401a03946e registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_producer 2026-04-24 04:07:16.626379 | orchestrator | a72c9e5fb24f registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_central 2026-04-24 04:07:16.626391 | orchestrator | 24a6196dc25b registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-24 04:07:16.626404 | orchestrator | c757e6fdf1d0 registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-24 04:07:16.626416 | orchestrator | b876a80bb928 registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-24 04:07:16.626429 | orchestrator | da48dfc4ffad registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-24 04:07:16.626441 | orchestrator | 5272e5fd77b8 registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-24 04:07:16.626454 | orchestrator | 09c0ecbec079 registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_backup 2026-04-24 04:07:16.626467 | orchestrator | 0635cbbdacc9 registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_volume 2026-04-24 04:07:16.626480 | orchestrator | 2382f74a3877 registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_scheduler 2026-04-24 04:07:16.626492 | orchestrator | 4d3f956f0ba5 registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_api 2026-04-24 04:07:16.626502 | orchestrator | 7586108d2927 registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) glance_api 2026-04-24 04:07:16.626521 | orchestrator | 59341fec50ce registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_console 2026-04-24 04:07:16.626533 | orchestrator | 18e0abcca692 registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_apiserver 2026-04-24 04:07:16.626552 | orchestrator | 3e1e4bf85969 registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 36 minutes ago Up 36 minutes (healthy) horizon 2026-04-24 04:07:16.626564 | orchestrator | 99f7f759e337 registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 40 minutes ago Up 40 minutes (healthy) nova_novncproxy 2026-04-24 04:07:16.626581 | orchestrator | fd67a2e5b981 registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) nova_conductor 2026-04-24 04:07:16.626592 | orchestrator | f3e053bf2b7c registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_api 2026-04-24 04:07:16.626603 | orchestrator | b6be4b3f7994 registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_scheduler 2026-04-24 04:07:16.626613 | orchestrator | 6ea70c3e6993 registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 47 minutes ago Up 47 minutes (healthy) neutron_server 2026-04-24 04:07:16.626624 | orchestrator | 7288c82940c0 registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 51 minutes ago Up 51 minutes (healthy) placement_api 2026-04-24 04:07:16.626634 | orchestrator | 3d2806812262 registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone 2026-04-24 04:07:16.626645 | orchestrator | 687e3ba641c7 registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_fernet 2026-04-24 04:07:16.626656 | orchestrator | 7895a7b4855b registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_ssh 2026-04-24 04:07:16.626666 | orchestrator | a729ca4aea8a registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 55 minutes ago Up 55 minutes ceph-mgr-testbed-node-1 2026-04-24 04:07:16.626677 | orchestrator | 74727e49add0 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-1 2026-04-24 04:07:16.626689 | orchestrator | cb6ff5b25438 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-1 2026-04-24 04:07:16.626699 | orchestrator | 0c46fec958f1 registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-24 04:07:16.626710 | orchestrator | e233fbedceb3 registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-24 04:07:16.626720 | orchestrator | 9c14a9715173 registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-24 04:07:16.626731 | orchestrator | fae53067b8d7 registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-24 04:07:16.626743 | orchestrator | 7a769635cc75 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-24 04:07:16.626762 | orchestrator | cffcde1990d4 registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-24 04:07:16.626781 | orchestrator | 7fa96f9481e2 registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-24 04:07:16.626819 | orchestrator | d9376555891c registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-24 04:07:16.626866 | orchestrator | 77d52b6e8b8b registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis_sentinel 2026-04-24 04:07:16.626887 | orchestrator | be31c7a7d75f registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis 2026-04-24 04:07:16.626903 | orchestrator | f8f0255e8b4a registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) memcached 2026-04-24 04:07:16.626914 | orchestrator | c8cea062502f registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch_dashboards 2026-04-24 04:07:16.626925 | orchestrator | 241bf8bc85bd registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch 2026-04-24 04:07:16.626943 | orchestrator | a163fe829c49 registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" About an hour ago Up About an hour keepalived 2026-04-24 04:07:16.626954 | orchestrator | 63b1fc7be83d registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) proxysql 2026-04-24 04:07:16.626965 | orchestrator | 299fc1e34d94 registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) haproxy 2026-04-24 04:07:16.626975 | orchestrator | 4e4a91f2ca0d registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-24 04:07:16.626991 | orchestrator | 8a453b12023b registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-24 04:07:16.627002 | orchestrator | fa8d3d8ba0d1 registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-24 04:07:16.945391 | orchestrator | 2026-04-24 04:07:16.945495 | orchestrator | ## Images @ testbed-node-1 2026-04-24 04:07:16.945511 | orchestrator | 2026-04-24 04:07:16.945522 | orchestrator | + echo 2026-04-24 04:07:16.945534 | orchestrator | + echo '## Images @ testbed-node-1' 2026-04-24 04:07:16.945546 | orchestrator | + echo 2026-04-24 04:07:16.945557 | orchestrator | + osism container testbed-node-1 images 2026-04-24 04:07:19.372201 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-24 04:07:19.372313 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-24 04:07:19.372328 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-24 04:07:19.372341 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-24 04:07:19.372353 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-24 04:07:19.372364 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-24 04:07:19.372395 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-24 04:07:19.372407 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-24 04:07:19.372418 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-24 04:07:19.372429 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-24 04:07:19.372440 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-24 04:07:19.372450 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-24 04:07:19.372461 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-24 04:07:19.372472 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-24 04:07:19.372482 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-24 04:07:19.372493 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-24 04:07:19.372504 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-24 04:07:19.372515 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-24 04:07:19.372526 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-24 04:07:19.372537 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-24 04:07:19.372548 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-24 04:07:19.372558 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-24 04:07:19.372569 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-24 04:07:19.372580 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-24 04:07:19.372591 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-24 04:07:19.372602 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-24 04:07:19.372612 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-24 04:07:19.372623 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-24 04:07:19.372634 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-24 04:07:19.372645 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-24 04:07:19.372655 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-24 04:07:19.372666 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-24 04:07:19.372696 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-24 04:07:19.372718 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-24 04:07:19.372732 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-24 04:07:19.372746 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-24 04:07:19.372767 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-24 04:07:19.372788 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-24 04:07:19.372806 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-24 04:07:19.372823 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-24 04:07:19.372927 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-24 04:07:19.372951 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-24 04:07:19.372971 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-24 04:07:19.372982 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-24 04:07:19.372993 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-24 04:07:19.373004 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-24 04:07:19.373015 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-24 04:07:19.373026 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-24 04:07:19.373037 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-24 04:07:19.373047 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-24 04:07:19.373058 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-24 04:07:19.373069 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-24 04:07:19.373080 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-24 04:07:19.373091 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-24 04:07:19.373102 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-24 04:07:19.373113 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-24 04:07:19.373124 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-24 04:07:19.373135 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-24 04:07:19.373146 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-24 04:07:19.373166 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-24 04:07:19.373182 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-24 04:07:19.373193 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-24 04:07:19.373204 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-24 04:07:19.373215 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-24 04:07:19.373235 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-24 04:07:19.373246 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-24 04:07:19.373257 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-24 04:07:19.373268 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-24 04:07:19.373279 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-24 04:07:19.373290 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-24 04:07:19.693462 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-24 04:07:19.693804 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-24 04:07:19.741786 | orchestrator | 2026-04-24 04:07:19.741981 | orchestrator | ## Containers @ testbed-node-2 2026-04-24 04:07:19.742012 | orchestrator | 2026-04-24 04:07:19.742208 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 04:07:19.742229 | orchestrator | + echo 2026-04-24 04:07:19.742248 | orchestrator | + echo '## Containers @ testbed-node-2' 2026-04-24 04:07:19.742267 | orchestrator | + echo 2026-04-24 04:07:19.742283 | orchestrator | + osism container testbed-node-2 ps 2026-04-24 04:07:22.182611 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-24 04:07:22.182690 | orchestrator | 0a6ee76a4d31 registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-24 04:07:22.182700 | orchestrator | 2851329eb13b registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-24 04:07:22.182706 | orchestrator | ec68cfcdb68f registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 7 minutes ago Up 7 minutes grafana 2026-04-24 04:07:22.182713 | orchestrator | e732361acf4b registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_elasticsearch_exporter 2026-04-24 04:07:22.182719 | orchestrator | e36d32d37281 registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_cadvisor 2026-04-24 04:07:22.182725 | orchestrator | 24d6bfa93801 registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_memcached_exporter 2026-04-24 04:07:22.182732 | orchestrator | 9691b042d133 registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_mysqld_exporter 2026-04-24 04:07:22.182759 | orchestrator | 2417d025e63f registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_node_exporter 2026-04-24 04:07:22.182766 | orchestrator | 4e1e46fc6f24 registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_share 2026-04-24 04:07:22.182772 | orchestrator | 16057ada2102 registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_scheduler 2026-04-24 04:07:22.182777 | orchestrator | 0b1749716762 registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_data 2026-04-24 04:07:22.182783 | orchestrator | 27b6078bbb23 registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_api 2026-04-24 04:07:22.183541 | orchestrator | 4d00ebf70666 registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_notifier 2026-04-24 04:07:22.183561 | orchestrator | 724a28cc7e3b registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 17 minutes ago Up 17 minutes (healthy) aodh_listener 2026-04-24 04:07:22.183581 | orchestrator | 1098b15f703e registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_evaluator 2026-04-24 04:07:22.183588 | orchestrator | 198242a4910b registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_api 2026-04-24 04:07:22.183594 | orchestrator | 13b1aa6d0d06 registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes ceilometer_central 2026-04-24 04:07:22.183600 | orchestrator | afb1357a0dd2 registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) ceilometer_notification 2026-04-24 04:07:22.183606 | orchestrator | 1f62461730e5 registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_worker 2026-04-24 04:07:22.183611 | orchestrator | 1001a2c76c9a registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_housekeeping 2026-04-24 04:07:22.183617 | orchestrator | 58dc3586f76a registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_health_manager 2026-04-24 04:07:22.183623 | orchestrator | 9669fef9ebad registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes octavia_driver_agent 2026-04-24 04:07:22.183629 | orchestrator | 4ffdd9914221 registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) octavia_api 2026-04-24 04:07:22.183634 | orchestrator | e09e624ac81e registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_worker 2026-04-24 04:07:22.183640 | orchestrator | 65e96fa3f9a3 registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_mdns 2026-04-24 04:07:22.183654 | orchestrator | 37efaf16ccc5 registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_producer 2026-04-24 04:07:22.183660 | orchestrator | 9c2ef981f5fd registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_central 2026-04-24 04:07:22.183665 | orchestrator | 0cf8f9ed3612 registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-24 04:07:22.183671 | orchestrator | 8c5ffad39094 registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-24 04:07:22.183677 | orchestrator | 501209a1cc0c registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-24 04:07:22.183682 | orchestrator | 2ae21fc0e09d registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-24 04:07:22.183688 | orchestrator | 98f835e47536 registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_api 2026-04-24 04:07:22.183697 | orchestrator | 9f496e742a60 registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_backup 2026-04-24 04:07:22.183712 | orchestrator | 78472805f512 registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_volume 2026-04-24 04:07:22.183718 | orchestrator | 1e901737bcfa registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_scheduler 2026-04-24 04:07:22.183724 | orchestrator | 0c5d4e44fa21 registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) cinder_api 2026-04-24 04:07:22.183730 | orchestrator | 366632d4b845 registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) glance_api 2026-04-24 04:07:22.183736 | orchestrator | cf84791b0665 registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_console 2026-04-24 04:07:22.183742 | orchestrator | 9298b8c99d2b registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) skyline_apiserver 2026-04-24 04:07:22.183747 | orchestrator | 9abdc1151e06 registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 37 minutes ago Up 37 minutes (healthy) horizon 2026-04-24 04:07:22.183753 | orchestrator | 54c1153fb506 registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 40 minutes ago Up 40 minutes (healthy) nova_novncproxy 2026-04-24 04:07:22.183759 | orchestrator | 560a0194156c registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 41 minutes ago Up 41 minutes (healthy) nova_conductor 2026-04-24 04:07:22.183769 | orchestrator | 446010dab9ea registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_api 2026-04-24 04:07:22.183774 | orchestrator | bab476de187f registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) nova_scheduler 2026-04-24 04:07:22.183780 | orchestrator | f2f446f7f045 registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 47 minutes ago Up 47 minutes (healthy) neutron_server 2026-04-24 04:07:22.183786 | orchestrator | e8dd442db727 registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 51 minutes ago Up 51 minutes (healthy) placement_api 2026-04-24 04:07:22.183791 | orchestrator | 6cdc4e098eda registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone 2026-04-24 04:07:22.183797 | orchestrator | 2301cfebd5ab registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_fernet 2026-04-24 04:07:22.183803 | orchestrator | 415d2ffc7a01 registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 53 minutes ago Up 53 minutes (healthy) keystone_ssh 2026-04-24 04:07:22.183808 | orchestrator | b57071bad04e registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 55 minutes ago Up 55 minutes ceph-mgr-testbed-node-2 2026-04-24 04:07:22.183814 | orchestrator | 410aa74e9b80 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-2 2026-04-24 04:07:22.183820 | orchestrator | 4af70b8ccc8b registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-2 2026-04-24 04:07:22.183826 | orchestrator | 9acf5e9e8928 registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-24 04:07:22.183867 | orchestrator | a090d59dee4c registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-24 04:07:22.183879 | orchestrator | 9755de7a7449 registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-24 04:07:22.183885 | orchestrator | 466a5502002d registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-24 04:07:22.183891 | orchestrator | eec005a42dd1 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-24 04:07:22.183896 | orchestrator | 58004d48600e registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-24 04:07:22.183902 | orchestrator | 02a759a44025 registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-24 04:07:22.183908 | orchestrator | e140862c48ec registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-24 04:07:22.183919 | orchestrator | c2d64b635de2 registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis_sentinel 2026-04-24 04:07:22.183925 | orchestrator | afcc04fb85e1 registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) redis 2026-04-24 04:07:22.183931 | orchestrator | 42717c903e66 registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) memcached 2026-04-24 04:07:22.183937 | orchestrator | a7b746b972f0 registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch_dashboards 2026-04-24 04:07:22.183943 | orchestrator | 2ad242adb093 registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) opensearch 2026-04-24 04:07:22.183949 | orchestrator | 8d81b5f03ef2 registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" About an hour ago Up About an hour keepalived 2026-04-24 04:07:22.183954 | orchestrator | ce273afee017 registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) proxysql 2026-04-24 04:07:22.183960 | orchestrator | 22421c6148c4 registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) haproxy 2026-04-24 04:07:22.183966 | orchestrator | f36a8b36158c registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-24 04:07:22.183971 | orchestrator | 224b68889f3e registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-24 04:07:22.183977 | orchestrator | fd2fe34b6b1f registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-24 04:07:22.519829 | orchestrator | 2026-04-24 04:07:22.519982 | orchestrator | ## Images @ testbed-node-2 2026-04-24 04:07:22.519997 | orchestrator | 2026-04-24 04:07:22.520010 | orchestrator | + echo 2026-04-24 04:07:22.520022 | orchestrator | + echo '## Images @ testbed-node-2' 2026-04-24 04:07:22.520034 | orchestrator | + echo 2026-04-24 04:07:22.520045 | orchestrator | + osism container testbed-node-2 images 2026-04-24 04:07:24.980881 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-24 04:07:24.981000 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-24 04:07:24.981034 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-24 04:07:24.981047 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-24 04:07:24.981058 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-24 04:07:24.981069 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-24 04:07:24.981080 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-24 04:07:24.981091 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-24 04:07:24.981125 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-24 04:07:24.981136 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-24 04:07:24.981147 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-24 04:07:24.981162 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-24 04:07:24.981173 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-24 04:07:24.981185 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-24 04:07:24.981195 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-24 04:07:24.981206 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-24 04:07:24.981217 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-24 04:07:24.981228 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-24 04:07:24.981239 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-24 04:07:24.981249 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-24 04:07:24.981260 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-24 04:07:24.981271 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-24 04:07:24.981281 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-24 04:07:24.981292 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-24 04:07:24.981303 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-24 04:07:24.981313 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-24 04:07:24.981324 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-24 04:07:24.981335 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-24 04:07:24.981345 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-24 04:07:24.981356 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-24 04:07:24.981367 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-24 04:07:24.981381 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-24 04:07:24.981414 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-24 04:07:24.981428 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-24 04:07:24.981440 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-24 04:07:24.981460 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-24 04:07:24.981473 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-24 04:07:24.981485 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-24 04:07:24.981498 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-24 04:07:24.981510 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-24 04:07:24.981523 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-24 04:07:24.981535 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-24 04:07:24.981547 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-24 04:07:24.981560 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-24 04:07:24.981580 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-24 04:07:24.981593 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-24 04:07:24.981605 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-24 04:07:24.981618 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-24 04:07:24.981630 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-24 04:07:24.981642 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-24 04:07:24.981654 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-24 04:07:24.981667 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-24 04:07:24.981679 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-24 04:07:24.981690 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-24 04:07:24.981701 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-24 04:07:24.981711 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-24 04:07:24.981722 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-24 04:07:24.981732 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-24 04:07:24.981743 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-24 04:07:24.981754 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-24 04:07:24.981764 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-24 04:07:24.981783 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-24 04:07:24.981794 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-24 04:07:24.981804 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-24 04:07:24.981822 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-24 04:07:24.981833 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-24 04:07:24.981875 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-24 04:07:24.981891 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-24 04:07:24.981902 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-24 04:07:24.981913 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-24 04:07:25.301330 | orchestrator | + sh -c /opt/configuration/scripts/check-services.sh 2026-04-24 04:07:25.307990 | orchestrator | + set -e 2026-04-24 04:07:25.308097 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 04:07:25.308120 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 04:07:25.308132 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 04:07:25.308143 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 04:07:25.308154 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 04:07:25.308166 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 04:07:25.308178 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 04:07:25.308189 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 04:07:25.308200 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 04:07:25.308211 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 04:07:25.308221 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 04:07:25.308232 | orchestrator | ++ export ARA=false 2026-04-24 04:07:25.308243 | orchestrator | ++ ARA=false 2026-04-24 04:07:25.308254 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 04:07:25.308264 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 04:07:25.308277 | orchestrator | ++ export TEMPEST=false 2026-04-24 04:07:25.308295 | orchestrator | ++ TEMPEST=false 2026-04-24 04:07:25.308315 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 04:07:25.308328 | orchestrator | ++ IS_ZUUL=true 2026-04-24 04:07:25.308339 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:07:25.308350 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:07:25.308361 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 04:07:25.308371 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 04:07:25.308382 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 04:07:25.308392 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 04:07:25.308404 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 04:07:25.308415 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 04:07:25.308426 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 04:07:25.308437 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 04:07:25.308448 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-24 04:07:25.308459 | orchestrator | + sh -c /opt/configuration/scripts/check/100-ceph-with-ansible.sh 2026-04-24 04:07:25.314479 | orchestrator | + set -e 2026-04-24 04:07:25.314556 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 04:07:25.314574 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 04:07:25.314588 | orchestrator | ++ INTERACTIVE=false 2026-04-24 04:07:25.314600 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 04:07:25.314611 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 04:07:25.314900 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 04:07:25.314925 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 04:07:25.319159 | orchestrator | 2026-04-24 04:07:25.319233 | orchestrator | # Ceph status 2026-04-24 04:07:25.319257 | orchestrator | 2026-04-24 04:07:25.319318 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 04:07:25.319333 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 04:07:25.319344 | orchestrator | + echo 2026-04-24 04:07:25.319355 | orchestrator | + echo '# Ceph status' 2026-04-24 04:07:25.319366 | orchestrator | + echo 2026-04-24 04:07:25.319377 | orchestrator | + ceph -s 2026-04-24 04:07:25.890289 | orchestrator | cluster: 2026-04-24 04:07:25.890367 | orchestrator | id: 11111111-1111-1111-1111-111111111111 2026-04-24 04:07:25.890378 | orchestrator | health: HEALTH_OK 2026-04-24 04:07:25.890386 | orchestrator | 2026-04-24 04:07:25.890393 | orchestrator | services: 2026-04-24 04:07:25.890400 | orchestrator | mon: 3 daemons, quorum testbed-node-0,testbed-node-1,testbed-node-2 (age 68m) 2026-04-24 04:07:25.890409 | orchestrator | mgr: testbed-node-1(active, since 55m), standbys: testbed-node-2, testbed-node-0 2026-04-24 04:07:25.890417 | orchestrator | mds: 1/1 daemons up, 2 standby 2026-04-24 04:07:25.890424 | orchestrator | osd: 6 osds: 6 up (since 64m), 6 in (since 65m) 2026-04-24 04:07:25.890432 | orchestrator | rgw: 3 daemons active (3 hosts, 1 zones) 2026-04-24 04:07:25.890439 | orchestrator | 2026-04-24 04:07:25.890446 | orchestrator | data: 2026-04-24 04:07:25.890453 | orchestrator | volumes: 1/1 healthy 2026-04-24 04:07:25.890460 | orchestrator | pools: 14 pools, 401 pgs 2026-04-24 04:07:25.890467 | orchestrator | objects: 556 objects, 2.2 GiB 2026-04-24 04:07:25.890474 | orchestrator | usage: 7.1 GiB used, 113 GiB / 120 GiB avail 2026-04-24 04:07:25.890481 | orchestrator | pgs: 401 active+clean 2026-04-24 04:07:25.890488 | orchestrator | 2026-04-24 04:07:25.933139 | orchestrator | 2026-04-24 04:07:25.933228 | orchestrator | # Ceph versions 2026-04-24 04:07:25.933242 | orchestrator | 2026-04-24 04:07:25.933254 | orchestrator | + echo 2026-04-24 04:07:25.933265 | orchestrator | + echo '# Ceph versions' 2026-04-24 04:07:25.933277 | orchestrator | + echo 2026-04-24 04:07:25.933288 | orchestrator | + ceph versions 2026-04-24 04:07:26.550707 | orchestrator | { 2026-04-24 04:07:26.550810 | orchestrator | "mon": { 2026-04-24 04:07:26.550827 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-24 04:07:26.550902 | orchestrator | }, 2026-04-24 04:07:26.550916 | orchestrator | "mgr": { 2026-04-24 04:07:26.550928 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-24 04:07:26.550940 | orchestrator | }, 2026-04-24 04:07:26.550951 | orchestrator | "osd": { 2026-04-24 04:07:26.550962 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 6 2026-04-24 04:07:26.550978 | orchestrator | }, 2026-04-24 04:07:26.550997 | orchestrator | "mds": { 2026-04-24 04:07:26.551016 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-24 04:07:26.551034 | orchestrator | }, 2026-04-24 04:07:26.551052 | orchestrator | "rgw": { 2026-04-24 04:07:26.551070 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-24 04:07:26.551088 | orchestrator | }, 2026-04-24 04:07:26.551105 | orchestrator | "overall": { 2026-04-24 04:07:26.551122 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 18 2026-04-24 04:07:26.551140 | orchestrator | } 2026-04-24 04:07:26.551156 | orchestrator | } 2026-04-24 04:07:26.603313 | orchestrator | 2026-04-24 04:07:26.603382 | orchestrator | # Ceph OSD tree 2026-04-24 04:07:26.603390 | orchestrator | 2026-04-24 04:07:26.603396 | orchestrator | + echo 2026-04-24 04:07:26.603403 | orchestrator | + echo '# Ceph OSD tree' 2026-04-24 04:07:26.603409 | orchestrator | + echo 2026-04-24 04:07:26.603415 | orchestrator | + ceph osd df tree 2026-04-24 04:07:27.181510 | orchestrator | ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME 2026-04-24 04:07:27.181610 | orchestrator | -1 0.11691 - 120 GiB 7.1 GiB 6.7 GiB 6 KiB 406 MiB 113 GiB 5.90 1.00 - root default 2026-04-24 04:07:27.181624 | orchestrator | -5 0.03897 - 40 GiB 2.4 GiB 2.2 GiB 2 KiB 143 MiB 38 GiB 5.92 1.00 - host testbed-node-3 2026-04-24 04:07:27.181636 | orchestrator | 0 hdd 0.01949 1.00000 20 GiB 1.1 GiB 1.1 GiB 1 KiB 66 MiB 19 GiB 5.61 0.95 190 up osd.0 2026-04-24 04:07:27.181647 | orchestrator | 4 hdd 0.01949 1.00000 20 GiB 1.2 GiB 1.2 GiB 1 KiB 78 MiB 19 GiB 6.22 1.06 202 up osd.4 2026-04-24 04:07:27.181658 | orchestrator | -3 0.03897 - 40 GiB 2.4 GiB 2.2 GiB 2 KiB 139 MiB 38 GiB 5.90 1.00 - host testbed-node-4 2026-04-24 04:07:27.181696 | orchestrator | 2 hdd 0.01949 1.00000 20 GiB 1008 MiB 930 MiB 1 KiB 78 MiB 19 GiB 4.93 0.84 196 up osd.2 2026-04-24 04:07:27.181708 | orchestrator | 3 hdd 0.01949 1.00000 20 GiB 1.4 GiB 1.3 GiB 1 KiB 62 MiB 19 GiB 6.88 1.17 194 up osd.3 2026-04-24 04:07:27.181719 | orchestrator | -7 0.03897 - 40 GiB 2.3 GiB 2.2 GiB 2 KiB 123 MiB 38 GiB 5.87 1.00 - host testbed-node-5 2026-04-24 04:07:27.181731 | orchestrator | 1 hdd 0.01949 1.00000 20 GiB 1.5 GiB 1.4 GiB 1 KiB 62 MiB 19 GiB 7.27 1.23 197 up osd.1 2026-04-24 04:07:27.181743 | orchestrator | 5 hdd 0.01949 1.00000 20 GiB 913 MiB 851 MiB 1 KiB 62 MiB 19 GiB 4.46 0.76 191 up osd.5 2026-04-24 04:07:27.181754 | orchestrator | TOTAL 120 GiB 7.1 GiB 6.7 GiB 9.3 KiB 406 MiB 113 GiB 5.90 2026-04-24 04:07:27.181765 | orchestrator | MIN/MAX VAR: 0.76/1.23 STDDEV: 1.00 2026-04-24 04:07:27.234422 | orchestrator | 2026-04-24 04:07:27.234523 | orchestrator | # Ceph monitor status 2026-04-24 04:07:27.234546 | orchestrator | 2026-04-24 04:07:27.234566 | orchestrator | + echo 2026-04-24 04:07:27.234588 | orchestrator | + echo '# Ceph monitor status' 2026-04-24 04:07:27.234608 | orchestrator | + echo 2026-04-24 04:07:27.234629 | orchestrator | + ceph mon stat 2026-04-24 04:07:27.855031 | orchestrator | e1: 3 mons at {testbed-node-0=[v2:192.168.16.10:3300/0,v1:192.168.16.10:6789/0],testbed-node-1=[v2:192.168.16.11:3300/0,v1:192.168.16.11:6789/0],testbed-node-2=[v2:192.168.16.12:3300/0,v1:192.168.16.12:6789/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 10, leader 0 testbed-node-0, quorum 0,1,2 testbed-node-0,testbed-node-1,testbed-node-2 2026-04-24 04:07:27.896350 | orchestrator | 2026-04-24 04:07:27.896448 | orchestrator | # Ceph quorum status 2026-04-24 04:07:27.896465 | orchestrator | 2026-04-24 04:07:27.896477 | orchestrator | + echo 2026-04-24 04:07:27.896489 | orchestrator | + echo '# Ceph quorum status' 2026-04-24 04:07:27.896500 | orchestrator | + echo 2026-04-24 04:07:27.896728 | orchestrator | + jq 2026-04-24 04:07:27.896750 | orchestrator | + ceph quorum_status 2026-04-24 04:07:28.564829 | orchestrator | { 2026-04-24 04:07:28.564962 | orchestrator | "election_epoch": 10, 2026-04-24 04:07:28.564980 | orchestrator | "quorum": [ 2026-04-24 04:07:28.564992 | orchestrator | 0, 2026-04-24 04:07:28.565004 | orchestrator | 1, 2026-04-24 04:07:28.565015 | orchestrator | 2 2026-04-24 04:07:28.565026 | orchestrator | ], 2026-04-24 04:07:28.565036 | orchestrator | "quorum_names": [ 2026-04-24 04:07:28.565047 | orchestrator | "testbed-node-0", 2026-04-24 04:07:28.565058 | orchestrator | "testbed-node-1", 2026-04-24 04:07:28.565082 | orchestrator | "testbed-node-2" 2026-04-24 04:07:28.565098 | orchestrator | ], 2026-04-24 04:07:28.565110 | orchestrator | "quorum_leader_name": "testbed-node-0", 2026-04-24 04:07:28.565122 | orchestrator | "quorum_age": 4093, 2026-04-24 04:07:28.565133 | orchestrator | "features": { 2026-04-24 04:07:28.565144 | orchestrator | "quorum_con": "4540138322906710015", 2026-04-24 04:07:28.565155 | orchestrator | "quorum_mon": [ 2026-04-24 04:07:28.565166 | orchestrator | "kraken", 2026-04-24 04:07:28.565177 | orchestrator | "luminous", 2026-04-24 04:07:28.565188 | orchestrator | "mimic", 2026-04-24 04:07:28.565199 | orchestrator | "osdmap-prune", 2026-04-24 04:07:28.565210 | orchestrator | "nautilus", 2026-04-24 04:07:28.565220 | orchestrator | "octopus", 2026-04-24 04:07:28.565231 | orchestrator | "pacific", 2026-04-24 04:07:28.565242 | orchestrator | "elector-pinging", 2026-04-24 04:07:28.565252 | orchestrator | "quincy", 2026-04-24 04:07:28.565263 | orchestrator | "reef" 2026-04-24 04:07:28.565274 | orchestrator | ] 2026-04-24 04:07:28.565285 | orchestrator | }, 2026-04-24 04:07:28.565296 | orchestrator | "monmap": { 2026-04-24 04:07:28.565307 | orchestrator | "epoch": 1, 2026-04-24 04:07:28.565317 | orchestrator | "fsid": "11111111-1111-1111-1111-111111111111", 2026-04-24 04:07:28.565330 | orchestrator | "modified": "2026-04-24T02:58:52.898625Z", 2026-04-24 04:07:28.565341 | orchestrator | "created": "2026-04-24T02:58:52.898625Z", 2026-04-24 04:07:28.565352 | orchestrator | "min_mon_release": 18, 2026-04-24 04:07:28.565362 | orchestrator | "min_mon_release_name": "reef", 2026-04-24 04:07:28.565373 | orchestrator | "election_strategy": 1, 2026-04-24 04:07:28.565387 | orchestrator | "disallowed_leaders: ": "", 2026-04-24 04:07:28.565399 | orchestrator | "stretch_mode": false, 2026-04-24 04:07:28.565413 | orchestrator | "tiebreaker_mon": "", 2026-04-24 04:07:28.565451 | orchestrator | "removed_ranks: ": "", 2026-04-24 04:07:28.565465 | orchestrator | "features": { 2026-04-24 04:07:28.565478 | orchestrator | "persistent": [ 2026-04-24 04:07:28.565490 | orchestrator | "kraken", 2026-04-24 04:07:28.565502 | orchestrator | "luminous", 2026-04-24 04:07:28.565514 | orchestrator | "mimic", 2026-04-24 04:07:28.565526 | orchestrator | "osdmap-prune", 2026-04-24 04:07:28.565538 | orchestrator | "nautilus", 2026-04-24 04:07:28.565551 | orchestrator | "octopus", 2026-04-24 04:07:28.565563 | orchestrator | "pacific", 2026-04-24 04:07:28.565575 | orchestrator | "elector-pinging", 2026-04-24 04:07:28.565589 | orchestrator | "quincy", 2026-04-24 04:07:28.565601 | orchestrator | "reef" 2026-04-24 04:07:28.565614 | orchestrator | ], 2026-04-24 04:07:28.565626 | orchestrator | "optional": [] 2026-04-24 04:07:28.565639 | orchestrator | }, 2026-04-24 04:07:28.565651 | orchestrator | "mons": [ 2026-04-24 04:07:28.565664 | orchestrator | { 2026-04-24 04:07:28.565677 | orchestrator | "rank": 0, 2026-04-24 04:07:28.565689 | orchestrator | "name": "testbed-node-0", 2026-04-24 04:07:28.565702 | orchestrator | "public_addrs": { 2026-04-24 04:07:28.565715 | orchestrator | "addrvec": [ 2026-04-24 04:07:28.565727 | orchestrator | { 2026-04-24 04:07:28.565740 | orchestrator | "type": "v2", 2026-04-24 04:07:28.565752 | orchestrator | "addr": "192.168.16.10:3300", 2026-04-24 04:07:28.565763 | orchestrator | "nonce": 0 2026-04-24 04:07:28.565774 | orchestrator | }, 2026-04-24 04:07:28.565785 | orchestrator | { 2026-04-24 04:07:28.565795 | orchestrator | "type": "v1", 2026-04-24 04:07:28.565806 | orchestrator | "addr": "192.168.16.10:6789", 2026-04-24 04:07:28.565817 | orchestrator | "nonce": 0 2026-04-24 04:07:28.565828 | orchestrator | } 2026-04-24 04:07:28.565862 | orchestrator | ] 2026-04-24 04:07:28.565875 | orchestrator | }, 2026-04-24 04:07:28.565886 | orchestrator | "addr": "192.168.16.10:6789/0", 2026-04-24 04:07:28.565897 | orchestrator | "public_addr": "192.168.16.10:6789/0", 2026-04-24 04:07:28.565908 | orchestrator | "priority": 0, 2026-04-24 04:07:28.565918 | orchestrator | "weight": 0, 2026-04-24 04:07:28.565929 | orchestrator | "crush_location": "{}" 2026-04-24 04:07:28.565940 | orchestrator | }, 2026-04-24 04:07:28.565951 | orchestrator | { 2026-04-24 04:07:28.565961 | orchestrator | "rank": 1, 2026-04-24 04:07:28.565972 | orchestrator | "name": "testbed-node-1", 2026-04-24 04:07:28.565983 | orchestrator | "public_addrs": { 2026-04-24 04:07:28.565993 | orchestrator | "addrvec": [ 2026-04-24 04:07:28.566004 | orchestrator | { 2026-04-24 04:07:28.566084 | orchestrator | "type": "v2", 2026-04-24 04:07:28.566098 | orchestrator | "addr": "192.168.16.11:3300", 2026-04-24 04:07:28.566109 | orchestrator | "nonce": 0 2026-04-24 04:07:28.566120 | orchestrator | }, 2026-04-24 04:07:28.566131 | orchestrator | { 2026-04-24 04:07:28.566142 | orchestrator | "type": "v1", 2026-04-24 04:07:28.566152 | orchestrator | "addr": "192.168.16.11:6789", 2026-04-24 04:07:28.566163 | orchestrator | "nonce": 0 2026-04-24 04:07:28.566174 | orchestrator | } 2026-04-24 04:07:28.566185 | orchestrator | ] 2026-04-24 04:07:28.566195 | orchestrator | }, 2026-04-24 04:07:28.566206 | orchestrator | "addr": "192.168.16.11:6789/0", 2026-04-24 04:07:28.566217 | orchestrator | "public_addr": "192.168.16.11:6789/0", 2026-04-24 04:07:28.566228 | orchestrator | "priority": 0, 2026-04-24 04:07:28.566238 | orchestrator | "weight": 0, 2026-04-24 04:07:28.566249 | orchestrator | "crush_location": "{}" 2026-04-24 04:07:28.566260 | orchestrator | }, 2026-04-24 04:07:28.566270 | orchestrator | { 2026-04-24 04:07:28.566281 | orchestrator | "rank": 2, 2026-04-24 04:07:28.566292 | orchestrator | "name": "testbed-node-2", 2026-04-24 04:07:28.566302 | orchestrator | "public_addrs": { 2026-04-24 04:07:28.566313 | orchestrator | "addrvec": [ 2026-04-24 04:07:28.566324 | orchestrator | { 2026-04-24 04:07:28.566334 | orchestrator | "type": "v2", 2026-04-24 04:07:28.566345 | orchestrator | "addr": "192.168.16.12:3300", 2026-04-24 04:07:28.566355 | orchestrator | "nonce": 0 2026-04-24 04:07:28.566366 | orchestrator | }, 2026-04-24 04:07:28.566377 | orchestrator | { 2026-04-24 04:07:28.566387 | orchestrator | "type": "v1", 2026-04-24 04:07:28.566398 | orchestrator | "addr": "192.168.16.12:6789", 2026-04-24 04:07:28.566409 | orchestrator | "nonce": 0 2026-04-24 04:07:28.566420 | orchestrator | } 2026-04-24 04:07:28.566430 | orchestrator | ] 2026-04-24 04:07:28.566449 | orchestrator | }, 2026-04-24 04:07:28.566460 | orchestrator | "addr": "192.168.16.12:6789/0", 2026-04-24 04:07:28.566471 | orchestrator | "public_addr": "192.168.16.12:6789/0", 2026-04-24 04:07:28.566482 | orchestrator | "priority": 0, 2026-04-24 04:07:28.566492 | orchestrator | "weight": 0, 2026-04-24 04:07:28.566503 | orchestrator | "crush_location": "{}" 2026-04-24 04:07:28.566514 | orchestrator | } 2026-04-24 04:07:28.566524 | orchestrator | ] 2026-04-24 04:07:28.566535 | orchestrator | } 2026-04-24 04:07:28.566546 | orchestrator | } 2026-04-24 04:07:28.566569 | orchestrator | 2026-04-24 04:07:28.566586 | orchestrator | # Ceph free space status 2026-04-24 04:07:28.566597 | orchestrator | 2026-04-24 04:07:28.566608 | orchestrator | + echo 2026-04-24 04:07:28.566619 | orchestrator | + echo '# Ceph free space status' 2026-04-24 04:07:28.566630 | orchestrator | + echo 2026-04-24 04:07:28.566641 | orchestrator | + ceph df 2026-04-24 04:07:29.201656 | orchestrator | --- RAW STORAGE --- 2026-04-24 04:07:29.201769 | orchestrator | CLASS SIZE AVAIL USED RAW USED %RAW USED 2026-04-24 04:07:29.201798 | orchestrator | hdd 120 GiB 113 GiB 7.1 GiB 7.1 GiB 5.90 2026-04-24 04:07:29.201807 | orchestrator | TOTAL 120 GiB 113 GiB 7.1 GiB 7.1 GiB 5.90 2026-04-24 04:07:29.201816 | orchestrator | 2026-04-24 04:07:29.201824 | orchestrator | --- POOLS --- 2026-04-24 04:07:29.201833 | orchestrator | POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL 2026-04-24 04:07:29.201900 | orchestrator | .mgr 1 1 577 KiB 2 1.1 MiB 0 53 GiB 2026-04-24 04:07:29.201909 | orchestrator | cephfs_data 2 32 0 B 0 0 B 0 35 GiB 2026-04-24 04:07:29.201920 | orchestrator | cephfs_metadata 3 16 4.4 KiB 22 96 KiB 0 35 GiB 2026-04-24 04:07:29.201934 | orchestrator | default.rgw.buckets.data 4 32 0 B 0 0 B 0 35 GiB 2026-04-24 04:07:29.201947 | orchestrator | default.rgw.buckets.index 5 32 0 B 0 0 B 0 35 GiB 2026-04-24 04:07:29.201960 | orchestrator | default.rgw.control 6 32 0 B 8 0 B 0 35 GiB 2026-04-24 04:07:29.201974 | orchestrator | default.rgw.log 7 32 3.6 KiB 209 408 KiB 0 35 GiB 2026-04-24 04:07:29.201988 | orchestrator | default.rgw.meta 8 32 0 B 0 0 B 0 35 GiB 2026-04-24 04:07:29.202002 | orchestrator | .rgw.root 9 32 3.9 KiB 8 64 KiB 0 53 GiB 2026-04-24 04:07:29.202058 | orchestrator | backups 10 32 19 B 2 12 KiB 0 35 GiB 2026-04-24 04:07:29.202068 | orchestrator | volumes 11 32 19 B 2 12 KiB 0 35 GiB 2026-04-24 04:07:29.202076 | orchestrator | images 12 32 2.2 GiB 299 6.7 GiB 5.95 35 GiB 2026-04-24 04:07:29.202084 | orchestrator | metrics 13 32 19 B 2 12 KiB 0 35 GiB 2026-04-24 04:07:29.202092 | orchestrator | vms 14 32 19 B 2 12 KiB 0 35 GiB 2026-04-24 04:07:29.253309 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-24 04:07:29.305092 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 04:07:29.305187 | orchestrator | + osism apply facts 2026-04-24 04:07:41.570788 | orchestrator | 2026-04-24 04:07:41 | INFO  | Task 549ecc01-a7b4-4b84-8666-d4d8e158221f (facts) was prepared for execution. 2026-04-24 04:07:41.571004 | orchestrator | 2026-04-24 04:07:41 | INFO  | It takes a moment until task 549ecc01-a7b4-4b84-8666-d4d8e158221f (facts) has been started and output is visible here. 2026-04-24 04:07:55.762389 | orchestrator | 2026-04-24 04:07:55.762495 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-24 04:07:55.762509 | orchestrator | 2026-04-24 04:07:55.762519 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-24 04:07:55.762528 | orchestrator | Friday 24 April 2026 04:07:46 +0000 (0:00:00.288) 0:00:00.288 ********** 2026-04-24 04:07:55.762536 | orchestrator | ok: [testbed-manager] 2026-04-24 04:07:55.762545 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:07:55.762553 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:07:55.762561 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:07:55.762569 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:07:55.762577 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:07:55.762585 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:07:55.762615 | orchestrator | 2026-04-24 04:07:55.762624 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-24 04:07:55.762631 | orchestrator | Friday 24 April 2026 04:07:47 +0000 (0:00:01.192) 0:00:01.481 ********** 2026-04-24 04:07:55.762639 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:07:55.762648 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:07:55.762656 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:07:55.762664 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:07:55.762672 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:07:55.762680 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:07:55.762688 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:07:55.762696 | orchestrator | 2026-04-24 04:07:55.762704 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-24 04:07:55.762712 | orchestrator | 2026-04-24 04:07:55.762720 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 04:07:55.762728 | orchestrator | Friday 24 April 2026 04:07:48 +0000 (0:00:01.393) 0:00:02.874 ********** 2026-04-24 04:07:55.762736 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:07:55.762743 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:07:55.762751 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:07:55.762759 | orchestrator | ok: [testbed-manager] 2026-04-24 04:07:55.762767 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:07:55.762775 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:07:55.762782 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:07:55.762790 | orchestrator | 2026-04-24 04:07:55.762799 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-24 04:07:55.762806 | orchestrator | 2026-04-24 04:07:55.762814 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-24 04:07:55.762823 | orchestrator | Friday 24 April 2026 04:07:54 +0000 (0:00:05.616) 0:00:08.491 ********** 2026-04-24 04:07:55.762831 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:07:55.762910 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:07:55.762919 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:07:55.762927 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:07:55.762936 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:07:55.762946 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:07:55.762955 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:07:55.762964 | orchestrator | 2026-04-24 04:07:55.762974 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:07:55.762984 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:07:55.763010 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:07:55.763019 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:07:55.763029 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:07:55.763039 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:07:55.763048 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:07:55.763056 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:07:55.763064 | orchestrator | 2026-04-24 04:07:55.763072 | orchestrator | 2026-04-24 04:07:55.763080 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:07:55.763088 | orchestrator | Friday 24 April 2026 04:07:55 +0000 (0:00:00.628) 0:00:09.120 ********** 2026-04-24 04:07:55.763103 | orchestrator | =============================================================================== 2026-04-24 04:07:55.763111 | orchestrator | Gathers facts about hosts ----------------------------------------------- 5.62s 2026-04-24 04:07:55.763119 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.39s 2026-04-24 04:07:55.763127 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.19s 2026-04-24 04:07:55.763135 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.63s 2026-04-24 04:07:56.098539 | orchestrator | + osism validate ceph-mons 2026-04-24 04:08:28.958520 | orchestrator | 2026-04-24 04:08:28.958636 | orchestrator | PLAY [Ceph validate mons] ****************************************************** 2026-04-24 04:08:28.958654 | orchestrator | 2026-04-24 04:08:28.958667 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-24 04:08:28.958678 | orchestrator | Friday 24 April 2026 04:08:12 +0000 (0:00:00.452) 0:00:00.452 ********** 2026-04-24 04:08:28.958690 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:28.958702 | orchestrator | 2026-04-24 04:08:28.958713 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-24 04:08:28.958724 | orchestrator | Friday 24 April 2026 04:08:13 +0000 (0:00:00.850) 0:00:01.302 ********** 2026-04-24 04:08:28.958735 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:28.958746 | orchestrator | 2026-04-24 04:08:28.958757 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-24 04:08:28.958768 | orchestrator | Friday 24 April 2026 04:08:14 +0000 (0:00:01.020) 0:00:02.323 ********** 2026-04-24 04:08:28.958779 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.958791 | orchestrator | 2026-04-24 04:08:28.958802 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-24 04:08:28.958813 | orchestrator | Friday 24 April 2026 04:08:14 +0000 (0:00:00.139) 0:00:02.462 ********** 2026-04-24 04:08:28.958824 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.958861 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:28.958874 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:28.958885 | orchestrator | 2026-04-24 04:08:28.958895 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-24 04:08:28.958906 | orchestrator | Friday 24 April 2026 04:08:15 +0000 (0:00:00.304) 0:00:02.767 ********** 2026-04-24 04:08:28.958917 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:28.958928 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:28.958939 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.958949 | orchestrator | 2026-04-24 04:08:28.958960 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-24 04:08:28.958971 | orchestrator | Friday 24 April 2026 04:08:16 +0000 (0:00:01.033) 0:00:03.800 ********** 2026-04-24 04:08:28.958982 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.958993 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:08:28.959004 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:08:28.959016 | orchestrator | 2026-04-24 04:08:28.959029 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-24 04:08:28.959041 | orchestrator | Friday 24 April 2026 04:08:16 +0000 (0:00:00.303) 0:00:04.104 ********** 2026-04-24 04:08:28.959054 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.959067 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:28.959080 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:28.959091 | orchestrator | 2026-04-24 04:08:28.959101 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 04:08:28.959112 | orchestrator | Friday 24 April 2026 04:08:17 +0000 (0:00:00.534) 0:00:04.639 ********** 2026-04-24 04:08:28.959123 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.959134 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:28.959144 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:28.959155 | orchestrator | 2026-04-24 04:08:28.959166 | orchestrator | TASK [Set test result to failed if ceph-mon is not running] ******************** 2026-04-24 04:08:28.959176 | orchestrator | Friday 24 April 2026 04:08:17 +0000 (0:00:00.354) 0:00:04.993 ********** 2026-04-24 04:08:28.959213 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.959225 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:08:28.959236 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:08:28.959246 | orchestrator | 2026-04-24 04:08:28.959257 | orchestrator | TASK [Set test result to passed if ceph-mon is running] ************************ 2026-04-24 04:08:28.959268 | orchestrator | Friday 24 April 2026 04:08:17 +0000 (0:00:00.309) 0:00:05.303 ********** 2026-04-24 04:08:28.959278 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.959289 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:28.959300 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:28.959310 | orchestrator | 2026-04-24 04:08:28.959321 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 04:08:28.959332 | orchestrator | Friday 24 April 2026 04:08:18 +0000 (0:00:00.505) 0:00:05.808 ********** 2026-04-24 04:08:28.959343 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.959354 | orchestrator | 2026-04-24 04:08:28.959365 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 04:08:28.959375 | orchestrator | Friday 24 April 2026 04:08:18 +0000 (0:00:00.305) 0:00:06.114 ********** 2026-04-24 04:08:28.959386 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.959397 | orchestrator | 2026-04-24 04:08:28.959408 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 04:08:28.959418 | orchestrator | Friday 24 April 2026 04:08:18 +0000 (0:00:00.265) 0:00:06.379 ********** 2026-04-24 04:08:28.959429 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.959439 | orchestrator | 2026-04-24 04:08:28.959450 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:28.959461 | orchestrator | Friday 24 April 2026 04:08:19 +0000 (0:00:00.254) 0:00:06.634 ********** 2026-04-24 04:08:28.959471 | orchestrator | 2026-04-24 04:08:28.959482 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:28.959493 | orchestrator | Friday 24 April 2026 04:08:19 +0000 (0:00:00.087) 0:00:06.721 ********** 2026-04-24 04:08:28.959503 | orchestrator | 2026-04-24 04:08:28.959514 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:28.959524 | orchestrator | Friday 24 April 2026 04:08:19 +0000 (0:00:00.074) 0:00:06.796 ********** 2026-04-24 04:08:28.959535 | orchestrator | 2026-04-24 04:08:28.959546 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 04:08:28.959556 | orchestrator | Friday 24 April 2026 04:08:19 +0000 (0:00:00.078) 0:00:06.875 ********** 2026-04-24 04:08:28.959567 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.959578 | orchestrator | 2026-04-24 04:08:28.959588 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-24 04:08:28.959599 | orchestrator | Friday 24 April 2026 04:08:19 +0000 (0:00:00.260) 0:00:07.135 ********** 2026-04-24 04:08:28.959610 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.959620 | orchestrator | 2026-04-24 04:08:28.959649 | orchestrator | TASK [Prepare quorum test vars] ************************************************ 2026-04-24 04:08:28.959661 | orchestrator | Friday 24 April 2026 04:08:19 +0000 (0:00:00.237) 0:00:07.372 ********** 2026-04-24 04:08:28.959672 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.959682 | orchestrator | 2026-04-24 04:08:28.959693 | orchestrator | TASK [Get monmap info from one mon container] ********************************** 2026-04-24 04:08:28.959704 | orchestrator | Friday 24 April 2026 04:08:19 +0000 (0:00:00.111) 0:00:07.484 ********** 2026-04-24 04:08:28.959715 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:08:28.959725 | orchestrator | 2026-04-24 04:08:28.959741 | orchestrator | TASK [Set quorum test data] **************************************************** 2026-04-24 04:08:28.959752 | orchestrator | Friday 24 April 2026 04:08:21 +0000 (0:00:01.540) 0:00:09.025 ********** 2026-04-24 04:08:28.959763 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.959774 | orchestrator | 2026-04-24 04:08:28.959784 | orchestrator | TASK [Fail quorum test if not all monitors are in quorum] ********************** 2026-04-24 04:08:28.959803 | orchestrator | Friday 24 April 2026 04:08:21 +0000 (0:00:00.569) 0:00:09.594 ********** 2026-04-24 04:08:28.959830 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.959871 | orchestrator | 2026-04-24 04:08:28.959883 | orchestrator | TASK [Pass quorum test if all monitors are in quorum] ************************** 2026-04-24 04:08:28.959893 | orchestrator | Friday 24 April 2026 04:08:22 +0000 (0:00:00.144) 0:00:09.738 ********** 2026-04-24 04:08:28.959904 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.959915 | orchestrator | 2026-04-24 04:08:28.959925 | orchestrator | TASK [Set fsid test vars] ****************************************************** 2026-04-24 04:08:28.959936 | orchestrator | Friday 24 April 2026 04:08:22 +0000 (0:00:00.330) 0:00:10.068 ********** 2026-04-24 04:08:28.959947 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.959958 | orchestrator | 2026-04-24 04:08:28.959969 | orchestrator | TASK [Fail Cluster FSID test if FSID does not match configuration] ************* 2026-04-24 04:08:28.959979 | orchestrator | Friday 24 April 2026 04:08:22 +0000 (0:00:00.335) 0:00:10.404 ********** 2026-04-24 04:08:28.959990 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.960001 | orchestrator | 2026-04-24 04:08:28.960011 | orchestrator | TASK [Pass Cluster FSID test if it matches configuration] ********************** 2026-04-24 04:08:28.960022 | orchestrator | Friday 24 April 2026 04:08:22 +0000 (0:00:00.134) 0:00:10.539 ********** 2026-04-24 04:08:28.960046 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.960069 | orchestrator | 2026-04-24 04:08:28.960080 | orchestrator | TASK [Prepare status test vars] ************************************************ 2026-04-24 04:08:28.960091 | orchestrator | Friday 24 April 2026 04:08:23 +0000 (0:00:00.159) 0:00:10.699 ********** 2026-04-24 04:08:28.960102 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.960113 | orchestrator | 2026-04-24 04:08:28.960123 | orchestrator | TASK [Gather status data] ****************************************************** 2026-04-24 04:08:28.960134 | orchestrator | Friday 24 April 2026 04:08:23 +0000 (0:00:00.126) 0:00:10.825 ********** 2026-04-24 04:08:28.960145 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:08:28.960155 | orchestrator | 2026-04-24 04:08:28.960166 | orchestrator | TASK [Set health test data] **************************************************** 2026-04-24 04:08:28.960177 | orchestrator | Friday 24 April 2026 04:08:24 +0000 (0:00:01.353) 0:00:12.178 ********** 2026-04-24 04:08:28.960187 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.960198 | orchestrator | 2026-04-24 04:08:28.960209 | orchestrator | TASK [Fail cluster-health if health is not acceptable] ************************* 2026-04-24 04:08:28.960219 | orchestrator | Friday 24 April 2026 04:08:24 +0000 (0:00:00.326) 0:00:12.505 ********** 2026-04-24 04:08:28.960230 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.960241 | orchestrator | 2026-04-24 04:08:28.960252 | orchestrator | TASK [Pass cluster-health if health is acceptable] ***************************** 2026-04-24 04:08:28.960262 | orchestrator | Friday 24 April 2026 04:08:25 +0000 (0:00:00.139) 0:00:12.645 ********** 2026-04-24 04:08:28.960273 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:28.960284 | orchestrator | 2026-04-24 04:08:28.960294 | orchestrator | TASK [Fail cluster-health if health is not acceptable (strict)] **************** 2026-04-24 04:08:28.960305 | orchestrator | Friday 24 April 2026 04:08:25 +0000 (0:00:00.155) 0:00:12.800 ********** 2026-04-24 04:08:28.960322 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.960333 | orchestrator | 2026-04-24 04:08:28.960344 | orchestrator | TASK [Pass cluster-health if status is OK (strict)] **************************** 2026-04-24 04:08:28.960355 | orchestrator | Friday 24 April 2026 04:08:25 +0000 (0:00:00.158) 0:00:12.958 ********** 2026-04-24 04:08:28.960365 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.960376 | orchestrator | 2026-04-24 04:08:28.960387 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-24 04:08:28.960398 | orchestrator | Friday 24 April 2026 04:08:25 +0000 (0:00:00.325) 0:00:13.284 ********** 2026-04-24 04:08:28.960408 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:28.960419 | orchestrator | 2026-04-24 04:08:28.960430 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-24 04:08:28.960448 | orchestrator | Friday 24 April 2026 04:08:25 +0000 (0:00:00.279) 0:00:13.564 ********** 2026-04-24 04:08:28.960458 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:28.960469 | orchestrator | 2026-04-24 04:08:28.960479 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 04:08:28.960490 | orchestrator | Friday 24 April 2026 04:08:26 +0000 (0:00:00.277) 0:00:13.841 ********** 2026-04-24 04:08:28.960501 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:28.960511 | orchestrator | 2026-04-24 04:08:28.960522 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 04:08:28.960533 | orchestrator | Friday 24 April 2026 04:08:28 +0000 (0:00:01.915) 0:00:15.756 ********** 2026-04-24 04:08:28.960543 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:28.960554 | orchestrator | 2026-04-24 04:08:28.960565 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 04:08:28.960575 | orchestrator | Friday 24 April 2026 04:08:28 +0000 (0:00:00.282) 0:00:16.039 ********** 2026-04-24 04:08:28.960586 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:28.960597 | orchestrator | 2026-04-24 04:08:28.960614 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:31.816309 | orchestrator | Friday 24 April 2026 04:08:28 +0000 (0:00:00.309) 0:00:16.349 ********** 2026-04-24 04:08:31.817329 | orchestrator | 2026-04-24 04:08:31.817364 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:31.817377 | orchestrator | Friday 24 April 2026 04:08:28 +0000 (0:00:00.071) 0:00:16.420 ********** 2026-04-24 04:08:31.817388 | orchestrator | 2026-04-24 04:08:31.817400 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:31.817412 | orchestrator | Friday 24 April 2026 04:08:28 +0000 (0:00:00.070) 0:00:16.491 ********** 2026-04-24 04:08:31.817423 | orchestrator | 2026-04-24 04:08:31.817434 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-24 04:08:31.817445 | orchestrator | Friday 24 April 2026 04:08:28 +0000 (0:00:00.073) 0:00:16.564 ********** 2026-04-24 04:08:31.817457 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:31.817468 | orchestrator | 2026-04-24 04:08:31.817479 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 04:08:31.817489 | orchestrator | Friday 24 April 2026 04:08:30 +0000 (0:00:01.653) 0:00:18.218 ********** 2026-04-24 04:08:31.817500 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-24 04:08:31.817511 | orchestrator |  "msg": [ 2026-04-24 04:08:31.817524 | orchestrator |  "Validator run completed.", 2026-04-24 04:08:31.817535 | orchestrator |  "You can find the report file here:", 2026-04-24 04:08:31.817546 | orchestrator |  "/opt/reports/validator/ceph-mons-validator-2026-04-24T04:08:13+00:00-report.json", 2026-04-24 04:08:31.817557 | orchestrator |  "on the following host:", 2026-04-24 04:08:31.817568 | orchestrator |  "testbed-manager" 2026-04-24 04:08:31.817579 | orchestrator |  ] 2026-04-24 04:08:31.817590 | orchestrator | } 2026-04-24 04:08:31.817601 | orchestrator | 2026-04-24 04:08:31.817612 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:08:31.817624 | orchestrator | testbed-node-0 : ok=24  changed=5  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026-04-24 04:08:31.817637 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:08:31.817648 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:08:31.817659 | orchestrator | 2026-04-24 04:08:31.817670 | orchestrator | 2026-04-24 04:08:31.817681 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:08:31.817717 | orchestrator | Friday 24 April 2026 04:08:31 +0000 (0:00:00.891) 0:00:19.109 ********** 2026-04-24 04:08:31.817729 | orchestrator | =============================================================================== 2026-04-24 04:08:31.817739 | orchestrator | Aggregate test results step one ----------------------------------------- 1.92s 2026-04-24 04:08:31.817750 | orchestrator | Write report file ------------------------------------------------------- 1.65s 2026-04-24 04:08:31.817761 | orchestrator | Get monmap info from one mon container ---------------------------------- 1.54s 2026-04-24 04:08:31.817771 | orchestrator | Gather status data ------------------------------------------------------ 1.35s 2026-04-24 04:08:31.817782 | orchestrator | Get container info ------------------------------------------------------ 1.03s 2026-04-24 04:08:31.817793 | orchestrator | Create report output directory ------------------------------------------ 1.02s 2026-04-24 04:08:31.817804 | orchestrator | Print report file information ------------------------------------------- 0.89s 2026-04-24 04:08:31.817815 | orchestrator | Get timestamp for report file ------------------------------------------- 0.85s 2026-04-24 04:08:31.817878 | orchestrator | Set quorum test data ---------------------------------------------------- 0.57s 2026-04-24 04:08:31.817892 | orchestrator | Set test result to passed if container is existing ---------------------- 0.53s 2026-04-24 04:08:31.817903 | orchestrator | Set test result to passed if ceph-mon is running ------------------------ 0.51s 2026-04-24 04:08:31.817914 | orchestrator | Prepare test data ------------------------------------------------------- 0.35s 2026-04-24 04:08:31.817925 | orchestrator | Set fsid test vars ------------------------------------------------------ 0.34s 2026-04-24 04:08:31.817935 | orchestrator | Pass quorum test if all monitors are in quorum -------------------------- 0.33s 2026-04-24 04:08:31.817946 | orchestrator | Set health test data ---------------------------------------------------- 0.33s 2026-04-24 04:08:31.817957 | orchestrator | Pass cluster-health if status is OK (strict) ---------------------------- 0.33s 2026-04-24 04:08:31.817968 | orchestrator | Aggregate test results step three --------------------------------------- 0.31s 2026-04-24 04:08:31.817978 | orchestrator | Set test result to failed if ceph-mon is not running -------------------- 0.31s 2026-04-24 04:08:31.817989 | orchestrator | Aggregate test results step one ----------------------------------------- 0.31s 2026-04-24 04:08:31.818000 | orchestrator | Prepare test data for container existance test -------------------------- 0.30s 2026-04-24 04:08:32.157239 | orchestrator | + osism validate ceph-mgrs 2026-04-24 04:08:53.819156 | orchestrator | 2026-04-24 04:08:53.819275 | orchestrator | PLAY [Ceph validate mgrs] ****************************************************** 2026-04-24 04:08:53.819294 | orchestrator | 2026-04-24 04:08:53.819307 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-24 04:08:53.819319 | orchestrator | Friday 24 April 2026 04:08:39 +0000 (0:00:00.444) 0:00:00.444 ********** 2026-04-24 04:08:53.819331 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:53.819342 | orchestrator | 2026-04-24 04:08:53.819353 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-24 04:08:53.819364 | orchestrator | Friday 24 April 2026 04:08:39 +0000 (0:00:00.848) 0:00:01.293 ********** 2026-04-24 04:08:53.819374 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:53.819385 | orchestrator | 2026-04-24 04:08:53.819396 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-24 04:08:53.819407 | orchestrator | Friday 24 April 2026 04:08:40 +0000 (0:00:01.067) 0:00:02.361 ********** 2026-04-24 04:08:53.819418 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.819430 | orchestrator | 2026-04-24 04:08:53.819441 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-24 04:08:53.819451 | orchestrator | Friday 24 April 2026 04:08:41 +0000 (0:00:00.153) 0:00:02.515 ********** 2026-04-24 04:08:53.819462 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.819473 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:53.819483 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:53.819494 | orchestrator | 2026-04-24 04:08:53.819529 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-24 04:08:53.819541 | orchestrator | Friday 24 April 2026 04:08:41 +0000 (0:00:00.352) 0:00:02.867 ********** 2026-04-24 04:08:53.819551 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:53.819562 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:53.819590 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.819612 | orchestrator | 2026-04-24 04:08:53.819624 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-24 04:08:53.819634 | orchestrator | Friday 24 April 2026 04:08:42 +0000 (0:00:00.985) 0:00:03.853 ********** 2026-04-24 04:08:53.819645 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.819656 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:08:53.819666 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:08:53.819677 | orchestrator | 2026-04-24 04:08:53.819687 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-24 04:08:53.819698 | orchestrator | Friday 24 April 2026 04:08:42 +0000 (0:00:00.363) 0:00:04.216 ********** 2026-04-24 04:08:53.819709 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.819720 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:53.819731 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:53.819741 | orchestrator | 2026-04-24 04:08:53.819752 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 04:08:53.819763 | orchestrator | Friday 24 April 2026 04:08:43 +0000 (0:00:00.555) 0:00:04.771 ********** 2026-04-24 04:08:53.819774 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.819784 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:53.819795 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:53.819805 | orchestrator | 2026-04-24 04:08:53.819816 | orchestrator | TASK [Set test result to failed if ceph-mgr is not running] ******************** 2026-04-24 04:08:53.819827 | orchestrator | Friday 24 April 2026 04:08:43 +0000 (0:00:00.325) 0:00:05.097 ********** 2026-04-24 04:08:53.819878 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.819890 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:08:53.819901 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:08:53.819912 | orchestrator | 2026-04-24 04:08:53.819923 | orchestrator | TASK [Set test result to passed if ceph-mgr is running] ************************ 2026-04-24 04:08:53.819934 | orchestrator | Friday 24 April 2026 04:08:44 +0000 (0:00:00.328) 0:00:05.425 ********** 2026-04-24 04:08:53.819945 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.819955 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:08:53.819966 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:08:53.819977 | orchestrator | 2026-04-24 04:08:53.819987 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 04:08:53.819998 | orchestrator | Friday 24 April 2026 04:08:44 +0000 (0:00:00.516) 0:00:05.941 ********** 2026-04-24 04:08:53.820009 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.820020 | orchestrator | 2026-04-24 04:08:53.820031 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 04:08:53.820041 | orchestrator | Friday 24 April 2026 04:08:44 +0000 (0:00:00.258) 0:00:06.199 ********** 2026-04-24 04:08:53.820052 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.820063 | orchestrator | 2026-04-24 04:08:53.820073 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 04:08:53.820084 | orchestrator | Friday 24 April 2026 04:08:45 +0000 (0:00:00.254) 0:00:06.454 ********** 2026-04-24 04:08:53.820095 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.820106 | orchestrator | 2026-04-24 04:08:53.820117 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:53.820127 | orchestrator | Friday 24 April 2026 04:08:45 +0000 (0:00:00.267) 0:00:06.721 ********** 2026-04-24 04:08:53.820138 | orchestrator | 2026-04-24 04:08:53.820149 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:53.820160 | orchestrator | Friday 24 April 2026 04:08:45 +0000 (0:00:00.079) 0:00:06.801 ********** 2026-04-24 04:08:53.820170 | orchestrator | 2026-04-24 04:08:53.820190 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:53.820201 | orchestrator | Friday 24 April 2026 04:08:45 +0000 (0:00:00.077) 0:00:06.878 ********** 2026-04-24 04:08:53.820211 | orchestrator | 2026-04-24 04:08:53.820222 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 04:08:53.820233 | orchestrator | Friday 24 April 2026 04:08:45 +0000 (0:00:00.097) 0:00:06.976 ********** 2026-04-24 04:08:53.820244 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.820254 | orchestrator | 2026-04-24 04:08:53.820265 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-24 04:08:53.820276 | orchestrator | Friday 24 April 2026 04:08:45 +0000 (0:00:00.261) 0:00:07.237 ********** 2026-04-24 04:08:53.820286 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.820297 | orchestrator | 2026-04-24 04:08:53.820326 | orchestrator | TASK [Define mgr module test vars] ********************************************* 2026-04-24 04:08:53.820337 | orchestrator | Friday 24 April 2026 04:08:46 +0000 (0:00:00.303) 0:00:07.540 ********** 2026-04-24 04:08:53.820348 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.820359 | orchestrator | 2026-04-24 04:08:53.820370 | orchestrator | TASK [Gather list of mgr modules] ********************************************** 2026-04-24 04:08:53.820381 | orchestrator | Friday 24 April 2026 04:08:46 +0000 (0:00:00.116) 0:00:07.656 ********** 2026-04-24 04:08:53.820392 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:08:53.820403 | orchestrator | 2026-04-24 04:08:53.820414 | orchestrator | TASK [Parse mgr module list from json] ***************************************** 2026-04-24 04:08:53.820424 | orchestrator | Friday 24 April 2026 04:08:48 +0000 (0:00:01.899) 0:00:09.555 ********** 2026-04-24 04:08:53.820435 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.820446 | orchestrator | 2026-04-24 04:08:53.820457 | orchestrator | TASK [Extract list of enabled mgr modules] ************************************* 2026-04-24 04:08:53.820467 | orchestrator | Friday 24 April 2026 04:08:48 +0000 (0:00:00.452) 0:00:10.008 ********** 2026-04-24 04:08:53.820478 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.820489 | orchestrator | 2026-04-24 04:08:53.820500 | orchestrator | TASK [Fail test if mgr modules are disabled that should be enabled] ************ 2026-04-24 04:08:53.820511 | orchestrator | Friday 24 April 2026 04:08:48 +0000 (0:00:00.330) 0:00:10.339 ********** 2026-04-24 04:08:53.820522 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.820533 | orchestrator | 2026-04-24 04:08:53.820544 | orchestrator | TASK [Pass test if required mgr modules are enabled] *************************** 2026-04-24 04:08:53.820554 | orchestrator | Friday 24 April 2026 04:08:49 +0000 (0:00:00.161) 0:00:10.501 ********** 2026-04-24 04:08:53.820565 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:08:53.820576 | orchestrator | 2026-04-24 04:08:53.820587 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-24 04:08:53.820598 | orchestrator | Friday 24 April 2026 04:08:49 +0000 (0:00:00.169) 0:00:10.670 ********** 2026-04-24 04:08:53.820608 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:53.820619 | orchestrator | 2026-04-24 04:08:53.820630 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-24 04:08:53.820641 | orchestrator | Friday 24 April 2026 04:08:49 +0000 (0:00:00.303) 0:00:10.974 ********** 2026-04-24 04:08:53.820652 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:08:53.820662 | orchestrator | 2026-04-24 04:08:53.820691 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 04:08:53.820703 | orchestrator | Friday 24 April 2026 04:08:49 +0000 (0:00:00.247) 0:00:11.221 ********** 2026-04-24 04:08:53.820714 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:53.820725 | orchestrator | 2026-04-24 04:08:53.820736 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 04:08:53.820747 | orchestrator | Friday 24 April 2026 04:08:51 +0000 (0:00:01.339) 0:00:12.560 ********** 2026-04-24 04:08:53.820758 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:53.820776 | orchestrator | 2026-04-24 04:08:53.820787 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 04:08:53.820798 | orchestrator | Friday 24 April 2026 04:08:51 +0000 (0:00:00.242) 0:00:12.803 ********** 2026-04-24 04:08:53.820809 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:53.820820 | orchestrator | 2026-04-24 04:08:53.820831 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:53.820872 | orchestrator | Friday 24 April 2026 04:08:51 +0000 (0:00:00.260) 0:00:13.063 ********** 2026-04-24 04:08:53.820884 | orchestrator | 2026-04-24 04:08:53.820894 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:53.820905 | orchestrator | Friday 24 April 2026 04:08:51 +0000 (0:00:00.075) 0:00:13.139 ********** 2026-04-24 04:08:53.820916 | orchestrator | 2026-04-24 04:08:53.820927 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:08:53.820938 | orchestrator | Friday 24 April 2026 04:08:51 +0000 (0:00:00.071) 0:00:13.210 ********** 2026-04-24 04:08:53.820949 | orchestrator | 2026-04-24 04:08:53.820960 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-24 04:08:53.820971 | orchestrator | Friday 24 April 2026 04:08:52 +0000 (0:00:00.270) 0:00:13.480 ********** 2026-04-24 04:08:53.820981 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 04:08:53.820992 | orchestrator | 2026-04-24 04:08:53.821003 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 04:08:53.821019 | orchestrator | Friday 24 April 2026 04:08:53 +0000 (0:00:01.329) 0:00:14.810 ********** 2026-04-24 04:08:53.821030 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-24 04:08:53.821041 | orchestrator |  "msg": [ 2026-04-24 04:08:53.821052 | orchestrator |  "Validator run completed.", 2026-04-24 04:08:53.821063 | orchestrator |  "You can find the report file here:", 2026-04-24 04:08:53.821074 | orchestrator |  "/opt/reports/validator/ceph-mgrs-validator-2026-04-24T04:08:39+00:00-report.json", 2026-04-24 04:08:53.821085 | orchestrator |  "on the following host:", 2026-04-24 04:08:53.821096 | orchestrator |  "testbed-manager" 2026-04-24 04:08:53.821107 | orchestrator |  ] 2026-04-24 04:08:53.821118 | orchestrator | } 2026-04-24 04:08:53.821129 | orchestrator | 2026-04-24 04:08:53.821140 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:08:53.821152 | orchestrator | testbed-node-0 : ok=19  changed=3  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 04:08:53.821164 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:08:53.821183 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:08:54.198171 | orchestrator | 2026-04-24 04:08:54.198273 | orchestrator | 2026-04-24 04:08:54.198288 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:08:54.198301 | orchestrator | Friday 24 April 2026 04:08:53 +0000 (0:00:00.393) 0:00:15.204 ********** 2026-04-24 04:08:54.198312 | orchestrator | =============================================================================== 2026-04-24 04:08:54.198323 | orchestrator | Gather list of mgr modules ---------------------------------------------- 1.90s 2026-04-24 04:08:54.198334 | orchestrator | Aggregate test results step one ----------------------------------------- 1.34s 2026-04-24 04:08:54.198345 | orchestrator | Write report file ------------------------------------------------------- 1.33s 2026-04-24 04:08:54.198356 | orchestrator | Create report output directory ------------------------------------------ 1.07s 2026-04-24 04:08:54.198366 | orchestrator | Get container info ------------------------------------------------------ 0.99s 2026-04-24 04:08:54.198377 | orchestrator | Get timestamp for report file ------------------------------------------- 0.85s 2026-04-24 04:08:54.198415 | orchestrator | Set test result to passed if container is existing ---------------------- 0.56s 2026-04-24 04:08:54.198427 | orchestrator | Set test result to passed if ceph-mgr is running ------------------------ 0.52s 2026-04-24 04:08:54.198438 | orchestrator | Parse mgr module list from json ----------------------------------------- 0.45s 2026-04-24 04:08:54.198449 | orchestrator | Flush handlers ---------------------------------------------------------- 0.42s 2026-04-24 04:08:54.198460 | orchestrator | Print report file information ------------------------------------------- 0.39s 2026-04-24 04:08:54.198471 | orchestrator | Set test result to failed if container is missing ----------------------- 0.36s 2026-04-24 04:08:54.198481 | orchestrator | Prepare test data for container existance test -------------------------- 0.35s 2026-04-24 04:08:54.198492 | orchestrator | Extract list of enabled mgr modules ------------------------------------- 0.33s 2026-04-24 04:08:54.198502 | orchestrator | Set test result to failed if ceph-mgr is not running -------------------- 0.33s 2026-04-24 04:08:54.198513 | orchestrator | Prepare test data ------------------------------------------------------- 0.33s 2026-04-24 04:08:54.198524 | orchestrator | Set validation result to passed if no test failed ----------------------- 0.30s 2026-04-24 04:08:54.198534 | orchestrator | Fail due to missing containers ------------------------------------------ 0.30s 2026-04-24 04:08:54.198545 | orchestrator | Aggregate test results step three --------------------------------------- 0.27s 2026-04-24 04:08:54.198556 | orchestrator | Print report file information ------------------------------------------- 0.26s 2026-04-24 04:08:54.517491 | orchestrator | + osism validate ceph-osds 2026-04-24 04:09:16.224389 | orchestrator | 2026-04-24 04:09:16.224473 | orchestrator | PLAY [Ceph validate OSDs] ****************************************************** 2026-04-24 04:09:16.224481 | orchestrator | 2026-04-24 04:09:16.224487 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-24 04:09:16.224493 | orchestrator | Friday 24 April 2026 04:09:11 +0000 (0:00:00.453) 0:00:00.453 ********** 2026-04-24 04:09:16.224499 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 04:09:16.224505 | orchestrator | 2026-04-24 04:09:16.224510 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-24 04:09:16.224515 | orchestrator | Friday 24 April 2026 04:09:12 +0000 (0:00:00.868) 0:00:01.322 ********** 2026-04-24 04:09:16.224520 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 04:09:16.224525 | orchestrator | 2026-04-24 04:09:16.224529 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-24 04:09:16.224534 | orchestrator | Friday 24 April 2026 04:09:12 +0000 (0:00:00.504) 0:00:01.827 ********** 2026-04-24 04:09:16.224539 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 04:09:16.224544 | orchestrator | 2026-04-24 04:09:16.224549 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-24 04:09:16.224554 | orchestrator | Friday 24 April 2026 04:09:13 +0000 (0:00:00.752) 0:00:02.579 ********** 2026-04-24 04:09:16.224559 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:16.224565 | orchestrator | 2026-04-24 04:09:16.224570 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-24 04:09:16.224575 | orchestrator | Friday 24 April 2026 04:09:13 +0000 (0:00:00.138) 0:00:02.717 ********** 2026-04-24 04:09:16.224581 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:16.224586 | orchestrator | 2026-04-24 04:09:16.224590 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-24 04:09:16.224608 | orchestrator | Friday 24 April 2026 04:09:13 +0000 (0:00:00.146) 0:00:02.864 ********** 2026-04-24 04:09:16.224614 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:16.224618 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:16.224623 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:16.224628 | orchestrator | 2026-04-24 04:09:16.224633 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-24 04:09:16.224638 | orchestrator | Friday 24 April 2026 04:09:14 +0000 (0:00:00.356) 0:00:03.220 ********** 2026-04-24 04:09:16.224661 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:16.224666 | orchestrator | 2026-04-24 04:09:16.224671 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-24 04:09:16.224676 | orchestrator | Friday 24 April 2026 04:09:14 +0000 (0:00:00.185) 0:00:03.406 ********** 2026-04-24 04:09:16.224681 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:16.224686 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:16.224690 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:16.224695 | orchestrator | 2026-04-24 04:09:16.224700 | orchestrator | TASK [Calculate total number of OSDs in cluster] ******************************* 2026-04-24 04:09:16.224705 | orchestrator | Friday 24 April 2026 04:09:14 +0000 (0:00:00.356) 0:00:03.763 ********** 2026-04-24 04:09:16.224710 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:16.224715 | orchestrator | 2026-04-24 04:09:16.224719 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 04:09:16.224724 | orchestrator | Friday 24 April 2026 04:09:15 +0000 (0:00:00.948) 0:00:04.711 ********** 2026-04-24 04:09:16.224729 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:16.224734 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:16.224739 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:16.224743 | orchestrator | 2026-04-24 04:09:16.224748 | orchestrator | TASK [Get list of ceph-osd containers on host] ********************************* 2026-04-24 04:09:16.224753 | orchestrator | Friday 24 April 2026 04:09:15 +0000 (0:00:00.308) 0:00:05.020 ********** 2026-04-24 04:09:16.224760 | orchestrator | skipping: [testbed-node-3] => (item={'id': '0283f4d173b1b53e34c13ee9edbafea6b8f10bbc0bed8f45f249d6947d8de073', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-24 04:09:16.224767 | orchestrator | skipping: [testbed-node-3] => (item={'id': '8e32be58166ca57b8e488ada20e73ffb0a123180431471010faa62b351672803', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-24 04:09:16.224773 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'ee4edf17593f7c0b18be023aa2a1a7c9152fddc35d2cc68e494da4d377bbcc98', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-24 04:09:16.224779 | orchestrator | skipping: [testbed-node-3] => (item={'id': '9757373d936545d0fe320fea1bd2a87c58ab5fb8700ff7b4d7eadf67561dcaf8', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 20 minutes (unhealthy)'})  2026-04-24 04:09:16.224784 | orchestrator | skipping: [testbed-node-3] => (item={'id': '85f2e2c435e9c6551eef8044770a401aa42b83bbf31b320796dc7e8989dc518b', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 39 minutes (healthy)'})  2026-04-24 04:09:16.224805 | orchestrator | skipping: [testbed-node-3] => (item={'id': '6dae185db6566818db98e565225c37c5569eeef204973fe077833ee169708e5d', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 40 minutes (healthy)'})  2026-04-24 04:09:16.224811 | orchestrator | skipping: [testbed-node-3] => (item={'id': '7134e2b38787270b69dd5fc1de06dd85f2da4ab75443189dc12b38e719e88a46', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 41 minutes (healthy)'})  2026-04-24 04:09:16.224816 | orchestrator | skipping: [testbed-node-3] => (item={'id': '36566bd76491131dccd1ff8bed36b74ac2f2444acaf5930d9eab3162842fc169', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-24 04:09:16.224821 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'dcc7ca9bad3f6d9586f31ec33e74b10bc6e1ac5bd02df20e11ff70da77933460', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-3-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.224872 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'c483479df68b46140489b926a226c246e2cb6c32e66beb50e37ff55645471f34', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.224879 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'c6909656cf7afc848ea93a1a17b1e6dd1de64be39ef1f6e2d3e0c2fea51a2fea', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.224886 | orchestrator | ok: [testbed-node-3] => (item={'id': '9cd5332a2e93c1c8e42389be0f0cbf1f8cb2d51c0cb8e7a549351af5311d0082', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-4', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-24 04:09:16.224891 | orchestrator | ok: [testbed-node-3] => (item={'id': '44ab85c15bc64a50c77ea87d25cdaf3dbf0917c857869834d23ae86084517d85', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-0', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-24 04:09:16.224896 | orchestrator | skipping: [testbed-node-3] => (item={'id': '6a280cbf60a55542e4a63d5b7d4480967b502bc0b193498d027a2995bfc0a524', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.224902 | orchestrator | skipping: [testbed-node-3] => (item={'id': '74ff41e0ff87d8103cb7419080de912e7c8a0c001affdef1c7948d79a3fd429f', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 04:09:16.224907 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'b9e799c0df6d7572b19eb299ccff4440cc5ef11bf8568a0e93f57d0ebc3ecc63', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 04:09:16.224912 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'e067d57520c1b22021643e1149b80cf8272b8ca98e244453ecaf0670eb09cbc8', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:16.224917 | orchestrator | skipping: [testbed-node-4] => (item={'id': '6201a7e2cf5c22c6e973836dbf77bb7b372ac1faa35f227ef570aec41f76ee52', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-24 04:09:16.224922 | orchestrator | skipping: [testbed-node-3] => (item={'id': '46a3d7b0d56dfa4178593b262896b9bb1d88fcda8c268f4eb304190d30f6a987', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:16.224927 | orchestrator | skipping: [testbed-node-4] => (item={'id': '399d57420f251ff60cdda11c138208f889e7e9f96de69206cf4a10cf39ede890', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-24 04:09:16.224936 | orchestrator | skipping: [testbed-node-3] => (item={'id': '462f72860e4fb310d9675a3476ba224f4b46f1ddcf4be66063f7168df0e63ab2', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:16.503649 | orchestrator | skipping: [testbed-node-4] => (item={'id': '551864ca2f05cdec35849b03479b0bb16ef113cca4c0e3e74011c8b0a5720875', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-24 04:09:16.503745 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'dcc7025709cbcbba36398e671720e60e6b0e13ee3e0028fe813e5585cb58670b', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 20 minutes (unhealthy)'})  2026-04-24 04:09:16.503757 | orchestrator | skipping: [testbed-node-4] => (item={'id': '59a90ab4a6b4f4d08eaaeeda688e308a16671b55bc52e35c6cbc2e8fec65e2bf', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 39 minutes (healthy)'})  2026-04-24 04:09:16.503769 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'e1e38c4b068065a0dca662150f0fbac9f4800cd180850992ccbd77b9c6c11ef4', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 40 minutes (healthy)'})  2026-04-24 04:09:16.503779 | orchestrator | skipping: [testbed-node-4] => (item={'id': '4e211ce4d653ba132c93b303fef58fb63e93808b903c9f132107964648aaedd2', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 41 minutes (healthy)'})  2026-04-24 04:09:16.503882 | orchestrator | skipping: [testbed-node-4] => (item={'id': '4eea1b104f34eed269f0dc856175be33804a8783e44edb97066371f0f0a364be', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-24 04:09:16.503892 | orchestrator | skipping: [testbed-node-4] => (item={'id': '92d39ca11e35da8dbcbbf480e3b373946f02fbe717c3cc10b4a639482699ab97', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-4-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.503898 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'cf611129968905f1b801f1156e80d41c7613f6cbecce6587c97069b19ab48c91', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.503904 | orchestrator | skipping: [testbed-node-4] => (item={'id': '5e0530d37c26d591471d5da85f3f87125f813c4f8d35e572b044a157bf6a5770', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.503911 | orchestrator | ok: [testbed-node-4] => (item={'id': '3fd376d09c8278edc0e848229e1bfcd99ce8ef97a1ee8aa33d49d61eb3cba509', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-3', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-24 04:09:16.503917 | orchestrator | ok: [testbed-node-4] => (item={'id': 'd9e9502000c108161e2f587d96d6c2d66a53637005d85bbd2e95d1d499fafb8e', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-2', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-24 04:09:16.503922 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'ae62c8724130709cb80a4ae255470d3a82e20cedb9ec43b4cf1f80fa835cf30d', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.503927 | orchestrator | skipping: [testbed-node-4] => (item={'id': '1913e8e13961ad44758779d33c2f586bc3ae424a6b3d7a32456115760308cba5', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 04:09:16.503932 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'a51486e0cad6a62ed7867d261d6b10ffe6faac107068f116516185a46737781f', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 04:09:16.503948 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'e03e2c29698b6cf8caaaf5a576ea60e18760b76a50ce062c777426be7571bc30', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:16.503960 | orchestrator | skipping: [testbed-node-4] => (item={'id': '42b86e564bad3601003f4bd6cfe5fe25c38caa2d11f55e4026d50405cd920a68', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:16.503966 | orchestrator | skipping: [testbed-node-4] => (item={'id': '99d7df88696b580fdb2b070cc499f9b8f6ef958e0b5462549be8bb5791031b24', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:16.503970 | orchestrator | skipping: [testbed-node-5] => (item={'id': '0d1a5331ad5178349e47ac04f7e173e37e9035cd38e01c6486f0c8252b5bc352', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-24 04:09:16.503978 | orchestrator | skipping: [testbed-node-5] => (item={'id': '9179164df5701354c0c6f48e76fb2ddecce51058eebf1a5aa7a856f74e67f6b1', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-24 04:09:16.503984 | orchestrator | skipping: [testbed-node-5] => (item={'id': '686f516a2d32e1f74a78de2cff001fa6cf02b188d2dba570156819588b507f0f', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-24 04:09:16.503988 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'c2fbfc3c1ff2a8ee1f4cf2caa31acad2845b281ca2d8f2e9f74aadc544684ab5', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 20 minutes (unhealthy)'})  2026-04-24 04:09:16.503993 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'fa8812a596f783f21c95afe1aded141a4ebe96c03dfd33c3bf522129f363c9ec', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 39 minutes (healthy)'})  2026-04-24 04:09:16.503998 | orchestrator | skipping: [testbed-node-5] => (item={'id': '94c9703692e118889e4381ea855a5544fbebdfaf2177903018156cfe6626d0b4', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 40 minutes (healthy)'})  2026-04-24 04:09:16.504003 | orchestrator | skipping: [testbed-node-5] => (item={'id': '7f613c33d5cfa4a47fe69fb8a034db6a038e92e6d81f709d89f1261bb7db9331', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 41 minutes (healthy)'})  2026-04-24 04:09:16.504008 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'aa99180fbeea1f2182d3b7c2aba29bb73c7475c2b88590f2a967b8104cf392f2', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 47 minutes (healthy)'})  2026-04-24 04:09:16.504013 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'a85d7eed239210aff745f2db54e69704f6286ebb5e159f27db454f5ce007cbaa', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-5-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.504018 | orchestrator | skipping: [testbed-node-5] => (item={'id': '0354bf2a26da3746cb741ad52058c62868aac8a8cca3ce89c2f26b5923cb26d5', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.504023 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'ec4cdc5ed5df8759e9f3a751b81584562500d5961d2490a27e2792eca4bf2e90', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:16.504031 | orchestrator | ok: [testbed-node-5] => (item={'id': '161c9857d832a58562356885bcfa3c3916c6014fac84a68667d3d2dd86c9394f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-1', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-24 04:09:16.504041 | orchestrator | ok: [testbed-node-5] => (item={'id': 'e8ca71b8af8fcdb6139068759631af53c0f61d4afe31e1bf7d5291d55edbc365', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-5', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-24 04:09:27.796213 | orchestrator | skipping: [testbed-node-5] => (item={'id': '4829c736c52ee75a1c7699fd77e8b3f61683e726e09a9a4fc41419894bf0aede', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 04:09:27.796334 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'bb169af191c65c3ba5b6659d7961cfc19facf5532361b27980324da7d8fa8296', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 04:09:27.796355 | orchestrator | skipping: [testbed-node-5] => (item={'id': '050e919c7995069ca41a4d7f6624d3e1d69505a6428c1cdb16cb1520bbd6f306', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 04:09:27.796387 | orchestrator | skipping: [testbed-node-5] => (item={'id': '1893fe4d7d9aeee4e76f9b90f01dbcda8187810b26bf638748feb34ee0440591', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:27.796401 | orchestrator | skipping: [testbed-node-5] => (item={'id': '0dadec3c34f382060d2dbd4af9b34ac1254a81fa261519d78737edacd5047b0d', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:27.796413 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'efc678c7ea6e0bb177efc1a0260e338b79521179b5d66c8043e773688a44a06d', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 04:09:27.796425 | orchestrator | 2026-04-24 04:09:27.796438 | orchestrator | TASK [Get count of ceph-osd containers on host] ******************************** 2026-04-24 04:09:27.796450 | orchestrator | Friday 24 April 2026 04:09:16 +0000 (0:00:00.535) 0:00:05.555 ********** 2026-04-24 04:09:27.796461 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.796473 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:27.796483 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:27.796494 | orchestrator | 2026-04-24 04:09:27.796505 | orchestrator | TASK [Set test result to failed when count of containers is wrong] ************* 2026-04-24 04:09:27.796516 | orchestrator | Friday 24 April 2026 04:09:16 +0000 (0:00:00.313) 0:00:05.868 ********** 2026-04-24 04:09:27.796526 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.796538 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:27.796549 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:27.796560 | orchestrator | 2026-04-24 04:09:27.796570 | orchestrator | TASK [Set test result to passed if count matches] ****************************** 2026-04-24 04:09:27.796587 | orchestrator | Friday 24 April 2026 04:09:17 +0000 (0:00:00.587) 0:00:06.456 ********** 2026-04-24 04:09:27.796610 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.796641 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:27.796661 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:27.796680 | orchestrator | 2026-04-24 04:09:27.796700 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 04:09:27.796721 | orchestrator | Friday 24 April 2026 04:09:17 +0000 (0:00:00.317) 0:00:06.774 ********** 2026-04-24 04:09:27.796767 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.796789 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:27.796811 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:27.796858 | orchestrator | 2026-04-24 04:09:27.796874 | orchestrator | TASK [Get list of ceph-osd containers that are not running] ******************** 2026-04-24 04:09:27.796888 | orchestrator | Friday 24 April 2026 04:09:18 +0000 (0:00:00.341) 0:00:07.116 ********** 2026-04-24 04:09:27.796900 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-4', 'osd_id': '4', 'state': 'running'})  2026-04-24 04:09:27.796914 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-0', 'osd_id': '0', 'state': 'running'})  2026-04-24 04:09:27.796927 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.796945 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-3', 'osd_id': '3', 'state': 'running'})  2026-04-24 04:09:27.796971 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-2', 'osd_id': '2', 'state': 'running'})  2026-04-24 04:09:27.796994 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:27.797012 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-1', 'osd_id': '1', 'state': 'running'})  2026-04-24 04:09:27.797030 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-5', 'osd_id': '5', 'state': 'running'})  2026-04-24 04:09:27.797047 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:27.797065 | orchestrator | 2026-04-24 04:09:27.797084 | orchestrator | TASK [Get count of ceph-osd containers that are not running] ******************* 2026-04-24 04:09:27.797101 | orchestrator | Friday 24 April 2026 04:09:18 +0000 (0:00:00.306) 0:00:07.423 ********** 2026-04-24 04:09:27.797118 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.797136 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:27.797153 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:27.797172 | orchestrator | 2026-04-24 04:09:27.797190 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-24 04:09:27.797209 | orchestrator | Friday 24 April 2026 04:09:18 +0000 (0:00:00.521) 0:00:07.945 ********** 2026-04-24 04:09:27.797226 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.797274 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:27.797296 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:27.797314 | orchestrator | 2026-04-24 04:09:27.797332 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-24 04:09:27.797350 | orchestrator | Friday 24 April 2026 04:09:19 +0000 (0:00:00.309) 0:00:08.254 ********** 2026-04-24 04:09:27.797367 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.797385 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:27.797404 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:27.797423 | orchestrator | 2026-04-24 04:09:27.797442 | orchestrator | TASK [Set test result to passed if all containers are running] ***************** 2026-04-24 04:09:27.797461 | orchestrator | Friday 24 April 2026 04:09:19 +0000 (0:00:00.293) 0:00:08.548 ********** 2026-04-24 04:09:27.797480 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.797499 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:27.797516 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:27.797535 | orchestrator | 2026-04-24 04:09:27.797553 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 04:09:27.797573 | orchestrator | Friday 24 April 2026 04:09:19 +0000 (0:00:00.515) 0:00:09.063 ********** 2026-04-24 04:09:27.797592 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.797612 | orchestrator | 2026-04-24 04:09:27.797630 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 04:09:27.797649 | orchestrator | Friday 24 April 2026 04:09:20 +0000 (0:00:00.267) 0:00:09.330 ********** 2026-04-24 04:09:27.797681 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.797700 | orchestrator | 2026-04-24 04:09:27.797719 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 04:09:27.797739 | orchestrator | Friday 24 April 2026 04:09:20 +0000 (0:00:00.313) 0:00:09.644 ********** 2026-04-24 04:09:27.797776 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.797794 | orchestrator | 2026-04-24 04:09:27.797813 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:09:27.797934 | orchestrator | Friday 24 April 2026 04:09:20 +0000 (0:00:00.254) 0:00:09.898 ********** 2026-04-24 04:09:27.797962 | orchestrator | 2026-04-24 04:09:27.797974 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:09:27.797985 | orchestrator | Friday 24 April 2026 04:09:20 +0000 (0:00:00.070) 0:00:09.968 ********** 2026-04-24 04:09:27.797995 | orchestrator | 2026-04-24 04:09:27.798007 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:09:27.798069 | orchestrator | Friday 24 April 2026 04:09:20 +0000 (0:00:00.075) 0:00:10.044 ********** 2026-04-24 04:09:27.798083 | orchestrator | 2026-04-24 04:09:27.798094 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 04:09:27.798105 | orchestrator | Friday 24 April 2026 04:09:21 +0000 (0:00:00.072) 0:00:10.116 ********** 2026-04-24 04:09:27.798116 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.798127 | orchestrator | 2026-04-24 04:09:27.798138 | orchestrator | TASK [Fail early due to containers not running] ******************************** 2026-04-24 04:09:27.798149 | orchestrator | Friday 24 April 2026 04:09:21 +0000 (0:00:00.253) 0:00:10.370 ********** 2026-04-24 04:09:27.798159 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.798170 | orchestrator | 2026-04-24 04:09:27.798180 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 04:09:27.798191 | orchestrator | Friday 24 April 2026 04:09:21 +0000 (0:00:00.250) 0:00:10.621 ********** 2026-04-24 04:09:27.798202 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.798221 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:27.798240 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:27.798257 | orchestrator | 2026-04-24 04:09:27.798276 | orchestrator | TASK [Set _mon_hostname fact] ************************************************** 2026-04-24 04:09:27.798295 | orchestrator | Friday 24 April 2026 04:09:21 +0000 (0:00:00.320) 0:00:10.941 ********** 2026-04-24 04:09:27.798314 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.798332 | orchestrator | 2026-04-24 04:09:27.798350 | orchestrator | TASK [Get ceph osd tree] ******************************************************* 2026-04-24 04:09:27.798369 | orchestrator | Friday 24 April 2026 04:09:22 +0000 (0:00:00.717) 0:00:11.659 ********** 2026-04-24 04:09:27.798388 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 04:09:27.798406 | orchestrator | 2026-04-24 04:09:27.798425 | orchestrator | TASK [Parse osd tree from JSON] ************************************************ 2026-04-24 04:09:27.798444 | orchestrator | Friday 24 April 2026 04:09:24 +0000 (0:00:01.674) 0:00:13.333 ********** 2026-04-24 04:09:27.798462 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.798479 | orchestrator | 2026-04-24 04:09:27.798495 | orchestrator | TASK [Get OSDs that are not up or in] ****************************************** 2026-04-24 04:09:27.798512 | orchestrator | Friday 24 April 2026 04:09:24 +0000 (0:00:00.182) 0:00:13.516 ********** 2026-04-24 04:09:27.798531 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.798550 | orchestrator | 2026-04-24 04:09:27.798566 | orchestrator | TASK [Fail test if OSDs are not up or in] ************************************** 2026-04-24 04:09:27.798585 | orchestrator | Friday 24 April 2026 04:09:24 +0000 (0:00:00.311) 0:00:13.827 ********** 2026-04-24 04:09:27.798605 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:27.798623 | orchestrator | 2026-04-24 04:09:27.798642 | orchestrator | TASK [Pass test if OSDs are all up and in] ************************************* 2026-04-24 04:09:27.798662 | orchestrator | Friday 24 April 2026 04:09:24 +0000 (0:00:00.144) 0:00:13.971 ********** 2026-04-24 04:09:27.798678 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.798689 | orchestrator | 2026-04-24 04:09:27.798700 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 04:09:27.798710 | orchestrator | Friday 24 April 2026 04:09:25 +0000 (0:00:00.154) 0:00:14.126 ********** 2026-04-24 04:09:27.798721 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:27.798748 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:27.798759 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:27.798769 | orchestrator | 2026-04-24 04:09:27.798780 | orchestrator | TASK [List ceph LVM volumes and collect data] ********************************** 2026-04-24 04:09:27.798791 | orchestrator | Friday 24 April 2026 04:09:25 +0000 (0:00:00.291) 0:00:14.417 ********** 2026-04-24 04:09:27.798801 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:09:27.798812 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:09:27.798822 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:09:38.972472 | orchestrator | 2026-04-24 04:09:38.972590 | orchestrator | TASK [Parse LVM data as JSON] ************************************************** 2026-04-24 04:09:38.972608 | orchestrator | Friday 24 April 2026 04:09:27 +0000 (0:00:02.431) 0:00:16.849 ********** 2026-04-24 04:09:38.972620 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:38.972632 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:38.972643 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:38.972654 | orchestrator | 2026-04-24 04:09:38.972665 | orchestrator | TASK [Get unencrypted and encrypted OSDs] ************************************** 2026-04-24 04:09:38.972676 | orchestrator | Friday 24 April 2026 04:09:28 +0000 (0:00:00.336) 0:00:17.185 ********** 2026-04-24 04:09:38.972687 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:38.972698 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:38.972709 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:38.972720 | orchestrator | 2026-04-24 04:09:38.972731 | orchestrator | TASK [Fail if count of encrypted OSDs does not match] ************************** 2026-04-24 04:09:38.972742 | orchestrator | Friday 24 April 2026 04:09:28 +0000 (0:00:00.609) 0:00:17.795 ********** 2026-04-24 04:09:38.972753 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:38.972765 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:38.972775 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:38.972786 | orchestrator | 2026-04-24 04:09:38.972797 | orchestrator | TASK [Pass if count of encrypted OSDs equals count of OSDs] ******************** 2026-04-24 04:09:38.972808 | orchestrator | Friday 24 April 2026 04:09:29 +0000 (0:00:00.328) 0:00:18.123 ********** 2026-04-24 04:09:38.972818 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:38.972829 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:38.972907 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:38.972918 | orchestrator | 2026-04-24 04:09:38.972929 | orchestrator | TASK [Fail if count of unencrypted OSDs does not match] ************************ 2026-04-24 04:09:38.972941 | orchestrator | Friday 24 April 2026 04:09:29 +0000 (0:00:00.586) 0:00:18.709 ********** 2026-04-24 04:09:38.972952 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:38.972962 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:38.972992 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:38.973004 | orchestrator | 2026-04-24 04:09:38.973015 | orchestrator | TASK [Pass if count of unencrypted OSDs equals count of OSDs] ****************** 2026-04-24 04:09:38.973026 | orchestrator | Friday 24 April 2026 04:09:29 +0000 (0:00:00.313) 0:00:19.023 ********** 2026-04-24 04:09:38.973037 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:38.973048 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:38.973059 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:38.973070 | orchestrator | 2026-04-24 04:09:38.973081 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 04:09:38.973092 | orchestrator | Friday 24 April 2026 04:09:30 +0000 (0:00:00.331) 0:00:19.354 ********** 2026-04-24 04:09:38.973102 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:38.973113 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:38.973124 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:38.973135 | orchestrator | 2026-04-24 04:09:38.973146 | orchestrator | TASK [Get CRUSH node data of each OSD host and root node childs] *************** 2026-04-24 04:09:38.973157 | orchestrator | Friday 24 April 2026 04:09:30 +0000 (0:00:00.532) 0:00:19.887 ********** 2026-04-24 04:09:38.973168 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:38.973178 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:38.973189 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:38.973218 | orchestrator | 2026-04-24 04:09:38.973230 | orchestrator | TASK [Calculate sub test expression results] *********************************** 2026-04-24 04:09:38.973241 | orchestrator | Friday 24 April 2026 04:09:31 +0000 (0:00:00.818) 0:00:20.705 ********** 2026-04-24 04:09:38.973252 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:38.973263 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:38.973273 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:38.973284 | orchestrator | 2026-04-24 04:09:38.973295 | orchestrator | TASK [Fail test if any sub test failed] **************************************** 2026-04-24 04:09:38.973306 | orchestrator | Friday 24 April 2026 04:09:31 +0000 (0:00:00.362) 0:00:21.068 ********** 2026-04-24 04:09:38.973316 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:38.973327 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:09:38.973338 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:09:38.973348 | orchestrator | 2026-04-24 04:09:38.973359 | orchestrator | TASK [Pass test if no sub test failed] ***************************************** 2026-04-24 04:09:38.973370 | orchestrator | Friday 24 April 2026 04:09:32 +0000 (0:00:00.323) 0:00:21.391 ********** 2026-04-24 04:09:38.973381 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:09:38.973393 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:09:38.973411 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:09:38.973430 | orchestrator | 2026-04-24 04:09:38.973447 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-24 04:09:38.973464 | orchestrator | Friday 24 April 2026 04:09:32 +0000 (0:00:00.516) 0:00:21.908 ********** 2026-04-24 04:09:38.973482 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 04:09:38.973502 | orchestrator | 2026-04-24 04:09:38.973519 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-24 04:09:38.973538 | orchestrator | Friday 24 April 2026 04:09:33 +0000 (0:00:00.297) 0:00:22.205 ********** 2026-04-24 04:09:38.973550 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:09:38.973561 | orchestrator | 2026-04-24 04:09:38.973572 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 04:09:38.973583 | orchestrator | Friday 24 April 2026 04:09:33 +0000 (0:00:00.278) 0:00:22.483 ********** 2026-04-24 04:09:38.973594 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 04:09:38.973605 | orchestrator | 2026-04-24 04:09:38.973616 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 04:09:38.973627 | orchestrator | Friday 24 April 2026 04:09:35 +0000 (0:00:01.816) 0:00:24.300 ********** 2026-04-24 04:09:38.973637 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 04:09:38.973648 | orchestrator | 2026-04-24 04:09:38.973659 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 04:09:38.973670 | orchestrator | Friday 24 April 2026 04:09:35 +0000 (0:00:00.269) 0:00:24.569 ********** 2026-04-24 04:09:38.973681 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 04:09:38.973692 | orchestrator | 2026-04-24 04:09:38.973725 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:09:38.973737 | orchestrator | Friday 24 April 2026 04:09:35 +0000 (0:00:00.288) 0:00:24.858 ********** 2026-04-24 04:09:38.973748 | orchestrator | 2026-04-24 04:09:38.973767 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:09:38.973785 | orchestrator | Friday 24 April 2026 04:09:35 +0000 (0:00:00.089) 0:00:24.948 ********** 2026-04-24 04:09:38.973803 | orchestrator | 2026-04-24 04:09:38.973820 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 04:09:38.973867 | orchestrator | Friday 24 April 2026 04:09:35 +0000 (0:00:00.071) 0:00:25.019 ********** 2026-04-24 04:09:38.973886 | orchestrator | 2026-04-24 04:09:38.973902 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-24 04:09:38.973919 | orchestrator | Friday 24 April 2026 04:09:36 +0000 (0:00:00.074) 0:00:25.093 ********** 2026-04-24 04:09:38.973939 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 04:09:38.973974 | orchestrator | 2026-04-24 04:09:38.973990 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 04:09:38.974007 | orchestrator | Friday 24 April 2026 04:09:37 +0000 (0:00:01.562) 0:00:26.656 ********** 2026-04-24 04:09:38.974092 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => { 2026-04-24 04:09:38.974109 | orchestrator |  "msg": [ 2026-04-24 04:09:38.974133 | orchestrator |  "Validator run completed.", 2026-04-24 04:09:38.974150 | orchestrator |  "You can find the report file here:", 2026-04-24 04:09:38.974167 | orchestrator |  "/opt/reports/validator/ceph-osds-validator-2026-04-24T04:09:12+00:00-report.json", 2026-04-24 04:09:38.974222 | orchestrator |  "on the following host:", 2026-04-24 04:09:38.974238 | orchestrator |  "testbed-manager" 2026-04-24 04:09:38.974254 | orchestrator |  ] 2026-04-24 04:09:38.974271 | orchestrator | } 2026-04-24 04:09:38.974288 | orchestrator | 2026-04-24 04:09:38.974305 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:09:38.974325 | orchestrator | testbed-node-3 : ok=35  changed=4  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 04:09:38.974344 | orchestrator | testbed-node-4 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 04:09:38.974364 | orchestrator | testbed-node-5 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 04:09:38.974384 | orchestrator | 2026-04-24 04:09:38.974401 | orchestrator | 2026-04-24 04:09:38.974418 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:09:38.974439 | orchestrator | Friday 24 April 2026 04:09:38 +0000 (0:00:01.034) 0:00:27.691 ********** 2026-04-24 04:09:38.974459 | orchestrator | =============================================================================== 2026-04-24 04:09:38.974480 | orchestrator | List ceph LVM volumes and collect data ---------------------------------- 2.43s 2026-04-24 04:09:38.974498 | orchestrator | Aggregate test results step one ----------------------------------------- 1.82s 2026-04-24 04:09:38.974518 | orchestrator | Get ceph osd tree ------------------------------------------------------- 1.67s 2026-04-24 04:09:38.974538 | orchestrator | Write report file ------------------------------------------------------- 1.56s 2026-04-24 04:09:38.974558 | orchestrator | Print report file information ------------------------------------------- 1.03s 2026-04-24 04:09:38.974576 | orchestrator | Calculate total number of OSDs in cluster ------------------------------- 0.95s 2026-04-24 04:09:38.974597 | orchestrator | Get timestamp for report file ------------------------------------------- 0.87s 2026-04-24 04:09:38.974615 | orchestrator | Get CRUSH node data of each OSD host and root node childs --------------- 0.82s 2026-04-24 04:09:38.974636 | orchestrator | Create report output directory ------------------------------------------ 0.75s 2026-04-24 04:09:38.974656 | orchestrator | Set _mon_hostname fact -------------------------------------------------- 0.72s 2026-04-24 04:09:38.974676 | orchestrator | Get unencrypted and encrypted OSDs -------------------------------------- 0.61s 2026-04-24 04:09:38.974694 | orchestrator | Set test result to failed when count of containers is wrong ------------- 0.59s 2026-04-24 04:09:38.974711 | orchestrator | Pass if count of encrypted OSDs equals count of OSDs -------------------- 0.59s 2026-04-24 04:09:38.974731 | orchestrator | Get list of ceph-osd containers on host --------------------------------- 0.54s 2026-04-24 04:09:38.974751 | orchestrator | Prepare test data ------------------------------------------------------- 0.53s 2026-04-24 04:09:38.974770 | orchestrator | Get count of ceph-osd containers that are not running ------------------- 0.52s 2026-04-24 04:09:38.974790 | orchestrator | Pass test if no sub test failed ----------------------------------------- 0.52s 2026-04-24 04:09:38.974811 | orchestrator | Set test result to passed if all containers are running ----------------- 0.52s 2026-04-24 04:09:38.974829 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 0.50s 2026-04-24 04:09:38.974888 | orchestrator | Calculate sub test expression results ----------------------------------- 0.36s 2026-04-24 04:09:39.325074 | orchestrator | + sh -c /opt/configuration/scripts/check/200-infrastructure.sh 2026-04-24 04:09:39.333114 | orchestrator | + set -e 2026-04-24 04:09:39.333182 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 04:09:39.333192 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 04:09:39.333200 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 04:09:39.333207 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 04:09:39.334060 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 04:09:39.334076 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 04:09:39.334084 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 04:09:39.334091 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 04:09:39.334098 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 04:09:39.334105 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 04:09:39.334111 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 04:09:39.334118 | orchestrator | ++ export ARA=false 2026-04-24 04:09:39.334125 | orchestrator | ++ ARA=false 2026-04-24 04:09:39.334132 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 04:09:39.334138 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 04:09:39.334144 | orchestrator | ++ export TEMPEST=false 2026-04-24 04:09:39.334151 | orchestrator | ++ TEMPEST=false 2026-04-24 04:09:39.334158 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 04:09:39.334164 | orchestrator | ++ IS_ZUUL=true 2026-04-24 04:09:39.334171 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:09:39.334178 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:09:39.334184 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 04:09:39.334190 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 04:09:39.334197 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 04:09:39.334203 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 04:09:39.334210 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 04:09:39.334217 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 04:09:39.334224 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 04:09:39.334230 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 04:09:39.334236 | orchestrator | + source /etc/os-release 2026-04-24 04:09:39.334243 | orchestrator | ++ PRETTY_NAME='Ubuntu 24.04.4 LTS' 2026-04-24 04:09:39.334249 | orchestrator | ++ NAME=Ubuntu 2026-04-24 04:09:39.334256 | orchestrator | ++ VERSION_ID=24.04 2026-04-24 04:09:39.334262 | orchestrator | ++ VERSION='24.04.4 LTS (Noble Numbat)' 2026-04-24 04:09:39.334269 | orchestrator | ++ VERSION_CODENAME=noble 2026-04-24 04:09:39.334275 | orchestrator | ++ ID=ubuntu 2026-04-24 04:09:39.334282 | orchestrator | ++ ID_LIKE=debian 2026-04-24 04:09:39.334288 | orchestrator | ++ HOME_URL=https://www.ubuntu.com/ 2026-04-24 04:09:39.334295 | orchestrator | ++ SUPPORT_URL=https://help.ubuntu.com/ 2026-04-24 04:09:39.334301 | orchestrator | ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 2026-04-24 04:09:39.334308 | orchestrator | ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 2026-04-24 04:09:39.334315 | orchestrator | ++ UBUNTU_CODENAME=noble 2026-04-24 04:09:39.334322 | orchestrator | ++ LOGO=ubuntu-logo 2026-04-24 04:09:39.334328 | orchestrator | + [[ ubuntu == \u\b\u\n\t\u ]] 2026-04-24 04:09:39.334351 | orchestrator | + packages='libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client' 2026-04-24 04:09:39.334358 | orchestrator | + dpkg -s libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-24 04:09:39.372052 | orchestrator | + sudo apt-get install -y libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-24 04:10:03.273077 | orchestrator | 2026-04-24 04:10:03.273234 | orchestrator | # Status of Elasticsearch 2026-04-24 04:10:03.273255 | orchestrator | 2026-04-24 04:10:03.273269 | orchestrator | + pushd /opt/configuration/contrib 2026-04-24 04:10:03.273281 | orchestrator | + echo 2026-04-24 04:10:03.273293 | orchestrator | + echo '# Status of Elasticsearch' 2026-04-24 04:10:03.273304 | orchestrator | + echo 2026-04-24 04:10:03.273315 | orchestrator | + bash nagios-plugins/check_elasticsearch -H api-int.testbed.osism.xyz -s 2026-04-24 04:10:03.434397 | orchestrator | OK - elasticsearch (kolla_logging) is running. status: green; timed_out: false; number_of_nodes: 3; number_of_data_nodes: 3; active_primary_shards: 9; active_shards: 22; relocating_shards: 0; initializing_shards: 0; delayed_unassigned_shards: 0; unassigned_shards: 0 | 'active_primary'=9 'active'=22 'relocating'=0 'init'=0 'delay_unass'=0 'unass'=0 2026-04-24 04:10:03.434538 | orchestrator | 2026-04-24 04:10:03.434569 | orchestrator | # Status of MariaDB 2026-04-24 04:10:03.434612 | orchestrator | 2026-04-24 04:10:03.434624 | orchestrator | + echo 2026-04-24 04:10:03.434636 | orchestrator | + echo '# Status of MariaDB' 2026-04-24 04:10:03.434653 | orchestrator | + echo 2026-04-24 04:10:03.435539 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-24 04:10:03.496198 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-24 04:10:03.496294 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-24 04:10:03.496309 | orchestrator | + MARIADB_USER=root_shard_0 2026-04-24 04:10:03.496322 | orchestrator | + bash nagios-plugins/check_galera_cluster -u root_shard_0 -p password -H api-int.testbed.osism.xyz -c 1 2026-04-24 04:10:03.571152 | orchestrator | Reading package lists... 2026-04-24 04:10:03.920723 | orchestrator | Building dependency tree... 2026-04-24 04:10:03.921097 | orchestrator | Reading state information... 2026-04-24 04:10:04.354498 | orchestrator | bc is already the newest version (1.07.1-3ubuntu4). 2026-04-24 04:10:04.354602 | orchestrator | bc set to manually installed. 2026-04-24 04:10:04.354619 | orchestrator | 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2026-04-24 04:10:05.025933 | orchestrator | OK: number of NODES = 3 (wsrep_cluster_size) 2026-04-24 04:10:05.026694 | orchestrator | 2026-04-24 04:10:05.026727 | orchestrator | # Status of Prometheus 2026-04-24 04:10:05.026742 | orchestrator | 2026-04-24 04:10:05.026755 | orchestrator | + echo 2026-04-24 04:10:05.026769 | orchestrator | + echo '# Status of Prometheus' 2026-04-24 04:10:05.026783 | orchestrator | + echo 2026-04-24 04:10:05.026796 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/healthy 2026-04-24 04:10:05.089821 | orchestrator | Unauthorized 2026-04-24 04:10:05.093135 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/ready 2026-04-24 04:10:05.159704 | orchestrator | Unauthorized 2026-04-24 04:10:05.162871 | orchestrator | 2026-04-24 04:10:05.162924 | orchestrator | # Status of RabbitMQ 2026-04-24 04:10:05.162945 | orchestrator | 2026-04-24 04:10:05.162961 | orchestrator | + echo 2026-04-24 04:10:05.162972 | orchestrator | + echo '# Status of RabbitMQ' 2026-04-24 04:10:05.162983 | orchestrator | + echo 2026-04-24 04:10:05.164184 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-24 04:10:05.228738 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-24 04:10:05.228806 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-24 04:10:05.228815 | orchestrator | + perl nagios-plugins/check_rabbitmq_cluster --ssl 1 -H api-int.testbed.osism.xyz -u openstack -p password 2026-04-24 04:10:05.727461 | orchestrator | RABBITMQ_CLUSTER OK - nb_running_node OK (3) nb_running_disc_node OK (3) nb_running_ram_node OK (0) 2026-04-24 04:10:05.737213 | orchestrator | 2026-04-24 04:10:05.737273 | orchestrator | # Status of Redis 2026-04-24 04:10:05.737285 | orchestrator | 2026-04-24 04:10:05.737294 | orchestrator | + echo 2026-04-24 04:10:05.737303 | orchestrator | + echo '# Status of Redis' 2026-04-24 04:10:05.737312 | orchestrator | + echo 2026-04-24 04:10:05.737321 | orchestrator | + /usr/lib/nagios/plugins/check_tcp -H 192.168.16.10 -p 6379 -A -E -s 'AUTH QHNA1SZRlOKzLADhUd5ZDgpHfQe6dNfr3bwEdY24\r\nPING\r\nINFO replication\r\nQUIT\r\n' -e PONG -e role:master -e slave0:ip=192.168.16.1 -e,port=6379 -j 2026-04-24 04:10:05.744657 | orchestrator | TCP OK - 0.002 second response time on 192.168.16.10 port 6379|time=0.002242s;;;0.000000;10.000000 2026-04-24 04:10:05.744712 | orchestrator | + popd 2026-04-24 04:10:05.745172 | orchestrator | 2026-04-24 04:10:05.745194 | orchestrator | # Create backup of MariaDB database 2026-04-24 04:10:05.745206 | orchestrator | 2026-04-24 04:10:05.745217 | orchestrator | + echo 2026-04-24 04:10:05.745229 | orchestrator | + echo '# Create backup of MariaDB database' 2026-04-24 04:10:05.745241 | orchestrator | + echo 2026-04-24 04:10:05.745252 | orchestrator | + osism apply mariadb_backup -e mariadb_backup_type=full 2026-04-24 04:10:07.511602 | orchestrator | 2026-04-24 04:10:07 | INFO  | Task fbcbcd10-d17f-4afe-a55b-35816b1c4315 (mariadb_backup) was prepared for execution. 2026-04-24 04:10:07.511686 | orchestrator | 2026-04-24 04:10:07 | INFO  | It takes a moment until task fbcbcd10-d17f-4afe-a55b-35816b1c4315 (mariadb_backup) has been started and output is visible here. 2026-04-24 04:11:11.524660 | orchestrator | 2026-04-24 04:11:11.524793 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:11:11.524810 | orchestrator | 2026-04-24 04:11:11.524822 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:11:11.524834 | orchestrator | Friday 24 April 2026 04:10:11 +0000 (0:00:00.192) 0:00:00.192 ********** 2026-04-24 04:11:11.524845 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:11:11.524887 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:11:11.524925 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:11:11.524936 | orchestrator | 2026-04-24 04:11:11.524947 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:11:11.524958 | orchestrator | Friday 24 April 2026 04:10:11 +0000 (0:00:00.316) 0:00:00.508 ********** 2026-04-24 04:11:11.524969 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-24 04:11:11.524980 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-24 04:11:11.524990 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-24 04:11:11.525001 | orchestrator | 2026-04-24 04:11:11.525011 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-24 04:11:11.525022 | orchestrator | 2026-04-24 04:11:11.525033 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-24 04:11:11.525044 | orchestrator | Friday 24 April 2026 04:10:12 +0000 (0:00:00.576) 0:00:01.084 ********** 2026-04-24 04:11:11.525054 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 04:11:11.525065 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 04:11:11.525076 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 04:11:11.525087 | orchestrator | 2026-04-24 04:11:11.525097 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 04:11:11.525108 | orchestrator | Friday 24 April 2026 04:10:12 +0000 (0:00:00.572) 0:00:01.657 ********** 2026-04-24 04:11:11.525134 | orchestrator | included: /ansible/roles/mariadb/tasks/backup.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:11:11.525146 | orchestrator | 2026-04-24 04:11:11.525157 | orchestrator | TASK [mariadb : Get MariaDB container facts] *********************************** 2026-04-24 04:11:11.525168 | orchestrator | Friday 24 April 2026 04:10:13 +0000 (0:00:00.540) 0:00:02.198 ********** 2026-04-24 04:11:11.525179 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:11:11.525191 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:11:11.525204 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:11:11.525215 | orchestrator | 2026-04-24 04:11:11.525227 | orchestrator | TASK [mariadb : Taking full database backup via Mariabackup] ******************* 2026-04-24 04:11:11.525240 | orchestrator | Friday 24 April 2026 04:10:16 +0000 (0:00:03.133) 0:00:05.332 ********** 2026-04-24 04:11:11.525253 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-24 04:11:11.525264 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-24 04:11:11.525278 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-24 04:11:11.525290 | orchestrator | mariadb_bootstrap_restart 2026-04-24 04:11:11.525303 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:11:11.525315 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:11:11.525327 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:11:11.525339 | orchestrator | 2026-04-24 04:11:11.525351 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-24 04:11:11.525363 | orchestrator | skipping: no hosts matched 2026-04-24 04:11:11.525375 | orchestrator | 2026-04-24 04:11:11.525387 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-24 04:11:11.525399 | orchestrator | skipping: no hosts matched 2026-04-24 04:11:11.525412 | orchestrator | 2026-04-24 04:11:11.525424 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-24 04:11:11.525436 | orchestrator | skipping: no hosts matched 2026-04-24 04:11:11.525449 | orchestrator | 2026-04-24 04:11:11.525461 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-24 04:11:11.525473 | orchestrator | 2026-04-24 04:11:11.525485 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-24 04:11:11.525497 | orchestrator | Friday 24 April 2026 04:11:10 +0000 (0:00:53.870) 0:00:59.202 ********** 2026-04-24 04:11:11.525509 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:11:11.525521 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:11:11.525534 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:11:11.525556 | orchestrator | 2026-04-24 04:11:11.525567 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-24 04:11:11.525578 | orchestrator | Friday 24 April 2026 04:11:10 +0000 (0:00:00.324) 0:00:59.527 ********** 2026-04-24 04:11:11.525588 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:11:11.525599 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:11:11.525610 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:11:11.525620 | orchestrator | 2026-04-24 04:11:11.525631 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:11:11.525643 | orchestrator | testbed-node-0 : ok=6  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:11:11.525655 | orchestrator | testbed-node-1 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 04:11:11.525666 | orchestrator | testbed-node-2 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 04:11:11.525677 | orchestrator | 2026-04-24 04:11:11.525687 | orchestrator | 2026-04-24 04:11:11.525698 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:11:11.525709 | orchestrator | Friday 24 April 2026 04:11:11 +0000 (0:00:00.416) 0:00:59.943 ********** 2026-04-24 04:11:11.525719 | orchestrator | =============================================================================== 2026-04-24 04:11:11.525730 | orchestrator | mariadb : Taking full database backup via Mariabackup ------------------ 53.87s 2026-04-24 04:11:11.525759 | orchestrator | mariadb : Get MariaDB container facts ----------------------------------- 3.13s 2026-04-24 04:11:11.525770 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.58s 2026-04-24 04:11:11.525781 | orchestrator | mariadb : Group MariaDB hosts based on shards --------------------------- 0.57s 2026-04-24 04:11:11.525792 | orchestrator | mariadb : include_tasks ------------------------------------------------- 0.54s 2026-04-24 04:11:11.525803 | orchestrator | Include mariadb post-upgrade.yml ---------------------------------------- 0.42s 2026-04-24 04:11:11.525814 | orchestrator | Include mariadb post-deploy.yml ----------------------------------------- 0.32s 2026-04-24 04:11:11.525824 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.32s 2026-04-24 04:11:11.849989 | orchestrator | + sh -c /opt/configuration/scripts/check/300-openstack.sh 2026-04-24 04:11:11.857369 | orchestrator | + set -e 2026-04-24 04:11:11.857439 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 04:11:11.858299 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 04:11:11.858331 | orchestrator | ++ INTERACTIVE=false 2026-04-24 04:11:11.858350 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 04:11:11.858367 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 04:11:11.858387 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 04:11:11.860592 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 04:11:11.866742 | orchestrator | 2026-04-24 04:11:11.866798 | orchestrator | # OpenStack endpoints 2026-04-24 04:11:11.866811 | orchestrator | 2026-04-24 04:11:11.866823 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 04:11:11.866834 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 04:11:11.866845 | orchestrator | + export OS_CLOUD=admin 2026-04-24 04:11:11.866884 | orchestrator | + OS_CLOUD=admin 2026-04-24 04:11:11.866895 | orchestrator | + echo 2026-04-24 04:11:11.866907 | orchestrator | + echo '# OpenStack endpoints' 2026-04-24 04:11:11.866918 | orchestrator | + echo 2026-04-24 04:11:11.866929 | orchestrator | + openstack endpoint list 2026-04-24 04:11:14.920348 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-24 04:11:14.920446 | orchestrator | | ID | Region | Service Name | Service Type | Enabled | Interface | URL | 2026-04-24 04:11:14.920460 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-24 04:11:14.920496 | orchestrator | | 0488740c03ac4485be3063afa0835ce6 | RegionOne | neutron | network | True | internal | https://api-int.testbed.osism.xyz:9696 | 2026-04-24 04:11:14.920506 | orchestrator | | 059b89c7bbab4b96b15d61763b278903 | RegionOne | nova | compute | True | internal | https://api-int.testbed.osism.xyz:8774/v2.1 | 2026-04-24 04:11:14.920515 | orchestrator | | 0a59d05fb4ea4638b7351e9cfa409bb4 | RegionOne | neutron | network | True | public | https://api.testbed.osism.xyz:9696 | 2026-04-24 04:11:14.920523 | orchestrator | | 1a8db2cfe1234ddf8843f3dae79fcd75 | RegionOne | barbican | key-manager | True | internal | https://api-int.testbed.osism.xyz:9311 | 2026-04-24 04:11:14.920532 | orchestrator | | 203dc339e24847edaf9208c5e99af84c | RegionOne | swift | object-store | True | public | https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-24 04:11:14.920540 | orchestrator | | 20aefd688048416faf483420ac257303 | RegionOne | manilav2 | sharev2 | True | internal | https://api-int.testbed.osism.xyz:8786/v2 | 2026-04-24 04:11:14.920550 | orchestrator | | 21a9eb54cece4b1dbbd4e7e3ca0db457 | RegionOne | glance | image | True | public | https://api.testbed.osism.xyz:9292 | 2026-04-24 04:11:14.920559 | orchestrator | | 225ff6fda47742859338c0ffe3c3c464 | RegionOne | manilav2 | sharev2 | True | public | https://api.testbed.osism.xyz:8786/v2 | 2026-04-24 04:11:14.920568 | orchestrator | | 2684d32070c1409993136e80f54274f1 | RegionOne | manila | share | True | internal | https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-24 04:11:14.920576 | orchestrator | | 2732c94c68a645ed944156a10f89c15a | RegionOne | skyline | panel | True | public | https://api.testbed.osism.xyz:9998 | 2026-04-24 04:11:14.920601 | orchestrator | | 3620a5ee47ca452d8b3066760469be71 | RegionOne | barbican | key-manager | True | public | https://api.testbed.osism.xyz:9311 | 2026-04-24 04:11:14.920610 | orchestrator | | 36548f7c139b44acac1b27f43a779d87 | RegionOne | placement | placement | True | public | https://api.testbed.osism.xyz:8780 | 2026-04-24 04:11:14.920618 | orchestrator | | 3a843f62c7984dc69f5f4fc7091804ba | RegionOne | designate | dns | True | public | https://api.testbed.osism.xyz:9001 | 2026-04-24 04:11:14.920627 | orchestrator | | 416af38802c54605b2bcb4d9b9a7d2fd | RegionOne | keystone | identity | True | internal | https://api-int.testbed.osism.xyz:5000 | 2026-04-24 04:11:14.920636 | orchestrator | | 42291067b2214877a6df693b7e3b2cc5 | RegionOne | aodh | alarming | True | internal | https://api-int.testbed.osism.xyz:8042 | 2026-04-24 04:11:14.920645 | orchestrator | | 434431f5cda841e29d4eee15d7cc5fba | RegionOne | skyline | panel | True | internal | https://api-int.testbed.osism.xyz:9998 | 2026-04-24 04:11:14.920653 | orchestrator | | 50c8bf9cafd043cd8cb622dab2757f2f | RegionOne | aodh | alarming | True | public | https://api.testbed.osism.xyz:8042 | 2026-04-24 04:11:14.920662 | orchestrator | | 5d87b164c1c94b288cdb14a528038cb9 | RegionOne | octavia | load-balancer | True | internal | https://api-int.testbed.osism.xyz:9876 | 2026-04-24 04:11:14.920671 | orchestrator | | 5dd6fe17b0e14c59905cf4a2a2ab79a1 | RegionOne | magnum | container-infra | True | public | https://api.testbed.osism.xyz:9511/v1 | 2026-04-24 04:11:14.920679 | orchestrator | | 5df38fb6815b436ba7f9c31a770d5cef | RegionOne | magnum | container-infra | True | internal | https://api-int.testbed.osism.xyz:9511/v1 | 2026-04-24 04:11:14.920709 | orchestrator | | 61708d2ad8354b8fb594f518150cdec0 | RegionOne | designate | dns | True | internal | https://api-int.testbed.osism.xyz:9001 | 2026-04-24 04:11:14.920723 | orchestrator | | 6aeb6f63d6534a2d8ffaeb5f178b7a48 | RegionOne | glance | image | True | internal | https://api-int.testbed.osism.xyz:9292 | 2026-04-24 04:11:14.920732 | orchestrator | | 70fe650f88044a148f6448d9e47d6b9b | RegionOne | cinderv3 | volumev3 | True | public | https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-24 04:11:14.920741 | orchestrator | | 8a54348f528243c7afb44e6ef498fcb6 | RegionOne | placement | placement | True | internal | https://api-int.testbed.osism.xyz:8780 | 2026-04-24 04:11:14.920749 | orchestrator | | a1ebcb58fca948e88fcc22ddf7a0e3b5 | RegionOne | swift | object-store | True | internal | https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-24 04:11:14.920758 | orchestrator | | ab0a2bdf69824acd82dfd009d8fd7a44 | RegionOne | keystone | identity | True | public | https://api.testbed.osism.xyz:5000 | 2026-04-24 04:11:14.920767 | orchestrator | | d27580cea43646a1a8399ded44b990d8 | RegionOne | manila | share | True | public | https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-24 04:11:14.920775 | orchestrator | | d7befd2e02504faa8d36efad8cc1cbd1 | RegionOne | octavia | load-balancer | True | public | https://api.testbed.osism.xyz:9876 | 2026-04-24 04:11:14.920784 | orchestrator | | df34ac1163704b4b8e0289b7a849979c | RegionOne | nova | compute | True | public | https://api.testbed.osism.xyz:8774/v2.1 | 2026-04-24 04:11:14.920792 | orchestrator | | e965d1cb2ddc49e9bc0bbab6d506c70e | RegionOne | cinderv3 | volumev3 | True | internal | https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-24 04:11:14.920801 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-24 04:11:15.168155 | orchestrator | 2026-04-24 04:11:15.168252 | orchestrator | # Cinder 2026-04-24 04:11:15.168268 | orchestrator | 2026-04-24 04:11:15.168279 | orchestrator | + echo 2026-04-24 04:11:15.168290 | orchestrator | + echo '# Cinder' 2026-04-24 04:11:15.168302 | orchestrator | + echo 2026-04-24 04:11:15.168313 | orchestrator | + openstack volume service list 2026-04-24 04:11:17.731480 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-24 04:11:17.731570 | orchestrator | | Binary | Host | Zone | Status | State | Updated At | 2026-04-24 04:11:17.731578 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-24 04:11:17.731585 | orchestrator | | cinder-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-24T04:11:08.000000 | 2026-04-24 04:11:17.731592 | orchestrator | | cinder-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-24T04:11:08.000000 | 2026-04-24 04:11:17.731599 | orchestrator | | cinder-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-24T04:11:08.000000 | 2026-04-24 04:11:17.731605 | orchestrator | | cinder-volume | testbed-node-0@rbd-volumes | nova | enabled | up | 2026-04-24T04:11:07.000000 | 2026-04-24 04:11:17.731611 | orchestrator | | cinder-volume | testbed-node-2@rbd-volumes | nova | enabled | up | 2026-04-24T04:11:13.000000 | 2026-04-24 04:11:17.731618 | orchestrator | | cinder-volume | testbed-node-1@rbd-volumes | nova | enabled | up | 2026-04-24T04:11:14.000000 | 2026-04-24 04:11:17.731624 | orchestrator | | cinder-backup | testbed-node-0 | nova | enabled | up | 2026-04-24T04:11:10.000000 | 2026-04-24 04:11:17.731630 | orchestrator | | cinder-backup | testbed-node-1 | nova | enabled | up | 2026-04-24T04:11:13.000000 | 2026-04-24 04:11:17.731637 | orchestrator | | cinder-backup | testbed-node-2 | nova | enabled | up | 2026-04-24T04:11:13.000000 | 2026-04-24 04:11:17.731668 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-24 04:11:17.975537 | orchestrator | 2026-04-24 04:11:17.975613 | orchestrator | # Neutron 2026-04-24 04:11:17.975627 | orchestrator | 2026-04-24 04:11:17.975635 | orchestrator | + echo 2026-04-24 04:11:17.975643 | orchestrator | + echo '# Neutron' 2026-04-24 04:11:17.975652 | orchestrator | + echo 2026-04-24 04:11:17.975660 | orchestrator | + openstack network agent list 2026-04-24 04:11:20.556153 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-24 04:11:20.556259 | orchestrator | | ID | Agent Type | Host | Availability Zone | Alive | State | Binary | 2026-04-24 04:11:20.556274 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-24 04:11:20.556287 | orchestrator | | testbed-node-1 | OVN Controller Gateway agent | testbed-node-1 | nova | :-) | UP | ovn-controller | 2026-04-24 04:11:20.556298 | orchestrator | | testbed-node-2 | OVN Controller Gateway agent | testbed-node-2 | nova | :-) | UP | ovn-controller | 2026-04-24 04:11:20.556331 | orchestrator | | testbed-node-5 | OVN Controller agent | testbed-node-5 | | :-) | UP | ovn-controller | 2026-04-24 04:11:20.556389 | orchestrator | | testbed-node-3 | OVN Controller agent | testbed-node-3 | | :-) | UP | ovn-controller | 2026-04-24 04:11:20.556410 | orchestrator | | testbed-node-0 | OVN Controller Gateway agent | testbed-node-0 | nova | :-) | UP | ovn-controller | 2026-04-24 04:11:20.556429 | orchestrator | | testbed-node-4 | OVN Controller agent | testbed-node-4 | | :-) | UP | ovn-controller | 2026-04-24 04:11:20.556448 | orchestrator | | 36b9d21c-9928-5c0a-9b27-73ac7a3e770c | OVN Metadata agent | testbed-node-5 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-24 04:11:20.556468 | orchestrator | | e645415a-98f5-5758-8cd1-c47af282b5c0 | OVN Metadata agent | testbed-node-3 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-24 04:11:20.556488 | orchestrator | | 4939696e-6092-5a33-bb73-b850064684df | OVN Metadata agent | testbed-node-4 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-24 04:11:20.556508 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-24 04:11:20.833265 | orchestrator | + openstack network service provider list 2026-04-24 04:11:23.375118 | orchestrator | +---------------+------+---------+ 2026-04-24 04:11:23.375249 | orchestrator | | Service Type | Name | Default | 2026-04-24 04:11:23.375269 | orchestrator | +---------------+------+---------+ 2026-04-24 04:11:23.375281 | orchestrator | | L3_ROUTER_NAT | ovn | True | 2026-04-24 04:11:23.375292 | orchestrator | +---------------+------+---------+ 2026-04-24 04:11:23.648349 | orchestrator | 2026-04-24 04:11:23.648445 | orchestrator | # Nova 2026-04-24 04:11:23.648460 | orchestrator | 2026-04-24 04:11:23.648472 | orchestrator | + echo 2026-04-24 04:11:23.648483 | orchestrator | + echo '# Nova' 2026-04-24 04:11:23.648494 | orchestrator | + echo 2026-04-24 04:11:23.648505 | orchestrator | + openstack compute service list 2026-04-24 04:11:26.233546 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-24 04:11:26.233658 | orchestrator | | ID | Binary | Host | Zone | Status | State | Updated At | 2026-04-24 04:11:26.233674 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-24 04:11:26.233686 | orchestrator | | e9e18870-3f37-4faa-83aa-edcebbc892ad | nova-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-24T04:11:23.000000 | 2026-04-24 04:11:26.233729 | orchestrator | | afbb5932-9f2f-46d0-ad45-b79501604e5a | nova-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-24T04:11:17.000000 | 2026-04-24 04:11:26.233741 | orchestrator | | e8d21d5f-bb00-4c60-bb7f-3857a1fb3a80 | nova-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-24T04:11:17.000000 | 2026-04-24 04:11:26.233753 | orchestrator | | 399e938c-cbb3-407a-8dee-ff3c93ea37c6 | nova-conductor | testbed-node-0 | internal | enabled | up | 2026-04-24T04:11:24.000000 | 2026-04-24 04:11:26.233764 | orchestrator | | ed078005-f8bf-4eb0-9e72-567d4cf4e3ae | nova-conductor | testbed-node-1 | internal | enabled | up | 2026-04-24T04:11:25.000000 | 2026-04-24 04:11:26.233775 | orchestrator | | 9fef3259-aa5a-468e-bf56-a80697c99b61 | nova-conductor | testbed-node-2 | internal | enabled | up | 2026-04-24T04:11:25.000000 | 2026-04-24 04:11:26.233785 | orchestrator | | 15149229-cd40-4c98-9332-18cee7229971 | nova-compute | testbed-node-3 | nova | enabled | up | 2026-04-24T04:11:24.000000 | 2026-04-24 04:11:26.233796 | orchestrator | | 3f48bb21-4298-4a42-b4b4-e9c16ed49b0a | nova-compute | testbed-node-5 | nova | enabled | up | 2026-04-24T04:11:25.000000 | 2026-04-24 04:11:26.233806 | orchestrator | | 5de0a6b5-d622-485e-a8e9-ebc9c0f678e9 | nova-compute | testbed-node-4 | nova | enabled | up | 2026-04-24T04:11:25.000000 | 2026-04-24 04:11:26.233817 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-24 04:11:26.502079 | orchestrator | + openstack hypervisor list 2026-04-24 04:11:29.176094 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-24 04:11:29.176188 | orchestrator | | ID | Hypervisor Hostname | Hypervisor Type | Host IP | State | 2026-04-24 04:11:29.176200 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-24 04:11:29.176211 | orchestrator | | 5f3c14b2-26b7-49e9-9281-8a7cb4163b5b | testbed-node-3 | QEMU | 192.168.16.13 | up | 2026-04-24 04:11:29.176220 | orchestrator | | d04f7abf-2d4c-4c2c-869d-62a5459c1287 | testbed-node-5 | QEMU | 192.168.16.15 | up | 2026-04-24 04:11:29.176236 | orchestrator | | 38ab19bd-ec59-43f5-a8a1-db353dc53241 | testbed-node-4 | QEMU | 192.168.16.14 | up | 2026-04-24 04:11:29.176245 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-24 04:11:29.498506 | orchestrator | 2026-04-24 04:11:29.498610 | orchestrator | # Run OpenStack test play 2026-04-24 04:11:29.498626 | orchestrator | 2026-04-24 04:11:29.498639 | orchestrator | + echo 2026-04-24 04:11:29.498651 | orchestrator | + echo '# Run OpenStack test play' 2026-04-24 04:11:29.498668 | orchestrator | + echo 2026-04-24 04:11:29.498679 | orchestrator | + osism apply --environment openstack test 2026-04-24 04:11:31.508800 | orchestrator | 2026-04-24 04:11:31 | INFO  | Trying to run play test in environment openstack 2026-04-24 04:11:41.723206 | orchestrator | 2026-04-24 04:11:41 | INFO  | Task 5b9d10a6-9f28-443d-bdbe-1537a5914d4f (test) was prepared for execution. 2026-04-24 04:11:41.723333 | orchestrator | 2026-04-24 04:11:41 | INFO  | It takes a moment until task 5b9d10a6-9f28-443d-bdbe-1537a5914d4f (test) has been started and output is visible here. 2026-04-24 04:14:54.069646 | orchestrator | 2026-04-24 04:14:54.069752 | orchestrator | PLAY [Create test project] ***************************************************** 2026-04-24 04:14:54.069766 | orchestrator | 2026-04-24 04:14:54.069777 | orchestrator | TASK [Create test domain] ****************************************************** 2026-04-24 04:14:54.069788 | orchestrator | Friday 24 April 2026 04:11:45 +0000 (0:00:00.069) 0:00:00.069 ********** 2026-04-24 04:14:54.069798 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.069809 | orchestrator | 2026-04-24 04:14:54.069819 | orchestrator | TASK [Create test-admin user] ************************************************** 2026-04-24 04:14:54.069828 | orchestrator | Friday 24 April 2026 04:11:49 +0000 (0:00:03.640) 0:00:03.710 ********** 2026-04-24 04:14:54.069915 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.069926 | orchestrator | 2026-04-24 04:14:54.069936 | orchestrator | TASK [Add manager role to user test-admin] ************************************* 2026-04-24 04:14:54.069946 | orchestrator | Friday 24 April 2026 04:11:53 +0000 (0:00:04.069) 0:00:07.779 ********** 2026-04-24 04:14:54.069956 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.069976 | orchestrator | 2026-04-24 04:14:54.069986 | orchestrator | TASK [Create test project] ***************************************************** 2026-04-24 04:14:54.069996 | orchestrator | Friday 24 April 2026 04:12:00 +0000 (0:00:06.626) 0:00:14.406 ********** 2026-04-24 04:14:54.070005 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.070067 | orchestrator | 2026-04-24 04:14:54.070079 | orchestrator | TASK [Create test user] ******************************************************** 2026-04-24 04:14:54.070089 | orchestrator | Friday 24 April 2026 04:12:04 +0000 (0:00:04.337) 0:00:18.744 ********** 2026-04-24 04:14:54.070098 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.070108 | orchestrator | 2026-04-24 04:14:54.070118 | orchestrator | TASK [Add member roles to user test] ******************************************* 2026-04-24 04:14:54.070127 | orchestrator | Friday 24 April 2026 04:12:08 +0000 (0:00:04.134) 0:00:22.878 ********** 2026-04-24 04:14:54.070137 | orchestrator | changed: [localhost] => (item=load-balancer_member) 2026-04-24 04:14:54.070147 | orchestrator | changed: [localhost] => (item=member) 2026-04-24 04:14:54.070158 | orchestrator | changed: [localhost] => (item=creator) 2026-04-24 04:14:54.070168 | orchestrator | 2026-04-24 04:14:54.070178 | orchestrator | TASK [Create test server group] ************************************************ 2026-04-24 04:14:54.070190 | orchestrator | Friday 24 April 2026 04:12:20 +0000 (0:00:11.310) 0:00:34.189 ********** 2026-04-24 04:14:54.070201 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.070212 | orchestrator | 2026-04-24 04:14:54.070223 | orchestrator | TASK [Create ssh security group] *********************************************** 2026-04-24 04:14:54.070235 | orchestrator | Friday 24 April 2026 04:12:24 +0000 (0:00:04.215) 0:00:38.405 ********** 2026-04-24 04:14:54.070246 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.070257 | orchestrator | 2026-04-24 04:14:54.070268 | orchestrator | TASK [Add rule to ssh security group] ****************************************** 2026-04-24 04:14:54.070279 | orchestrator | Friday 24 April 2026 04:12:28 +0000 (0:00:04.719) 0:00:43.124 ********** 2026-04-24 04:14:54.070290 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.070301 | orchestrator | 2026-04-24 04:14:54.070311 | orchestrator | TASK [Create icmp security group] ********************************************** 2026-04-24 04:14:54.070321 | orchestrator | Friday 24 April 2026 04:12:33 +0000 (0:00:04.225) 0:00:47.350 ********** 2026-04-24 04:14:54.070330 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.070340 | orchestrator | 2026-04-24 04:14:54.070349 | orchestrator | TASK [Add rule to icmp security group] ***************************************** 2026-04-24 04:14:54.070359 | orchestrator | Friday 24 April 2026 04:12:37 +0000 (0:00:04.308) 0:00:51.659 ********** 2026-04-24 04:14:54.070368 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.070378 | orchestrator | 2026-04-24 04:14:54.070388 | orchestrator | TASK [Create test keypair] ***************************************************** 2026-04-24 04:14:54.070397 | orchestrator | Friday 24 April 2026 04:12:41 +0000 (0:00:03.988) 0:00:55.647 ********** 2026-04-24 04:14:54.070411 | orchestrator | changed: [localhost] 2026-04-24 04:14:54.070426 | orchestrator | 2026-04-24 04:14:54.070435 | orchestrator | TASK [Create test networks] **************************************************** 2026-04-24 04:14:54.070445 | orchestrator | Friday 24 April 2026 04:12:45 +0000 (0:00:03.823) 0:00:59.470 ********** 2026-04-24 04:14:54.070454 | orchestrator | changed: [localhost] => (item={'name': 'test-1'}) 2026-04-24 04:14:54.070464 | orchestrator | changed: [localhost] => (item={'name': 'test-2'}) 2026-04-24 04:14:54.070473 | orchestrator | changed: [localhost] => (item={'name': 'test-3'}) 2026-04-24 04:14:54.070483 | orchestrator | 2026-04-24 04:14:54.070494 | orchestrator | TASK [Create test subnets] ***************************************************** 2026-04-24 04:14:54.070503 | orchestrator | Friday 24 April 2026 04:12:58 +0000 (0:00:13.345) 0:01:12.816 ********** 2026-04-24 04:14:54.070522 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'subnet': 'subnet-test-1', 'cidr': '192.168.200.0/24'}) 2026-04-24 04:14:54.070532 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'subnet': 'subnet-test-2', 'cidr': '192.168.201.0/24'}) 2026-04-24 04:14:54.070541 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'subnet': 'subnet-test-3', 'cidr': '192.168.202.0/24'}) 2026-04-24 04:14:54.070551 | orchestrator | 2026-04-24 04:14:54.070561 | orchestrator | TASK [Create test routers] ***************************************************** 2026-04-24 04:14:54.070570 | orchestrator | Friday 24 April 2026 04:13:13 +0000 (0:00:15.355) 0:01:28.171 ********** 2026-04-24 04:14:54.070580 | orchestrator | changed: [localhost] => (item={'router': 'router-test-1', 'subnet': 'subnet-test-1'}) 2026-04-24 04:14:54.070589 | orchestrator | changed: [localhost] => (item={'router': 'router-test-2', 'subnet': 'subnet-test-2'}) 2026-04-24 04:14:54.070613 | orchestrator | changed: [localhost] => (item={'router': 'router-test-3', 'subnet': 'subnet-test-3'}) 2026-04-24 04:14:54.070623 | orchestrator | 2026-04-24 04:14:54.070633 | orchestrator | PLAY [Manage test instances and volumes] *************************************** 2026-04-24 04:14:54.070642 | orchestrator | 2026-04-24 04:14:54.070652 | orchestrator | TASK [Get test server group] *************************************************** 2026-04-24 04:14:54.070683 | orchestrator | Friday 24 April 2026 04:13:43 +0000 (0:00:29.452) 0:01:57.624 ********** 2026-04-24 04:14:54.070701 | orchestrator | ok: [localhost] 2026-04-24 04:14:54.070712 | orchestrator | 2026-04-24 04:14:54.070722 | orchestrator | TASK [Detach test volume] ****************************************************** 2026-04-24 04:14:54.070731 | orchestrator | Friday 24 April 2026 04:13:46 +0000 (0:00:03.466) 0:02:01.090 ********** 2026-04-24 04:14:54.070741 | orchestrator | skipping: [localhost] 2026-04-24 04:14:54.070751 | orchestrator | 2026-04-24 04:14:54.070760 | orchestrator | TASK [Delete test volume] ****************************************************** 2026-04-24 04:14:54.070770 | orchestrator | Friday 24 April 2026 04:13:46 +0000 (0:00:00.061) 0:02:01.152 ********** 2026-04-24 04:14:54.070779 | orchestrator | skipping: [localhost] 2026-04-24 04:14:54.070789 | orchestrator | 2026-04-24 04:14:54.070798 | orchestrator | TASK [Delete test instances] *************************************************** 2026-04-24 04:14:54.070808 | orchestrator | Friday 24 April 2026 04:13:47 +0000 (0:00:00.059) 0:02:01.212 ********** 2026-04-24 04:14:54.070817 | orchestrator | skipping: [localhost] => (item={'name': 'test-4', 'network': 'test-3'})  2026-04-24 04:14:54.070827 | orchestrator | skipping: [localhost] => (item={'name': 'test-3', 'network': 'test-2'})  2026-04-24 04:14:54.070859 | orchestrator | skipping: [localhost] => (item={'name': 'test-2', 'network': 'test-2'})  2026-04-24 04:14:54.070869 | orchestrator | skipping: [localhost] => (item={'name': 'test-1', 'network': 'test-1'})  2026-04-24 04:14:54.070879 | orchestrator | skipping: [localhost] => (item={'name': 'test', 'network': 'test-1'})  2026-04-24 04:14:54.070888 | orchestrator | skipping: [localhost] 2026-04-24 04:14:54.070898 | orchestrator | 2026-04-24 04:14:54.070907 | orchestrator | TASK [Wait for instance deletion to complete] ********************************** 2026-04-24 04:14:54.070917 | orchestrator | Friday 24 April 2026 04:13:47 +0000 (0:00:00.177) 0:02:01.389 ********** 2026-04-24 04:14:54.070927 | orchestrator | skipping: [localhost] 2026-04-24 04:14:54.070936 | orchestrator | 2026-04-24 04:14:54.070946 | orchestrator | TASK [Create test instances] *************************************************** 2026-04-24 04:14:54.070955 | orchestrator | Friday 24 April 2026 04:13:47 +0000 (0:00:00.145) 0:02:01.535 ********** 2026-04-24 04:14:54.070965 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-24 04:14:54.070975 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-24 04:14:54.070984 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-24 04:14:54.070994 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-24 04:14:54.071003 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-24 04:14:54.071020 | orchestrator | 2026-04-24 04:14:54.071030 | orchestrator | TASK [Wait for instance creation to complete] ********************************** 2026-04-24 04:14:54.071039 | orchestrator | Friday 24 April 2026 04:13:52 +0000 (0:00:04.661) 0:02:06.197 ********** 2026-04-24 04:14:54.071049 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (60 retries left). 2026-04-24 04:14:54.071060 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (59 retries left). 2026-04-24 04:14:54.071069 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (58 retries left). 2026-04-24 04:14:54.071079 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (57 retries left). 2026-04-24 04:14:54.071091 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j841166078833.3739', 'results_file': '/ansible/.ansible_async/j841166078833.3739', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:14:54.071104 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j347263186206.3764', 'results_file': '/ansible/.ansible_async/j347263186206.3764', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:14:54.071114 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j423982790973.3789', 'results_file': '/ansible/.ansible_async/j423982790973.3789', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:14:54.071124 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (60 retries left). 2026-04-24 04:14:54.071134 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j396303755287.3814', 'results_file': '/ansible/.ansible_async/j396303755287.3814', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:14:54.071144 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j968187686182.3839', 'results_file': '/ansible/.ansible_async/j968187686182.3839', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:14:54.071154 | orchestrator | 2026-04-24 04:14:54.071164 | orchestrator | TASK [Add metadata to instances] *********************************************** 2026-04-24 04:14:54.071174 | orchestrator | Friday 24 April 2026 04:14:49 +0000 (0:00:57.509) 0:03:03.706 ********** 2026-04-24 04:14:54.071190 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-24 04:16:01.758906 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-24 04:16:01.759027 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-24 04:16:01.759044 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-24 04:16:01.759056 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-24 04:16:01.759068 | orchestrator | 2026-04-24 04:16:01.759080 | orchestrator | TASK [Wait for metadata to be added] ******************************************* 2026-04-24 04:16:01.759092 | orchestrator | Friday 24 April 2026 04:14:54 +0000 (0:00:04.531) 0:03:08.238 ********** 2026-04-24 04:16:01.759103 | orchestrator | FAILED - RETRYING: [localhost]: Wait for metadata to be added (30 retries left). 2026-04-24 04:16:01.759118 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j468531205444.3950', 'results_file': '/ansible/.ansible_async/j468531205444.3950', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759131 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j315936229378.3975', 'results_file': '/ansible/.ansible_async/j315936229378.3975', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759165 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j888574378631.4000', 'results_file': '/ansible/.ansible_async/j888574378631.4000', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759178 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j874202417908.4025', 'results_file': '/ansible/.ansible_async/j874202417908.4025', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759206 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j812021474745.4050', 'results_file': '/ansible/.ansible_async/j812021474745.4050', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759218 | orchestrator | 2026-04-24 04:16:01.759229 | orchestrator | TASK [Add tag to instances] **************************************************** 2026-04-24 04:16:01.759240 | orchestrator | Friday 24 April 2026 04:15:03 +0000 (0:00:09.291) 0:03:17.529 ********** 2026-04-24 04:16:01.759251 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-24 04:16:01.759262 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-24 04:16:01.759273 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-24 04:16:01.759283 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-24 04:16:01.759294 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-24 04:16:01.759306 | orchestrator | 2026-04-24 04:16:01.759317 | orchestrator | TASK [Wait for tags to be added] *********************************************** 2026-04-24 04:16:01.759328 | orchestrator | Friday 24 April 2026 04:15:07 +0000 (0:00:04.513) 0:03:22.043 ********** 2026-04-24 04:16:01.759338 | orchestrator | FAILED - RETRYING: [localhost]: Wait for tags to be added (30 retries left). 2026-04-24 04:16:01.759350 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j562533098364.4126', 'results_file': '/ansible/.ansible_async/j562533098364.4126', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759361 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j766691547007.4151', 'results_file': '/ansible/.ansible_async/j766691547007.4151', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759374 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j410382716491.4177', 'results_file': '/ansible/.ansible_async/j410382716491.4177', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759395 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j107964686575.4203', 'results_file': '/ansible/.ansible_async/j107964686575.4203', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759427 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j189037976399.4229', 'results_file': '/ansible/.ansible_async/j189037976399.4229', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-24 04:16:01.759440 | orchestrator | 2026-04-24 04:16:01.759453 | orchestrator | TASK [Create test volume] ****************************************************** 2026-04-24 04:16:01.759466 | orchestrator | Friday 24 April 2026 04:15:17 +0000 (0:00:09.630) 0:03:31.673 ********** 2026-04-24 04:16:01.759488 | orchestrator | changed: [localhost] 2026-04-24 04:16:01.759502 | orchestrator | 2026-04-24 04:16:01.759515 | orchestrator | TASK [Attach test volume] ****************************************************** 2026-04-24 04:16:01.759528 | orchestrator | Friday 24 April 2026 04:15:23 +0000 (0:00:06.286) 0:03:37.960 ********** 2026-04-24 04:16:01.759540 | orchestrator | changed: [localhost] 2026-04-24 04:16:01.759552 | orchestrator | 2026-04-24 04:16:01.759564 | orchestrator | TASK [Create floating ip addresses] ******************************************** 2026-04-24 04:16:01.759576 | orchestrator | Friday 24 April 2026 04:15:37 +0000 (0:00:13.447) 0:03:51.407 ********** 2026-04-24 04:16:01.759589 | orchestrator | ok: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-24 04:16:01.759602 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-24 04:16:01.759614 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-24 04:16:01.759626 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-24 04:16:01.759638 | orchestrator | ok: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-24 04:16:01.759650 | orchestrator | 2026-04-24 04:16:01.759663 | orchestrator | TASK [Print floating ip addresses] ********************************************* 2026-04-24 04:16:01.759675 | orchestrator | Friday 24 April 2026 04:16:01 +0000 (0:00:24.035) 0:04:15.442 ********** 2026-04-24 04:16:01.759688 | orchestrator | ok: [localhost] => (item=test) => { 2026-04-24 04:16:01.759700 | orchestrator |  "msg": "test: 192.168.112.152" 2026-04-24 04:16:01.759713 | orchestrator | } 2026-04-24 04:16:01.759726 | orchestrator | ok: [localhost] => (item=test-1) => { 2026-04-24 04:16:01.759737 | orchestrator |  "msg": "test-1: 192.168.112.157" 2026-04-24 04:16:01.759748 | orchestrator | } 2026-04-24 04:16:01.759759 | orchestrator | ok: [localhost] => (item=test-2) => { 2026-04-24 04:16:01.759787 | orchestrator |  "msg": "test-2: 192.168.112.198" 2026-04-24 04:16:01.759799 | orchestrator | } 2026-04-24 04:16:01.759809 | orchestrator | ok: [localhost] => (item=test-3) => { 2026-04-24 04:16:01.759820 | orchestrator |  "msg": "test-3: 192.168.112.156" 2026-04-24 04:16:01.759831 | orchestrator | } 2026-04-24 04:16:01.759841 | orchestrator | ok: [localhost] => (item=test-4) => { 2026-04-24 04:16:01.759852 | orchestrator |  "msg": "test-4: 192.168.112.154" 2026-04-24 04:16:01.759862 | orchestrator | } 2026-04-24 04:16:01.759873 | orchestrator | 2026-04-24 04:16:01.759883 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:16:01.759895 | orchestrator | localhost : ok=26  changed=23  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 04:16:01.759907 | orchestrator | 2026-04-24 04:16:01.759918 | orchestrator | 2026-04-24 04:16:01.759929 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:16:01.759939 | orchestrator | Friday 24 April 2026 04:16:01 +0000 (0:00:00.118) 0:04:15.560 ********** 2026-04-24 04:16:01.759950 | orchestrator | =============================================================================== 2026-04-24 04:16:01.759961 | orchestrator | Wait for instance creation to complete --------------------------------- 57.51s 2026-04-24 04:16:01.759971 | orchestrator | Create test routers ---------------------------------------------------- 29.45s 2026-04-24 04:16:01.759982 | orchestrator | Create floating ip addresses ------------------------------------------- 24.04s 2026-04-24 04:16:01.759993 | orchestrator | Create test subnets ---------------------------------------------------- 15.36s 2026-04-24 04:16:01.760004 | orchestrator | Attach test volume ----------------------------------------------------- 13.45s 2026-04-24 04:16:01.760014 | orchestrator | Create test networks --------------------------------------------------- 13.35s 2026-04-24 04:16:01.760025 | orchestrator | Add member roles to user test ------------------------------------------ 11.31s 2026-04-24 04:16:01.760035 | orchestrator | Wait for tags to be added ----------------------------------------------- 9.63s 2026-04-24 04:16:01.760046 | orchestrator | Wait for metadata to be added ------------------------------------------- 9.29s 2026-04-24 04:16:01.760063 | orchestrator | Add manager role to user test-admin ------------------------------------- 6.63s 2026-04-24 04:16:01.760073 | orchestrator | Create test volume ------------------------------------------------------ 6.29s 2026-04-24 04:16:01.760084 | orchestrator | Create ssh security group ----------------------------------------------- 4.72s 2026-04-24 04:16:01.760094 | orchestrator | Create test instances --------------------------------------------------- 4.66s 2026-04-24 04:16:01.760105 | orchestrator | Add metadata to instances ----------------------------------------------- 4.53s 2026-04-24 04:16:01.760115 | orchestrator | Add tag to instances ---------------------------------------------------- 4.51s 2026-04-24 04:16:01.760126 | orchestrator | Create test project ----------------------------------------------------- 4.34s 2026-04-24 04:16:01.760137 | orchestrator | Create icmp security group ---------------------------------------------- 4.31s 2026-04-24 04:16:01.760147 | orchestrator | Add rule to ssh security group ------------------------------------------ 4.23s 2026-04-24 04:16:01.760158 | orchestrator | Create test server group ------------------------------------------------ 4.22s 2026-04-24 04:16:01.760174 | orchestrator | Create test user -------------------------------------------------------- 4.13s 2026-04-24 04:16:02.236156 | orchestrator | + server_list 2026-04-24 04:16:02.236261 | orchestrator | + openstack --os-cloud test server list 2026-04-24 04:16:06.086619 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-24 04:16:06.086722 | orchestrator | | ID | Name | Status | Networks | Image | Flavor | 2026-04-24 04:16:06.086737 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-24 04:16:06.086749 | orchestrator | | 5f4a659a-edce-4cff-8b45-0bde33698973 | test-4 | ACTIVE | test-3=192.168.112.154, 192.168.202.91 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 04:16:06.086760 | orchestrator | | d45cb391-5e9b-414f-9591-6f9d670b0318 | test-3 | ACTIVE | test-2=192.168.112.156, 192.168.201.248 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 04:16:06.086819 | orchestrator | | 05f2fb8d-6493-4264-8f4b-8434c880e215 | test-1 | ACTIVE | test-1=192.168.112.157, 192.168.200.14 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 04:16:06.086831 | orchestrator | | 17ef2d07-a4bf-4690-bcd8-6db22c8534fa | test-2 | ACTIVE | test-2=192.168.112.198, 192.168.201.20 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 04:16:06.086842 | orchestrator | | 5c172fc5-b958-4855-b1a9-5c8d349ff15d | test | ACTIVE | test-1=192.168.112.152, 192.168.200.229 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 04:16:06.086854 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-24 04:16:06.497301 | orchestrator | + openstack --os-cloud test server show test 2026-04-24 04:16:09.862618 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:09.862737 | orchestrator | | Field | Value | 2026-04-24 04:16:09.862794 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:09.862840 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 04:16:09.862860 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 04:16:09.862880 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 04:16:09.862908 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test | 2026-04-24 04:16:09.862929 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 04:16:09.862942 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 04:16:09.862971 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 04:16:09.862983 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 04:16:09.862994 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 04:16:09.863021 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 04:16:09.863033 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 04:16:09.863044 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 04:16:09.863055 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 04:16:09.863081 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 04:16:09.863100 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 04:16:09.863119 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:23.000000 | 2026-04-24 04:16:09.863149 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 04:16:09.863168 | orchestrator | | accessIPv4 | | 2026-04-24 04:16:09.863185 | orchestrator | | accessIPv6 | | 2026-04-24 04:16:09.863216 | orchestrator | | addresses | test-1=192.168.112.152, 192.168.200.229 | 2026-04-24 04:16:09.863237 | orchestrator | | config_drive | | 2026-04-24 04:16:09.863257 | orchestrator | | created | 2026-04-24T04:13:56Z | 2026-04-24 04:16:09.863277 | orchestrator | | description | None | 2026-04-24 04:16:09.863303 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 04:16:09.863324 | orchestrator | | hostId | 9d84bece4141ce992672cd49578e0103207c410225513520729b6d9a | 2026-04-24 04:16:09.863344 | orchestrator | | host_status | None | 2026-04-24 04:16:09.863375 | orchestrator | | id | 5c172fc5-b958-4855-b1a9-5c8d349ff15d | 2026-04-24 04:16:09.863394 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 04:16:09.863422 | orchestrator | | key_name | test | 2026-04-24 04:16:09.863440 | orchestrator | | locked | False | 2026-04-24 04:16:09.863460 | orchestrator | | locked_reason | None | 2026-04-24 04:16:09.863478 | orchestrator | | name | test | 2026-04-24 04:16:09.863497 | orchestrator | | pinned_availability_zone | None | 2026-04-24 04:16:09.863516 | orchestrator | | progress | 0 | 2026-04-24 04:16:09.863546 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 04:16:09.863564 | orchestrator | | properties | hostname='test' | 2026-04-24 04:16:09.863594 | orchestrator | | security_groups | name='icmp' | 2026-04-24 04:16:09.863634 | orchestrator | | | name='ssh' | 2026-04-24 04:16:09.863653 | orchestrator | | server_groups | None | 2026-04-24 04:16:09.863665 | orchestrator | | status | ACTIVE | 2026-04-24 04:16:09.863676 | orchestrator | | tags | test | 2026-04-24 04:16:09.863687 | orchestrator | | trusted_image_certificates | None | 2026-04-24 04:16:09.863698 | orchestrator | | updated | 2026-04-24T04:14:55Z | 2026-04-24 04:16:09.863715 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 04:16:09.863726 | orchestrator | | volumes_attached | delete_on_termination='True', id='b218890f-74d1-46ff-89e1-1c386f3099a3' | 2026-04-24 04:16:09.863737 | orchestrator | | | delete_on_termination='False', id='cf485be9-0353-4c39-bf82-19de5539869c' | 2026-04-24 04:16:09.867572 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:10.317098 | orchestrator | + openstack --os-cloud test server show test-1 2026-04-24 04:16:13.246687 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:13.246825 | orchestrator | | Field | Value | 2026-04-24 04:16:13.246840 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:13.246849 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 04:16:13.246858 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 04:16:13.246882 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 04:16:13.246890 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-1 | 2026-04-24 04:16:13.246899 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 04:16:13.246928 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 04:16:13.246954 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 04:16:13.246963 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 04:16:13.246971 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 04:16:13.246979 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 04:16:13.246987 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 04:16:13.246995 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 04:16:13.247007 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 04:16:13.247016 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 04:16:13.247024 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 04:16:13.247038 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:22.000000 | 2026-04-24 04:16:13.247052 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 04:16:13.247061 | orchestrator | | accessIPv4 | | 2026-04-24 04:16:13.247069 | orchestrator | | accessIPv6 | | 2026-04-24 04:16:13.247077 | orchestrator | | addresses | test-1=192.168.112.157, 192.168.200.14 | 2026-04-24 04:16:13.247085 | orchestrator | | config_drive | | 2026-04-24 04:16:13.247093 | orchestrator | | created | 2026-04-24T04:13:57Z | 2026-04-24 04:16:13.247106 | orchestrator | | description | None | 2026-04-24 04:16:13.247115 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 04:16:13.247128 | orchestrator | | hostId | 9d84bece4141ce992672cd49578e0103207c410225513520729b6d9a | 2026-04-24 04:16:13.247136 | orchestrator | | host_status | None | 2026-04-24 04:16:13.247149 | orchestrator | | id | 05f2fb8d-6493-4264-8f4b-8434c880e215 | 2026-04-24 04:16:13.247158 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 04:16:13.247166 | orchestrator | | key_name | test | 2026-04-24 04:16:13.247174 | orchestrator | | locked | False | 2026-04-24 04:16:13.247182 | orchestrator | | locked_reason | None | 2026-04-24 04:16:13.247191 | orchestrator | | name | test-1 | 2026-04-24 04:16:13.247203 | orchestrator | | pinned_availability_zone | None | 2026-04-24 04:16:13.247216 | orchestrator | | progress | 0 | 2026-04-24 04:16:13.247228 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 04:16:13.247260 | orchestrator | | properties | hostname='test-1' | 2026-04-24 04:16:13.247294 | orchestrator | | security_groups | name='icmp' | 2026-04-24 04:16:13.247310 | orchestrator | | | name='ssh' | 2026-04-24 04:16:13.247323 | orchestrator | | server_groups | None | 2026-04-24 04:16:13.247337 | orchestrator | | status | ACTIVE | 2026-04-24 04:16:13.247351 | orchestrator | | tags | test | 2026-04-24 04:16:13.247361 | orchestrator | | trusted_image_certificates | None | 2026-04-24 04:16:13.247379 | orchestrator | | updated | 2026-04-24T04:14:55Z | 2026-04-24 04:16:13.247393 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 04:16:13.247406 | orchestrator | | volumes_attached | delete_on_termination='True', id='e7a6f4bc-a41e-4ffe-a7e1-926bdf5d11ff' | 2026-04-24 04:16:13.250247 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:13.533396 | orchestrator | + openstack --os-cloud test server show test-2 2026-04-24 04:16:16.488887 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:16.489048 | orchestrator | | Field | Value | 2026-04-24 04:16:16.489080 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:16.489102 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 04:16:16.489123 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 04:16:16.489144 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 04:16:16.489204 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-2 | 2026-04-24 04:16:16.489229 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 04:16:16.489251 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 04:16:16.489296 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 04:16:16.489320 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 04:16:16.489342 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 04:16:16.489365 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 04:16:16.489387 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 04:16:16.489405 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 04:16:16.489428 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 04:16:16.489448 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 04:16:16.489461 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 04:16:16.489474 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:23.000000 | 2026-04-24 04:16:16.489494 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 04:16:16.489508 | orchestrator | | accessIPv4 | | 2026-04-24 04:16:16.489520 | orchestrator | | accessIPv6 | | 2026-04-24 04:16:16.489533 | orchestrator | | addresses | test-2=192.168.112.198, 192.168.201.20 | 2026-04-24 04:16:16.489545 | orchestrator | | config_drive | | 2026-04-24 04:16:16.489574 | orchestrator | | created | 2026-04-24T04:13:57Z | 2026-04-24 04:16:16.489592 | orchestrator | | description | None | 2026-04-24 04:16:16.489605 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 04:16:16.489617 | orchestrator | | hostId | 9d84bece4141ce992672cd49578e0103207c410225513520729b6d9a | 2026-04-24 04:16:16.489630 | orchestrator | | host_status | None | 2026-04-24 04:16:16.489650 | orchestrator | | id | 17ef2d07-a4bf-4690-bcd8-6db22c8534fa | 2026-04-24 04:16:16.489662 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 04:16:16.489674 | orchestrator | | key_name | test | 2026-04-24 04:16:16.489684 | orchestrator | | locked | False | 2026-04-24 04:16:16.489702 | orchestrator | | locked_reason | None | 2026-04-24 04:16:16.489713 | orchestrator | | name | test-2 | 2026-04-24 04:16:16.489729 | orchestrator | | pinned_availability_zone | None | 2026-04-24 04:16:16.489741 | orchestrator | | progress | 0 | 2026-04-24 04:16:16.489752 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 04:16:16.489785 | orchestrator | | properties | hostname='test-2' | 2026-04-24 04:16:16.489806 | orchestrator | | security_groups | name='icmp' | 2026-04-24 04:16:16.489817 | orchestrator | | | name='ssh' | 2026-04-24 04:16:16.489828 | orchestrator | | server_groups | None | 2026-04-24 04:16:16.489840 | orchestrator | | status | ACTIVE | 2026-04-24 04:16:16.489858 | orchestrator | | tags | test | 2026-04-24 04:16:16.489869 | orchestrator | | trusted_image_certificates | None | 2026-04-24 04:16:16.489885 | orchestrator | | updated | 2026-04-24T04:14:56Z | 2026-04-24 04:16:16.489896 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 04:16:16.489908 | orchestrator | | volumes_attached | delete_on_termination='True', id='ce502b5a-e4f3-4883-a517-4add09db06b8' | 2026-04-24 04:16:16.492966 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:16.756828 | orchestrator | + openstack --os-cloud test server show test-3 2026-04-24 04:16:19.791232 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:19.791340 | orchestrator | | Field | Value | 2026-04-24 04:16:19.791356 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:19.791389 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 04:16:19.791401 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 04:16:19.791413 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 04:16:19.791432 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-3 | 2026-04-24 04:16:19.791444 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 04:16:19.791455 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 04:16:19.791483 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 04:16:19.791502 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 04:16:19.791522 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 04:16:19.791553 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 04:16:19.791573 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 04:16:19.791593 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 04:16:19.791615 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 04:16:19.791636 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 04:16:19.791658 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 04:16:19.791680 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:25.000000 | 2026-04-24 04:16:19.791711 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 04:16:19.791732 | orchestrator | | accessIPv4 | | 2026-04-24 04:16:19.791791 | orchestrator | | accessIPv6 | | 2026-04-24 04:16:19.791815 | orchestrator | | addresses | test-2=192.168.112.156, 192.168.201.248 | 2026-04-24 04:16:19.792266 | orchestrator | | config_drive | | 2026-04-24 04:16:19.792299 | orchestrator | | created | 2026-04-24T04:13:58Z | 2026-04-24 04:16:19.792319 | orchestrator | | description | None | 2026-04-24 04:16:19.792339 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 04:16:19.792359 | orchestrator | | hostId | 9d84bece4141ce992672cd49578e0103207c410225513520729b6d9a | 2026-04-24 04:16:19.792377 | orchestrator | | host_status | None | 2026-04-24 04:16:19.792408 | orchestrator | | id | d45cb391-5e9b-414f-9591-6f9d670b0318 | 2026-04-24 04:16:19.792431 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 04:16:19.792442 | orchestrator | | key_name | test | 2026-04-24 04:16:19.792453 | orchestrator | | locked | False | 2026-04-24 04:16:19.792469 | orchestrator | | locked_reason | None | 2026-04-24 04:16:19.792481 | orchestrator | | name | test-3 | 2026-04-24 04:16:19.792492 | orchestrator | | pinned_availability_zone | None | 2026-04-24 04:16:19.792503 | orchestrator | | progress | 0 | 2026-04-24 04:16:19.792514 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 04:16:19.792525 | orchestrator | | properties | hostname='test-3' | 2026-04-24 04:16:19.792543 | orchestrator | | security_groups | name='icmp' | 2026-04-24 04:16:19.792562 | orchestrator | | | name='ssh' | 2026-04-24 04:16:19.792573 | orchestrator | | server_groups | None | 2026-04-24 04:16:19.792584 | orchestrator | | status | ACTIVE | 2026-04-24 04:16:19.792600 | orchestrator | | tags | test | 2026-04-24 04:16:19.792611 | orchestrator | | trusted_image_certificates | None | 2026-04-24 04:16:19.792622 | orchestrator | | updated | 2026-04-24T04:14:57Z | 2026-04-24 04:16:19.792633 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 04:16:19.792644 | orchestrator | | volumes_attached | delete_on_termination='True', id='c41e9875-88d3-4a1a-b9b6-b4d9adb0d129' | 2026-04-24 04:16:19.794983 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:20.094670 | orchestrator | + openstack --os-cloud test server show test-4 2026-04-24 04:16:22.996235 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:22.996348 | orchestrator | | Field | Value | 2026-04-24 04:16:22.996366 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:22.996378 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 04:16:22.996407 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 04:16:22.996420 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 04:16:22.996431 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-4 | 2026-04-24 04:16:22.996442 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 04:16:22.996454 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 04:16:22.996510 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 04:16:22.996523 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 04:16:22.996535 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 04:16:22.996546 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 04:16:22.996557 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 04:16:22.996573 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 04:16:22.996585 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 04:16:22.996596 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 04:16:22.996607 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 04:16:22.996626 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:25.000000 | 2026-04-24 04:16:22.996645 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 04:16:22.996657 | orchestrator | | accessIPv4 | | 2026-04-24 04:16:22.996669 | orchestrator | | accessIPv6 | | 2026-04-24 04:16:22.996680 | orchestrator | | addresses | test-3=192.168.112.154, 192.168.202.91 | 2026-04-24 04:16:22.996696 | orchestrator | | config_drive | | 2026-04-24 04:16:22.996708 | orchestrator | | created | 2026-04-24T04:14:00Z | 2026-04-24 04:16:22.996719 | orchestrator | | description | None | 2026-04-24 04:16:22.996730 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 04:16:22.996777 | orchestrator | | hostId | cd5597e5a70304b7bed36fc408e8e25c4b6519cec084a045b6f99dd7 | 2026-04-24 04:16:22.996791 | orchestrator | | host_status | None | 2026-04-24 04:16:22.996812 | orchestrator | | id | 5f4a659a-edce-4cff-8b45-0bde33698973 | 2026-04-24 04:16:22.996826 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 04:16:22.996839 | orchestrator | | key_name | test | 2026-04-24 04:16:22.996852 | orchestrator | | locked | False | 2026-04-24 04:16:22.996869 | orchestrator | | locked_reason | None | 2026-04-24 04:16:22.996882 | orchestrator | | name | test-4 | 2026-04-24 04:16:22.996895 | orchestrator | | pinned_availability_zone | None | 2026-04-24 04:16:22.996908 | orchestrator | | progress | 0 | 2026-04-24 04:16:22.996927 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 04:16:22.996940 | orchestrator | | properties | hostname='test-4' | 2026-04-24 04:16:22.996960 | orchestrator | | security_groups | name='icmp' | 2026-04-24 04:16:22.996973 | orchestrator | | | name='ssh' | 2026-04-24 04:16:22.996985 | orchestrator | | server_groups | None | 2026-04-24 04:16:22.996998 | orchestrator | | status | ACTIVE | 2026-04-24 04:16:22.997016 | orchestrator | | tags | test | 2026-04-24 04:16:22.997029 | orchestrator | | trusted_image_certificates | None | 2026-04-24 04:16:22.997041 | orchestrator | | updated | 2026-04-24T04:14:58Z | 2026-04-24 04:16:22.997061 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 04:16:22.997073 | orchestrator | | volumes_attached | delete_on_termination='True', id='c21374b5-887b-4330-b43a-96a0e89796a0' | 2026-04-24 04:16:23.000213 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 04:16:23.290420 | orchestrator | + server_ping 2026-04-24 04:16:23.291961 | orchestrator | ++ openstack --os-cloud test floating ip list --status ACTIVE -f value -c 'Floating IP Address' 2026-04-24 04:16:23.292015 | orchestrator | ++ tr -d '\r' 2026-04-24 04:16:26.077144 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 04:16:26.077250 | orchestrator | + ping -c3 192.168.112.198 2026-04-24 04:16:26.099359 | orchestrator | PING 192.168.112.198 (192.168.112.198) 56(84) bytes of data. 2026-04-24 04:16:26.099450 | orchestrator | 64 bytes from 192.168.112.198: icmp_seq=1 ttl=63 time=10.8 ms 2026-04-24 04:16:27.092930 | orchestrator | 64 bytes from 192.168.112.198: icmp_seq=2 ttl=63 time=2.55 ms 2026-04-24 04:16:28.094428 | orchestrator | 64 bytes from 192.168.112.198: icmp_seq=3 ttl=63 time=1.97 ms 2026-04-24 04:16:28.094555 | orchestrator | 2026-04-24 04:16:28.094573 | orchestrator | --- 192.168.112.198 ping statistics --- 2026-04-24 04:16:28.094586 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-24 04:16:28.094598 | orchestrator | rtt min/avg/max/mdev = 1.966/5.089/10.755/4.013 ms 2026-04-24 04:16:28.094885 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 04:16:28.094981 | orchestrator | + ping -c3 192.168.112.152 2026-04-24 04:16:28.109897 | orchestrator | PING 192.168.112.152 (192.168.112.152) 56(84) bytes of data. 2026-04-24 04:16:28.109979 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=1 ttl=63 time=9.72 ms 2026-04-24 04:16:29.104566 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=2 ttl=63 time=2.30 ms 2026-04-24 04:16:30.105422 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=3 ttl=63 time=1.77 ms 2026-04-24 04:16:30.105506 | orchestrator | 2026-04-24 04:16:30.105519 | orchestrator | --- 192.168.112.152 ping statistics --- 2026-04-24 04:16:30.105533 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-24 04:16:30.105545 | orchestrator | rtt min/avg/max/mdev = 1.772/4.595/9.715/3.626 ms 2026-04-24 04:16:30.105827 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 04:16:30.105847 | orchestrator | + ping -c3 192.168.112.154 2026-04-24 04:16:30.117177 | orchestrator | PING 192.168.112.154 (192.168.112.154) 56(84) bytes of data. 2026-04-24 04:16:30.117242 | orchestrator | 64 bytes from 192.168.112.154: icmp_seq=1 ttl=63 time=8.13 ms 2026-04-24 04:16:31.113463 | orchestrator | 64 bytes from 192.168.112.154: icmp_seq=2 ttl=63 time=2.40 ms 2026-04-24 04:16:32.115051 | orchestrator | 64 bytes from 192.168.112.154: icmp_seq=3 ttl=63 time=1.91 ms 2026-04-24 04:16:32.115190 | orchestrator | 2026-04-24 04:16:32.115235 | orchestrator | --- 192.168.112.154 ping statistics --- 2026-04-24 04:16:32.115250 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-24 04:16:32.115261 | orchestrator | rtt min/avg/max/mdev = 1.906/4.144/8.129/2.824 ms 2026-04-24 04:16:32.115544 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 04:16:32.115570 | orchestrator | + ping -c3 192.168.112.157 2026-04-24 04:16:32.123490 | orchestrator | PING 192.168.112.157 (192.168.112.157) 56(84) bytes of data. 2026-04-24 04:16:32.123565 | orchestrator | 64 bytes from 192.168.112.157: icmp_seq=1 ttl=63 time=3.95 ms 2026-04-24 04:16:33.123298 | orchestrator | 64 bytes from 192.168.112.157: icmp_seq=2 ttl=63 time=2.22 ms 2026-04-24 04:16:34.124523 | orchestrator | 64 bytes from 192.168.112.157: icmp_seq=3 ttl=63 time=1.65 ms 2026-04-24 04:16:34.124627 | orchestrator | 2026-04-24 04:16:34.124643 | orchestrator | --- 192.168.112.157 ping statistics --- 2026-04-24 04:16:34.124656 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-24 04:16:34.124668 | orchestrator | rtt min/avg/max/mdev = 1.646/2.605/3.951/0.979 ms 2026-04-24 04:16:34.125095 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 04:16:34.125119 | orchestrator | + ping -c3 192.168.112.156 2026-04-24 04:16:34.135446 | orchestrator | PING 192.168.112.156 (192.168.112.156) 56(84) bytes of data. 2026-04-24 04:16:34.135498 | orchestrator | 64 bytes from 192.168.112.156: icmp_seq=1 ttl=63 time=6.63 ms 2026-04-24 04:16:35.133329 | orchestrator | 64 bytes from 192.168.112.156: icmp_seq=2 ttl=63 time=2.74 ms 2026-04-24 04:16:36.134973 | orchestrator | 64 bytes from 192.168.112.156: icmp_seq=3 ttl=63 time=2.05 ms 2026-04-24 04:16:36.135093 | orchestrator | 2026-04-24 04:16:36.135121 | orchestrator | --- 192.168.112.156 ping statistics --- 2026-04-24 04:16:36.135143 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-24 04:16:36.135165 | orchestrator | rtt min/avg/max/mdev = 2.048/3.805/6.630/2.016 ms 2026-04-24 04:16:36.136037 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-24 04:16:36.387480 | orchestrator | ok: Runtime: 0:09:33.408813 2026-04-24 04:16:36.449681 | 2026-04-24 04:16:36.449881 | TASK [Run tempest] 2026-04-24 04:16:36.986286 | orchestrator | skipping: Conditional result was False 2026-04-24 04:16:36.996025 | 2026-04-24 04:16:36.996146 | TASK [Check prometheus alert status] 2026-04-24 04:16:37.537464 | orchestrator | skipping: Conditional result was False 2026-04-24 04:16:37.552466 | 2026-04-24 04:16:37.552622 | PLAY [Upgrade testbed] 2026-04-24 04:16:37.564648 | 2026-04-24 04:16:37.564852 | TASK [Print next ceph version] 2026-04-24 04:16:37.646338 | orchestrator | ok 2026-04-24 04:16:37.656496 | 2026-04-24 04:16:37.656631 | TASK [Print next openstack version] 2026-04-24 04:16:37.728773 | orchestrator | ok 2026-04-24 04:16:37.741347 | 2026-04-24 04:16:37.741481 | TASK [Print next manager version] 2026-04-24 04:16:37.822081 | orchestrator | ok 2026-04-24 04:16:37.833067 | 2026-04-24 04:16:37.833191 | TASK [Set cloud fact (Zuul deployment)] 2026-04-24 04:16:37.893622 | orchestrator | ok 2026-04-24 04:16:37.905174 | 2026-04-24 04:16:37.905302 | TASK [Set cloud fact (local deployment)] 2026-04-24 04:16:37.941498 | orchestrator | skipping: Conditional result was False 2026-04-24 04:16:37.959502 | 2026-04-24 04:16:37.959652 | TASK [Fetch manager address] 2026-04-24 04:16:38.234674 | orchestrator | ok 2026-04-24 04:16:38.245160 | 2026-04-24 04:16:38.245297 | TASK [Set manager_host address] 2026-04-24 04:16:38.325474 | orchestrator | ok 2026-04-24 04:16:38.336750 | 2026-04-24 04:16:38.336893 | TASK [Run upgrade] 2026-04-24 04:16:39.034900 | orchestrator | + set -e 2026-04-24 04:16:39.035121 | orchestrator | + export MANAGER_VERSION=10.0.0 2026-04-24 04:16:39.035150 | orchestrator | + MANAGER_VERSION=10.0.0 2026-04-24 04:16:39.035163 | orchestrator | + CEPH_VERSION=reef 2026-04-24 04:16:39.035175 | orchestrator | + OPENSTACK_VERSION=2024.2 2026-04-24 04:16:39.035187 | orchestrator | + KOLLA_NAMESPACE=kolla/release 2026-04-24 04:16:39.035199 | orchestrator | + sh -c '/opt/configuration/scripts/upgrade-manager.sh 10.0.0 reef 2024.2 kolla/release' 2026-04-24 04:16:39.044144 | orchestrator | + set -e 2026-04-24 04:16:39.044202 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 04:16:39.044213 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 04:16:39.044226 | orchestrator | ++ INTERACTIVE=false 2026-04-24 04:16:39.044233 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 04:16:39.044243 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 04:16:39.045343 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "org.opencontainers.image.version"}}' osism-ansible 2026-04-24 04:16:39.085213 | orchestrator | + OLD_MANAGER_VERSION=v0.20251130.0 2026-04-24 04:16:39.086121 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "de.osism.release.openstack"}}' kolla-ansible 2026-04-24 04:16:39.130497 | orchestrator | 2026-04-24 04:16:39.130578 | orchestrator | # UPGRADE MANAGER 2026-04-24 04:16:39.130592 | orchestrator | 2026-04-24 04:16:39.130600 | orchestrator | + OLD_OPENSTACK_VERSION=2024.2 2026-04-24 04:16:39.130608 | orchestrator | + echo 2026-04-24 04:16:39.130618 | orchestrator | + echo '# UPGRADE MANAGER' 2026-04-24 04:16:39.130625 | orchestrator | + echo 2026-04-24 04:16:39.130633 | orchestrator | + export MANAGER_VERSION=10.0.0 2026-04-24 04:16:39.130640 | orchestrator | + MANAGER_VERSION=10.0.0 2026-04-24 04:16:39.130648 | orchestrator | + CEPH_VERSION=reef 2026-04-24 04:16:39.130655 | orchestrator | + OPENSTACK_VERSION=2024.2 2026-04-24 04:16:39.130663 | orchestrator | + KOLLA_NAMESPACE=kolla/release 2026-04-24 04:16:39.130670 | orchestrator | + /opt/configuration/scripts/set-manager-version.sh 10.0.0 2026-04-24 04:16:39.135152 | orchestrator | + set -e 2026-04-24 04:16:39.135246 | orchestrator | + VERSION=10.0.0 2026-04-24 04:16:39.135261 | orchestrator | + sed -i 's/manager_version: .*/manager_version: 10.0.0/g' /opt/configuration/environments/manager/configuration.yml 2026-04-24 04:16:39.141287 | orchestrator | + [[ 10.0.0 != \l\a\t\e\s\t ]] 2026-04-24 04:16:39.141382 | orchestrator | + sed -i /ceph_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-24 04:16:39.146156 | orchestrator | + sed -i /openstack_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-24 04:16:39.153422 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-24 04:16:39.163371 | orchestrator | /opt/configuration ~ 2026-04-24 04:16:39.163418 | orchestrator | + set -e 2026-04-24 04:16:39.163426 | orchestrator | + pushd /opt/configuration 2026-04-24 04:16:39.163433 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-24 04:16:39.163441 | orchestrator | + source /opt/venv/bin/activate 2026-04-24 04:16:39.164905 | orchestrator | ++ deactivate nondestructive 2026-04-24 04:16:39.164938 | orchestrator | ++ '[' -n '' ']' 2026-04-24 04:16:39.164945 | orchestrator | ++ '[' -n '' ']' 2026-04-24 04:16:39.164956 | orchestrator | ++ hash -r 2026-04-24 04:16:39.164965 | orchestrator | ++ '[' -n '' ']' 2026-04-24 04:16:39.164971 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-24 04:16:39.165070 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-24 04:16:39.165080 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-24 04:16:39.165340 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-24 04:16:39.165356 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-24 04:16:39.165365 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-24 04:16:39.165373 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-24 04:16:39.165393 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 04:16:39.165406 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 04:16:39.165416 | orchestrator | ++ export PATH 2026-04-24 04:16:39.165454 | orchestrator | ++ '[' -n '' ']' 2026-04-24 04:16:39.165716 | orchestrator | ++ '[' -z '' ']' 2026-04-24 04:16:39.165733 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-24 04:16:39.165764 | orchestrator | ++ PS1='(venv) ' 2026-04-24 04:16:39.165773 | orchestrator | ++ export PS1 2026-04-24 04:16:39.165781 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-24 04:16:39.165789 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-24 04:16:39.165798 | orchestrator | ++ hash -r 2026-04-24 04:16:39.165922 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-24 04:16:40.375732 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-24 04:16:40.376498 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-24 04:16:40.378157 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-24 04:16:40.379191 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-24 04:16:40.380610 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.1) 2026-04-24 04:16:40.391523 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.3) 2026-04-24 04:16:40.393183 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-24 04:16:40.394163 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-24 04:16:40.395502 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-24 04:16:40.430246 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-24 04:16:40.431637 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.13) 2026-04-24 04:16:40.433486 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-24 04:16:40.435116 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.4.22) 2026-04-24 04:16:40.439502 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-24 04:16:40.661297 | orchestrator | ++ which gilt 2026-04-24 04:16:40.664605 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-24 04:16:40.664638 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-24 04:16:40.985225 | orchestrator | osism.generics: 2026-04-24 04:16:41.102558 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-24 04:16:41.103886 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-24 04:16:41.106070 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-24 04:16:41.106099 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-24 04:16:42.192046 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-24 04:16:42.207893 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-24 04:16:42.561511 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-24 04:16:42.617316 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-24 04:16:42.617423 | orchestrator | + deactivate 2026-04-24 04:16:42.617441 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-24 04:16:42.617455 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 04:16:42.617467 | orchestrator | + export PATH 2026-04-24 04:16:42.617485 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-24 04:16:42.617497 | orchestrator | + '[' -n '' ']' 2026-04-24 04:16:42.617508 | orchestrator | + hash -r 2026-04-24 04:16:42.617519 | orchestrator | + '[' -n '' ']' 2026-04-24 04:16:42.617530 | orchestrator | + unset VIRTUAL_ENV 2026-04-24 04:16:42.617541 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-24 04:16:42.617552 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-24 04:16:42.617641 | orchestrator | ~ 2026-04-24 04:16:42.617657 | orchestrator | + unset -f deactivate 2026-04-24 04:16:42.617668 | orchestrator | + popd 2026-04-24 04:16:42.619685 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-24 04:16:42.619731 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release 2026-04-24 04:16:42.627824 | orchestrator | + set -e 2026-04-24 04:16:42.627862 | orchestrator | + NAMESPACE=kolla/release 2026-04-24 04:16:42.627962 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-24 04:16:42.639882 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-24 04:16:42.648575 | orchestrator | /opt/configuration ~ 2026-04-24 04:16:42.648637 | orchestrator | + set -e 2026-04-24 04:16:42.648651 | orchestrator | + pushd /opt/configuration 2026-04-24 04:16:42.648663 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-24 04:16:42.648674 | orchestrator | + source /opt/venv/bin/activate 2026-04-24 04:16:42.648958 | orchestrator | ++ deactivate nondestructive 2026-04-24 04:16:42.648980 | orchestrator | ++ '[' -n '' ']' 2026-04-24 04:16:42.648991 | orchestrator | ++ '[' -n '' ']' 2026-04-24 04:16:42.649002 | orchestrator | ++ hash -r 2026-04-24 04:16:42.649013 | orchestrator | ++ '[' -n '' ']' 2026-04-24 04:16:42.649023 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-24 04:16:42.649041 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-24 04:16:42.649053 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-24 04:16:42.649297 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-24 04:16:42.649320 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-24 04:16:42.649331 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-24 04:16:42.649347 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-24 04:16:42.649362 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 04:16:42.649374 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 04:16:42.649385 | orchestrator | ++ export PATH 2026-04-24 04:16:42.649396 | orchestrator | ++ '[' -n '' ']' 2026-04-24 04:16:42.649546 | orchestrator | ++ '[' -z '' ']' 2026-04-24 04:16:42.649568 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-24 04:16:42.649578 | orchestrator | ++ PS1='(venv) ' 2026-04-24 04:16:42.649589 | orchestrator | ++ export PS1 2026-04-24 04:16:42.649600 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-24 04:16:42.649611 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-24 04:16:42.649621 | orchestrator | ++ hash -r 2026-04-24 04:16:42.649699 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-24 04:16:43.208145 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-24 04:16:43.209125 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-24 04:16:43.210695 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-24 04:16:43.211914 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-24 04:16:43.213298 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.1) 2026-04-24 04:16:43.223503 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.3) 2026-04-24 04:16:43.225327 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-24 04:16:43.226325 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-24 04:16:43.227830 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-24 04:16:43.260621 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-24 04:16:43.262247 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.13) 2026-04-24 04:16:43.264586 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-24 04:16:43.266705 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.4.22) 2026-04-24 04:16:43.273909 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-24 04:16:43.524651 | orchestrator | ++ which gilt 2026-04-24 04:16:43.525922 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-24 04:16:43.526097 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-24 04:16:43.682239 | orchestrator | osism.generics: 2026-04-24 04:16:43.776453 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-24 04:16:43.776674 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-24 04:16:43.776970 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-24 04:16:43.777206 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-24 04:16:44.334826 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-24 04:16:44.342477 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-24 04:16:44.747924 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-24 04:16:44.806707 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-24 04:16:44.806814 | orchestrator | + deactivate 2026-04-24 04:16:44.806828 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-24 04:16:44.806841 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-24 04:16:44.806851 | orchestrator | + export PATH 2026-04-24 04:16:44.806861 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-24 04:16:44.807041 | orchestrator | ~ 2026-04-24 04:16:44.807058 | orchestrator | + '[' -n '' ']' 2026-04-24 04:16:44.807073 | orchestrator | + hash -r 2026-04-24 04:16:44.807090 | orchestrator | + '[' -n '' ']' 2026-04-24 04:16:44.807107 | orchestrator | + unset VIRTUAL_ENV 2026-04-24 04:16:44.807123 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-24 04:16:44.807141 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-24 04:16:44.807157 | orchestrator | + unset -f deactivate 2026-04-24 04:16:44.807171 | orchestrator | + popd 2026-04-24 04:16:44.808897 | orchestrator | ++ semver v0.20251130.0 6.0.0 2026-04-24 04:16:44.855902 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-24 04:16:44.855976 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-24 04:16:44.856359 | orchestrator | ++ semver 10.0.0 10.0.0-0 2026-04-24 04:16:44.933243 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 04:16:44.933323 | orchestrator | + sed -i '/^om_enable_rabbitmq_high_availability:/d' /opt/configuration/environments/kolla/configuration.yml 2026-04-24 04:16:44.939563 | orchestrator | + sed -i '/^om_enable_rabbitmq_quorum_queues:/d' /opt/configuration/environments/kolla/configuration.yml 2026-04-24 04:16:44.945822 | orchestrator | ++ semver v0.20251130.0 9.5.0 2026-04-24 04:16:45.014547 | orchestrator | + [[ -1 -le 0 ]] 2026-04-24 04:16:45.014624 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-24 04:16:45.015551 | orchestrator | ++ semver 10.0.0 10.0.0-0 2026-04-24 04:16:45.109330 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 04:16:45.109410 | orchestrator | + MANAGER_UPGRADE_CROSSES_10=true 2026-04-24 04:16:45.111072 | orchestrator | +++ semver 2024.2 2024.2 2026-04-24 04:16:45.203943 | orchestrator | ++ '[' 0 -le 0 ']' 2026-04-24 04:16:45.204800 | orchestrator | +++ semver 2024.2 2025.1 2026-04-24 04:16:45.273367 | orchestrator | ++ '[' -1 -ge 0 ']' 2026-04-24 04:16:45.273433 | orchestrator | ++ echo false 2026-04-24 04:16:45.273848 | orchestrator | + OPENSTACK_UPGRADE_CROSSES_2025=false 2026-04-24 04:16:45.273862 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-24 04:16:45.273867 | orchestrator | + echo 'om_rpc_vhost: openstack' 2026-04-24 04:16:45.273963 | orchestrator | + echo 'om_notify_vhost: openstack' 2026-04-24 04:16:45.273974 | orchestrator | + sed -i 's#manager_listener_broker_vhost: .*#manager_listener_broker_vhost: /openstack#g' /opt/configuration/environments/manager/configuration.yml 2026-04-24 04:16:45.279997 | orchestrator | + echo 'export RABBITMQ3TO4=true' 2026-04-24 04:16:45.280200 | orchestrator | + sudo tee -a /opt/manager-vars.sh 2026-04-24 04:16:45.300044 | orchestrator | export RABBITMQ3TO4=true 2026-04-24 04:16:45.302993 | orchestrator | + osism update manager 2026-04-24 04:16:50.888313 | orchestrator | Collecting uv 2026-04-24 04:16:50.998465 | orchestrator | Downloading uv-0.11.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) 2026-04-24 04:16:51.017775 | orchestrator | Downloading uv-0.11.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (24.9 MB) 2026-04-24 04:16:51.913590 | orchestrator | ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.9/24.9 MB 30.2 MB/s eta 0:00:00 2026-04-24 04:16:51.976375 | orchestrator | Installing collected packages: uv 2026-04-24 04:16:52.448056 | orchestrator | Successfully installed uv-0.11.7 2026-04-24 04:16:53.140951 | orchestrator | Resolved 11 packages in 378ms 2026-04-24 04:16:53.172321 | orchestrator | Downloading cryptography (4.3MiB) 2026-04-24 04:16:53.172412 | orchestrator | Downloading ansible (54.5MiB) 2026-04-24 04:16:53.172425 | orchestrator | Downloading netaddr (2.2MiB) 2026-04-24 04:16:53.172438 | orchestrator | Downloading ansible-core (2.1MiB) 2026-04-24 04:16:53.615063 | orchestrator | Downloaded netaddr 2026-04-24 04:16:53.702533 | orchestrator | Downloaded ansible-core 2026-04-24 04:16:53.789379 | orchestrator | Downloaded cryptography 2026-04-24 04:16:59.817606 | orchestrator | Downloaded ansible 2026-04-24 04:16:59.818080 | orchestrator | Prepared 11 packages in 6.67s 2026-04-24 04:17:00.432605 | orchestrator | Installed 11 packages in 613ms 2026-04-24 04:17:00.432703 | orchestrator | + ansible==11.11.0 2026-04-24 04:17:00.432709 | orchestrator | + ansible-core==2.18.16 2026-04-24 04:17:00.432714 | orchestrator | + cffi==2.0.0 2026-04-24 04:17:00.432759 | orchestrator | + cryptography==46.0.7 2026-04-24 04:17:00.432764 | orchestrator | + jinja2==3.1.6 2026-04-24 04:17:00.432769 | orchestrator | + markupsafe==3.0.3 2026-04-24 04:17:00.432773 | orchestrator | + netaddr==1.3.0 2026-04-24 04:17:00.432777 | orchestrator | + packaging==26.1 2026-04-24 04:17:00.432783 | orchestrator | + pycparser==3.0 2026-04-24 04:17:00.432788 | orchestrator | + pyyaml==6.0.3 2026-04-24 04:17:00.432793 | orchestrator | + resolvelib==1.0.1 2026-04-24 04:17:01.577058 | orchestrator | Cloning into '/home/dragon/.ansible/tmp/ansible-local-199915mzykd1w2/tmp23b3045w/ansible-collection-servicesw613e_7j'... 2026-04-24 04:17:03.039580 | orchestrator | Your branch is up to date with 'origin/main'. 2026-04-24 04:17:03.039704 | orchestrator | Already on 'main' 2026-04-24 04:17:03.543683 | orchestrator | Starting galaxy collection install process 2026-04-24 04:17:03.543859 | orchestrator | Process install dependency map 2026-04-24 04:17:03.543878 | orchestrator | Starting collection install process 2026-04-24 04:17:03.543892 | orchestrator | Installing 'osism.services:999.0.0' to '/home/dragon/.ansible/collections/ansible_collections/osism/services' 2026-04-24 04:17:03.543906 | orchestrator | Created collection for osism.services:999.0.0 at /home/dragon/.ansible/collections/ansible_collections/osism/services 2026-04-24 04:17:03.543917 | orchestrator | osism.services:999.0.0 was installed successfully 2026-04-24 04:17:04.100907 | orchestrator | Cloning into '/home/dragon/.ansible/tmp/ansible-local-2000278i6q5wfx/tmp3m8i383v/ansible-playbooks-manageraaiwonpi'... 2026-04-24 04:17:04.795647 | orchestrator | Already on 'main' 2026-04-24 04:17:04.795789 | orchestrator | Your branch is up to date with 'origin/main'. 2026-04-24 04:17:05.058324 | orchestrator | Starting galaxy collection install process 2026-04-24 04:17:05.058425 | orchestrator | Process install dependency map 2026-04-24 04:17:05.058441 | orchestrator | Starting collection install process 2026-04-24 04:17:05.058455 | orchestrator | Installing 'osism.manager:999.0.0' to '/home/dragon/.ansible/collections/ansible_collections/osism/manager' 2026-04-24 04:17:05.058469 | orchestrator | Created collection for osism.manager:999.0.0 at /home/dragon/.ansible/collections/ansible_collections/osism/manager 2026-04-24 04:17:05.058480 | orchestrator | osism.manager:999.0.0 was installed successfully 2026-04-24 04:17:05.765448 | orchestrator | [WARNING]: Invalid characters were found in group names but not replaced, use 2026-04-24 04:17:05.765547 | orchestrator | -vvvv to see details 2026-04-24 04:17:06.210509 | orchestrator | 2026-04-24 04:17:06.210609 | orchestrator | PLAY [Apply role manager] ****************************************************** 2026-04-24 04:17:06.210626 | orchestrator | 2026-04-24 04:17:06.210660 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-24 04:17:11.345132 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:11.345233 | orchestrator | 2026-04-24 04:17:11.345249 | orchestrator | TASK [osism.services.manager : Include install tasks] ************************** 2026-04-24 04:17:11.419770 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 04:17:11.419895 | orchestrator | 2026-04-24 04:17:11.419924 | orchestrator | TASK [osism.services.manager : Install required packages] ********************** 2026-04-24 04:17:13.245206 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:13.245355 | orchestrator | 2026-04-24 04:17:13.245380 | orchestrator | TASK [osism.services.manager : Gather variables for each operating system] ***** 2026-04-24 04:17:13.305364 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:13.305473 | orchestrator | 2026-04-24 04:17:13.305490 | orchestrator | TASK [osism.services.manager : Include config tasks] *************************** 2026-04-24 04:17:13.371587 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config.yml for testbed-manager 2026-04-24 04:17:13.371707 | orchestrator | 2026-04-24 04:17:13.371798 | orchestrator | TASK [osism.services.manager : Create required directories] ******************** 2026-04-24 04:17:17.729614 | orchestrator | ok: [testbed-manager] => (item=/opt/ansible) 2026-04-24 04:17:17.729801 | orchestrator | ok: [testbed-manager] => (item=/opt/archive) 2026-04-24 04:17:17.729828 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/configuration) 2026-04-24 04:17:17.729859 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/data) 2026-04-24 04:17:17.729871 | orchestrator | ok: [testbed-manager] => (item=/opt/manager) 2026-04-24 04:17:17.729882 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/secrets) 2026-04-24 04:17:17.729893 | orchestrator | ok: [testbed-manager] => (item=/opt/ansible/secrets) 2026-04-24 04:17:17.729904 | orchestrator | ok: [testbed-manager] => (item=/opt/state) 2026-04-24 04:17:17.729916 | orchestrator | 2026-04-24 04:17:17.729928 | orchestrator | TASK [osism.services.manager : Copy all environment file] ********************** 2026-04-24 04:17:18.789220 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:18.789326 | orchestrator | 2026-04-24 04:17:18.789342 | orchestrator | TASK [osism.services.manager : Copy client environment file] ******************* 2026-04-24 04:17:19.743829 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:19.743933 | orchestrator | 2026-04-24 04:17:19.743950 | orchestrator | TASK [osism.services.manager : Include ara config tasks] *********************** 2026-04-24 04:17:19.822190 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ara.yml for testbed-manager 2026-04-24 04:17:19.822303 | orchestrator | 2026-04-24 04:17:19.822317 | orchestrator | TASK [osism.services.manager : Copy ARA environment files] ********************* 2026-04-24 04:17:21.640649 | orchestrator | ok: [testbed-manager] => (item=ara) 2026-04-24 04:17:21.640802 | orchestrator | ok: [testbed-manager] => (item=ara-server) 2026-04-24 04:17:21.640818 | orchestrator | 2026-04-24 04:17:21.640831 | orchestrator | TASK [osism.services.manager : Copy MariaDB environment file] ****************** 2026-04-24 04:17:22.655573 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:22.655683 | orchestrator | 2026-04-24 04:17:22.655698 | orchestrator | TASK [osism.services.manager : Include vault config tasks] ********************* 2026-04-24 04:17:22.736876 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:17:22.736975 | orchestrator | 2026-04-24 04:17:22.736991 | orchestrator | TASK [osism.services.manager : Include frontend config tasks] ****************** 2026-04-24 04:17:22.848976 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-frontend.yml for testbed-manager 2026-04-24 04:17:22.849094 | orchestrator | 2026-04-24 04:17:22.849122 | orchestrator | TASK [osism.services.manager : Copy frontend environment file] ***************** 2026-04-24 04:17:23.848867 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:23.848951 | orchestrator | 2026-04-24 04:17:23.848958 | orchestrator | TASK [osism.services.manager : Include ansible config tasks] ******************* 2026-04-24 04:17:23.928809 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ansible.yml for testbed-manager 2026-04-24 04:17:23.928955 | orchestrator | 2026-04-24 04:17:23.928983 | orchestrator | TASK [osism.services.manager : Copy private ssh keys] ************************** 2026-04-24 04:17:26.122139 | orchestrator | ok: [testbed-manager] => (item=None) 2026-04-24 04:17:26.122226 | orchestrator | ok: [testbed-manager] => (item=None) 2026-04-24 04:17:26.122236 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:26.122246 | orchestrator | 2026-04-24 04:17:26.122254 | orchestrator | TASK [osism.services.manager : Copy ansible environment file] ****************** 2026-04-24 04:17:27.070240 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:27.070317 | orchestrator | 2026-04-24 04:17:27.070326 | orchestrator | TASK [osism.services.manager : Include netbox config tasks] ******************** 2026-04-24 04:17:27.134471 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:17:27.134568 | orchestrator | 2026-04-24 04:17:27.134584 | orchestrator | TASK [osism.services.manager : Include celery config tasks] ******************** 2026-04-24 04:17:27.239090 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-celery.yml for testbed-manager 2026-04-24 04:17:27.239203 | orchestrator | 2026-04-24 04:17:27.239221 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_watches] **************** 2026-04-24 04:17:27.920068 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:27.920166 | orchestrator | 2026-04-24 04:17:27.920184 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_instances] ************** 2026-04-24 04:17:28.501663 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:28.501871 | orchestrator | 2026-04-24 04:17:28.501912 | orchestrator | TASK [osism.services.manager : Copy celery environment files] ****************** 2026-04-24 04:17:30.316259 | orchestrator | ok: [testbed-manager] => (item=conductor) 2026-04-24 04:17:30.316360 | orchestrator | ok: [testbed-manager] => (item=openstack) 2026-04-24 04:17:30.316375 | orchestrator | 2026-04-24 04:17:30.316389 | orchestrator | TASK [osism.services.manager : Copy listener environment file] ***************** 2026-04-24 04:17:31.474340 | orchestrator | changed: [testbed-manager] 2026-04-24 04:17:31.474441 | orchestrator | 2026-04-24 04:17:31.474457 | orchestrator | TASK [osism.services.manager : Check for conductor.yml] ************************ 2026-04-24 04:17:32.047668 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:32.047806 | orchestrator | 2026-04-24 04:17:32.047818 | orchestrator | TASK [osism.services.manager : Copy conductor configuration file] ************** 2026-04-24 04:17:32.610087 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:32.610185 | orchestrator | 2026-04-24 04:17:32.610200 | orchestrator | TASK [osism.services.manager : Copy empty conductor configuration file] ******** 2026-04-24 04:17:32.670895 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:17:32.670973 | orchestrator | 2026-04-24 04:17:32.670985 | orchestrator | TASK [osism.services.manager : Include wrapper config tasks] ******************* 2026-04-24 04:17:32.768630 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-wrapper.yml for testbed-manager 2026-04-24 04:17:32.768762 | orchestrator | 2026-04-24 04:17:32.768775 | orchestrator | TASK [osism.services.manager : Include wrapper vars file] ********************** 2026-04-24 04:17:32.814281 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:32.814377 | orchestrator | 2026-04-24 04:17:32.814400 | orchestrator | TASK [osism.services.manager : Copy wrapper scripts] *************************** 2026-04-24 04:17:35.788754 | orchestrator | ok: [testbed-manager] => (item=osism) 2026-04-24 04:17:35.788891 | orchestrator | ok: [testbed-manager] => (item=osism-update-docker) 2026-04-24 04:17:35.788920 | orchestrator | ok: [testbed-manager] => (item=osism-update-manager) 2026-04-24 04:17:35.788942 | orchestrator | 2026-04-24 04:17:35.788964 | orchestrator | TASK [osism.services.manager : Copy cilium wrapper script] ********************* 2026-04-24 04:17:36.747017 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:36.747150 | orchestrator | 2026-04-24 04:17:36.747168 | orchestrator | TASK [osism.services.manager : Copy hubble wrapper script] ********************* 2026-04-24 04:17:37.830570 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:37.830670 | orchestrator | 2026-04-24 04:17:37.830686 | orchestrator | TASK [osism.services.manager : Copy flux wrapper script] *********************** 2026-04-24 04:17:38.852587 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:38.852686 | orchestrator | 2026-04-24 04:17:38.852775 | orchestrator | TASK [osism.services.manager : Include scripts config tasks] ******************* 2026-04-24 04:17:38.926290 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-scripts.yml for testbed-manager 2026-04-24 04:17:38.926384 | orchestrator | 2026-04-24 04:17:38.926400 | orchestrator | TASK [osism.services.manager : Include scripts vars file] ********************** 2026-04-24 04:17:38.985435 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:38.985527 | orchestrator | 2026-04-24 04:17:38.985542 | orchestrator | TASK [osism.services.manager : Copy scripts] *********************************** 2026-04-24 04:17:40.033497 | orchestrator | ok: [testbed-manager] => (item=osism-include) 2026-04-24 04:17:40.033601 | orchestrator | 2026-04-24 04:17:40.033617 | orchestrator | TASK [osism.services.manager : Include service tasks] ************************** 2026-04-24 04:17:40.112837 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/service.yml for testbed-manager 2026-04-24 04:17:40.112938 | orchestrator | 2026-04-24 04:17:40.112954 | orchestrator | TASK [osism.services.manager : Copy manager systemd unit file] ***************** 2026-04-24 04:17:41.186288 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:41.186402 | orchestrator | 2026-04-24 04:17:41.186419 | orchestrator | TASK [osism.services.manager : Create traefik external network] **************** 2026-04-24 04:17:42.414900 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:42.414983 | orchestrator | 2026-04-24 04:17:42.414994 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb < 11.0.0] *** 2026-04-24 04:17:42.487068 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:17:42.487157 | orchestrator | 2026-04-24 04:17:42.487171 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb >= 11.0.0] *** 2026-04-24 04:17:42.539138 | orchestrator | ok: [testbed-manager] 2026-04-24 04:17:42.539226 | orchestrator | 2026-04-24 04:17:42.539238 | orchestrator | TASK [osism.services.manager : Copy docker-compose.yml file] ******************* 2026-04-24 04:17:43.858855 | orchestrator | changed: [testbed-manager] 2026-04-24 04:17:43.858933 | orchestrator | 2026-04-24 04:17:43.858943 | orchestrator | TASK [osism.services.manager : Pull container images] ************************** 2026-04-24 04:18:56.639620 | orchestrator | changed: [testbed-manager] 2026-04-24 04:18:56.639780 | orchestrator | 2026-04-24 04:18:56.639807 | orchestrator | TASK [osism.services.manager : Stop and disable old service docker-compose@manager] *** 2026-04-24 04:18:57.820770 | orchestrator | ok: [testbed-manager] 2026-04-24 04:18:57.820865 | orchestrator | 2026-04-24 04:18:57.820879 | orchestrator | TASK [osism.services.manager : Do a manual start of the manager service] ******* 2026-04-24 04:18:57.888457 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:18:57.888556 | orchestrator | 2026-04-24 04:18:57.888571 | orchestrator | TASK [osism.services.manager : Manage manager service] ************************* 2026-04-24 04:18:58.775391 | orchestrator | ok: [testbed-manager] 2026-04-24 04:18:58.775496 | orchestrator | 2026-04-24 04:18:58.775513 | orchestrator | TASK [osism.services.manager : Register that manager service was started] ****** 2026-04-24 04:18:58.847774 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:18:58.847887 | orchestrator | 2026-04-24 04:18:58.847910 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-24 04:18:58.847929 | orchestrator | 2026-04-24 04:18:58.847948 | orchestrator | RUNNING HANDLER [osism.services.manager : Restart manager service] ************* 2026-04-24 04:19:31.804695 | orchestrator | changed: [testbed-manager] 2026-04-24 04:19:31.804833 | orchestrator | 2026-04-24 04:19:31.804851 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for manager service to start] *** 2026-04-24 04:20:31.875227 | orchestrator | Pausing for 60 seconds 2026-04-24 04:20:31.875326 | orchestrator | changed: [testbed-manager] 2026-04-24 04:20:31.875337 | orchestrator | 2026-04-24 04:20:31.875347 | orchestrator | RUNNING HANDLER [osism.services.manager : Register that manager service was restarted] *** 2026-04-24 04:20:31.927912 | orchestrator | ok: [testbed-manager] 2026-04-24 04:20:31.928060 | orchestrator | 2026-04-24 04:20:31.928079 | orchestrator | RUNNING HANDLER [osism.services.manager : Ensure that all containers are up] *** 2026-04-24 04:20:35.471965 | orchestrator | changed: [testbed-manager] 2026-04-24 04:20:35.472076 | orchestrator | 2026-04-24 04:20:35.472096 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for an healthy manager service] *** 2026-04-24 04:21:38.412477 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (50 retries left). 2026-04-24 04:21:38.412588 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (49 retries left). 2026-04-24 04:21:38.412603 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (48 retries left). 2026-04-24 04:21:38.412615 | orchestrator | changed: [testbed-manager] 2026-04-24 04:21:38.412626 | orchestrator | 2026-04-24 04:21:38.412637 | orchestrator | RUNNING HANDLER [osism.services.manager : Copy osismclient bash completion script] *** 2026-04-24 04:21:44.688898 | orchestrator | changed: [testbed-manager] 2026-04-24 04:21:44.689013 | orchestrator | 2026-04-24 04:21:44.689031 | orchestrator | TASK [osism.services.manager : Include initialize tasks] *********************** 2026-04-24 04:21:44.786879 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/initialize.yml for testbed-manager 2026-04-24 04:21:44.786981 | orchestrator | 2026-04-24 04:21:44.786991 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-24 04:21:44.786998 | orchestrator | 2026-04-24 04:21:44.787006 | orchestrator | TASK [osism.services.manager : Include vault initialize tasks] ***************** 2026-04-24 04:21:44.852856 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:21:44.852938 | orchestrator | 2026-04-24 04:21:44.852948 | orchestrator | TASK [osism.services.manager : Include version verification tasks] ************* 2026-04-24 04:21:44.968707 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/verify-versions.yml for testbed-manager 2026-04-24 04:21:44.968818 | orchestrator | 2026-04-24 04:21:44.968915 | orchestrator | TASK [osism.services.manager : Deploy service manager version check script] **** 2026-04-24 04:21:46.164524 | orchestrator | changed: [testbed-manager] 2026-04-24 04:21:46.164621 | orchestrator | 2026-04-24 04:21:46.164636 | orchestrator | TASK [osism.services.manager : Execute service manager version check] ********** 2026-04-24 04:21:50.066771 | orchestrator | ok: [testbed-manager] 2026-04-24 04:21:50.066905 | orchestrator | 2026-04-24 04:21:50.066928 | orchestrator | TASK [osism.services.manager : Display version check results] ****************** 2026-04-24 04:21:50.152188 | orchestrator | ok: [testbed-manager] => { 2026-04-24 04:21:50.152267 | orchestrator | "version_check_result.stdout_lines": [ 2026-04-24 04:21:50.152279 | orchestrator | "=== OSISM Container Version Check ===", 2026-04-24 04:21:50.152287 | orchestrator | "Checking running containers against expected versions...", 2026-04-24 04:21:50.152296 | orchestrator | "", 2026-04-24 04:21:50.152304 | orchestrator | "Checking service: inventory_reconciler (Inventory Reconciler Service)", 2026-04-24 04:21:50.152311 | orchestrator | " Expected: registry.osism.tech/osism/inventory-reconciler:0.20260322.0", 2026-04-24 04:21:50.152320 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152327 | orchestrator | " Running: registry.osism.tech/osism/inventory-reconciler:0.20260322.0", 2026-04-24 04:21:50.152335 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152342 | orchestrator | "", 2026-04-24 04:21:50.152350 | orchestrator | "Checking service: osism-ansible (OSISM Ansible Service)", 2026-04-24 04:21:50.152358 | orchestrator | " Expected: registry.osism.tech/osism/osism-ansible:0.20260322.0", 2026-04-24 04:21:50.152365 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152373 | orchestrator | " Running: registry.osism.tech/osism/osism-ansible:0.20260322.0", 2026-04-24 04:21:50.152380 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152387 | orchestrator | "", 2026-04-24 04:21:50.152395 | orchestrator | "Checking service: osism-kubernetes (Osism-Kubernetes Service)", 2026-04-24 04:21:50.152403 | orchestrator | " Expected: registry.osism.tech/osism/osism-kubernetes:0.20260322.0", 2026-04-24 04:21:50.152410 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152417 | orchestrator | " Running: registry.osism.tech/osism/osism-kubernetes:0.20260322.0", 2026-04-24 04:21:50.152425 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152432 | orchestrator | "", 2026-04-24 04:21:50.152439 | orchestrator | "Checking service: ceph-ansible (Ceph-Ansible Service)", 2026-04-24 04:21:50.152446 | orchestrator | " Expected: registry.osism.tech/osism/ceph-ansible:0.20260322.0", 2026-04-24 04:21:50.152454 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152461 | orchestrator | " Running: registry.osism.tech/osism/ceph-ansible:0.20260322.0", 2026-04-24 04:21:50.152468 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152476 | orchestrator | "", 2026-04-24 04:21:50.152483 | orchestrator | "Checking service: kolla-ansible (Kolla-Ansible Service)", 2026-04-24 04:21:50.152490 | orchestrator | " Expected: registry.osism.tech/osism/kolla-ansible:0.20260328.0", 2026-04-24 04:21:50.152498 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152505 | orchestrator | " Running: registry.osism.tech/osism/kolla-ansible:0.20260328.0", 2026-04-24 04:21:50.152512 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152519 | orchestrator | "", 2026-04-24 04:21:50.152527 | orchestrator | "Checking service: osismclient (OSISM Client)", 2026-04-24 04:21:50.152534 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152570 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152579 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152586 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152594 | orchestrator | "", 2026-04-24 04:21:50.152601 | orchestrator | "Checking service: ara-server (ARA Server)", 2026-04-24 04:21:50.152608 | orchestrator | " Expected: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-24 04:21:50.152615 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152622 | orchestrator | " Running: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-24 04:21:50.152629 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152636 | orchestrator | "", 2026-04-24 04:21:50.152643 | orchestrator | "Checking service: mariadb (MariaDB for ARA)", 2026-04-24 04:21:50.152650 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-24 04:21:50.152658 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152685 | orchestrator | " Running: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-24 04:21:50.152692 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152699 | orchestrator | "", 2026-04-24 04:21:50.152706 | orchestrator | "Checking service: frontend (OSISM Frontend)", 2026-04-24 04:21:50.152714 | orchestrator | " Expected: registry.osism.tech/osism/osism-frontend:0.20260320.0", 2026-04-24 04:21:50.152721 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152728 | orchestrator | " Running: registry.osism.tech/osism/osism-frontend:0.20260320.0", 2026-04-24 04:21:50.152735 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152746 | orchestrator | "", 2026-04-24 04:21:50.152754 | orchestrator | "Checking service: redis (Redis Cache)", 2026-04-24 04:21:50.152761 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-24 04:21:50.152768 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152776 | orchestrator | " Running: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-24 04:21:50.152783 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152790 | orchestrator | "", 2026-04-24 04:21:50.152797 | orchestrator | "Checking service: api (OSISM API Service)", 2026-04-24 04:21:50.152805 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152812 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152819 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152826 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152833 | orchestrator | "", 2026-04-24 04:21:50.152840 | orchestrator | "Checking service: listener (OpenStack Event Listener)", 2026-04-24 04:21:50.152848 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152855 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152862 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152869 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152876 | orchestrator | "", 2026-04-24 04:21:50.152883 | orchestrator | "Checking service: openstack (OpenStack Integration)", 2026-04-24 04:21:50.152891 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152898 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152905 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152912 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152919 | orchestrator | "", 2026-04-24 04:21:50.152927 | orchestrator | "Checking service: beat (Celery Beat Scheduler)", 2026-04-24 04:21:50.152934 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152941 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.152949 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152969 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.152976 | orchestrator | "", 2026-04-24 04:21:50.152984 | orchestrator | "Checking service: flower (Celery Flower Monitor)", 2026-04-24 04:21:50.152991 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.152998 | orchestrator | " Enabled: true", 2026-04-24 04:21:50.153011 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-24 04:21:50.153019 | orchestrator | " Status: ✅ MATCH", 2026-04-24 04:21:50.153026 | orchestrator | "", 2026-04-24 04:21:50.153034 | orchestrator | "=== Summary ===", 2026-04-24 04:21:50.153041 | orchestrator | "Errors (version mismatches): 0", 2026-04-24 04:21:50.153048 | orchestrator | "Warnings (expected containers not running): 0", 2026-04-24 04:21:50.153055 | orchestrator | "", 2026-04-24 04:21:50.153063 | orchestrator | "✅ All running containers match expected versions!" 2026-04-24 04:21:50.153070 | orchestrator | ] 2026-04-24 04:21:50.153077 | orchestrator | } 2026-04-24 04:21:50.153085 | orchestrator | 2026-04-24 04:21:50.153093 | orchestrator | TASK [osism.services.manager : Skip version check due to service configuration] *** 2026-04-24 04:21:50.215394 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:21:50.215478 | orchestrator | 2026-04-24 04:21:50.215496 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:21:50.215512 | orchestrator | testbed-manager : ok=51 changed=9 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-24 04:21:50.215527 | orchestrator | 2026-04-24 04:22:03.279131 | orchestrator | 2026-04-24 04:22:03 | INFO  | Task 38ca2bcb-b27a-48ff-9e85-b2816919dea8 (sync inventory) is running in background. Output coming soon. 2026-04-24 04:22:35.388283 | orchestrator | 2026-04-24 04:22:04 | INFO  | Starting group_vars file reorganization 2026-04-24 04:22:35.388399 | orchestrator | 2026-04-24 04:22:04 | INFO  | Moved 0 file(s) to their respective directories 2026-04-24 04:22:35.388417 | orchestrator | 2026-04-24 04:22:04 | INFO  | Group_vars file reorganization completed 2026-04-24 04:22:35.388430 | orchestrator | 2026-04-24 04:22:07 | INFO  | Starting variable preparation from inventory 2026-04-24 04:22:35.388442 | orchestrator | 2026-04-24 04:22:10 | INFO  | Writing 050-kolla-ceph-rgw-hosts.yml with ceph_rgw_hosts 2026-04-24 04:22:35.388453 | orchestrator | 2026-04-24 04:22:10 | INFO  | Writing 050-infrastructure-cephclient-mons.yml with cephclient_mons 2026-04-24 04:22:35.388464 | orchestrator | 2026-04-24 04:22:10 | INFO  | Writing 050-ceph-cluster-fsid.yml with ceph_cluster_fsid 2026-04-24 04:22:35.388475 | orchestrator | 2026-04-24 04:22:10 | INFO  | 3 file(s) written, 6 host(s) processed 2026-04-24 04:22:35.388487 | orchestrator | 2026-04-24 04:22:10 | INFO  | Variable preparation completed 2026-04-24 04:22:35.388498 | orchestrator | 2026-04-24 04:22:12 | INFO  | Starting inventory overwrite handling 2026-04-24 04:22:35.388509 | orchestrator | 2026-04-24 04:22:12 | INFO  | Handling group overwrites in 99-overwrite 2026-04-24 04:22:35.388520 | orchestrator | 2026-04-24 04:22:12 | INFO  | Removing group frr:children from 60-generic 2026-04-24 04:22:35.388531 | orchestrator | 2026-04-24 04:22:12 | INFO  | Removing group netbird:children from 50-infrastructure 2026-04-24 04:22:35.388542 | orchestrator | 2026-04-24 04:22:12 | INFO  | Removing group ceph-rgw from 50-ceph 2026-04-24 04:22:35.388553 | orchestrator | 2026-04-24 04:22:12 | INFO  | Removing group ceph-mds from 50-ceph 2026-04-24 04:22:35.388564 | orchestrator | 2026-04-24 04:22:12 | INFO  | Handling group overwrites in 20-roles 2026-04-24 04:22:35.388575 | orchestrator | 2026-04-24 04:22:12 | INFO  | Removing group k3s_node from 50-infrastructure 2026-04-24 04:22:35.388586 | orchestrator | 2026-04-24 04:22:12 | INFO  | Removed 5 group(s) in total 2026-04-24 04:22:35.388597 | orchestrator | 2026-04-24 04:22:12 | INFO  | Inventory overwrite handling completed 2026-04-24 04:22:35.388608 | orchestrator | 2026-04-24 04:22:13 | INFO  | Starting merge of inventory files 2026-04-24 04:22:35.388619 | orchestrator | 2026-04-24 04:22:13 | INFO  | Inventory files merged successfully 2026-04-24 04:22:35.388721 | orchestrator | 2026-04-24 04:22:19 | INFO  | Generating minified hosts file 2026-04-24 04:22:35.388737 | orchestrator | 2026-04-24 04:22:20 | INFO  | Successfully wrote minified hosts file to /inventory.merge/hosts-minified.yml 2026-04-24 04:22:35.388749 | orchestrator | 2026-04-24 04:22:20 | INFO  | Successfully wrote fast inventory to /inventory.merge/fast/hosts.json 2026-04-24 04:22:35.388760 | orchestrator | 2026-04-24 04:22:22 | INFO  | Generating ClusterShell configuration from Ansible inventory 2026-04-24 04:22:35.388771 | orchestrator | 2026-04-24 04:22:33 | INFO  | Successfully wrote ClusterShell configuration 2026-04-24 04:22:35.602732 | orchestrator | + [[ '' == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-24 04:22:35.602824 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-24 04:22:35.602839 | orchestrator | + local max_attempts=60 2026-04-24 04:22:35.602946 | orchestrator | + local name=kolla-ansible 2026-04-24 04:22:35.602958 | orchestrator | + local attempt_num=1 2026-04-24 04:22:35.603292 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-24 04:22:35.659031 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-24 04:22:35.659133 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-24 04:22:35.659150 | orchestrator | + local max_attempts=60 2026-04-24 04:22:35.659163 | orchestrator | + local name=osism-ansible 2026-04-24 04:22:35.659175 | orchestrator | + local attempt_num=1 2026-04-24 04:22:35.660260 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-24 04:22:35.697064 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-24 04:22:35.697138 | orchestrator | + docker compose --project-directory /opt/manager ps 2026-04-24 04:22:35.904116 | orchestrator | NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS 2026-04-24 04:22:35.904207 | orchestrator | ceph-ansible registry.osism.tech/osism/ceph-ansible:0.20260322.0 "/entrypoint.sh osis…" ceph-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-24 04:22:35.904221 | orchestrator | kolla-ansible registry.osism.tech/osism/kolla-ansible:0.20260328.0 "/entrypoint.sh osis…" kolla-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-24 04:22:35.904230 | orchestrator | manager-api-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" api 3 minutes ago Up 3 minutes (healthy) 192.168.16.5:8000->8000/tcp 2026-04-24 04:22:35.904258 | orchestrator | manager-ara-server-1 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" ara-server 2 hours ago Up 2 minutes (healthy) 8000/tcp 2026-04-24 04:22:35.904267 | orchestrator | manager-beat-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" beat 3 minutes ago Up 3 minutes (healthy) 2026-04-24 04:22:35.904276 | orchestrator | manager-flower-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" flower 3 minutes ago Up 3 minutes (healthy) 2026-04-24 04:22:35.904285 | orchestrator | manager-inventory_reconciler-1 registry.osism.tech/osism/inventory-reconciler:0.20260322.0 "/sbin/tini -- /entr…" inventory_reconciler 3 minutes ago Up 2 minutes (healthy) 2026-04-24 04:22:35.904293 | orchestrator | manager-listener-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" listener 3 minutes ago Restarting (0) 42 seconds ago 2026-04-24 04:22:35.904302 | orchestrator | manager-mariadb-1 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" mariadb 2 hours ago Up 3 minutes (healthy) 3306/tcp 2026-04-24 04:22:35.904310 | orchestrator | manager-openstack-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" openstack 3 minutes ago Up 3 minutes (healthy) 2026-04-24 04:22:35.904503 | orchestrator | manager-redis-1 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" redis 2 hours ago Up 3 minutes (healthy) 6379/tcp 2026-04-24 04:22:35.904518 | orchestrator | osism-ansible registry.osism.tech/osism/osism-ansible:0.20260322.0 "/entrypoint.sh osis…" osism-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-24 04:22:35.904527 | orchestrator | osism-frontend registry.osism.tech/osism/osism-frontend:0.20260320.0 "docker-entrypoint.s…" frontend 3 minutes ago Up 3 minutes 192.168.16.5:3000->3000/tcp 2026-04-24 04:22:35.904536 | orchestrator | osism-kubernetes registry.osism.tech/osism/osism-kubernetes:0.20260322.0 "/entrypoint.sh osis…" osism-kubernetes 3 minutes ago Up 2 minutes (healthy) 2026-04-24 04:22:35.904544 | orchestrator | osismclient registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- sleep…" osismclient 3 minutes ago Up 3 minutes (healthy) 2026-04-24 04:22:35.912251 | orchestrator | + [[ '' == \t\r\u\e ]] 2026-04-24 04:22:35.912332 | orchestrator | + [[ '' == \f\a\l\s\e ]] 2026-04-24 04:22:35.912346 | orchestrator | + osism apply facts 2026-04-24 04:22:47.246358 | orchestrator | 2026-04-24 04:22:47 | INFO  | Prepare task for execution of facts. 2026-04-24 04:22:47.324726 | orchestrator | 2026-04-24 04:22:47 | INFO  | Task d4b20bb7-bc9b-421e-8b85-09c77717fac5 (facts) was prepared for execution. 2026-04-24 04:22:47.324815 | orchestrator | 2026-04-24 04:22:47 | INFO  | It takes a moment until task d4b20bb7-bc9b-421e-8b85-09c77717fac5 (facts) has been started and output is visible here. 2026-04-24 04:23:05.462368 | orchestrator | 2026-04-24 04:23:05.462482 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-24 04:23:05.462498 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 04:23:05.462511 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 04:23:05.462534 | orchestrator | 2026-04-24 04:23:05.462545 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-24 04:23:05.462556 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 04:23:05.462567 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 04:23:05.462589 | orchestrator | Friday 24 April 2026 04:22:52 +0000 (0:00:01.638) 0:00:01.638 ********** 2026-04-24 04:23:05.462599 | orchestrator | ok: [testbed-manager] 2026-04-24 04:23:05.462611 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:23:05.462622 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:23:05.462633 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:23:05.462644 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:23:05.462703 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:23:05.462714 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:23:05.462724 | orchestrator | 2026-04-24 04:23:05.462735 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-24 04:23:05.462746 | orchestrator | Friday 24 April 2026 04:22:54 +0000 (0:00:02.282) 0:00:03.920 ********** 2026-04-24 04:23:05.462757 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:23:05.462768 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:23:05.462778 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:23:05.462790 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:23:05.462800 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:23:05.462811 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:23:05.462822 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:23:05.462832 | orchestrator | 2026-04-24 04:23:05.462843 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-24 04:23:05.462882 | orchestrator | 2026-04-24 04:23:05.462894 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 04:23:05.462905 | orchestrator | Friday 24 April 2026 04:22:57 +0000 (0:00:02.374) 0:00:06.295 ********** 2026-04-24 04:23:05.462917 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:23:05.462930 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:23:05.462943 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:23:05.462956 | orchestrator | ok: [testbed-manager] 2026-04-24 04:23:05.462969 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:23:05.462981 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:23:05.462994 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:23:05.463007 | orchestrator | 2026-04-24 04:23:05.463019 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-24 04:23:05.463032 | orchestrator | 2026-04-24 04:23:05.463044 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-24 04:23:05.463057 | orchestrator | Friday 24 April 2026 04:23:03 +0000 (0:00:06.046) 0:00:12.342 ********** 2026-04-24 04:23:05.463070 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:23:05.463082 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:23:05.463095 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:23:05.463108 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:23:05.463120 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:23:05.463132 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:23:05.463145 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:23:05.463158 | orchestrator | 2026-04-24 04:23:05.463171 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:23:05.463184 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:23:05.463198 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:23:05.463212 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:23:05.463225 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:23:05.463238 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:23:05.463251 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:23:05.463263 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 04:23:05.463274 | orchestrator | 2026-04-24 04:23:05.463285 | orchestrator | 2026-04-24 04:23:05.463296 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:23:05.463307 | orchestrator | Friday 24 April 2026 04:23:05 +0000 (0:00:01.800) 0:00:14.143 ********** 2026-04-24 04:23:05.463317 | orchestrator | =============================================================================== 2026-04-24 04:23:05.463345 | orchestrator | Gathers facts about hosts ----------------------------------------------- 6.05s 2026-04-24 04:23:05.463356 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 2.37s 2026-04-24 04:23:05.463367 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 2.28s 2026-04-24 04:23:05.463378 | orchestrator | Gather facts for all hosts ---------------------------------------------- 1.80s 2026-04-24 04:23:05.668904 | orchestrator | + [[ 10.0.0 != \l\a\t\e\s\t ]] 2026-04-24 04:23:05.669235 | orchestrator | ++ semver 10.0.0 10.0.0-0 2026-04-24 04:23:05.765099 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 04:23:05.765581 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "de.osism.release.openstack"}}' kolla-ansible 2026-04-24 04:23:05.797956 | orchestrator | + OPENSTACK_VERSION=2025.1 2026-04-24 04:23:05.798099 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release/2025.1 2026-04-24 04:23:05.803086 | orchestrator | + set -e 2026-04-24 04:23:05.803151 | orchestrator | + NAMESPACE=kolla/release/2025.1 2026-04-24 04:23:05.803165 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release/2025.1#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-24 04:23:05.811719 | orchestrator | + sh -c /opt/configuration/scripts/upgrade-services.sh 2026-04-24 04:23:05.818716 | orchestrator | 2026-04-24 04:23:05.818773 | orchestrator | # UPGRADE SERVICES 2026-04-24 04:23:05.818785 | orchestrator | 2026-04-24 04:23:05.818795 | orchestrator | + set -e 2026-04-24 04:23:05.818806 | orchestrator | + echo 2026-04-24 04:23:05.818816 | orchestrator | + echo '# UPGRADE SERVICES' 2026-04-24 04:23:05.818825 | orchestrator | + echo 2026-04-24 04:23:05.818835 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 04:23:05.819758 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 04:23:05.819789 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 04:23:05.819800 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 04:23:05.819811 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 04:23:05.819823 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 04:23:05.819834 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 04:23:05.819845 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 04:23:05.819857 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 04:23:05.819867 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 04:23:05.819878 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 04:23:05.819889 | orchestrator | ++ export ARA=false 2026-04-24 04:23:05.819900 | orchestrator | ++ ARA=false 2026-04-24 04:23:05.819910 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 04:23:05.819921 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 04:23:05.819932 | orchestrator | ++ export TEMPEST=false 2026-04-24 04:23:05.819942 | orchestrator | ++ TEMPEST=false 2026-04-24 04:23:05.819953 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 04:23:05.819963 | orchestrator | ++ IS_ZUUL=true 2026-04-24 04:23:05.819974 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:23:05.819985 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:23:05.819996 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 04:23:05.820022 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 04:23:05.820033 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 04:23:05.820044 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 04:23:05.820066 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 04:23:05.820077 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 04:23:05.820088 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 04:23:05.820099 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 04:23:05.820110 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-24 04:23:05.820120 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-24 04:23:05.820131 | orchestrator | + SKIP_OPENSTACK_UPGRADE=false 2026-04-24 04:23:05.820142 | orchestrator | + SKIP_CEPH_UPGRADE=false 2026-04-24 04:23:05.820153 | orchestrator | + sh -c /opt/configuration/scripts/pull-images.sh 2026-04-24 04:23:05.825910 | orchestrator | + set -e 2026-04-24 04:23:05.825946 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 04:23:05.827127 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 04:23:05.827164 | orchestrator | ++ INTERACTIVE=false 2026-04-24 04:23:05.827175 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 04:23:05.827186 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 04:23:05.827197 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 04:23:05.827208 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 04:23:05.827219 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 04:23:05.827229 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 04:23:05.827240 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 04:23:05.827251 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 04:23:05.827262 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 04:23:05.827273 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 04:23:05.827284 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 04:23:05.827296 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 04:23:05.827306 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 04:23:05.827317 | orchestrator | ++ export ARA=false 2026-04-24 04:23:05.827328 | orchestrator | ++ ARA=false 2026-04-24 04:23:05.827340 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 04:23:05.827351 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 04:23:05.827362 | orchestrator | ++ export TEMPEST=false 2026-04-24 04:23:05.827373 | orchestrator | ++ TEMPEST=false 2026-04-24 04:23:05.827386 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 04:23:05.827404 | orchestrator | ++ IS_ZUUL=true 2026-04-24 04:23:05.827465 | orchestrator | 2026-04-24 04:23:05.827489 | orchestrator | # PULL IMAGES 2026-04-24 04:23:05.827507 | orchestrator | 2026-04-24 04:23:05.827526 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:23:05.827546 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 04:23:05.827565 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 04:23:05.827586 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 04:23:05.827604 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 04:23:05.827623 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 04:23:05.827635 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 04:23:05.827698 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 04:23:05.827712 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 04:23:05.827723 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 04:23:05.827734 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-24 04:23:05.827747 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-24 04:23:05.827773 | orchestrator | + echo 2026-04-24 04:23:05.827796 | orchestrator | + echo '# PULL IMAGES' 2026-04-24 04:23:05.827815 | orchestrator | + echo 2026-04-24 04:23:05.828134 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-24 04:23:05.884040 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 04:23:05.884124 | orchestrator | + osism apply --no-wait -r 2 -e custom pull-images 2026-04-24 04:23:07.258232 | orchestrator | 2026-04-24 04:23:07 | INFO  | Trying to run play pull-images in environment custom 2026-04-24 04:23:17.368113 | orchestrator | 2026-04-24 04:23:17 | INFO  | Prepare task for execution of pull-images. 2026-04-24 04:23:17.482287 | orchestrator | 2026-04-24 04:23:17 | INFO  | Task ae457fcd-9ad5-4be7-985e-6d20db058be2 (pull-images) was prepared for execution. 2026-04-24 04:23:17.482371 | orchestrator | 2026-04-24 04:23:17 | INFO  | Task ae457fcd-9ad5-4be7-985e-6d20db058be2 is running in background. No more output. Check ARA for logs. 2026-04-24 04:23:17.690519 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/500-kubernetes.sh 2026-04-24 04:23:17.702465 | orchestrator | + set -e 2026-04-24 04:23:17.702550 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 04:23:17.702565 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 04:23:17.702577 | orchestrator | ++ INTERACTIVE=false 2026-04-24 04:23:17.702588 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 04:23:17.702599 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 04:23:17.702610 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 04:23:17.704287 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 04:23:17.708241 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-24 04:23:17.708328 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-24 04:23:17.709094 | orchestrator | ++ semver 10.0.0 8.0.3 2026-04-24 04:23:17.769579 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 04:23:17.769744 | orchestrator | + osism apply frr 2026-04-24 04:23:29.200528 | orchestrator | 2026-04-24 04:23:29 | INFO  | Prepare task for execution of frr. 2026-04-24 04:23:29.325687 | orchestrator | 2026-04-24 04:23:29 | INFO  | Task 163bc034-8e3a-43c9-b812-529af6d7dd19 (frr) was prepared for execution. 2026-04-24 04:23:29.325781 | orchestrator | 2026-04-24 04:23:29 | INFO  | It takes a moment until task 163bc034-8e3a-43c9-b812-529af6d7dd19 (frr) has been started and output is visible here. 2026-04-24 04:24:04.997364 | orchestrator | 2026-04-24 04:24:04.997507 | orchestrator | PLAY [Apply role frr] ********************************************************** 2026-04-24 04:24:04.997530 | orchestrator | 2026-04-24 04:24:04.997542 | orchestrator | TASK [osism.services.frr : Include distribution specific install tasks] ******** 2026-04-24 04:24:04.997554 | orchestrator | Friday 24 April 2026 04:23:36 +0000 (0:00:03.919) 0:00:03.919 ********** 2026-04-24 04:24:04.997577 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/frr/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 04:24:04.997591 | orchestrator | 2026-04-24 04:24:04.997602 | orchestrator | TASK [osism.services.frr : Pin frr package version] **************************** 2026-04-24 04:24:04.997614 | orchestrator | Friday 24 April 2026 04:23:38 +0000 (0:00:01.804) 0:00:05.723 ********** 2026-04-24 04:24:04.997679 | orchestrator | ok: [testbed-manager] 2026-04-24 04:24:04.997694 | orchestrator | 2026-04-24 04:24:04.997706 | orchestrator | TASK [osism.services.frr : Install frr package] ******************************** 2026-04-24 04:24:04.997743 | orchestrator | Friday 24 April 2026 04:23:41 +0000 (0:00:02.548) 0:00:08.271 ********** 2026-04-24 04:24:04.997754 | orchestrator | ok: [testbed-manager] 2026-04-24 04:24:04.997765 | orchestrator | 2026-04-24 04:24:04.997776 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/vtysh.conf] ********************* 2026-04-24 04:24:04.997787 | orchestrator | Friday 24 April 2026 04:23:44 +0000 (0:00:03.021) 0:00:11.292 ********** 2026-04-24 04:24:04.997804 | orchestrator | ok: [testbed-manager] 2026-04-24 04:24:04.997815 | orchestrator | 2026-04-24 04:24:04.997826 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/daemons] ************************ 2026-04-24 04:24:04.997836 | orchestrator | Friday 24 April 2026 04:23:46 +0000 (0:00:01.972) 0:00:13.265 ********** 2026-04-24 04:24:04.997847 | orchestrator | ok: [testbed-manager] 2026-04-24 04:24:04.997858 | orchestrator | 2026-04-24 04:24:04.997869 | orchestrator | TASK [osism.services.frr : Set _frr_uplinks fact] ****************************** 2026-04-24 04:24:04.997882 | orchestrator | Friday 24 April 2026 04:23:48 +0000 (0:00:02.019) 0:00:15.284 ********** 2026-04-24 04:24:04.997895 | orchestrator | ok: [testbed-manager] 2026-04-24 04:24:04.997908 | orchestrator | 2026-04-24 04:24:04.997921 | orchestrator | TASK [osism.services.frr : Write frr_config_template to temporary file] ******** 2026-04-24 04:24:04.997934 | orchestrator | Friday 24 April 2026 04:23:50 +0000 (0:00:02.574) 0:00:17.859 ********** 2026-04-24 04:24:04.997948 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:24:04.997961 | orchestrator | 2026-04-24 04:24:04.997974 | orchestrator | TASK [osism.services.frr : Render frr.conf from frr_config_template variable] *** 2026-04-24 04:24:04.997987 | orchestrator | Friday 24 April 2026 04:23:51 +0000 (0:00:01.208) 0:00:19.067 ********** 2026-04-24 04:24:04.998000 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:24:04.998152 | orchestrator | 2026-04-24 04:24:04.998178 | orchestrator | TASK [osism.services.frr : Remove temporary frr_config_template file] ********** 2026-04-24 04:24:04.998201 | orchestrator | Friday 24 April 2026 04:23:53 +0000 (0:00:01.120) 0:00:20.188 ********** 2026-04-24 04:24:04.998221 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:24:04.998238 | orchestrator | 2026-04-24 04:24:04.998253 | orchestrator | TASK [osism.services.frr : Check for frr.conf file in the configuration repository] *** 2026-04-24 04:24:04.998266 | orchestrator | Friday 24 April 2026 04:23:54 +0000 (0:00:01.178) 0:00:21.367 ********** 2026-04-24 04:24:04.998277 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:24:04.998287 | orchestrator | 2026-04-24 04:24:04.998298 | orchestrator | TASK [osism.services.frr : Copy frr.conf file from the configuration repository] *** 2026-04-24 04:24:04.998309 | orchestrator | Friday 24 April 2026 04:23:55 +0000 (0:00:01.179) 0:00:22.546 ********** 2026-04-24 04:24:04.998320 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:24:04.998330 | orchestrator | 2026-04-24 04:24:04.998341 | orchestrator | TASK [osism.services.frr : Copy default frr.conf file of type k3s_cilium] ****** 2026-04-24 04:24:04.998352 | orchestrator | Friday 24 April 2026 04:23:56 +0000 (0:00:01.234) 0:00:23.780 ********** 2026-04-24 04:24:04.998362 | orchestrator | ok: [testbed-manager] 2026-04-24 04:24:04.998379 | orchestrator | 2026-04-24 04:24:04.998398 | orchestrator | TASK [osism.services.frr : Set sysctl parameters] ****************************** 2026-04-24 04:24:04.998416 | orchestrator | Friday 24 April 2026 04:23:58 +0000 (0:00:01.926) 0:00:25.707 ********** 2026-04-24 04:24:04.998433 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-04-24 04:24:04.998452 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.send_redirects', 'value': 0}) 2026-04-24 04:24:04.998473 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.accept_redirects', 'value': 0}) 2026-04-24 04:24:04.998491 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.fib_multipath_hash_policy', 'value': 1}) 2026-04-24 04:24:04.998509 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.default.ignore_routes_with_linkdown', 'value': 1}) 2026-04-24 04:24:04.998524 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 2}) 2026-04-24 04:24:04.998547 | orchestrator | 2026-04-24 04:24:04.998558 | orchestrator | TASK [osism.services.frr : Manage frr service] ********************************* 2026-04-24 04:24:04.998569 | orchestrator | Friday 24 April 2026 04:24:02 +0000 (0:00:03.512) 0:00:29.219 ********** 2026-04-24 04:24:04.998580 | orchestrator | ok: [testbed-manager] 2026-04-24 04:24:04.998591 | orchestrator | 2026-04-24 04:24:04.998601 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:24:04.998612 | orchestrator | testbed-manager : ok=9  changed=0 unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 04:24:04.998623 | orchestrator | 2026-04-24 04:24:04.998712 | orchestrator | 2026-04-24 04:24:04.998798 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:24:04.998823 | orchestrator | Friday 24 April 2026 04:24:04 +0000 (0:00:02.547) 0:00:31.769 ********** 2026-04-24 04:24:04.998841 | orchestrator | =============================================================================== 2026-04-24 04:24:04.998885 | orchestrator | osism.services.frr : Set sysctl parameters ------------------------------ 3.51s 2026-04-24 04:24:04.998905 | orchestrator | osism.services.frr : Install frr package -------------------------------- 3.02s 2026-04-24 04:24:04.998923 | orchestrator | osism.services.frr : Set _frr_uplinks fact ------------------------------ 2.57s 2026-04-24 04:24:04.998942 | orchestrator | osism.services.frr : Manage frr service --------------------------------- 2.55s 2026-04-24 04:24:04.998960 | orchestrator | osism.services.frr : Pin frr package version ---------------------------- 2.55s 2026-04-24 04:24:04.998978 | orchestrator | osism.services.frr : Copy file: /etc/frr/daemons ------------------------ 2.02s 2026-04-24 04:24:04.998989 | orchestrator | osism.services.frr : Copy file: /etc/frr/vtysh.conf --------------------- 1.97s 2026-04-24 04:24:04.998999 | orchestrator | osism.services.frr : Copy default frr.conf file of type k3s_cilium ------ 1.93s 2026-04-24 04:24:04.999010 | orchestrator | osism.services.frr : Include distribution specific install tasks -------- 1.80s 2026-04-24 04:24:04.999021 | orchestrator | osism.services.frr : Copy frr.conf file from the configuration repository --- 1.23s 2026-04-24 04:24:04.999032 | orchestrator | osism.services.frr : Write frr_config_template to temporary file -------- 1.21s 2026-04-24 04:24:04.999043 | orchestrator | osism.services.frr : Check for frr.conf file in the configuration repository --- 1.18s 2026-04-24 04:24:04.999053 | orchestrator | osism.services.frr : Remove temporary frr_config_template file ---------- 1.18s 2026-04-24 04:24:04.999064 | orchestrator | osism.services.frr : Render frr.conf from frr_config_template variable --- 1.12s 2026-04-24 04:24:05.232274 | orchestrator | + osism apply kubernetes 2026-04-24 04:24:06.553308 | orchestrator | 2026-04-24 04:24:06 | INFO  | Prepare task for execution of kubernetes. 2026-04-24 04:24:06.628568 | orchestrator | 2026-04-24 04:24:06 | INFO  | Task 06590aca-6a82-4ce8-b9a1-7cd839588926 (kubernetes) was prepared for execution. 2026-04-24 04:24:06.628723 | orchestrator | 2026-04-24 04:24:06 | INFO  | It takes a moment until task 06590aca-6a82-4ce8-b9a1-7cd839588926 (kubernetes) has been started and output is visible here. 2026-04-24 04:24:48.265488 | orchestrator | 2026-04-24 04:24:48.265602 | orchestrator | PLAY [Prepare all k3s nodes] *************************************************** 2026-04-24 04:24:48.265659 | orchestrator | 2026-04-24 04:24:48.265672 | orchestrator | TASK [k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites] *** 2026-04-24 04:24:48.265685 | orchestrator | Friday 24 April 2026 04:24:12 +0000 (0:00:01.984) 0:00:01.985 ********** 2026-04-24 04:24:48.265696 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:24:48.265709 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:24:48.265719 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:24:48.265730 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:24:48.265741 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:24:48.265752 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:24:48.265763 | orchestrator | 2026-04-24 04:24:48.265774 | orchestrator | TASK [k3s_prereq : Set same timezone on every Server] ************************** 2026-04-24 04:24:48.265785 | orchestrator | Friday 24 April 2026 04:24:16 +0000 (0:00:04.004) 0:00:05.990 ********** 2026-04-24 04:24:48.265818 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.265830 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.265841 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.265852 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.265862 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.265873 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.265884 | orchestrator | 2026-04-24 04:24:48.265895 | orchestrator | TASK [k3s_prereq : Set SELinux to disabled state] ****************************** 2026-04-24 04:24:48.265906 | orchestrator | Friday 24 April 2026 04:24:18 +0000 (0:00:01.973) 0:00:07.963 ********** 2026-04-24 04:24:48.265916 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.265927 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.265938 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.265948 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.265959 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.265969 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.265980 | orchestrator | 2026-04-24 04:24:48.265991 | orchestrator | TASK [k3s_prereq : Enable IPv4 forwarding] ************************************* 2026-04-24 04:24:48.266005 | orchestrator | Friday 24 April 2026 04:24:20 +0000 (0:00:01.798) 0:00:09.762 ********** 2026-04-24 04:24:48.266077 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:24:48.266091 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:24:48.266104 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:24:48.266116 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:24:48.266129 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:24:48.266142 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:24:48.266154 | orchestrator | 2026-04-24 04:24:48.266167 | orchestrator | TASK [k3s_prereq : Enable IPv6 forwarding] ************************************* 2026-04-24 04:24:48.266179 | orchestrator | Friday 24 April 2026 04:24:22 +0000 (0:00:02.552) 0:00:12.315 ********** 2026-04-24 04:24:48.266192 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:24:48.266205 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:24:48.266217 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:24:48.266230 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:24:48.266242 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:24:48.266254 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:24:48.266267 | orchestrator | 2026-04-24 04:24:48.266279 | orchestrator | TASK [k3s_prereq : Enable IPv6 router advertisements] ************************** 2026-04-24 04:24:48.266292 | orchestrator | Friday 24 April 2026 04:24:24 +0000 (0:00:02.073) 0:00:14.388 ********** 2026-04-24 04:24:48.266305 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:24:48.266317 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:24:48.266329 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:24:48.266342 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:24:48.266354 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:24:48.266366 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:24:48.266377 | orchestrator | 2026-04-24 04:24:48.266388 | orchestrator | TASK [k3s_prereq : Add br_netfilter to /etc/modules-load.d/] ******************* 2026-04-24 04:24:48.266399 | orchestrator | Friday 24 April 2026 04:24:26 +0000 (0:00:02.353) 0:00:16.742 ********** 2026-04-24 04:24:48.266410 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.266421 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.266432 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.266442 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.266453 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.266464 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.266475 | orchestrator | 2026-04-24 04:24:48.266486 | orchestrator | TASK [k3s_prereq : Load br_netfilter] ****************************************** 2026-04-24 04:24:48.266497 | orchestrator | Friday 24 April 2026 04:24:28 +0000 (0:00:01.946) 0:00:18.688 ********** 2026-04-24 04:24:48.266507 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.266518 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.266529 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.266539 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.266556 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.266567 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.266578 | orchestrator | 2026-04-24 04:24:48.266589 | orchestrator | TASK [k3s_prereq : Set bridge-nf-call-iptables (just to be sure)] ************** 2026-04-24 04:24:48.266600 | orchestrator | Friday 24 April 2026 04:24:31 +0000 (0:00:02.089) 0:00:20.777 ********** 2026-04-24 04:24:48.266611 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 04:24:48.266641 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 04:24:48.266652 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.266663 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 04:24:48.266674 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 04:24:48.266685 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.266696 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 04:24:48.266707 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 04:24:48.266717 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.266728 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 04:24:48.266739 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 04:24:48.266751 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.266780 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 04:24:48.266791 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 04:24:48.266802 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.266812 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 04:24:48.266823 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 04:24:48.266834 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.266845 | orchestrator | 2026-04-24 04:24:48.266855 | orchestrator | TASK [k3s_prereq : Add /usr/local/bin to sudo secure_path] ********************* 2026-04-24 04:24:48.266866 | orchestrator | Friday 24 April 2026 04:24:33 +0000 (0:00:02.088) 0:00:22.866 ********** 2026-04-24 04:24:48.266877 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.266888 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.266898 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.266909 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.266920 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.266931 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.266941 | orchestrator | 2026-04-24 04:24:48.266952 | orchestrator | TASK [k3s_download : Validating arguments against arg spec 'main' - Manage the downloading of K3S binaries] *** 2026-04-24 04:24:48.266965 | orchestrator | Friday 24 April 2026 04:24:35 +0000 (0:00:02.198) 0:00:25.064 ********** 2026-04-24 04:24:48.266975 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:24:48.266986 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:24:48.266997 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:24:48.267008 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:24:48.267019 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:24:48.267029 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:24:48.267040 | orchestrator | 2026-04-24 04:24:48.267051 | orchestrator | TASK [k3s_download : Download k3s binary x64] ********************************** 2026-04-24 04:24:48.267061 | orchestrator | Friday 24 April 2026 04:24:37 +0000 (0:00:01.842) 0:00:26.907 ********** 2026-04-24 04:24:48.267072 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:24:48.267083 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:24:48.267094 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:24:48.267105 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:24:48.267120 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:24:48.267131 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:24:48.267153 | orchestrator | 2026-04-24 04:24:48.267164 | orchestrator | TASK [k3s_download : Download k3s binary arm64] ******************************** 2026-04-24 04:24:48.267175 | orchestrator | Friday 24 April 2026 04:24:39 +0000 (0:00:02.664) 0:00:29.571 ********** 2026-04-24 04:24:48.267201 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.267223 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.267246 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.267257 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.267268 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.267278 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.267289 | orchestrator | 2026-04-24 04:24:48.267300 | orchestrator | TASK [k3s_download : Download k3s binary armhf] ******************************** 2026-04-24 04:24:48.267310 | orchestrator | Friday 24 April 2026 04:24:41 +0000 (0:00:01.802) 0:00:31.374 ********** 2026-04-24 04:24:48.267321 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.267331 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.267342 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.267352 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.267363 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.267374 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.267384 | orchestrator | 2026-04-24 04:24:48.267395 | orchestrator | TASK [k3s_custom_registries : Validating arguments against arg spec 'main' - Configure the use of a custom container registry] *** 2026-04-24 04:24:48.267408 | orchestrator | Friday 24 April 2026 04:24:43 +0000 (0:00:02.236) 0:00:33.611 ********** 2026-04-24 04:24:48.267418 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.267429 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.267439 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.267450 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.267461 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.267471 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.267482 | orchestrator | 2026-04-24 04:24:48.267492 | orchestrator | TASK [k3s_custom_registries : Create directory /etc/rancher/k3s] *************** 2026-04-24 04:24:48.267503 | orchestrator | Friday 24 April 2026 04:24:45 +0000 (0:00:02.110) 0:00:35.721 ********** 2026-04-24 04:24:48.267514 | orchestrator | skipping: [testbed-node-3] => (item=rancher)  2026-04-24 04:24:48.267524 | orchestrator | skipping: [testbed-node-3] => (item=rancher/k3s)  2026-04-24 04:24:48.267535 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.267546 | orchestrator | skipping: [testbed-node-4] => (item=rancher)  2026-04-24 04:24:48.267556 | orchestrator | skipping: [testbed-node-4] => (item=rancher/k3s)  2026-04-24 04:24:48.267567 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.267578 | orchestrator | skipping: [testbed-node-5] => (item=rancher)  2026-04-24 04:24:48.267588 | orchestrator | skipping: [testbed-node-5] => (item=rancher/k3s)  2026-04-24 04:24:48.267599 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:24:48.267610 | orchestrator | skipping: [testbed-node-0] => (item=rancher)  2026-04-24 04:24:48.267645 | orchestrator | skipping: [testbed-node-0] => (item=rancher/k3s)  2026-04-24 04:24:48.267655 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:24:48.267671 | orchestrator | skipping: [testbed-node-1] => (item=rancher)  2026-04-24 04:24:48.267682 | orchestrator | skipping: [testbed-node-1] => (item=rancher/k3s)  2026-04-24 04:24:48.267692 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:24:48.267703 | orchestrator | skipping: [testbed-node-2] => (item=rancher)  2026-04-24 04:24:48.267714 | orchestrator | skipping: [testbed-node-2] => (item=rancher/k3s)  2026-04-24 04:24:48.267724 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:24:48.267735 | orchestrator | 2026-04-24 04:24:48.267746 | orchestrator | TASK [k3s_custom_registries : Insert registries into /etc/rancher/k3s/registries.yaml] *** 2026-04-24 04:24:48.267757 | orchestrator | Friday 24 April 2026 04:24:47 +0000 (0:00:01.778) 0:00:37.499 ********** 2026-04-24 04:24:48.267767 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:24:48.267778 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:24:48.267803 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:26:26.669317 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:26:26.669426 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.669441 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.669452 | orchestrator | 2026-04-24 04:26:26.669463 | orchestrator | TASK [k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured] *** 2026-04-24 04:26:26.669475 | orchestrator | Friday 24 April 2026 04:24:49 +0000 (0:00:01.923) 0:00:39.422 ********** 2026-04-24 04:26:26.669485 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:26:26.669508 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:26:26.669518 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:26:26.669528 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:26:26.669537 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.669547 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.669557 | orchestrator | 2026-04-24 04:26:26.669567 | orchestrator | PLAY [Deploy k3s master nodes] ************************************************* 2026-04-24 04:26:26.669576 | orchestrator | 2026-04-24 04:26:26.669670 | orchestrator | TASK [k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers] *** 2026-04-24 04:26:26.669683 | orchestrator | Friday 24 April 2026 04:24:52 +0000 (0:00:02.719) 0:00:42.142 ********** 2026-04-24 04:26:26.669692 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.669703 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.669712 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.669722 | orchestrator | 2026-04-24 04:26:26.669732 | orchestrator | TASK [k3s_server : Stop k3s-init] ********************************************** 2026-04-24 04:26:26.669742 | orchestrator | Friday 24 April 2026 04:24:55 +0000 (0:00:02.810) 0:00:44.955 ********** 2026-04-24 04:26:26.669752 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.669762 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.669772 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.669781 | orchestrator | 2026-04-24 04:26:26.669791 | orchestrator | TASK [k3s_server : Stop k3s] *************************************************** 2026-04-24 04:26:26.669800 | orchestrator | Friday 24 April 2026 04:24:57 +0000 (0:00:02.794) 0:00:47.750 ********** 2026-04-24 04:26:26.669810 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:26:26.669820 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:26:26.669829 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:26:26.669839 | orchestrator | 2026-04-24 04:26:26.669848 | orchestrator | TASK [k3s_server : Clean previous runs of k3s-init] **************************** 2026-04-24 04:26:26.669858 | orchestrator | Friday 24 April 2026 04:25:00 +0000 (0:00:02.120) 0:00:49.870 ********** 2026-04-24 04:26:26.669868 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.669877 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.669887 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.669896 | orchestrator | 2026-04-24 04:26:26.669906 | orchestrator | TASK [k3s_server : Deploy K3s http_proxy conf] ********************************* 2026-04-24 04:26:26.669915 | orchestrator | Friday 24 April 2026 04:25:01 +0000 (0:00:01.723) 0:00:51.593 ********** 2026-04-24 04:26:26.669925 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:26:26.669935 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.669944 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.669954 | orchestrator | 2026-04-24 04:26:26.669963 | orchestrator | TASK [k3s_server : Create /etc/rancher/k3s directory] ************************** 2026-04-24 04:26:26.669973 | orchestrator | Friday 24 April 2026 04:25:03 +0000 (0:00:01.372) 0:00:52.966 ********** 2026-04-24 04:26:26.669982 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.669992 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.670001 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.670011 | orchestrator | 2026-04-24 04:26:26.670078 | orchestrator | TASK [k3s_server : Create custom resolv.conf for k3s] ************************** 2026-04-24 04:26:26.670089 | orchestrator | Friday 24 April 2026 04:25:05 +0000 (0:00:01.959) 0:00:54.926 ********** 2026-04-24 04:26:26.670098 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.670108 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.670141 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.670151 | orchestrator | 2026-04-24 04:26:26.670161 | orchestrator | TASK [k3s_server : Deploy vip manifest] **************************************** 2026-04-24 04:26:26.670171 | orchestrator | Friday 24 April 2026 04:25:07 +0000 (0:00:02.227) 0:00:57.154 ********** 2026-04-24 04:26:26.670180 | orchestrator | included: /ansible/roles/k3s_server/tasks/vip.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:26:26.670190 | orchestrator | 2026-04-24 04:26:26.670199 | orchestrator | TASK [k3s_server : Set _kube_vip_bgp_peers fact] ******************************* 2026-04-24 04:26:26.670209 | orchestrator | Friday 24 April 2026 04:25:09 +0000 (0:00:01.719) 0:00:58.873 ********** 2026-04-24 04:26:26.670218 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.670228 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.670237 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.670246 | orchestrator | 2026-04-24 04:26:26.670256 | orchestrator | TASK [k3s_server : Create manifests directory on first master] ***************** 2026-04-24 04:26:26.670265 | orchestrator | Friday 24 April 2026 04:25:11 +0000 (0:00:02.631) 0:01:01.504 ********** 2026-04-24 04:26:26.670275 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.670284 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.670294 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.670303 | orchestrator | 2026-04-24 04:26:26.670313 | orchestrator | TASK [k3s_server : Download vip rbac manifest to first master] ***************** 2026-04-24 04:26:26.670322 | orchestrator | Friday 24 April 2026 04:25:13 +0000 (0:00:01.554) 0:01:03.059 ********** 2026-04-24 04:26:26.670332 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.670342 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.670351 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:26:26.670360 | orchestrator | 2026-04-24 04:26:26.670370 | orchestrator | TASK [k3s_server : Copy vip manifest to first master] ************************** 2026-04-24 04:26:26.670380 | orchestrator | Friday 24 April 2026 04:25:15 +0000 (0:00:01.854) 0:01:04.913 ********** 2026-04-24 04:26:26.670389 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.670399 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.670408 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:26:26.670417 | orchestrator | 2026-04-24 04:26:26.670427 | orchestrator | TASK [k3s_server : Deploy metallb manifest] ************************************ 2026-04-24 04:26:26.670436 | orchestrator | Friday 24 April 2026 04:25:17 +0000 (0:00:02.447) 0:01:07.361 ********** 2026-04-24 04:26:26.670446 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:26:26.670456 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.670483 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.670494 | orchestrator | 2026-04-24 04:26:26.670503 | orchestrator | TASK [k3s_server : Deploy kube-vip manifest] *********************************** 2026-04-24 04:26:26.670529 | orchestrator | Friday 24 April 2026 04:25:18 +0000 (0:00:01.362) 0:01:08.724 ********** 2026-04-24 04:26:26.670539 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:26:26.670549 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.670558 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.670568 | orchestrator | 2026-04-24 04:26:26.670577 | orchestrator | TASK [k3s_server : Init cluster inside the transient k3s-init service] ********* 2026-04-24 04:26:26.670606 | orchestrator | Friday 24 April 2026 04:25:20 +0000 (0:00:01.392) 0:01:10.117 ********** 2026-04-24 04:26:26.670616 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:26:26.670625 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:26:26.670635 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:26:26.670644 | orchestrator | 2026-04-24 04:26:26.670654 | orchestrator | TASK [k3s_server : Detect Kubernetes version for label compatibility] ********** 2026-04-24 04:26:26.670663 | orchestrator | Friday 24 April 2026 04:25:22 +0000 (0:00:02.330) 0:01:12.448 ********** 2026-04-24 04:26:26.670673 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.670682 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.670692 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.670701 | orchestrator | 2026-04-24 04:26:26.670711 | orchestrator | TASK [k3s_server : Set node role label selector based on Kubernetes version] *** 2026-04-24 04:26:26.670729 | orchestrator | Friday 24 April 2026 04:25:24 +0000 (0:00:02.211) 0:01:14.659 ********** 2026-04-24 04:26:26.670738 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.670748 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.670757 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.670767 | orchestrator | 2026-04-24 04:26:26.670776 | orchestrator | TASK [k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails)] *** 2026-04-24 04:26:26.670786 | orchestrator | Friday 24 April 2026 04:25:26 +0000 (0:00:01.373) 0:01:16.032 ********** 2026-04-24 04:26:26.670796 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-24 04:26:26.670807 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-24 04:26:26.670817 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-24 04:26:26.670826 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-24 04:26:26.670836 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-24 04:26:26.670846 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-24 04:26:26.670855 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.670865 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.670874 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.670883 | orchestrator | 2026-04-24 04:26:26.670893 | orchestrator | TASK [k3s_server : Save logs of k3s-init.service] ****************************** 2026-04-24 04:26:26.670902 | orchestrator | Friday 24 April 2026 04:25:49 +0000 (0:00:23.028) 0:01:39.061 ********** 2026-04-24 04:26:26.670912 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:26:26.670921 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:26:26.670931 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:26:26.670941 | orchestrator | 2026-04-24 04:26:26.670950 | orchestrator | TASK [k3s_server : Kill the temporary service used for initialization] ********* 2026-04-24 04:26:26.670960 | orchestrator | Friday 24 April 2026 04:25:50 +0000 (0:00:01.317) 0:01:40.379 ********** 2026-04-24 04:26:26.670969 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:26:26.670978 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:26:26.670988 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:26:26.670997 | orchestrator | 2026-04-24 04:26:26.671007 | orchestrator | TASK [k3s_server : Copy K3s service file] ************************************** 2026-04-24 04:26:26.671016 | orchestrator | Friday 24 April 2026 04:25:52 +0000 (0:00:02.265) 0:01:42.644 ********** 2026-04-24 04:26:26.671026 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.671035 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.671044 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.671054 | orchestrator | 2026-04-24 04:26:26.671063 | orchestrator | TASK [k3s_server : Enable and check K3s service] ******************************* 2026-04-24 04:26:26.671073 | orchestrator | Friday 24 April 2026 04:25:55 +0000 (0:00:02.251) 0:01:44.895 ********** 2026-04-24 04:26:26.671082 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:26:26.671092 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:26:26.671101 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:26:26.671110 | orchestrator | 2026-04-24 04:26:26.671120 | orchestrator | TASK [k3s_server : Wait for node-token] **************************************** 2026-04-24 04:26:26.671130 | orchestrator | Friday 24 April 2026 04:26:22 +0000 (0:00:27.169) 0:02:12.065 ********** 2026-04-24 04:26:26.671139 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.671148 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.671158 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.671174 | orchestrator | 2026-04-24 04:26:26.671183 | orchestrator | TASK [k3s_server : Register node-token file access mode] *********************** 2026-04-24 04:26:26.671193 | orchestrator | Friday 24 April 2026 04:26:24 +0000 (0:00:01.941) 0:02:14.006 ********** 2026-04-24 04:26:26.671203 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:26:26.671212 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:26:26.671222 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:26:26.671231 | orchestrator | 2026-04-24 04:26:26.671241 | orchestrator | TASK [k3s_server : Change file access node-token] ****************************** 2026-04-24 04:26:26.671250 | orchestrator | Friday 24 April 2026 04:26:25 +0000 (0:00:01.711) 0:02:15.718 ********** 2026-04-24 04:26:26.671260 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:26:26.671270 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:26:26.671279 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:26:26.671289 | orchestrator | 2026-04-24 04:26:26.671304 | orchestrator | TASK [k3s_server : Read node-token from master] ******************************** 2026-04-24 04:27:16.405954 | orchestrator | Friday 24 April 2026 04:26:27 +0000 (0:00:01.691) 0:02:17.410 ********** 2026-04-24 04:27:16.406119 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:27:16.406137 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:27:16.406149 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:27:16.406160 | orchestrator | 2026-04-24 04:27:16.406172 | orchestrator | TASK [k3s_server : Store Master node-token] ************************************ 2026-04-24 04:27:16.406184 | orchestrator | Friday 24 April 2026 04:26:29 +0000 (0:00:01.654) 0:02:19.064 ********** 2026-04-24 04:27:16.406195 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:27:16.406206 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:27:16.406216 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:27:16.406227 | orchestrator | 2026-04-24 04:27:16.406238 | orchestrator | TASK [k3s_server : Restore node-token file access] ***************************** 2026-04-24 04:27:16.406249 | orchestrator | Friday 24 April 2026 04:26:30 +0000 (0:00:01.572) 0:02:20.637 ********** 2026-04-24 04:27:16.406259 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:27:16.406271 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:27:16.406281 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:27:16.406292 | orchestrator | 2026-04-24 04:27:16.406319 | orchestrator | TASK [k3s_server : Create directory .kube] ************************************* 2026-04-24 04:27:16.406330 | orchestrator | Friday 24 April 2026 04:26:32 +0000 (0:00:01.695) 0:02:22.333 ********** 2026-04-24 04:27:16.406352 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:27:16.406363 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:27:16.406374 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:27:16.406385 | orchestrator | 2026-04-24 04:27:16.406396 | orchestrator | TASK [k3s_server : Copy config file to user home directory] ******************** 2026-04-24 04:27:16.406407 | orchestrator | Friday 24 April 2026 04:26:34 +0000 (0:00:01.736) 0:02:24.069 ********** 2026-04-24 04:27:16.406417 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:27:16.406428 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:27:16.406439 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:27:16.406450 | orchestrator | 2026-04-24 04:27:16.406460 | orchestrator | TASK [k3s_server : Configure kubectl cluster to https://192.168.16.8:6443] ***** 2026-04-24 04:27:16.406471 | orchestrator | Friday 24 April 2026 04:26:36 +0000 (0:00:01.820) 0:02:25.890 ********** 2026-04-24 04:27:16.406482 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:27:16.406493 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:27:16.406506 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:27:16.406519 | orchestrator | 2026-04-24 04:27:16.406533 | orchestrator | TASK [k3s_server : Create kubectl symlink] ************************************* 2026-04-24 04:27:16.406545 | orchestrator | Friday 24 April 2026 04:26:38 +0000 (0:00:02.132) 0:02:28.022 ********** 2026-04-24 04:27:16.406557 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:27:16.406587 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:27:16.406600 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:27:16.406612 | orchestrator | 2026-04-24 04:27:16.406624 | orchestrator | TASK [k3s_server : Create crictl symlink] ************************************** 2026-04-24 04:27:16.406663 | orchestrator | Friday 24 April 2026 04:26:39 +0000 (0:00:01.343) 0:02:29.365 ********** 2026-04-24 04:27:16.406675 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:27:16.406688 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:27:16.406699 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:27:16.406712 | orchestrator | 2026-04-24 04:27:16.406729 | orchestrator | TASK [k3s_server : Get contents of manifests folder] *************************** 2026-04-24 04:27:16.406749 | orchestrator | Friday 24 April 2026 04:26:41 +0000 (0:00:01.420) 0:02:30.785 ********** 2026-04-24 04:27:16.406769 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:27:16.406788 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:27:16.406807 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:27:16.406826 | orchestrator | 2026-04-24 04:27:16.406841 | orchestrator | TASK [k3s_server : Get sub dirs of manifests folder] *************************** 2026-04-24 04:27:16.406852 | orchestrator | Friday 24 April 2026 04:26:42 +0000 (0:00:01.809) 0:02:32.595 ********** 2026-04-24 04:27:16.406862 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:27:16.406873 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:27:16.406883 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:27:16.406894 | orchestrator | 2026-04-24 04:27:16.406905 | orchestrator | TASK [k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start] *** 2026-04-24 04:27:16.406918 | orchestrator | Friday 24 April 2026 04:26:44 +0000 (0:00:01.700) 0:02:34.295 ********** 2026-04-24 04:27:16.406928 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-24 04:27:16.406940 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-24 04:27:16.406950 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-24 04:27:16.406961 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-24 04:27:16.406972 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-24 04:27:16.406999 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-24 04:27:16.407015 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-24 04:27:16.407027 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-24 04:27:16.407038 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-24 04:27:16.407048 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip.yaml) 2026-04-24 04:27:16.407059 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-24 04:27:16.407069 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-24 04:27:16.407099 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-24 04:27:16.407111 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip-rbac.yaml) 2026-04-24 04:27:16.407121 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-24 04:27:16.407132 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-24 04:27:16.407143 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-24 04:27:16.407153 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-24 04:27:16.407163 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-24 04:27:16.407174 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-24 04:27:16.407185 | orchestrator | 2026-04-24 04:27:16.407204 | orchestrator | PLAY [Deploy k3s worker nodes] ************************************************* 2026-04-24 04:27:16.407214 | orchestrator | 2026-04-24 04:27:16.407225 | orchestrator | TASK [k3s_agent : Validating arguments against arg spec 'main' - Setup k3s agents] *** 2026-04-24 04:27:16.407235 | orchestrator | Friday 24 April 2026 04:26:48 +0000 (0:00:04.371) 0:02:38.666 ********** 2026-04-24 04:27:16.407246 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:27:16.407257 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:27:16.407267 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:27:16.407277 | orchestrator | 2026-04-24 04:27:16.407288 | orchestrator | TASK [k3s_agent : Check if system is PXE-booted] ******************************* 2026-04-24 04:27:16.407299 | orchestrator | Friday 24 April 2026 04:26:50 +0000 (0:00:01.697) 0:02:40.364 ********** 2026-04-24 04:27:16.407309 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:27:16.407319 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:27:16.407330 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:27:16.407340 | orchestrator | 2026-04-24 04:27:16.407351 | orchestrator | TASK [k3s_agent : Set fact for PXE-booted system] ****************************** 2026-04-24 04:27:16.407362 | orchestrator | Friday 24 April 2026 04:26:52 +0000 (0:00:01.675) 0:02:42.039 ********** 2026-04-24 04:27:16.407372 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:27:16.407382 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:27:16.407393 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:27:16.407404 | orchestrator | 2026-04-24 04:27:16.407414 | orchestrator | TASK [k3s_agent : Include http_proxy configuration tasks] ********************** 2026-04-24 04:27:16.407425 | orchestrator | Friday 24 April 2026 04:26:53 +0000 (0:00:01.444) 0:02:43.484 ********** 2026-04-24 04:27:16.407435 | orchestrator | included: /ansible/roles/k3s_agent/tasks/http_proxy.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 04:27:16.407446 | orchestrator | 2026-04-24 04:27:16.407457 | orchestrator | TASK [k3s_agent : Create k3s-node.service.d directory] ************************* 2026-04-24 04:27:16.407467 | orchestrator | Friday 24 April 2026 04:26:55 +0000 (0:00:01.948) 0:02:45.432 ********** 2026-04-24 04:27:16.407478 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:27:16.407489 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:27:16.407499 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:27:16.407510 | orchestrator | 2026-04-24 04:27:16.407520 | orchestrator | TASK [k3s_agent : Copy K3s http_proxy conf file] ******************************* 2026-04-24 04:27:16.407531 | orchestrator | Friday 24 April 2026 04:26:57 +0000 (0:00:01.394) 0:02:46.826 ********** 2026-04-24 04:27:16.407541 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:27:16.407552 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:27:16.407562 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:27:16.407594 | orchestrator | 2026-04-24 04:27:16.407605 | orchestrator | TASK [k3s_agent : Deploy K3s http_proxy conf] ********************************** 2026-04-24 04:27:16.407615 | orchestrator | Friday 24 April 2026 04:26:58 +0000 (0:00:01.347) 0:02:48.174 ********** 2026-04-24 04:27:16.407626 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:27:16.407636 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:27:16.407647 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:27:16.407657 | orchestrator | 2026-04-24 04:27:16.407668 | orchestrator | TASK [k3s_agent : Create /etc/rancher/k3s directory] *************************** 2026-04-24 04:27:16.407678 | orchestrator | Friday 24 April 2026 04:26:59 +0000 (0:00:01.345) 0:02:49.520 ********** 2026-04-24 04:27:16.407689 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:27:16.407699 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:27:16.407710 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:27:16.407720 | orchestrator | 2026-04-24 04:27:16.407731 | orchestrator | TASK [k3s_agent : Create custom resolv.conf for k3s] *************************** 2026-04-24 04:27:16.407742 | orchestrator | Friday 24 April 2026 04:27:01 +0000 (0:00:01.726) 0:02:51.247 ********** 2026-04-24 04:27:16.407752 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:27:16.407763 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:27:16.407773 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:27:16.407783 | orchestrator | 2026-04-24 04:27:16.407794 | orchestrator | TASK [k3s_agent : Configure the k3s service] *********************************** 2026-04-24 04:27:16.407812 | orchestrator | Friday 24 April 2026 04:27:03 +0000 (0:00:02.305) 0:02:53.552 ********** 2026-04-24 04:27:16.407823 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:27:16.407833 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:27:16.407849 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:27:16.407860 | orchestrator | 2026-04-24 04:27:16.407870 | orchestrator | TASK [k3s_agent : Manage k3s service] ****************************************** 2026-04-24 04:27:16.407881 | orchestrator | Friday 24 April 2026 04:27:06 +0000 (0:00:02.408) 0:02:55.961 ********** 2026-04-24 04:27:16.407892 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:27:16.407902 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:27:16.407913 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:27:16.407924 | orchestrator | 2026-04-24 04:27:16.407934 | orchestrator | PLAY [Prepare kubeconfig file] ************************************************* 2026-04-24 04:27:16.407945 | orchestrator | 2026-04-24 04:27:16.407956 | orchestrator | TASK [Get home directory of operator user] ************************************* 2026-04-24 04:27:16.407966 | orchestrator | Friday 24 April 2026 04:27:14 +0000 (0:00:08.081) 0:03:04.043 ********** 2026-04-24 04:27:16.407977 | orchestrator | ok: [testbed-manager] 2026-04-24 04:27:16.407988 | orchestrator | 2026-04-24 04:27:16.407998 | orchestrator | TASK [Create .kube directory] ************************************************** 2026-04-24 04:27:16.408015 | orchestrator | Friday 24 April 2026 04:27:16 +0000 (0:00:02.111) 0:03:06.154 ********** 2026-04-24 04:28:27.832087 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.832207 | orchestrator | 2026-04-24 04:28:27.832225 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-24 04:28:27.832239 | orchestrator | Friday 24 April 2026 04:27:17 +0000 (0:00:01.482) 0:03:07.636 ********** 2026-04-24 04:28:27.832251 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-24 04:28:27.832262 | orchestrator | 2026-04-24 04:28:27.832273 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-24 04:28:27.832284 | orchestrator | Friday 24 April 2026 04:27:19 +0000 (0:00:01.573) 0:03:09.210 ********** 2026-04-24 04:28:27.832295 | orchestrator | changed: [testbed-manager] 2026-04-24 04:28:27.832306 | orchestrator | 2026-04-24 04:28:27.832317 | orchestrator | TASK [Change server address in the kubeconfig] ********************************* 2026-04-24 04:28:27.832328 | orchestrator | Friday 24 April 2026 04:27:21 +0000 (0:00:02.018) 0:03:11.229 ********** 2026-04-24 04:28:27.832339 | orchestrator | changed: [testbed-manager] 2026-04-24 04:28:27.832350 | orchestrator | 2026-04-24 04:28:27.832361 | orchestrator | TASK [Make kubeconfig available for use inside the manager service] ************ 2026-04-24 04:28:27.832371 | orchestrator | Friday 24 April 2026 04:27:23 +0000 (0:00:01.590) 0:03:12.819 ********** 2026-04-24 04:28:27.832382 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-24 04:28:27.832393 | orchestrator | 2026-04-24 04:28:27.832404 | orchestrator | TASK [Change server address in the kubeconfig inside the manager service] ****** 2026-04-24 04:28:27.832415 | orchestrator | Friday 24 April 2026 04:27:26 +0000 (0:00:03.089) 0:03:15.909 ********** 2026-04-24 04:28:27.832426 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-24 04:28:27.832436 | orchestrator | 2026-04-24 04:28:27.832449 | orchestrator | TASK [Set KUBECONFIG environment variable] ************************************* 2026-04-24 04:28:27.832468 | orchestrator | Friday 24 April 2026 04:27:28 +0000 (0:00:01.881) 0:03:17.790 ********** 2026-04-24 04:28:27.832484 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.832500 | orchestrator | 2026-04-24 04:28:27.832516 | orchestrator | TASK [Enable kubectl command line completion] ********************************** 2026-04-24 04:28:27.832533 | orchestrator | Friday 24 April 2026 04:27:29 +0000 (0:00:01.437) 0:03:19.228 ********** 2026-04-24 04:28:27.832584 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.832606 | orchestrator | 2026-04-24 04:28:27.832624 | orchestrator | PLAY [Apply role kubectl] ****************************************************** 2026-04-24 04:28:27.832642 | orchestrator | 2026-04-24 04:28:27.832654 | orchestrator | TASK [kubectl : Gather variables for each operating system] ******************** 2026-04-24 04:28:27.832691 | orchestrator | Friday 24 April 2026 04:27:31 +0000 (0:00:01.803) 0:03:21.031 ********** 2026-04-24 04:28:27.832705 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.832717 | orchestrator | 2026-04-24 04:28:27.832730 | orchestrator | TASK [kubectl : Include distribution specific install tasks] ******************* 2026-04-24 04:28:27.832743 | orchestrator | Friday 24 April 2026 04:27:32 +0000 (0:00:01.169) 0:03:22.201 ********** 2026-04-24 04:28:27.832755 | orchestrator | included: /ansible/roles/kubectl/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 04:28:27.832769 | orchestrator | 2026-04-24 04:28:27.832782 | orchestrator | TASK [kubectl : Remove old architecture-dependent repository] ****************** 2026-04-24 04:28:27.832794 | orchestrator | Friday 24 April 2026 04:27:34 +0000 (0:00:01.646) 0:03:23.848 ********** 2026-04-24 04:28:27.832806 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.832819 | orchestrator | 2026-04-24 04:28:27.832831 | orchestrator | TASK [kubectl : Install apt-transport-https package] *************************** 2026-04-24 04:28:27.832843 | orchestrator | Friday 24 April 2026 04:27:35 +0000 (0:00:01.884) 0:03:25.732 ********** 2026-04-24 04:28:27.832855 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.832867 | orchestrator | 2026-04-24 04:28:27.832880 | orchestrator | TASK [kubectl : Add repository gpg key] **************************************** 2026-04-24 04:28:27.832892 | orchestrator | Friday 24 April 2026 04:27:38 +0000 (0:00:02.639) 0:03:28.372 ********** 2026-04-24 04:28:27.832904 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.832917 | orchestrator | 2026-04-24 04:28:27.832929 | orchestrator | TASK [kubectl : Set permissions of gpg key] ************************************ 2026-04-24 04:28:27.832942 | orchestrator | Friday 24 April 2026 04:27:40 +0000 (0:00:01.418) 0:03:29.791 ********** 2026-04-24 04:28:27.832953 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.832967 | orchestrator | 2026-04-24 04:28:27.832985 | orchestrator | TASK [kubectl : Add repository Debian] ***************************************** 2026-04-24 04:28:27.833004 | orchestrator | Friday 24 April 2026 04:27:41 +0000 (0:00:01.493) 0:03:31.284 ********** 2026-04-24 04:28:27.833022 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.833039 | orchestrator | 2026-04-24 04:28:27.833057 | orchestrator | TASK [kubectl : Install required packages] ************************************* 2026-04-24 04:28:27.833075 | orchestrator | Friday 24 April 2026 04:27:43 +0000 (0:00:01.631) 0:03:32.916 ********** 2026-04-24 04:28:27.833092 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.833109 | orchestrator | 2026-04-24 04:28:27.833127 | orchestrator | TASK [kubectl : Remove kubectl symlink] **************************************** 2026-04-24 04:28:27.833145 | orchestrator | Friday 24 April 2026 04:27:45 +0000 (0:00:02.597) 0:03:35.513 ********** 2026-04-24 04:28:27.833164 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:27.833182 | orchestrator | 2026-04-24 04:28:27.833202 | orchestrator | PLAY [Run post actions on master nodes] **************************************** 2026-04-24 04:28:27.833221 | orchestrator | 2026-04-24 04:28:27.833261 | orchestrator | TASK [k3s_server_post : Validating arguments against arg spec 'main' - Configure k3s cluster] *** 2026-04-24 04:28:27.833282 | orchestrator | Friday 24 April 2026 04:27:47 +0000 (0:00:01.919) 0:03:37.433 ********** 2026-04-24 04:28:27.833300 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:28:27.833320 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:28:27.833339 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:28:27.833356 | orchestrator | 2026-04-24 04:28:27.833372 | orchestrator | TASK [k3s_server_post : Deploy calico] ***************************************** 2026-04-24 04:28:27.833383 | orchestrator | Friday 24 April 2026 04:27:49 +0000 (0:00:01.574) 0:03:39.007 ********** 2026-04-24 04:28:27.833394 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:28:27.833405 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:28:27.833416 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:28:27.833427 | orchestrator | 2026-04-24 04:28:27.833459 | orchestrator | TASK [k3s_server_post : Deploy cilium] ***************************************** 2026-04-24 04:28:27.833470 | orchestrator | Friday 24 April 2026 04:27:50 +0000 (0:00:01.570) 0:03:40.578 ********** 2026-04-24 04:28:27.833482 | orchestrator | included: /ansible/roles/k3s_server_post/tasks/cilium.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:28:27.833503 | orchestrator | 2026-04-24 04:28:27.833519 | orchestrator | TASK [k3s_server_post : Create tmp directory on first master] ****************** 2026-04-24 04:28:27.833537 | orchestrator | Friday 24 April 2026 04:27:52 +0000 (0:00:01.912) 0:03:42.490 ********** 2026-04-24 04:28:27.833599 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.833620 | orchestrator | 2026-04-24 04:28:27.833638 | orchestrator | TASK [k3s_server_post : Wait for connectivity to kube VIP] ********************* 2026-04-24 04:28:27.833657 | orchestrator | Friday 24 April 2026 04:27:54 +0000 (0:00:01.945) 0:03:44.436 ********** 2026-04-24 04:28:27.833670 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.833680 | orchestrator | 2026-04-24 04:28:27.833691 | orchestrator | TASK [k3s_server_post : Fail if kube VIP not reachable] ************************ 2026-04-24 04:28:27.833702 | orchestrator | Friday 24 April 2026 04:27:56 +0000 (0:00:02.006) 0:03:46.443 ********** 2026-04-24 04:28:27.833713 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:28:27.833730 | orchestrator | 2026-04-24 04:28:27.833757 | orchestrator | TASK [k3s_server_post : Test for existing Cilium install] ********************** 2026-04-24 04:28:27.833779 | orchestrator | Friday 24 April 2026 04:27:57 +0000 (0:00:01.268) 0:03:47.712 ********** 2026-04-24 04:28:27.833796 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.833814 | orchestrator | 2026-04-24 04:28:27.833831 | orchestrator | TASK [k3s_server_post : Check Cilium version] ********************************** 2026-04-24 04:28:27.833849 | orchestrator | Friday 24 April 2026 04:28:00 +0000 (0:00:02.144) 0:03:49.856 ********** 2026-04-24 04:28:27.833868 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.833918 | orchestrator | 2026-04-24 04:28:27.833932 | orchestrator | TASK [k3s_server_post : Parse installed Cilium version] ************************ 2026-04-24 04:28:27.833943 | orchestrator | Friday 24 April 2026 04:28:02 +0000 (0:00:02.459) 0:03:52.316 ********** 2026-04-24 04:28:27.833953 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.833964 | orchestrator | 2026-04-24 04:28:27.833975 | orchestrator | TASK [k3s_server_post : Determine if Cilium needs update] ********************** 2026-04-24 04:28:27.833985 | orchestrator | Friday 24 April 2026 04:28:03 +0000 (0:00:01.212) 0:03:53.529 ********** 2026-04-24 04:28:27.833996 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.834006 | orchestrator | 2026-04-24 04:28:27.834077 | orchestrator | TASK [k3s_server_post : Log result] ******************************************** 2026-04-24 04:28:27.834099 | orchestrator | Friday 24 April 2026 04:28:05 +0000 (0:00:01.242) 0:03:54.772 ********** 2026-04-24 04:28:27.834116 | orchestrator | ok: [testbed-node-0 -> localhost] => { 2026-04-24 04:28:27.834134 | orchestrator |  "msg": "Installed Cilium version: 1.18.2, Target Cilium version: v1.18.2, Update needed: False\n" 2026-04-24 04:28:27.834153 | orchestrator | } 2026-04-24 04:28:27.834172 | orchestrator | 2026-04-24 04:28:27.834207 | orchestrator | TASK [k3s_server_post : Install Cilium] **************************************** 2026-04-24 04:28:27.834220 | orchestrator | Friday 24 April 2026 04:28:06 +0000 (0:00:01.366) 0:03:56.139 ********** 2026-04-24 04:28:27.834231 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:28:27.834242 | orchestrator | 2026-04-24 04:28:27.834252 | orchestrator | TASK [k3s_server_post : Wait for Cilium resources] ***************************** 2026-04-24 04:28:27.834263 | orchestrator | Friday 24 April 2026 04:28:07 +0000 (0:00:01.234) 0:03:57.374 ********** 2026-04-24 04:28:27.834274 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/cilium-operator) 2026-04-24 04:28:27.834285 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=daemonset/cilium) 2026-04-24 04:28:27.834296 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-relay) 2026-04-24 04:28:27.834306 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-ui) 2026-04-24 04:28:27.834317 | orchestrator | 2026-04-24 04:28:27.834334 | orchestrator | TASK [k3s_server_post : Set _cilium_bgp_neighbors fact] ************************ 2026-04-24 04:28:27.834361 | orchestrator | Friday 24 April 2026 04:28:13 +0000 (0:00:05.902) 0:04:03.277 ********** 2026-04-24 04:28:27.834398 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.834415 | orchestrator | 2026-04-24 04:28:27.834434 | orchestrator | TASK [k3s_server_post : Copy BGP manifests to first master] ******************** 2026-04-24 04:28:27.834453 | orchestrator | Friday 24 April 2026 04:28:15 +0000 (0:00:02.466) 0:04:05.743 ********** 2026-04-24 04:28:27.834470 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.834489 | orchestrator | 2026-04-24 04:28:27.834508 | orchestrator | TASK [k3s_server_post : Apply BGP manifests] *********************************** 2026-04-24 04:28:27.834527 | orchestrator | Friday 24 April 2026 04:28:18 +0000 (0:00:02.825) 0:04:08.568 ********** 2026-04-24 04:28:27.834539 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-24 04:28:27.834628 | orchestrator | 2026-04-24 04:28:27.834656 | orchestrator | TASK [k3s_server_post : Print error message if BGP manifests application fails] *** 2026-04-24 04:28:27.834668 | orchestrator | Friday 24 April 2026 04:28:23 +0000 (0:00:04.309) 0:04:12.878 ********** 2026-04-24 04:28:27.834677 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:28:27.834687 | orchestrator | 2026-04-24 04:28:27.834696 | orchestrator | TASK [k3s_server_post : Test for BGP config resources] ************************* 2026-04-24 04:28:27.834706 | orchestrator | Friday 24 April 2026 04:28:24 +0000 (0:00:01.167) 0:04:14.046 ********** 2026-04-24 04:28:27.834715 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumBGPPeeringPolicy.cilium.io) 2026-04-24 04:28:27.834725 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumLoadBalancerIPPool.cilium.io) 2026-04-24 04:28:27.834735 | orchestrator | 2026-04-24 04:28:27.834744 | orchestrator | TASK [k3s_server_post : Deploy metallb pool] *********************************** 2026-04-24 04:28:27.834754 | orchestrator | Friday 24 April 2026 04:28:27 +0000 (0:00:03.281) 0:04:17.327 ********** 2026-04-24 04:28:27.834764 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:28:27.834787 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:28:57.818399 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:28:57.819361 | orchestrator | 2026-04-24 04:28:57.819411 | orchestrator | TASK [k3s_server_post : Remove tmp directory used for manifests] *************** 2026-04-24 04:28:57.819430 | orchestrator | Friday 24 April 2026 04:28:29 +0000 (0:00:01.487) 0:04:18.815 ********** 2026-04-24 04:28:57.819446 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:28:57.819457 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:28:57.819466 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:28:57.819475 | orchestrator | 2026-04-24 04:28:57.819484 | orchestrator | PLAY [Apply role k9s] ********************************************************** 2026-04-24 04:28:57.819493 | orchestrator | 2026-04-24 04:28:57.819502 | orchestrator | TASK [k9s : Gather variables for each operating system] ************************ 2026-04-24 04:28:57.819511 | orchestrator | Friday 24 April 2026 04:28:31 +0000 (0:00:02.536) 0:04:21.352 ********** 2026-04-24 04:28:57.819519 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:57.819528 | orchestrator | 2026-04-24 04:28:57.819537 | orchestrator | TASK [k9s : Include distribution specific install tasks] *********************** 2026-04-24 04:28:57.819546 | orchestrator | Friday 24 April 2026 04:28:32 +0000 (0:00:01.198) 0:04:22.550 ********** 2026-04-24 04:28:57.819590 | orchestrator | included: /ansible/roles/k9s/tasks/install-Debian-family.yml for testbed-manager 2026-04-24 04:28:57.819600 | orchestrator | 2026-04-24 04:28:57.819609 | orchestrator | TASK [k9s : Install k9s packages] ********************************************** 2026-04-24 04:28:57.819618 | orchestrator | Friday 24 April 2026 04:28:34 +0000 (0:00:01.563) 0:04:24.114 ********** 2026-04-24 04:28:57.819626 | orchestrator | ok: [testbed-manager] 2026-04-24 04:28:57.819635 | orchestrator | 2026-04-24 04:28:57.819643 | orchestrator | PLAY [Manage labels, annotations, and taints on all k3s nodes] ***************** 2026-04-24 04:28:57.819652 | orchestrator | 2026-04-24 04:28:57.819660 | orchestrator | TASK [Merge labels, annotations, and taints] *********************************** 2026-04-24 04:28:57.819669 | orchestrator | Friday 24 April 2026 04:28:40 +0000 (0:00:05.800) 0:04:29.914 ********** 2026-04-24 04:28:57.819678 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:28:57.819687 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:28:57.819720 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:28:57.819729 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:28:57.819737 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:28:57.819745 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:28:57.819754 | orchestrator | 2026-04-24 04:28:57.819762 | orchestrator | TASK [Manage labels] *********************************************************** 2026-04-24 04:28:57.819771 | orchestrator | Friday 24 April 2026 04:28:41 +0000 (0:00:01.828) 0:04:31.743 ********** 2026-04-24 04:28:57.819780 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-24 04:28:57.819788 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-24 04:28:57.819797 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-24 04:28:57.819806 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-24 04:28:57.819814 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-24 04:28:57.819823 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-24 04:28:57.819845 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-24 04:28:57.819854 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-24 04:28:57.819863 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-24 04:28:57.819871 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-24 04:28:57.819880 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-24 04:28:57.819889 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-24 04:28:57.819897 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-24 04:28:57.819905 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-24 04:28:57.819914 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-24 04:28:57.819922 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-24 04:28:57.819931 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-24 04:28:57.819939 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-24 04:28:57.819948 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-24 04:28:57.819957 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-24 04:28:57.819965 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-24 04:28:57.819974 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-24 04:28:57.819982 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-24 04:28:57.819991 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-24 04:28:57.819999 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-24 04:28:57.820008 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-24 04:28:57.820037 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-24 04:28:57.820045 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-24 04:28:57.820054 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-24 04:28:57.820062 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-24 04:28:57.820078 | orchestrator | 2026-04-24 04:28:57.820087 | orchestrator | TASK [Manage annotations] ****************************************************** 2026-04-24 04:28:57.820095 | orchestrator | Friday 24 April 2026 04:28:52 +0000 (0:00:10.927) 0:04:42.671 ********** 2026-04-24 04:28:57.820103 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:28:57.820112 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:28:57.820120 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:28:57.820129 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:28:57.820137 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:28:57.820161 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:28:57.820170 | orchestrator | 2026-04-24 04:28:57.820178 | orchestrator | TASK [Manage taints] *********************************************************** 2026-04-24 04:28:57.820187 | orchestrator | Friday 24 April 2026 04:28:54 +0000 (0:00:01.820) 0:04:44.491 ********** 2026-04-24 04:28:57.820195 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:28:57.820204 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:28:57.820212 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:28:57.820221 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:28:57.820230 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:28:57.820245 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:28:57.820259 | orchestrator | 2026-04-24 04:28:57.820332 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:28:57.820354 | orchestrator | testbed-manager : ok=21  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 04:28:57.820371 | orchestrator | testbed-node-0 : ok=53  changed=14  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-24 04:28:57.820385 | orchestrator | testbed-node-1 : ok=38  changed=9  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-24 04:28:57.820400 | orchestrator | testbed-node-2 : ok=38  changed=9  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-24 04:28:57.820416 | orchestrator | testbed-node-3 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 04:28:57.820430 | orchestrator | testbed-node-4 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 04:28:57.820445 | orchestrator | testbed-node-5 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 04:28:57.820455 | orchestrator | 2026-04-24 04:28:57.820463 | orchestrator | 2026-04-24 04:28:57.820472 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:28:57.820481 | orchestrator | Friday 24 April 2026 04:28:57 +0000 (0:00:03.056) 0:04:47.548 ********** 2026-04-24 04:28:57.820489 | orchestrator | =============================================================================== 2026-04-24 04:28:57.820498 | orchestrator | k3s_server : Enable and check K3s service ------------------------------ 27.17s 2026-04-24 04:28:57.820506 | orchestrator | k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails) -- 23.03s 2026-04-24 04:28:57.820516 | orchestrator | Manage labels ---------------------------------------------------------- 10.93s 2026-04-24 04:28:57.820525 | orchestrator | k3s_agent : Manage k3s service ------------------------------------------ 8.08s 2026-04-24 04:28:57.820533 | orchestrator | k3s_server_post : Wait for Cilium resources ----------------------------- 5.90s 2026-04-24 04:28:57.820543 | orchestrator | k9s : Install k9s packages ---------------------------------------------- 5.80s 2026-04-24 04:28:57.820583 | orchestrator | k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start --- 4.37s 2026-04-24 04:28:57.820641 | orchestrator | k3s_server_post : Apply BGP manifests ----------------------------------- 4.31s 2026-04-24 04:28:57.820669 | orchestrator | k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites --- 4.01s 2026-04-24 04:28:57.820693 | orchestrator | k3s_server_post : Test for BGP config resources ------------------------- 3.28s 2026-04-24 04:28:57.820726 | orchestrator | Make kubeconfig available for use inside the manager service ------------ 3.09s 2026-04-24 04:28:57.820740 | orchestrator | Manage taints ----------------------------------------------------------- 3.06s 2026-04-24 04:28:57.820749 | orchestrator | k3s_server_post : Copy BGP manifests to first master -------------------- 2.83s 2026-04-24 04:28:57.820757 | orchestrator | k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers --- 2.81s 2026-04-24 04:28:57.820766 | orchestrator | k3s_server : Stop k3s-init ---------------------------------------------- 2.79s 2026-04-24 04:28:57.820774 | orchestrator | k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured --- 2.72s 2026-04-24 04:28:57.820783 | orchestrator | k3s_download : Download k3s binary x64 ---------------------------------- 2.66s 2026-04-24 04:28:57.820792 | orchestrator | kubectl : Install apt-transport-https package --------------------------- 2.64s 2026-04-24 04:28:57.820811 | orchestrator | k3s_server : Set _kube_vip_bgp_peers fact ------------------------------- 2.63s 2026-04-24 04:28:58.153110 | orchestrator | kubectl : Install required packages ------------------------------------- 2.60s 2026-04-24 04:28:58.432816 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-24 04:28:58.432913 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/200-infrastructure.sh 2026-04-24 04:28:58.442944 | orchestrator | + set -e 2026-04-24 04:28:58.443004 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 04:28:58.443017 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 04:28:58.443029 | orchestrator | ++ INTERACTIVE=false 2026-04-24 04:28:58.443040 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 04:28:58.443944 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 04:28:58.443971 | orchestrator | + osism apply openstackclient 2026-04-24 04:29:09.826851 | orchestrator | 2026-04-24 04:29:09 | INFO  | Prepare task for execution of openstackclient. 2026-04-24 04:29:09.917976 | orchestrator | 2026-04-24 04:29:09 | INFO  | Task 02105a8a-b345-41ca-8045-f0fd4da9daef (openstackclient) was prepared for execution. 2026-04-24 04:29:09.918128 | orchestrator | 2026-04-24 04:29:09 | INFO  | It takes a moment until task 02105a8a-b345-41ca-8045-f0fd4da9daef (openstackclient) has been started and output is visible here. 2026-04-24 04:29:46.157915 | orchestrator | 2026-04-24 04:29:46.158090 | orchestrator | PLAY [Apply role openstackclient] ********************************************** 2026-04-24 04:29:46.158110 | orchestrator | 2026-04-24 04:29:46.158122 | orchestrator | TASK [osism.services.openstackclient : Include tasks] ************************** 2026-04-24 04:29:46.158134 | orchestrator | Friday 24 April 2026 04:29:15 +0000 (0:00:02.202) 0:00:02.202 ********** 2026-04-24 04:29:46.158146 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/openstackclient/tasks/container-Debian-family.yml for testbed-manager 2026-04-24 04:29:46.158159 | orchestrator | 2026-04-24 04:29:46.158170 | orchestrator | TASK [osism.services.openstackclient : Create required directories] ************ 2026-04-24 04:29:46.158191 | orchestrator | Friday 24 April 2026 04:29:17 +0000 (0:00:01.984) 0:00:04.187 ********** 2026-04-24 04:29:46.158202 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/openstack) 2026-04-24 04:29:46.158215 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient/data) 2026-04-24 04:29:46.158226 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient) 2026-04-24 04:29:46.158237 | orchestrator | 2026-04-24 04:29:46.158248 | orchestrator | TASK [osism.services.openstackclient : Copy docker-compose.yml file] *********** 2026-04-24 04:29:46.158259 | orchestrator | Friday 24 April 2026 04:29:20 +0000 (0:00:02.592) 0:00:06.780 ********** 2026-04-24 04:29:46.158270 | orchestrator | changed: [testbed-manager] 2026-04-24 04:29:46.158282 | orchestrator | 2026-04-24 04:29:46.158293 | orchestrator | TASK [osism.services.openstackclient : Manage openstackclient service] ********* 2026-04-24 04:29:46.158304 | orchestrator | Friday 24 April 2026 04:29:22 +0000 (0:00:02.281) 0:00:09.061 ********** 2026-04-24 04:29:46.158344 | orchestrator | ok: [testbed-manager] 2026-04-24 04:29:46.158356 | orchestrator | 2026-04-24 04:29:46.158367 | orchestrator | TASK [osism.services.openstackclient : Copy openstack wrapper script] ********** 2026-04-24 04:29:46.158378 | orchestrator | Friday 24 April 2026 04:29:24 +0000 (0:00:02.197) 0:00:11.259 ********** 2026-04-24 04:29:46.158389 | orchestrator | ok: [testbed-manager] 2026-04-24 04:29:46.158399 | orchestrator | 2026-04-24 04:29:46.158410 | orchestrator | TASK [osism.services.openstackclient : Remove ospurge wrapper script] ********** 2026-04-24 04:29:46.158421 | orchestrator | Friday 24 April 2026 04:29:26 +0000 (0:00:02.007) 0:00:13.267 ********** 2026-04-24 04:29:46.158433 | orchestrator | ok: [testbed-manager] 2026-04-24 04:29:46.158445 | orchestrator | 2026-04-24 04:29:46.158458 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Restart openstackclient service] *** 2026-04-24 04:29:46.158471 | orchestrator | Friday 24 April 2026 04:29:28 +0000 (0:00:01.635) 0:00:14.902 ********** 2026-04-24 04:29:46.158484 | orchestrator | changed: [testbed-manager] 2026-04-24 04:29:46.158496 | orchestrator | 2026-04-24 04:29:46.158508 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Ensure that all containers are up] *** 2026-04-24 04:29:46.158521 | orchestrator | Friday 24 April 2026 04:29:40 +0000 (0:00:12.037) 0:00:26.940 ********** 2026-04-24 04:29:46.158533 | orchestrator | changed: [testbed-manager] 2026-04-24 04:29:46.158545 | orchestrator | 2026-04-24 04:29:46.158558 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Wait for an healthy service] *** 2026-04-24 04:29:46.158610 | orchestrator | Friday 24 April 2026 04:29:42 +0000 (0:00:01.674) 0:00:28.615 ********** 2026-04-24 04:29:46.158621 | orchestrator | changed: [testbed-manager] 2026-04-24 04:29:46.158632 | orchestrator | 2026-04-24 04:29:46.158643 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Copy bash completion script] *** 2026-04-24 04:29:46.158654 | orchestrator | Friday 24 April 2026 04:29:43 +0000 (0:00:01.589) 0:00:30.204 ********** 2026-04-24 04:29:46.158665 | orchestrator | ok: [testbed-manager] 2026-04-24 04:29:46.158676 | orchestrator | 2026-04-24 04:29:46.158686 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:29:46.158698 | orchestrator | testbed-manager : ok=10  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 04:29:46.158710 | orchestrator | 2026-04-24 04:29:46.158721 | orchestrator | 2026-04-24 04:29:46.158732 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:29:46.158743 | orchestrator | Friday 24 April 2026 04:29:45 +0000 (0:00:01.946) 0:00:32.151 ********** 2026-04-24 04:29:46.158754 | orchestrator | =============================================================================== 2026-04-24 04:29:46.158765 | orchestrator | osism.services.openstackclient : Restart openstackclient service ------- 12.04s 2026-04-24 04:29:46.158776 | orchestrator | osism.services.openstackclient : Create required directories ------------ 2.59s 2026-04-24 04:29:46.158787 | orchestrator | osism.services.openstackclient : Copy docker-compose.yml file ----------- 2.28s 2026-04-24 04:29:46.158798 | orchestrator | osism.services.openstackclient : Manage openstackclient service --------- 2.20s 2026-04-24 04:29:46.158809 | orchestrator | osism.services.openstackclient : Copy openstack wrapper script ---------- 2.01s 2026-04-24 04:29:46.158820 | orchestrator | osism.services.openstackclient : Include tasks -------------------------- 1.98s 2026-04-24 04:29:46.158830 | orchestrator | osism.services.openstackclient : Copy bash completion script ------------ 1.95s 2026-04-24 04:29:46.158841 | orchestrator | osism.services.openstackclient : Ensure that all containers are up ------ 1.67s 2026-04-24 04:29:46.158852 | orchestrator | osism.services.openstackclient : Remove ospurge wrapper script ---------- 1.64s 2026-04-24 04:29:46.158863 | orchestrator | osism.services.openstackclient : Wait for an healthy service ------------ 1.59s 2026-04-24 04:29:46.341845 | orchestrator | + osism apply -a upgrade common 2026-04-24 04:29:47.666173 | orchestrator | 2026-04-24 04:29:47 | INFO  | Prepare task for execution of common. 2026-04-24 04:29:47.732716 | orchestrator | 2026-04-24 04:29:47 | INFO  | Task ccceefb1-1d82-45f7-9029-72dc46e648c2 (common) was prepared for execution. 2026-04-24 04:29:47.732838 | orchestrator | 2026-04-24 04:29:47 | INFO  | It takes a moment until task ccceefb1-1d82-45f7-9029-72dc46e648c2 (common) has been started and output is visible here. 2026-04-24 04:30:06.485804 | orchestrator | 2026-04-24 04:30:06.485921 | orchestrator | PLAY [Apply role common] ******************************************************* 2026-04-24 04:30:06.485937 | orchestrator | 2026-04-24 04:30:06.485950 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-24 04:30:06.485961 | orchestrator | Friday 24 April 2026 04:29:53 +0000 (0:00:02.133) 0:00:02.133 ********** 2026-04-24 04:30:06.485972 | orchestrator | included: /ansible/roles/common/tasks/upgrade.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 04:30:06.485985 | orchestrator | 2026-04-24 04:30:06.486012 | orchestrator | TASK [common : Ensuring config directories exist] ****************************** 2026-04-24 04:30:06.486096 | orchestrator | Friday 24 April 2026 04:29:57 +0000 (0:00:03.756) 0:00:05.889 ********** 2026-04-24 04:30:06.486109 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:30:06.486120 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:30:06.486131 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:30:06.486142 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:30:06.486152 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:30:06.486163 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:30:06.486175 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:30:06.486186 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:30:06.486197 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:30:06.486209 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:30:06.486220 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:30:06.486231 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:30:06.486242 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:30:06.486253 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:30:06.486264 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:30:06.486275 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:30:06.486286 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:30:06.486296 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:30:06.486336 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:30:06.486358 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:30:06.486376 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:30:06.486397 | orchestrator | 2026-04-24 04:30:06.486418 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-24 04:30:06.486448 | orchestrator | Friday 24 April 2026 04:30:01 +0000 (0:00:04.299) 0:00:10.188 ********** 2026-04-24 04:30:06.486470 | orchestrator | included: /ansible/roles/common/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 04:30:06.486485 | orchestrator | 2026-04-24 04:30:06.486498 | orchestrator | TASK [service-cert-copy : common | Copying over extra CA certificates] ********* 2026-04-24 04:30:06.486537 | orchestrator | Friday 24 April 2026 04:30:04 +0000 (0:00:02.902) 0:00:13.091 ********** 2026-04-24 04:30:06.486554 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:06.486604 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:06.486651 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:06.486664 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:06.486675 | orchestrator | ok: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:06.486687 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:06.486704 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:06.486724 | orchestrator | ok: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:06.486736 | orchestrator | ok: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:06.486755 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:09.622657 | orchestrator | ok: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622761 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622790 | orchestrator | ok: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622803 | orchestrator | ok: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622838 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622851 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622862 | orchestrator | ok: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622894 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622906 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622918 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622929 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:09.622941 | orchestrator | 2026-04-24 04:30:09.622954 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS certificate] *** 2026-04-24 04:30:09.623163 | orchestrator | Friday 24 April 2026 04:30:09 +0000 (0:00:04.921) 0:00:18.012 ********** 2026-04-24 04:30:09.623190 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:09.623214 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:09.623228 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:09.623242 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:09.623266 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168373 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:11.168484 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:30:11.168514 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168537 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168699 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168720 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:11.168732 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:30:11.168743 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:11.168755 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168796 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168808 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:30:11.168819 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168831 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168851 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:30:11.168862 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:30:11.168879 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:11.168891 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168902 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:11.168913 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:30:11.168927 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:11.168949 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.817575 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.817727 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:30:13.817743 | orchestrator | 2026-04-24 04:30:13.817755 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS key] ****** 2026-04-24 04:30:13.817768 | orchestrator | Friday 24 April 2026 04:30:12 +0000 (0:00:03.466) 0:00:21.479 ********** 2026-04-24 04:30:13.817800 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:13.817814 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.817825 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:13.817876 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.817890 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.817902 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.817928 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:30:13.817957 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:13.817970 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:13.817989 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.818006 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.818069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.818084 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:30:13.818096 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:13.818107 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:30:13.818118 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:30:13.818131 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:13.818155 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:27.452483 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:27.452691 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:27.452713 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:30:27.452744 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:27.452758 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:30:27.452769 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:27.452781 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:30:27.452792 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:27.452803 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:27.452835 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:30:27.452846 | orchestrator | 2026-04-24 04:30:27.452858 | orchestrator | TASK [common : Ensure /var/log/journal exists on EL10 systems] ***************** 2026-04-24 04:30:27.452870 | orchestrator | Friday 24 April 2026 04:30:15 +0000 (0:00:03.294) 0:00:24.774 ********** 2026-04-24 04:30:27.452881 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:30:27.452892 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:30:27.452903 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:30:27.452913 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:30:27.452941 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:30:27.452953 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:30:27.452963 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:30:27.452974 | orchestrator | 2026-04-24 04:30:27.452985 | orchestrator | TASK [common : Copying over /run subdirectories conf] ************************** 2026-04-24 04:30:27.452996 | orchestrator | Friday 24 April 2026 04:30:18 +0000 (0:00:02.240) 0:00:27.015 ********** 2026-04-24 04:30:27.453009 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:30:27.453027 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:30:27.453046 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:30:27.453065 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:30:27.453083 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:30:27.453102 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:30:27.453121 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:30:27.453139 | orchestrator | 2026-04-24 04:30:27.453159 | orchestrator | TASK [common : Restart systemd-tmpfiles] *************************************** 2026-04-24 04:30:27.453179 | orchestrator | Friday 24 April 2026 04:30:20 +0000 (0:00:02.537) 0:00:29.552 ********** 2026-04-24 04:30:27.453194 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:30:27.453206 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:30:27.453219 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:30:27.453232 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:30:27.453244 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:30:27.453257 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:30:27.453270 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:30:27.453282 | orchestrator | 2026-04-24 04:30:27.453295 | orchestrator | TASK [common : Copying over kolla.target] ************************************** 2026-04-24 04:30:27.453307 | orchestrator | Friday 24 April 2026 04:30:22 +0000 (0:00:02.195) 0:00:31.747 ********** 2026-04-24 04:30:27.453320 | orchestrator | changed: [testbed-manager] 2026-04-24 04:30:27.453333 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:30:27.453345 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:30:27.453357 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:30:27.453370 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:30:27.453382 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:30:27.453395 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:30:27.453405 | orchestrator | 2026-04-24 04:30:27.453416 | orchestrator | TASK [common : Copying over config.json files for services] ******************** 2026-04-24 04:30:27.453427 | orchestrator | Friday 24 April 2026 04:30:25 +0000 (0:00:02.934) 0:00:34.682 ********** 2026-04-24 04:30:27.453439 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:27.453452 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:27.453474 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:27.453486 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:27.453507 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:29.401988 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:29.402135 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:29.402184 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402198 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402233 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402245 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402277 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402290 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402301 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402319 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402332 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402352 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402363 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402374 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402386 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:29.402405 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:49.497311 | orchestrator | 2026-04-24 04:30:49.497422 | orchestrator | TASK [common : Find custom fluentd input config files] ************************* 2026-04-24 04:30:49.497439 | orchestrator | Friday 24 April 2026 04:30:30 +0000 (0:00:04.834) 0:00:39.516 ********** 2026-04-24 04:30:49.497451 | orchestrator | [WARNING]: Skipped 2026-04-24 04:30:49.497462 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' path due 2026-04-24 04:30:49.497473 | orchestrator | to this access issue: 2026-04-24 04:30:49.497483 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' is not a 2026-04-24 04:30:49.497493 | orchestrator | directory 2026-04-24 04:30:49.497502 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 04:30:49.497513 | orchestrator | 2026-04-24 04:30:49.497523 | orchestrator | TASK [common : Find custom fluentd filter config files] ************************ 2026-04-24 04:30:49.497533 | orchestrator | Friday 24 April 2026 04:30:33 +0000 (0:00:02.438) 0:00:41.955 ********** 2026-04-24 04:30:49.497543 | orchestrator | [WARNING]: Skipped 2026-04-24 04:30:49.497552 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' path due 2026-04-24 04:30:49.497562 | orchestrator | to this access issue: 2026-04-24 04:30:49.497572 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' is not a 2026-04-24 04:30:49.497581 | orchestrator | directory 2026-04-24 04:30:49.497684 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 04:30:49.497696 | orchestrator | 2026-04-24 04:30:49.497706 | orchestrator | TASK [common : Find custom fluentd format config files] ************************ 2026-04-24 04:30:49.497715 | orchestrator | Friday 24 April 2026 04:30:34 +0000 (0:00:01.868) 0:00:43.823 ********** 2026-04-24 04:30:49.497725 | orchestrator | [WARNING]: Skipped 2026-04-24 04:30:49.497747 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' path due 2026-04-24 04:30:49.497757 | orchestrator | to this access issue: 2026-04-24 04:30:49.497767 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' is not a 2026-04-24 04:30:49.497776 | orchestrator | directory 2026-04-24 04:30:49.497785 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 04:30:49.497795 | orchestrator | 2026-04-24 04:30:49.497804 | orchestrator | TASK [common : Find custom fluentd output config files] ************************ 2026-04-24 04:30:49.497814 | orchestrator | Friday 24 April 2026 04:30:37 +0000 (0:00:02.147) 0:00:45.971 ********** 2026-04-24 04:30:49.497823 | orchestrator | [WARNING]: Skipped 2026-04-24 04:30:49.497833 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' path due 2026-04-24 04:30:49.497842 | orchestrator | to this access issue: 2026-04-24 04:30:49.497854 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' is not a 2026-04-24 04:30:49.497864 | orchestrator | directory 2026-04-24 04:30:49.497876 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 04:30:49.497887 | orchestrator | 2026-04-24 04:30:49.497897 | orchestrator | TASK [common : Copying over fluentd.conf] ************************************** 2026-04-24 04:30:49.497908 | orchestrator | Friday 24 April 2026 04:30:38 +0000 (0:00:01.893) 0:00:47.865 ********** 2026-04-24 04:30:49.497919 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:30:49.497931 | orchestrator | changed: [testbed-manager] 2026-04-24 04:30:49.497941 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:30:49.497952 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:30:49.497963 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:30:49.497974 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:30:49.497985 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:30:49.497996 | orchestrator | 2026-04-24 04:30:49.498007 | orchestrator | TASK [common : Copying over cron logrotate config file] ************************ 2026-04-24 04:30:49.498064 | orchestrator | Friday 24 April 2026 04:30:42 +0000 (0:00:03.580) 0:00:51.445 ********** 2026-04-24 04:30:49.498077 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:30:49.498089 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:30:49.498101 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:30:49.498112 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:30:49.498123 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:30:49.498134 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:30:49.498145 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:30:49.498155 | orchestrator | 2026-04-24 04:30:49.498164 | orchestrator | TASK [common : Ensure RabbitMQ Erlang cookie exists] *************************** 2026-04-24 04:30:49.498174 | orchestrator | Friday 24 April 2026 04:30:45 +0000 (0:00:03.176) 0:00:54.621 ********** 2026-04-24 04:30:49.498183 | orchestrator | ok: [testbed-manager] 2026-04-24 04:30:49.498193 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:30:49.498202 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:30:49.498212 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:30:49.498221 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:30:49.498231 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:30:49.498240 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:30:49.498257 | orchestrator | 2026-04-24 04:30:49.498266 | orchestrator | TASK [common : Ensuring config directories have correct owner and permission] *** 2026-04-24 04:30:49.498276 | orchestrator | Friday 24 April 2026 04:30:48 +0000 (0:00:02.926) 0:00:57.548 ********** 2026-04-24 04:30:49.498316 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:49.498331 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:49.498347 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:49.498357 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:49.498367 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:49.498377 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:49.498387 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:49.498411 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:57.478658 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:57.478732 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:57.478739 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:57.478757 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:57.478762 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:57.478766 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:57.478783 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:57.478798 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:57.478803 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:30:57.478810 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:57.478815 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:57.478818 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:57.478822 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:57.478826 | orchestrator | 2026-04-24 04:30:57.478831 | orchestrator | TASK [common : Copy rabbitmq-env.conf to kolla toolbox] ************************ 2026-04-24 04:30:57.478836 | orchestrator | Friday 24 April 2026 04:30:51 +0000 (0:00:02.604) 0:01:00.152 ********** 2026-04-24 04:30:57.478840 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:30:57.478848 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:30:57.478851 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:30:57.478855 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:30:57.478859 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:30:57.478862 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:30:57.478866 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:30:57.478870 | orchestrator | 2026-04-24 04:30:57.478874 | orchestrator | TASK [common : Copy rabbitmq erl_inetrc to kolla toolbox] ********************** 2026-04-24 04:30:57.478877 | orchestrator | Friday 24 April 2026 04:30:54 +0000 (0:00:02.961) 0:01:03.114 ********** 2026-04-24 04:30:57.478881 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:30:57.478885 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:30:57.478889 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:30:57.478895 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:30:57.478898 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:30:57.478902 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:30:57.478906 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:30:57.478909 | orchestrator | 2026-04-24 04:30:57.478913 | orchestrator | TASK [service-check-containers : common | Check containers] ******************** 2026-04-24 04:30:57.478920 | orchestrator | Friday 24 April 2026 04:30:57 +0000 (0:00:03.237) 0:01:06.352 ********** 2026-04-24 04:30:59.721982 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:59.722090 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:59.722099 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:59.722104 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:59.722122 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:59.722126 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:59.722130 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:30:59.722146 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:59.722154 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:59.722158 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:59.722162 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:59.722169 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:59.722173 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:59.722177 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:30:59.722185 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:03.889187 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:03.889246 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:03.889251 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:03.889265 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:03.889269 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:03.889273 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:03.889277 | orchestrator | 2026-04-24 04:31:03.889282 | orchestrator | TASK [service-check-containers : common | Notify handlers to restart containers] *** 2026-04-24 04:31:03.889287 | orchestrator | Friday 24 April 2026 04:31:01 +0000 (0:00:04.195) 0:01:10.547 ********** 2026-04-24 04:31:03.889291 | orchestrator | changed: [testbed-manager] => { 2026-04-24 04:31:03.889296 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:31:03.889300 | orchestrator | } 2026-04-24 04:31:03.889304 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:31:03.889308 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:31:03.889311 | orchestrator | } 2026-04-24 04:31:03.889315 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:31:03.889319 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:31:03.889322 | orchestrator | } 2026-04-24 04:31:03.889326 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:31:03.889330 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:31:03.889334 | orchestrator | } 2026-04-24 04:31:03.889337 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 04:31:03.889341 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:31:03.889345 | orchestrator | } 2026-04-24 04:31:03.889348 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 04:31:03.889352 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:31:03.889356 | orchestrator | } 2026-04-24 04:31:03.889359 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 04:31:03.889363 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:31:03.889367 | orchestrator | } 2026-04-24 04:31:03.889371 | orchestrator | 2026-04-24 04:31:03.889374 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:31:03.889378 | orchestrator | Friday 24 April 2026 04:31:03 +0000 (0:00:01.888) 0:01:12.436 ********** 2026-04-24 04:31:03.889389 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:03.889404 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:03.889411 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:03.889416 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:31:03.889420 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:03.889424 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:03.889428 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:03.889432 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:31:03.889436 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:03.889440 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:03.889450 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424592 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:11.424698 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424706 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424712 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:31:11.424717 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:11.424721 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:31:11.424725 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424729 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424733 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:31:11.424737 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:11.424767 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424772 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424776 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:31:11.424780 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:11.424784 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424788 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:11.424791 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:31:11.424795 | orchestrator | 2026-04-24 04:31:11.424800 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:31:11.424805 | orchestrator | Friday 24 April 2026 04:31:06 +0000 (0:00:02.880) 0:01:15.317 ********** 2026-04-24 04:31:11.424809 | orchestrator | 2026-04-24 04:31:11.424813 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:31:11.424816 | orchestrator | Friday 24 April 2026 04:31:06 +0000 (0:00:00.441) 0:01:15.758 ********** 2026-04-24 04:31:11.424820 | orchestrator | 2026-04-24 04:31:11.424824 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:31:11.424831 | orchestrator | Friday 24 April 2026 04:31:07 +0000 (0:00:00.461) 0:01:16.220 ********** 2026-04-24 04:31:11.424834 | orchestrator | 2026-04-24 04:31:11.424838 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:31:11.424842 | orchestrator | Friday 24 April 2026 04:31:07 +0000 (0:00:00.435) 0:01:16.655 ********** 2026-04-24 04:31:11.424846 | orchestrator | 2026-04-24 04:31:11.424849 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:31:11.424853 | orchestrator | Friday 24 April 2026 04:31:08 +0000 (0:00:00.474) 0:01:17.130 ********** 2026-04-24 04:31:11.424857 | orchestrator | 2026-04-24 04:31:11.424861 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:31:11.424864 | orchestrator | Friday 24 April 2026 04:31:08 +0000 (0:00:00.459) 0:01:17.589 ********** 2026-04-24 04:31:11.424868 | orchestrator | 2026-04-24 04:31:11.424872 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:31:11.424876 | orchestrator | Friday 24 April 2026 04:31:09 +0000 (0:00:00.430) 0:01:18.020 ********** 2026-04-24 04:31:11.424879 | orchestrator | 2026-04-24 04:31:11.424883 | orchestrator | RUNNING HANDLER [common : Restart fluentd container] *************************** 2026-04-24 04:31:11.424887 | orchestrator | Friday 24 April 2026 04:31:10 +0000 (0:00:00.870) 0:01:18.890 ********** 2026-04-24 04:31:11.424900 | orchestrator | fatal: [testbed-manager]: FAILED! => {"changed": true, "msg": "'Traceback (most recent call last):\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 275, in _raise_for_status\\n response.raise_for_status()\\n File \"/usr/lib/python3/dist-packages/requests/models.py\", line 1021, in raise_for_status\\n raise HTTPError(http_error_msg, response=self)\\nrequests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd\\n\\nThe above exception was the direct cause of the following exception:\\n\\nTraceback (most recent call last):\\n File \"/tmp/ansible_kolla_container_payload_5vdhk8a_/ansible_kolla_container_payload.zip/ansible/modules/kolla_container.py\", line 421, in main\\n result = bool(getattr(cw, module.params.get(\\'action\\'))())\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/tmp/ansible_kolla_container_payload_5vdhk8a_/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 361, in recreate_or_restart_container\\n self.pull_image()\\n File \"/tmp/ansible_kolla_container_payload_5vdhk8a_/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 202, in pull_image\\n json.loads(line.strip().decode(\\'utf-8\\')) for line in self.dc.pull(\\n ^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/api/image.py\", line 429, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 277, in _raise_for_status\\n raise create_api_error_from_http_exception(e) from e\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/errors.py\", line 39, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation) from e\\ndocker.errors.APIError: 500 Server Error for http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd: Internal Server Error (\"unknown: artifact kolla/release/fluentd:5.0.9.20260328 not found\")\\n'"} 2026-04-24 04:31:13.322884 | orchestrator | fatal: [testbed-node-1]: FAILED! => {"changed": true, "msg": "'Traceback (most recent call last):\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 275, in _raise_for_status\\n response.raise_for_status()\\n File \"/usr/lib/python3/dist-packages/requests/models.py\", line 1021, in raise_for_status\\n raise HTTPError(http_error_msg, response=self)\\nrequests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd\\n\\nThe above exception was the direct cause of the following exception:\\n\\nTraceback (most recent call last):\\n File \"/tmp/ansible_kolla_container_payload_0q5ltbfm/ansible_kolla_container_payload.zip/ansible/modules/kolla_container.py\", line 421, in main\\n result = bool(getattr(cw, module.params.get(\\'action\\'))())\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/tmp/ansible_kolla_container_payload_0q5ltbfm/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 361, in recreate_or_restart_container\\n self.pull_image()\\n File \"/tmp/ansible_kolla_container_payload_0q5ltbfm/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 202, in pull_image\\n json.loads(line.strip().decode(\\'utf-8\\')) for line in self.dc.pull(\\n ^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/api/image.py\", line 429, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 277, in _raise_for_status\\n raise create_api_error_from_http_exception(e) from e\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/errors.py\", line 39, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation) from e\\ndocker.errors.APIError: 500 Server Error for http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd: Internal Server Error (\"unknown: artifact kolla/release/fluentd:5.0.9.20260328 not found\")\\n'"} 2026-04-24 04:31:13.323035 | orchestrator | fatal: [testbed-node-0]: FAILED! => {"changed": true, "msg": "'Traceback (most recent call last):\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 275, in _raise_for_status\\n response.raise_for_status()\\n File \"/usr/lib/python3/dist-packages/requests/models.py\", line 1021, in raise_for_status\\n raise HTTPError(http_error_msg, response=self)\\nrequests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd\\n\\nThe above exception was the direct cause of the following exception:\\n\\nTraceback (most recent call last):\\n File \"/tmp/ansible_kolla_container_payload_swy8wmiz/ansible_kolla_container_payload.zip/ansible/modules/kolla_container.py\", line 421, in main\\n result = bool(getattr(cw, module.params.get(\\'action\\'))())\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/tmp/ansible_kolla_container_payload_swy8wmiz/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 361, in recreate_or_restart_container\\n self.pull_image()\\n File \"/tmp/ansible_kolla_container_payload_swy8wmiz/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 202, in pull_image\\n json.loads(line.strip().decode(\\'utf-8\\')) for line in self.dc.pull(\\n ^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/api/image.py\", line 429, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 277, in _raise_for_status\\n raise create_api_error_from_http_exception(e) from e\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/errors.py\", line 39, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation) from e\\ndocker.errors.APIError: 500 Server Error for http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd: Internal Server Error (\"unknown: artifact kolla/release/fluentd:5.0.9.20260328 not found\")\\n'"} 2026-04-24 04:31:13.323063 | orchestrator | fatal: [testbed-node-3]: FAILED! => {"changed": true, "msg": "'Traceback (most recent call last):\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 275, in _raise_for_status\\n response.raise_for_status()\\n File \"/usr/lib/python3/dist-packages/requests/models.py\", line 1021, in raise_for_status\\n raise HTTPError(http_error_msg, response=self)\\nrequests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd\\n\\nThe above exception was the direct cause of the following exception:\\n\\nTraceback (most recent call last):\\n File \"/tmp/ansible_kolla_container_payload_d6yg7w6d/ansible_kolla_container_payload.zip/ansible/modules/kolla_container.py\", line 421, in main\\n result = bool(getattr(cw, module.params.get(\\'action\\'))())\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/tmp/ansible_kolla_container_payload_d6yg7w6d/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 361, in recreate_or_restart_container\\n self.pull_image()\\n File \"/tmp/ansible_kolla_container_payload_d6yg7w6d/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 202, in pull_image\\n json.loads(line.strip().decode(\\'utf-8\\')) for line in self.dc.pull(\\n ^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/api/image.py\", line 429, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 277, in _raise_for_status\\n raise create_api_error_from_http_exception(e) from e\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/errors.py\", line 39, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation) from e\\ndocker.errors.APIError: 500 Server Error for http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd: Internal Server Error (\"unknown: artifact kolla/release/fluentd:5.0.9.20260328 not found\")\\n'"} 2026-04-24 04:31:13.323096 | orchestrator | fatal: [testbed-node-4]: FAILED! => {"changed": true, "msg": "'Traceback (most recent call last):\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 275, in _raise_for_status\\n response.raise_for_status()\\n File \"/usr/lib/python3/dist-packages/requests/models.py\", line 1021, in raise_for_status\\n raise HTTPError(http_error_msg, response=self)\\nrequests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd\\n\\nThe above exception was the direct cause of the following exception:\\n\\nTraceback (most recent call last):\\n File \"/tmp/ansible_kolla_container_payload_38hc7vo3/ansible_kolla_container_payload.zip/ansible/modules/kolla_container.py\", line 421, in main\\n result = bool(getattr(cw, module.params.get(\\'action\\'))())\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/tmp/ansible_kolla_container_payload_38hc7vo3/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 361, in recreate_or_restart_container\\n self.pull_image()\\n File \"/tmp/ansible_kolla_container_payload_38hc7vo3/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 202, in pull_image\\n json.loads(line.strip().decode(\\'utf-8\\')) for line in self.dc.pull(\\n ^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/api/image.py\", line 429, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 277, in _raise_for_status\\n raise create_api_error_from_http_exception(e) from e\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/errors.py\", line 39, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation) from e\\ndocker.errors.APIError: 500 Server Error for http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd: Internal Server Error (\"unknown: artifact kolla/release/fluentd:5.0.9.20260328 not found\")\\n'"} 2026-04-24 04:31:16.815472 | orchestrator | 2026-04-24 04:31:16 | INFO  | Prepare task for execution of common. 2026-04-24 04:31:16.820030 | orchestrator | 2026-04-24 04:31:16 | INFO  | Task 6b468470-7128-41e3-95a5-c906463cd698 (common) was prepared for execution. 2026-04-24 04:31:16.820104 | orchestrator | 2026-04-24 04:31:16 | INFO  | It takes a moment until task 6b468470-7128-41e3-95a5-c906463cd698 (common) has been started and output is visible here. 2026-04-24 04:31:23.496610 | orchestrator | fatal: [testbed-node-5]: FAILED! => {"changed": true, "msg": "'Traceback (most recent call last):\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 275, in _raise_for_status\\n response.raise_for_status()\\n File \"/usr/lib/python3/dist-packages/requests/models.py\", line 1021, in raise_for_status\\n raise HTTPError(http_error_msg, response=self)\\nrequests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd\\n\\nThe above exception was the direct cause of the following exception:\\n\\nTraceback (most recent call last):\\n File \"/tmp/ansible_kolla_container_payload_cy1y51xt/ansible_kolla_container_payload.zip/ansible/modules/kolla_container.py\", line 421, in main\\n result = bool(getattr(cw, module.params.get(\\'action\\'))())\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/tmp/ansible_kolla_container_payload_cy1y51xt/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 361, in recreate_or_restart_container\\n self.pull_image()\\n File \"/tmp/ansible_kolla_container_payload_cy1y51xt/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 202, in pull_image\\n json.loads(line.strip().decode(\\'utf-8\\')) for line in self.dc.pull(\\n ^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/api/image.py\", line 429, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 277, in _raise_for_status\\n raise create_api_error_from_http_exception(e) from e\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/errors.py\", line 39, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation) from e\\ndocker.errors.APIError: 500 Server Error for http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd: Internal Server Error (\"unknown: artifact kolla/release/fluentd:5.0.9.20260328 not found\")\\n'"} 2026-04-24 04:31:23.496807 | orchestrator | fatal: [testbed-node-2]: FAILED! => {"changed": true, "msg": "'Traceback (most recent call last):\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 275, in _raise_for_status\\n response.raise_for_status()\\n File \"/usr/lib/python3/dist-packages/requests/models.py\", line 1021, in raise_for_status\\n raise HTTPError(http_error_msg, response=self)\\nrequests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd\\n\\nThe above exception was the direct cause of the following exception:\\n\\nTraceback (most recent call last):\\n File \"/tmp/ansible_kolla_container_payload_o8yjkcne/ansible_kolla_container_payload.zip/ansible/modules/kolla_container.py\", line 421, in main\\n result = bool(getattr(cw, module.params.get(\\'action\\'))())\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/tmp/ansible_kolla_container_payload_o8yjkcne/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 361, in recreate_or_restart_container\\n self.pull_image()\\n File \"/tmp/ansible_kolla_container_payload_o8yjkcne/ansible_kolla_container_payload.zip/ansible/module_utils/kolla_docker_worker.py\", line 202, in pull_image\\n json.loads(line.strip().decode(\\'utf-8\\')) for line in self.dc.pull(\\n ^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/api/image.py\", line 429, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python3/dist-packages/docker/api/client.py\", line 277, in _raise_for_status\\n raise create_api_error_from_http_exception(e) from e\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/usr/lib/python3/dist-packages/docker/errors.py\", line 39, in create_api_error_from_http_exception\\n raise cls(e, response=response, explanation=explanation) from e\\ndocker.errors.APIError: 500 Server Error for http+docker://localhost/v1.47/images/create?tag=5.0.9.20260328&fromImage=registry.osism.tech%2Fkolla%2Frelease%2Ffluentd: Internal Server Error (\"unknown: artifact kolla/release/fluentd:5.0.9.20260328 not found\")\\n'"} 2026-04-24 04:31:23.496853 | orchestrator | 2026-04-24 04:31:23.496867 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:31:23.496879 | orchestrator | testbed-manager : ok=18  changed=5  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026-04-24 04:31:23.496896 | orchestrator | testbed-node-0 : ok=14  changed=5  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026-04-24 04:31:23.496906 | orchestrator | testbed-node-1 : ok=14  changed=5  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026-04-24 04:31:23.496916 | orchestrator | testbed-node-2 : ok=14  changed=5  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026-04-24 04:31:23.496926 | orchestrator | testbed-node-3 : ok=14  changed=5  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026-04-24 04:31:23.496935 | orchestrator | testbed-node-4 : ok=14  changed=5  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026-04-24 04:31:23.496945 | orchestrator | testbed-node-5 : ok=14  changed=5  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026-04-24 04:31:23.496954 | orchestrator | 2026-04-24 04:31:23.496964 | orchestrator | 2026-04-24 04:31:23.496974 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:31:23.496984 | orchestrator | Friday 24 April 2026 04:31:16 +0000 (0:00:06.466) 0:01:25.357 ********** 2026-04-24 04:31:23.496994 | orchestrator | =============================================================================== 2026-04-24 04:31:23.497003 | orchestrator | common : Restart fluentd container -------------------------------------- 6.47s 2026-04-24 04:31:23.497013 | orchestrator | service-cert-copy : common | Copying over extra CA certificates --------- 4.92s 2026-04-24 04:31:23.497023 | orchestrator | common : Copying over config.json files for services -------------------- 4.83s 2026-04-24 04:31:23.497032 | orchestrator | common : Ensuring config directories exist ------------------------------ 4.29s 2026-04-24 04:31:23.497042 | orchestrator | service-check-containers : common | Check containers -------------------- 4.20s 2026-04-24 04:31:23.497059 | orchestrator | common : include_tasks -------------------------------------------------- 3.76s 2026-04-24 04:31:23.497068 | orchestrator | common : Copying over fluentd.conf -------------------------------------- 3.58s 2026-04-24 04:31:23.497078 | orchestrator | common : Flush handlers ------------------------------------------------- 3.57s 2026-04-24 04:31:23.497087 | orchestrator | service-cert-copy : common | Copying over backend internal TLS certificate --- 3.47s 2026-04-24 04:31:23.497098 | orchestrator | service-cert-copy : common | Copying over backend internal TLS key ------ 3.29s 2026-04-24 04:31:23.497108 | orchestrator | common : Copy rabbitmq erl_inetrc to kolla toolbox ---------------------- 3.24s 2026-04-24 04:31:23.497119 | orchestrator | common : Copying over cron logrotate config file ------------------------ 3.18s 2026-04-24 04:31:23.497130 | orchestrator | common : Copy rabbitmq-env.conf to kolla toolbox ------------------------ 2.96s 2026-04-24 04:31:23.497142 | orchestrator | common : Copying over kolla.target -------------------------------------- 2.93s 2026-04-24 04:31:23.497154 | orchestrator | common : Ensure RabbitMQ Erlang cookie exists --------------------------- 2.93s 2026-04-24 04:31:23.497165 | orchestrator | common : include_tasks -------------------------------------------------- 2.90s 2026-04-24 04:31:23.497176 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.88s 2026-04-24 04:31:23.497187 | orchestrator | common : Ensuring config directories have correct owner and permission --- 2.60s 2026-04-24 04:31:23.497199 | orchestrator | common : Copying over /run subdirectories conf -------------------------- 2.54s 2026-04-24 04:31:23.497210 | orchestrator | common : Find custom fluentd input config files ------------------------- 2.44s 2026-04-24 04:31:23.497220 | orchestrator | 2026-04-24 04:31:23.497232 | orchestrator | PLAY [Apply role common] ******************************************************* 2026-04-24 04:31:23.497242 | orchestrator | 2026-04-24 04:31:23.497253 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-24 04:31:23.497264 | orchestrator | Friday 24 April 2026 04:31:21 +0000 (0:00:01.869) 0:00:01.870 ********** 2026-04-24 04:31:23.497275 | orchestrator | included: /ansible/roles/common/tasks/upgrade.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 04:31:23.497287 | orchestrator | 2026-04-24 04:31:23.497305 | orchestrator | TASK [common : Ensuring config directories exist] ****************************** 2026-04-24 04:31:33.436320 | orchestrator | Friday 24 April 2026 04:31:24 +0000 (0:00:03.063) 0:00:04.933 ********** 2026-04-24 04:31:33.436431 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:31:33.436446 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:31:33.436458 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:31:33.436469 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:31:33.436480 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:31:33.436491 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:31:33.436503 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:31:33.436514 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:31:33.436525 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:31:33.436551 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:31:33.436562 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-24 04:31:33.436573 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:31:33.436584 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:31:33.436594 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:31:33.436679 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:31:33.436692 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:31:33.436703 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:31:33.436713 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-24 04:31:33.436724 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:31:33.436735 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:31:33.436745 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-24 04:31:33.436756 | orchestrator | 2026-04-24 04:31:33.436767 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-24 04:31:33.436778 | orchestrator | Friday 24 April 2026 04:31:28 +0000 (0:00:03.742) 0:00:08.676 ********** 2026-04-24 04:31:33.436790 | orchestrator | included: /ansible/roles/common/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 04:31:33.436803 | orchestrator | 2026-04-24 04:31:33.436814 | orchestrator | TASK [service-cert-copy : common | Copying over extra CA certificates] ********* 2026-04-24 04:31:33.436824 | orchestrator | Friday 24 April 2026 04:31:31 +0000 (0:00:02.653) 0:00:11.329 ********** 2026-04-24 04:31:33.436839 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:33.436855 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:33.436869 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:33.436900 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:33.436920 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:33.436942 | orchestrator | ok: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:33.436956 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:33.436970 | orchestrator | ok: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:33.436982 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:33.436996 | orchestrator | ok: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:33.437018 | orchestrator | ok: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556225 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556355 | orchestrator | ok: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556375 | orchestrator | ok: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556388 | orchestrator | ok: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556399 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556411 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556421 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556432 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556470 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556484 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:36.556497 | orchestrator | 2026-04-24 04:31:36.556511 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS certificate] *** 2026-04-24 04:31:36.556525 | orchestrator | Friday 24 April 2026 04:31:35 +0000 (0:00:04.610) 0:00:15.940 ********** 2026-04-24 04:31:36.556539 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:36.556552 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:36.556566 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:36.556587 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:36.556599 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:36.556655 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661297 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661401 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661419 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:37.661431 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661443 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:37.661455 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:31:37.661468 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:31:37.661479 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:31:37.661490 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661525 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661560 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661574 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661585 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:31:37.661596 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:31:37.661608 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:37.661646 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661658 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:37.661670 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661691 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:31:37.661705 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:37.661727 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013032 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:31:40.013109 | orchestrator | 2026-04-24 04:31:40.013131 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS key] ****** 2026-04-24 04:31:40.013141 | orchestrator | Friday 24 April 2026 04:31:38 +0000 (0:00:02.798) 0:00:18.738 ********** 2026-04-24 04:31:40.013152 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:40.013163 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:40.013172 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013181 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013209 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:40.013219 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013243 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013253 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:31:40.013261 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013270 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013278 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:31:40.013286 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:31:40.013294 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:40.013303 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:40.013317 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:40.013325 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013333 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:40.013350 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:51.962322 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:31:51.962437 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:51.962457 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:31:51.962471 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:51.962507 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:31:51.962520 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:51.962532 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:51.962543 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:31:51.962554 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:31:51.962565 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:31:51.962576 | orchestrator | 2026-04-24 04:31:51.962588 | orchestrator | TASK [common : Ensure /var/log/journal exists on EL10 systems] ***************** 2026-04-24 04:31:51.962601 | orchestrator | Friday 24 April 2026 04:31:41 +0000 (0:00:02.932) 0:00:21.671 ********** 2026-04-24 04:31:51.962612 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:31:51.962669 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:31:51.962682 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:31:51.962693 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:31:51.962704 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:31:51.962715 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:31:51.962725 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:31:51.962736 | orchestrator | 2026-04-24 04:31:51.962747 | orchestrator | TASK [common : Copying over /run subdirectories conf] ************************** 2026-04-24 04:31:51.962773 | orchestrator | Friday 24 April 2026 04:31:43 +0000 (0:00:01.832) 0:00:23.504 ********** 2026-04-24 04:31:51.962785 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:31:51.962796 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:31:51.962806 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:31:51.962817 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:31:51.962828 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:31:51.962838 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:31:51.962849 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:31:51.962862 | orchestrator | 2026-04-24 04:31:51.962875 | orchestrator | TASK [common : Restart systemd-tmpfiles] *************************************** 2026-04-24 04:31:51.962905 | orchestrator | Friday 24 April 2026 04:31:45 +0000 (0:00:01.991) 0:00:25.496 ********** 2026-04-24 04:31:51.962918 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:31:51.962932 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:31:51.962944 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:31:51.962955 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:31:51.962965 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:31:51.962975 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:31:51.962986 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:31:51.963006 | orchestrator | 2026-04-24 04:31:51.963017 | orchestrator | TASK [common : Copying over kolla.target] ************************************** 2026-04-24 04:31:51.963027 | orchestrator | Friday 24 April 2026 04:31:47 +0000 (0:00:02.000) 0:00:27.496 ********** 2026-04-24 04:31:51.963038 | orchestrator | ok: [testbed-manager] 2026-04-24 04:31:51.963050 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:31:51.963060 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:31:51.963071 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:31:51.963082 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:31:51.963092 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:31:51.963103 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:31:51.963113 | orchestrator | 2026-04-24 04:31:51.963124 | orchestrator | TASK [common : Copying over config.json files for services] ******************** 2026-04-24 04:31:51.963135 | orchestrator | Friday 24 April 2026 04:31:50 +0000 (0:00:02.794) 0:00:30.291 ********** 2026-04-24 04:31:51.963146 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:51.963159 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:51.963171 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:51.963182 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:51.963194 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:51.963206 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:51.963231 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:31:58.700073 | orchestrator | ok: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700656 | orchestrator | ok: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700689 | orchestrator | ok: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700710 | orchestrator | ok: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700723 | orchestrator | ok: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700756 | orchestrator | ok: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700791 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700808 | orchestrator | ok: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700826 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700846 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700865 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700892 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700911 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700942 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:31:58.700961 | orchestrator | 2026-04-24 04:31:58.700982 | orchestrator | TASK [common : Find custom fluentd input config files] ************************* 2026-04-24 04:31:58.701001 | orchestrator | Friday 24 April 2026 04:31:55 +0000 (0:00:05.213) 0:00:35.504 ********** 2026-04-24 04:31:58.701018 | orchestrator | [WARNING]: Skipped 2026-04-24 04:31:58.701036 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' path due 2026-04-24 04:31:58.701054 | orchestrator | to this access issue: 2026-04-24 04:31:58.701072 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' is not a 2026-04-24 04:31:58.701090 | orchestrator | directory 2026-04-24 04:31:58.701109 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 04:31:58.701127 | orchestrator | 2026-04-24 04:31:58.701146 | orchestrator | TASK [common : Find custom fluentd filter config files] ************************ 2026-04-24 04:31:58.701160 | orchestrator | Friday 24 April 2026 04:31:57 +0000 (0:00:02.371) 0:00:37.875 ********** 2026-04-24 04:31:58.701171 | orchestrator | [WARNING]: Skipped 2026-04-24 04:31:58.701192 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' path due 2026-04-24 04:32:14.662337 | orchestrator | to this access issue: 2026-04-24 04:32:14.662476 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' is not a 2026-04-24 04:32:14.662496 | orchestrator | directory 2026-04-24 04:32:14.662508 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 04:32:14.662523 | orchestrator | 2026-04-24 04:32:14.662542 | orchestrator | TASK [common : Find custom fluentd format config files] ************************ 2026-04-24 04:32:14.662561 | orchestrator | Friday 24 April 2026 04:31:59 +0000 (0:00:01.854) 0:00:39.730 ********** 2026-04-24 04:32:14.662581 | orchestrator | [WARNING]: Skipped 2026-04-24 04:32:14.662600 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' path due 2026-04-24 04:32:14.662619 | orchestrator | to this access issue: 2026-04-24 04:32:14.662667 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' is not a 2026-04-24 04:32:14.662685 | orchestrator | directory 2026-04-24 04:32:14.662704 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 04:32:14.662723 | orchestrator | 2026-04-24 04:32:14.662742 | orchestrator | TASK [common : Find custom fluentd output config files] ************************ 2026-04-24 04:32:14.662762 | orchestrator | Friday 24 April 2026 04:32:01 +0000 (0:00:02.088) 0:00:41.818 ********** 2026-04-24 04:32:14.662780 | orchestrator | [WARNING]: Skipped 2026-04-24 04:32:14.662798 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' path due 2026-04-24 04:32:14.662817 | orchestrator | to this access issue: 2026-04-24 04:32:14.662837 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' is not a 2026-04-24 04:32:14.662857 | orchestrator | directory 2026-04-24 04:32:14.662877 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 04:32:14.662896 | orchestrator | 2026-04-24 04:32:14.662917 | orchestrator | TASK [common : Copying over fluentd.conf] ************************************** 2026-04-24 04:32:14.662937 | orchestrator | Friday 24 April 2026 04:32:03 +0000 (0:00:01.912) 0:00:43.731 ********** 2026-04-24 04:32:14.662956 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:32:14.662975 | orchestrator | ok: [testbed-manager] 2026-04-24 04:32:14.662995 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:32:14.663014 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:32:14.663034 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:32:14.663055 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:32:14.663074 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:32:14.663125 | orchestrator | 2026-04-24 04:32:14.663146 | orchestrator | TASK [common : Copying over cron logrotate config file] ************************ 2026-04-24 04:32:14.663166 | orchestrator | Friday 24 April 2026 04:32:07 +0000 (0:00:03.904) 0:00:47.635 ********** 2026-04-24 04:32:14.663186 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:32:14.663208 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:32:14.663225 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:32:14.663242 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:32:14.663277 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:32:14.663294 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:32:14.663312 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-24 04:32:14.663329 | orchestrator | 2026-04-24 04:32:14.663346 | orchestrator | TASK [common : Ensure RabbitMQ Erlang cookie exists] *************************** 2026-04-24 04:32:14.663362 | orchestrator | Friday 24 April 2026 04:32:10 +0000 (0:00:03.145) 0:00:50.782 ********** 2026-04-24 04:32:14.663378 | orchestrator | ok: [testbed-manager] 2026-04-24 04:32:14.663395 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:32:14.663412 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:32:14.663430 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:32:14.663445 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:32:14.663461 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:32:14.663478 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:32:14.663495 | orchestrator | 2026-04-24 04:32:14.663510 | orchestrator | TASK [common : Ensuring config directories have correct owner and permission] *** 2026-04-24 04:32:14.663526 | orchestrator | Friday 24 April 2026 04:32:13 +0000 (0:00:02.858) 0:00:53.640 ********** 2026-04-24 04:32:14.663546 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:14.663598 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:14.663620 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:14.663661 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:14.663695 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:14.663721 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:14.663739 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:14.663756 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:14.663774 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:14.663806 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:24.194826 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:24.194938 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:24.194950 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:24.194972 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:24.194984 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:24.194993 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:24.195002 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:24.195029 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:24.195049 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:24.195056 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:24.195062 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:24.195068 | orchestrator | 2026-04-24 04:32:24.195075 | orchestrator | TASK [common : Copy rabbitmq-env.conf to kolla toolbox] ************************ 2026-04-24 04:32:24.195083 | orchestrator | Friday 24 April 2026 04:32:16 +0000 (0:00:02.846) 0:00:56.486 ********** 2026-04-24 04:32:24.195092 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:32:24.195100 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:32:24.195105 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:32:24.195111 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:32:24.195117 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:32:24.195122 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:32:24.195128 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-24 04:32:24.195134 | orchestrator | 2026-04-24 04:32:24.195140 | orchestrator | TASK [common : Copy rabbitmq erl_inetrc to kolla toolbox] ********************** 2026-04-24 04:32:24.195145 | orchestrator | Friday 24 April 2026 04:32:19 +0000 (0:00:03.214) 0:00:59.701 ********** 2026-04-24 04:32:24.195151 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:32:24.195157 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:32:24.195162 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:32:24.195168 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:32:24.195174 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:32:24.195179 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:32:24.195185 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-24 04:32:24.195191 | orchestrator | 2026-04-24 04:32:24.195196 | orchestrator | TASK [service-check-containers : common | Check containers] ******************** 2026-04-24 04:32:24.195202 | orchestrator | Friday 24 April 2026 04:32:23 +0000 (0:00:03.298) 0:01:03.000 ********** 2026-04-24 04:32:24.195213 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:24.195225 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:25.575845 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:25.575967 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:25.576001 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:25.576014 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:25.576026 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-24 04:32:25.576038 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576084 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576116 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576129 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576141 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576152 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576246 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576277 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576292 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:25.576314 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:30.092857 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:30.092989 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:30.093021 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:30.093030 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:32:30.093037 | orchestrator | 2026-04-24 04:32:30.093046 | orchestrator | TASK [service-check-containers : common | Notify handlers to restart containers] *** 2026-04-24 04:32:30.093055 | orchestrator | Friday 24 April 2026 04:32:27 +0000 (0:00:04.139) 0:01:07.139 ********** 2026-04-24 04:32:30.093064 | orchestrator | changed: [testbed-manager] => { 2026-04-24 04:32:30.093098 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:32:30.093105 | orchestrator | } 2026-04-24 04:32:30.093113 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:32:30.093119 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:32:30.093125 | orchestrator | } 2026-04-24 04:32:30.093131 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:32:30.093138 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:32:30.093144 | orchestrator | } 2026-04-24 04:32:30.093151 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:32:30.093158 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:32:30.093164 | orchestrator | } 2026-04-24 04:32:30.093171 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 04:32:30.093178 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:32:30.093184 | orchestrator | } 2026-04-24 04:32:30.093191 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 04:32:30.093197 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:32:30.093204 | orchestrator | } 2026-04-24 04:32:30.093210 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 04:32:30.093217 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:32:30.093223 | orchestrator | } 2026-04-24 04:32:30.093229 | orchestrator | 2026-04-24 04:32:30.093235 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:32:30.093242 | orchestrator | Friday 24 April 2026 04:32:29 +0000 (0:00:02.019) 0:01:09.159 ********** 2026-04-24 04:32:30.093252 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:32:30.093264 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:30.093292 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:30.093301 | orchestrator | skipping: [testbed-manager] 2026-04-24 04:32:30.093308 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:32:30.093321 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:30.093335 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:30.093343 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:32:30.093350 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:30.093358 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:32:30.093365 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:32:30.093381 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:33:56.276693 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:33:56.276832 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:33:56.276875 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:33:56.276890 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:33:56.276904 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:33:56.276915 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:33:56.276927 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:33:56.276938 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:33:56.276950 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:33:56.276962 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:33:56.276992 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:33:56.277005 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:33:56.277016 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-24 04:33:56.277041 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:33:56.277054 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:33:56.277066 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:33:56.277085 | orchestrator | 2026-04-24 04:33:56.277104 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:33:56.277124 | orchestrator | Friday 24 April 2026 04:32:32 +0000 (0:00:03.295) 0:01:12.455 ********** 2026-04-24 04:33:56.277144 | orchestrator | 2026-04-24 04:33:56.277163 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:33:56.277183 | orchestrator | Friday 24 April 2026 04:32:32 +0000 (0:00:00.477) 0:01:12.932 ********** 2026-04-24 04:33:56.277195 | orchestrator | 2026-04-24 04:33:56.277206 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:33:56.277216 | orchestrator | Friday 24 April 2026 04:32:33 +0000 (0:00:00.449) 0:01:13.382 ********** 2026-04-24 04:33:56.277227 | orchestrator | 2026-04-24 04:33:56.277237 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:33:56.277248 | orchestrator | Friday 24 April 2026 04:32:33 +0000 (0:00:00.432) 0:01:13.815 ********** 2026-04-24 04:33:56.277259 | orchestrator | 2026-04-24 04:33:56.277270 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:33:56.277281 | orchestrator | Friday 24 April 2026 04:32:34 +0000 (0:00:00.453) 0:01:14.268 ********** 2026-04-24 04:33:56.277292 | orchestrator | 2026-04-24 04:33:56.277302 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:33:56.277313 | orchestrator | Friday 24 April 2026 04:32:34 +0000 (0:00:00.468) 0:01:14.737 ********** 2026-04-24 04:33:56.277323 | orchestrator | 2026-04-24 04:33:56.277334 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-24 04:33:56.277345 | orchestrator | Friday 24 April 2026 04:32:35 +0000 (0:00:00.481) 0:01:15.218 ********** 2026-04-24 04:33:56.277355 | orchestrator | 2026-04-24 04:33:56.277366 | orchestrator | RUNNING HANDLER [common : Restart fluentd container] *************************** 2026-04-24 04:33:56.277377 | orchestrator | Friday 24 April 2026 04:32:36 +0000 (0:00:00.868) 0:01:16.087 ********** 2026-04-24 04:33:56.277387 | orchestrator | changed: [testbed-manager] 2026-04-24 04:33:56.277398 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:33:56.277409 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:33:56.277419 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:33:56.277430 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:33:56.277441 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:33:56.277451 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:33:56.277469 | orchestrator | 2026-04-24 04:33:56.277480 | orchestrator | RUNNING HANDLER [common : Restart kolla-toolbox container] ********************* 2026-04-24 04:33:56.277491 | orchestrator | Friday 24 April 2026 04:33:18 +0000 (0:00:42.759) 0:01:58.846 ********** 2026-04-24 04:33:56.277501 | orchestrator | changed: [testbed-manager] 2026-04-24 04:33:56.277512 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:33:56.277523 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:33:56.277533 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:33:56.277544 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:33:56.277555 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:33:56.277565 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:33:56.277576 | orchestrator | 2026-04-24 04:33:56.277595 | orchestrator | RUNNING HANDLER [common : Initializing toolbox container using normal user] **** 2026-04-24 04:34:12.512980 | orchestrator | Friday 24 April 2026 04:33:57 +0000 (0:00:38.141) 0:02:36.988 ********** 2026-04-24 04:34:12.513071 | orchestrator | ok: [testbed-manager] 2026-04-24 04:34:12.513083 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:12.513090 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:12.513096 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:12.513103 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:34:12.513109 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:34:12.513116 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:34:12.513122 | orchestrator | 2026-04-24 04:34:12.513130 | orchestrator | RUNNING HANDLER [common : Restart cron container] ****************************** 2026-04-24 04:34:12.513136 | orchestrator | Friday 24 April 2026 04:33:59 +0000 (0:00:02.845) 0:02:39.833 ********** 2026-04-24 04:34:12.513143 | orchestrator | changed: [testbed-manager] 2026-04-24 04:34:12.513150 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:34:12.513157 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:34:12.513163 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:34:12.513169 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:34:12.513176 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:34:12.513182 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:34:12.513188 | orchestrator | 2026-04-24 04:34:12.513195 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:34:12.513202 | orchestrator | testbed-manager : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:34:12.513236 | orchestrator | testbed-node-0 : ok=18  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:34:12.513244 | orchestrator | testbed-node-1 : ok=18  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:34:12.513251 | orchestrator | testbed-node-2 : ok=18  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:34:12.513257 | orchestrator | testbed-node-3 : ok=18  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:34:12.513263 | orchestrator | testbed-node-4 : ok=18  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:34:12.513270 | orchestrator | testbed-node-5 : ok=18  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:34:12.513276 | orchestrator | 2026-04-24 04:34:12.513282 | orchestrator | 2026-04-24 04:34:12.513289 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:34:12.513295 | orchestrator | Friday 24 April 2026 04:34:12 +0000 (0:00:12.186) 0:02:52.020 ********** 2026-04-24 04:34:12.513301 | orchestrator | =============================================================================== 2026-04-24 04:34:12.513308 | orchestrator | common : Restart fluentd container ------------------------------------- 42.76s 2026-04-24 04:34:12.513334 | orchestrator | common : Restart kolla-toolbox container ------------------------------- 38.14s 2026-04-24 04:34:12.513341 | orchestrator | common : Restart cron container ---------------------------------------- 12.19s 2026-04-24 04:34:12.513347 | orchestrator | common : Copying over config.json files for services -------------------- 5.21s 2026-04-24 04:34:12.513353 | orchestrator | service-cert-copy : common | Copying over extra CA certificates --------- 4.61s 2026-04-24 04:34:12.513359 | orchestrator | service-check-containers : common | Check containers -------------------- 4.14s 2026-04-24 04:34:12.513366 | orchestrator | common : Copying over fluentd.conf -------------------------------------- 3.90s 2026-04-24 04:34:12.513372 | orchestrator | common : Ensuring config directories exist ------------------------------ 3.74s 2026-04-24 04:34:12.513378 | orchestrator | common : Flush handlers ------------------------------------------------- 3.63s 2026-04-24 04:34:12.513384 | orchestrator | common : Copy rabbitmq erl_inetrc to kolla toolbox ---------------------- 3.30s 2026-04-24 04:34:12.513391 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.30s 2026-04-24 04:34:12.513397 | orchestrator | common : Copy rabbitmq-env.conf to kolla toolbox ------------------------ 3.21s 2026-04-24 04:34:12.513403 | orchestrator | common : Copying over cron logrotate config file ------------------------ 3.15s 2026-04-24 04:34:12.513409 | orchestrator | common : include_tasks -------------------------------------------------- 3.06s 2026-04-24 04:34:12.513416 | orchestrator | service-cert-copy : common | Copying over backend internal TLS key ------ 2.93s 2026-04-24 04:34:12.513422 | orchestrator | common : Ensure RabbitMQ Erlang cookie exists --------------------------- 2.86s 2026-04-24 04:34:12.513428 | orchestrator | common : Ensuring config directories have correct owner and permission --- 2.85s 2026-04-24 04:34:12.513434 | orchestrator | common : Initializing toolbox container using normal user --------------- 2.85s 2026-04-24 04:34:12.513441 | orchestrator | service-cert-copy : common | Copying over backend internal TLS certificate --- 2.80s 2026-04-24 04:34:12.513448 | orchestrator | common : Copying over kolla.target -------------------------------------- 2.79s 2026-04-24 04:34:12.697709 | orchestrator | + osism apply -a upgrade loadbalancer 2026-04-24 04:34:13.995959 | orchestrator | 2026-04-24 04:34:13 | INFO  | Prepare task for execution of loadbalancer. 2026-04-24 04:34:14.060222 | orchestrator | 2026-04-24 04:34:14 | INFO  | Task 9089d95e-4a1b-466b-b7a4-5f86b36499f0 (loadbalancer) was prepared for execution. 2026-04-24 04:34:14.060321 | orchestrator | 2026-04-24 04:34:14 | INFO  | It takes a moment until task 9089d95e-4a1b-466b-b7a4-5f86b36499f0 (loadbalancer) has been started and output is visible here. 2026-04-24 04:34:33.330442 | orchestrator | 2026-04-24 04:34:33.330555 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:34:33.330572 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 04:34:33.330586 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 04:34:33.330608 | orchestrator | 2026-04-24 04:34:33.330619 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:34:33.330680 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 04:34:33.330692 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 04:34:33.330714 | orchestrator | Friday 24 April 2026 04:34:18 +0000 (0:00:01.351) 0:00:01.351 ********** 2026-04-24 04:34:33.330725 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:33.330737 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:33.330748 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:33.330758 | orchestrator | 2026-04-24 04:34:33.330787 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:34:33.330799 | orchestrator | Friday 24 April 2026 04:34:19 +0000 (0:00:00.853) 0:00:02.204 ********** 2026-04-24 04:34:33.330832 | orchestrator | ok: [testbed-node-0] => (item=enable_loadbalancer_True) 2026-04-24 04:34:33.330843 | orchestrator | ok: [testbed-node-1] => (item=enable_loadbalancer_True) 2026-04-24 04:34:33.330854 | orchestrator | ok: [testbed-node-2] => (item=enable_loadbalancer_True) 2026-04-24 04:34:33.330864 | orchestrator | 2026-04-24 04:34:33.330875 | orchestrator | PLAY [Apply role loadbalancer] ************************************************* 2026-04-24 04:34:33.330885 | orchestrator | 2026-04-24 04:34:33.330896 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-24 04:34:33.330906 | orchestrator | Friday 24 April 2026 04:34:20 +0000 (0:00:00.851) 0:00:03.056 ********** 2026-04-24 04:34:33.330917 | orchestrator | included: /ansible/roles/loadbalancer/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:34:33.330928 | orchestrator | 2026-04-24 04:34:33.330939 | orchestrator | TASK [loadbalancer : Stop and remove containers for haproxy exporter containers] *** 2026-04-24 04:34:33.330950 | orchestrator | Friday 24 April 2026 04:34:21 +0000 (0:00:01.248) 0:00:04.304 ********** 2026-04-24 04:34:33.330962 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:33.330975 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:33.330988 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:33.331000 | orchestrator | 2026-04-24 04:34:33.331012 | orchestrator | TASK [loadbalancer : Removing config for haproxy exporter] ********************* 2026-04-24 04:34:33.331025 | orchestrator | Friday 24 April 2026 04:34:23 +0000 (0:00:01.492) 0:00:05.797 ********** 2026-04-24 04:34:33.331038 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:33.331049 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:33.331076 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:33.331089 | orchestrator | 2026-04-24 04:34:33.331112 | orchestrator | TASK [loadbalancer : Check IPv6 support] *************************************** 2026-04-24 04:34:33.331124 | orchestrator | Friday 24 April 2026 04:34:24 +0000 (0:00:01.248) 0:00:07.046 ********** 2026-04-24 04:34:33.331137 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:33.331149 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:33.331161 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:33.331174 | orchestrator | 2026-04-24 04:34:33.331186 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-24 04:34:33.331199 | orchestrator | Friday 24 April 2026 04:34:25 +0000 (0:00:00.741) 0:00:07.787 ********** 2026-04-24 04:34:33.331212 | orchestrator | included: sysctl for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:34:33.331224 | orchestrator | 2026-04-24 04:34:33.331236 | orchestrator | TASK [sysctl : Check IPv6 support] ********************************************* 2026-04-24 04:34:33.331248 | orchestrator | Friday 24 April 2026 04:34:26 +0000 (0:00:00.867) 0:00:08.655 ********** 2026-04-24 04:34:33.331260 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:33.331272 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:33.331284 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:33.331296 | orchestrator | 2026-04-24 04:34:33.331310 | orchestrator | TASK [sysctl : Setting sysctl values] ****************************************** 2026-04-24 04:34:33.331322 | orchestrator | Friday 24 April 2026 04:34:26 +0000 (0:00:00.606) 0:00:09.261 ********** 2026-04-24 04:34:33.331333 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-24 04:34:33.331344 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-24 04:34:33.331354 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-24 04:34:33.331365 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-24 04:34:33.331375 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-24 04:34:33.331386 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-24 04:34:33.331397 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-24 04:34:33.331408 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-24 04:34:33.331427 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-24 04:34:33.331438 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-24 04:34:33.331448 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-24 04:34:33.331477 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-24 04:34:33.331489 | orchestrator | 2026-04-24 04:34:33.331499 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-24 04:34:33.331510 | orchestrator | Friday 24 April 2026 04:34:29 +0000 (0:00:02.646) 0:00:11.908 ********** 2026-04-24 04:34:33.331521 | orchestrator | ok: [testbed-node-1] => (item=ip_vs) 2026-04-24 04:34:33.331532 | orchestrator | ok: [testbed-node-0] => (item=ip_vs) 2026-04-24 04:34:33.331543 | orchestrator | ok: [testbed-node-2] => (item=ip_vs) 2026-04-24 04:34:33.331553 | orchestrator | 2026-04-24 04:34:33.331564 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-24 04:34:33.331575 | orchestrator | Friday 24 April 2026 04:34:29 +0000 (0:00:00.681) 0:00:12.590 ********** 2026-04-24 04:34:33.331585 | orchestrator | ok: [testbed-node-1] => (item=ip_vs) 2026-04-24 04:34:33.331596 | orchestrator | ok: [testbed-node-0] => (item=ip_vs) 2026-04-24 04:34:33.331607 | orchestrator | ok: [testbed-node-2] => (item=ip_vs) 2026-04-24 04:34:33.331618 | orchestrator | 2026-04-24 04:34:33.331648 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-24 04:34:33.331659 | orchestrator | Friday 24 April 2026 04:34:31 +0000 (0:00:01.183) 0:00:13.773 ********** 2026-04-24 04:34:33.331670 | orchestrator | skipping: [testbed-node-0] => (item=ip_vs)  2026-04-24 04:34:33.331687 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:34:33.331698 | orchestrator | skipping: [testbed-node-1] => (item=ip_vs)  2026-04-24 04:34:33.331709 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:34:33.331719 | orchestrator | skipping: [testbed-node-2] => (item=ip_vs)  2026-04-24 04:34:33.331730 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:34:33.331741 | orchestrator | 2026-04-24 04:34:33.331751 | orchestrator | TASK [loadbalancer : Ensuring config directories exist] ************************ 2026-04-24 04:34:33.331762 | orchestrator | Friday 24 April 2026 04:34:32 +0000 (0:00:01.095) 0:00:14.869 ********** 2026-04-24 04:34:33.331777 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:33.331796 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:33.331808 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:33.331827 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:33.331848 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:39.941873 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:39.941985 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:34:39.942001 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:34:39.942013 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:34:39.942103 | orchestrator | 2026-04-24 04:34:39.942117 | orchestrator | TASK [loadbalancer : Ensuring haproxy service config subdir exists] ************ 2026-04-24 04:34:39.942130 | orchestrator | Friday 24 April 2026 04:34:33 +0000 (0:00:01.640) 0:00:16.510 ********** 2026-04-24 04:34:39.942141 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:39.942153 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:39.942173 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:39.942184 | orchestrator | 2026-04-24 04:34:39.942195 | orchestrator | TASK [loadbalancer : Ensuring proxysql service config subdirectories exist] **** 2026-04-24 04:34:39.942206 | orchestrator | Friday 24 April 2026 04:34:35 +0000 (0:00:01.486) 0:00:17.996 ********** 2026-04-24 04:34:39.942217 | orchestrator | ok: [testbed-node-0] => (item=users) 2026-04-24 04:34:39.942228 | orchestrator | ok: [testbed-node-1] => (item=users) 2026-04-24 04:34:39.942240 | orchestrator | ok: [testbed-node-2] => (item=users) 2026-04-24 04:34:39.942251 | orchestrator | ok: [testbed-node-0] => (item=rules) 2026-04-24 04:34:39.942261 | orchestrator | ok: [testbed-node-1] => (item=rules) 2026-04-24 04:34:39.942272 | orchestrator | ok: [testbed-node-2] => (item=rules) 2026-04-24 04:34:39.942282 | orchestrator | 2026-04-24 04:34:39.942293 | orchestrator | TASK [loadbalancer : Ensuring keepalived checks subdir exists] ***************** 2026-04-24 04:34:39.942304 | orchestrator | Friday 24 April 2026 04:34:36 +0000 (0:00:01.499) 0:00:19.496 ********** 2026-04-24 04:34:39.942314 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:39.942325 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:39.942336 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:39.942346 | orchestrator | 2026-04-24 04:34:39.942357 | orchestrator | TASK [loadbalancer : Remove mariadb.cfg if proxysql enabled] ******************* 2026-04-24 04:34:39.942367 | orchestrator | Friday 24 April 2026 04:34:37 +0000 (0:00:00.920) 0:00:20.416 ********** 2026-04-24 04:34:39.942378 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:34:39.942388 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:34:39.942399 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:34:39.942412 | orchestrator | 2026-04-24 04:34:39.942424 | orchestrator | TASK [loadbalancer : Removing checks for services which are disabled] ********** 2026-04-24 04:34:39.942437 | orchestrator | Friday 24 April 2026 04:34:39 +0000 (0:00:01.447) 0:00:21.864 ********** 2026-04-24 04:34:39.942468 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 04:34:39.942531 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:34:39.942547 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:34:39.942571 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 04:34:39.942586 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:34:39.942599 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 04:34:39.942612 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:34:39.942623 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:34:39.942676 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 04:34:42.749079 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:34:42.749181 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 04:34:42.749224 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:34:42.749238 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:34:42.749251 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 04:34:42.749263 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:34:42.749275 | orchestrator | 2026-04-24 04:34:42.749287 | orchestrator | TASK [loadbalancer : Copying checks for services which are enabled] ************ 2026-04-24 04:34:42.749299 | orchestrator | Friday 24 April 2026 04:34:40 +0000 (0:00:00.950) 0:00:22.815 ********** 2026-04-24 04:34:42.749311 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:42.749355 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:42.749368 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:42.749387 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:42.749398 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:34:42.749410 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 04:34:42.749421 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:42.749432 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:42.749465 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:34:48.251242 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:34:48.251355 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 04:34:48.251374 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18', '__omit_place_holder__6515dbe41956c2689fabb6fe87cb40befebb7e18'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-24 04:34:48.251387 | orchestrator | 2026-04-24 04:34:48.251401 | orchestrator | TASK [loadbalancer : Copying over config.json files for services] ************** 2026-04-24 04:34:48.251414 | orchestrator | Friday 24 April 2026 04:34:42 +0000 (0:00:02.647) 0:00:25.462 ********** 2026-04-24 04:34:48.251426 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:48.251439 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:48.251466 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 04:34:48.251521 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:48.251535 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:48.251546 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:34:48.251558 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:34:48.251569 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:34:48.251580 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:34:48.251600 | orchestrator | 2026-04-24 04:34:48.251611 | orchestrator | TASK [loadbalancer : Copying over haproxy.cfg] ********************************* 2026-04-24 04:34:48.251699 | orchestrator | Friday 24 April 2026 04:34:46 +0000 (0:00:03.527) 0:00:28.990 ********** 2026-04-24 04:34:48.251716 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-24 04:34:48.251728 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-24 04:34:48.251739 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-24 04:34:48.251750 | orchestrator | 2026-04-24 04:34:48.251772 | orchestrator | TASK [loadbalancer : Copying over proxysql config] ***************************** 2026-04-24 04:35:04.541349 | orchestrator | Friday 24 April 2026 04:34:48 +0000 (0:00:01.873) 0:00:30.863 ********** 2026-04-24 04:35:04.541467 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-24 04:35:04.541483 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-24 04:35:04.541495 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-24 04:35:04.541508 | orchestrator | 2026-04-24 04:35:04.541531 | orchestrator | TASK [loadbalancer : Copying over haproxy single external frontend config] ***** 2026-04-24 04:35:04.541550 | orchestrator | Friday 24 April 2026 04:34:51 +0000 (0:00:03.179) 0:00:34.043 ********** 2026-04-24 04:35:04.541568 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:04.541587 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:04.541605 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:04.541680 | orchestrator | 2026-04-24 04:35:04.541705 | orchestrator | TASK [loadbalancer : Copying over custom haproxy services configuration] ******* 2026-04-24 04:35:04.541724 | orchestrator | Friday 24 April 2026 04:34:51 +0000 (0:00:00.570) 0:00:34.614 ********** 2026-04-24 04:35:04.541744 | orchestrator | ok: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-24 04:35:04.541758 | orchestrator | ok: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-24 04:35:04.541771 | orchestrator | ok: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-24 04:35:04.541782 | orchestrator | 2026-04-24 04:35:04.541793 | orchestrator | TASK [loadbalancer : Copying over keepalived.conf] ***************************** 2026-04-24 04:35:04.541804 | orchestrator | Friday 24 April 2026 04:34:54 +0000 (0:00:02.135) 0:00:36.749 ********** 2026-04-24 04:35:04.541823 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-24 04:35:04.541840 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-24 04:35:04.541858 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-24 04:35:04.541877 | orchestrator | 2026-04-24 04:35:04.541896 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-24 04:35:04.541916 | orchestrator | Friday 24 April 2026 04:34:56 +0000 (0:00:02.138) 0:00:38.887 ********** 2026-04-24 04:35:04.541936 | orchestrator | included: /ansible/roles/loadbalancer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:35:04.541956 | orchestrator | 2026-04-24 04:35:04.541971 | orchestrator | TASK [loadbalancer : Copying over haproxy.pem] ********************************* 2026-04-24 04:35:04.541983 | orchestrator | Friday 24 April 2026 04:34:57 +0000 (0:00:00.968) 0:00:39.856 ********** 2026-04-24 04:35:04.542083 | orchestrator | ok: [testbed-node-0] => (item=haproxy.pem) 2026-04-24 04:35:04.542099 | orchestrator | ok: [testbed-node-1] => (item=haproxy.pem) 2026-04-24 04:35:04.542113 | orchestrator | ok: [testbed-node-2] => (item=haproxy.pem) 2026-04-24 04:35:04.542125 | orchestrator | 2026-04-24 04:35:04.542138 | orchestrator | TASK [loadbalancer : Copying over haproxy-internal.pem] ************************ 2026-04-24 04:35:04.542151 | orchestrator | Friday 24 April 2026 04:34:58 +0000 (0:00:01.579) 0:00:41.435 ********** 2026-04-24 04:35:04.542164 | orchestrator | ok: [testbed-node-0] => (item=haproxy-internal.pem) 2026-04-24 04:35:04.542178 | orchestrator | ok: [testbed-node-1] => (item=haproxy-internal.pem) 2026-04-24 04:35:04.542190 | orchestrator | ok: [testbed-node-2] => (item=haproxy-internal.pem) 2026-04-24 04:35:04.542203 | orchestrator | 2026-04-24 04:35:04.542215 | orchestrator | TASK [loadbalancer : Copying over proxysql-cert.pem] *************************** 2026-04-24 04:35:04.542226 | orchestrator | Friday 24 April 2026 04:35:00 +0000 (0:00:01.864) 0:00:43.299 ********** 2026-04-24 04:35:04.542237 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:04.542248 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:04.542258 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:04.542269 | orchestrator | 2026-04-24 04:35:04.542280 | orchestrator | TASK [loadbalancer : Copying over proxysql-key.pem] **************************** 2026-04-24 04:35:04.542291 | orchestrator | Friday 24 April 2026 04:35:01 +0000 (0:00:00.330) 0:00:43.630 ********** 2026-04-24 04:35:04.542302 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:04.542313 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:04.542323 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:04.542334 | orchestrator | 2026-04-24 04:35:04.542345 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-24 04:35:04.542356 | orchestrator | Friday 24 April 2026 04:35:01 +0000 (0:00:00.693) 0:00:44.324 ********** 2026-04-24 04:35:04.542386 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 04:35:04.542424 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 04:35:04.542438 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 04:35:04.542449 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:35:04.542469 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:35:04.542481 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:35:04.542498 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:35:04.542518 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:35:05.867970 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:35:05.868071 | orchestrator | 2026-04-24 04:35:05.868094 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-24 04:35:05.868111 | orchestrator | Friday 24 April 2026 04:35:04 +0000 (0:00:02.940) 0:00:47.265 ********** 2026-04-24 04:35:05.868129 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 04:35:05.868194 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:05.868215 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:05.868232 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:05.868251 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 04:35:05.868284 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:05.868324 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:05.868340 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:05.868354 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 04:35:05.868380 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:05.868394 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:05.868410 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:05.868426 | orchestrator | 2026-04-24 04:35:05.868443 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-24 04:35:05.868461 | orchestrator | Friday 24 April 2026 04:35:05 +0000 (0:00:00.900) 0:00:48.165 ********** 2026-04-24 04:35:05.868477 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 04:35:05.868493 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:05.868520 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:12.892544 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:12.892723 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 04:35:12.892770 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:12.892782 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:12.892793 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:12.892845 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 04:35:12.892857 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:12.892872 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:12.892883 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:12.892893 | orchestrator | 2026-04-24 04:35:12.892903 | orchestrator | TASK [loadbalancer : Copying over haproxy start script] ************************ 2026-04-24 04:35:12.892915 | orchestrator | Friday 24 April 2026 04:35:06 +0000 (0:00:00.858) 0:00:49.024 ********** 2026-04-24 04:35:12.892925 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-24 04:35:12.892960 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-24 04:35:12.892971 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-24 04:35:12.892980 | orchestrator | 2026-04-24 04:35:12.892990 | orchestrator | TASK [loadbalancer : Copying over proxysql start script] *********************** 2026-04-24 04:35:12.893000 | orchestrator | Friday 24 April 2026 04:35:08 +0000 (0:00:01.703) 0:00:50.727 ********** 2026-04-24 04:35:12.893010 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-24 04:35:12.893019 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-24 04:35:12.893029 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-24 04:35:12.893038 | orchestrator | 2026-04-24 04:35:12.893048 | orchestrator | TASK [loadbalancer : Copying files for haproxy-ssh] **************************** 2026-04-24 04:35:12.893057 | orchestrator | Friday 24 April 2026 04:35:09 +0000 (0:00:01.651) 0:00:52.379 ********** 2026-04-24 04:35:12.893067 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 04:35:12.893076 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 04:35:12.893086 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 04:35:12.893095 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 04:35:12.893105 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:12.893114 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 04:35:12.893124 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:12.893133 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 04:35:12.893143 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:12.893152 | orchestrator | 2026-04-24 04:35:12.893162 | orchestrator | TASK [service-check-containers : loadbalancer | Check containers] ************** 2026-04-24 04:35:12.893171 | orchestrator | Friday 24 April 2026 04:35:11 +0000 (0:00:01.285) 0:00:53.664 ********** 2026-04-24 04:35:12.893182 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 04:35:12.893192 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 04:35:12.893207 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 04:35:12.893232 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:35:15.175706 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:35:15.175816 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:35:15.175833 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:35:15.175847 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:35:15.175859 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:35:15.175897 | orchestrator | 2026-04-24 04:35:15.175926 | orchestrator | TASK [service-check-containers : loadbalancer | Notify handlers to restart containers] *** 2026-04-24 04:35:15.175939 | orchestrator | Friday 24 April 2026 04:35:13 +0000 (0:00:02.917) 0:00:56.582 ********** 2026-04-24 04:35:15.175952 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:35:15.175964 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:35:15.175976 | orchestrator | } 2026-04-24 04:35:15.175987 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:35:15.175998 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:35:15.176009 | orchestrator | } 2026-04-24 04:35:15.176019 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:35:15.176030 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:35:15.176041 | orchestrator | } 2026-04-24 04:35:15.176052 | orchestrator | 2026-04-24 04:35:15.176063 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:35:15.176074 | orchestrator | Friday 24 April 2026 04:35:14 +0000 (0:00:00.669) 0:00:57.252 ********** 2026-04-24 04:35:15.176104 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 04:35:15.176117 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:15.176129 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:15.176141 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:15.176155 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 04:35:15.176169 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:15.176196 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:15.176209 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:15.176223 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 04:35:15.176245 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:35:20.428686 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:35:20.428806 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:20.428823 | orchestrator | 2026-04-24 04:35:20.428835 | orchestrator | TASK [include_role : aodh] ***************************************************** 2026-04-24 04:35:20.428848 | orchestrator | Friday 24 April 2026 04:35:15 +0000 (0:00:01.105) 0:00:58.358 ********** 2026-04-24 04:35:20.428859 | orchestrator | included: aodh for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:35:20.428870 | orchestrator | 2026-04-24 04:35:20.428881 | orchestrator | TASK [haproxy-config : Copying over aodh haproxy config] *********************** 2026-04-24 04:35:20.428892 | orchestrator | Friday 24 April 2026 04:35:16 +0000 (0:00:01.228) 0:00:59.586 ********** 2026-04-24 04:35:20.428907 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:20.428958 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 04:35:20.428972 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:20.428985 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 04:35:20.429029 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:20.429044 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 04:35:20.429064 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:20.429075 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 04:35:20.429092 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:20.429113 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 04:35:21.345178 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:21.345274 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 04:35:21.345314 | orchestrator | 2026-04-24 04:35:21.345326 | orchestrator | TASK [haproxy-config : Add configuration for aodh when using single external frontend] *** 2026-04-24 04:35:21.345337 | orchestrator | Friday 24 April 2026 04:35:20 +0000 (0:00:03.589) 0:01:03.176 ********** 2026-04-24 04:35:21.345349 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:21.345376 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 04:35:21.345388 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:21.345415 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 04:35:21.345426 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:21.345437 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:21.345456 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 04:35:21.345467 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:21.345481 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 04:35:21.345491 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:21.345501 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:21.345519 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 04:35:30.645265 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:30.645379 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 04:35:30.645395 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:30.645408 | orchestrator | 2026-04-24 04:35:30.645419 | orchestrator | TASK [haproxy-config : Configuring firewall for aodh] ************************** 2026-04-24 04:35:30.645430 | orchestrator | Friday 24 April 2026 04:35:21 +0000 (0:00:01.073) 0:01:04.249 ********** 2026-04-24 04:35:30.645441 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:30.645454 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:30.645466 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:30.645492 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:30.645503 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:30.645513 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:30.645523 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:30.645533 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:30.645543 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:30.645552 | orchestrator | 2026-04-24 04:35:30.645562 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL users config] *************** 2026-04-24 04:35:30.645572 | orchestrator | Friday 24 April 2026 04:35:22 +0000 (0:00:01.314) 0:01:05.564 ********** 2026-04-24 04:35:30.645582 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:35:30.645592 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:35:30.645602 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:35:30.645611 | orchestrator | 2026-04-24 04:35:30.645672 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL rules config] *************** 2026-04-24 04:35:30.645682 | orchestrator | Friday 24 April 2026 04:35:24 +0000 (0:00:01.196) 0:01:06.761 ********** 2026-04-24 04:35:30.645714 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:35:30.645724 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:35:30.645734 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:35:30.645743 | orchestrator | 2026-04-24 04:35:30.645753 | orchestrator | TASK [include_role : barbican] ************************************************* 2026-04-24 04:35:30.645762 | orchestrator | Friday 24 April 2026 04:35:26 +0000 (0:00:02.135) 0:01:08.897 ********** 2026-04-24 04:35:30.645772 | orchestrator | included: barbican for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:35:30.645782 | orchestrator | 2026-04-24 04:35:30.645791 | orchestrator | TASK [haproxy-config : Copying over barbican haproxy config] ******************* 2026-04-24 04:35:30.645801 | orchestrator | Friday 24 April 2026 04:35:27 +0000 (0:00:00.887) 0:01:09.784 ********** 2026-04-24 04:35:30.645832 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:30.645846 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:30.645862 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:35:30.645874 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:30.645893 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:30.645911 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:35:32.239945 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:32.240034 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:32.240047 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:35:32.240075 | orchestrator | 2026-04-24 04:35:32.240085 | orchestrator | TASK [haproxy-config : Add configuration for barbican when using single external frontend] *** 2026-04-24 04:35:32.240094 | orchestrator | Friday 24 April 2026 04:35:31 +0000 (0:00:04.356) 0:01:14.141 ********** 2026-04-24 04:35:32.240105 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:32.240129 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:32.240178 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:35:32.240188 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:32.240202 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:32.240211 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:32.240226 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:35:32.240234 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:32.240250 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:42.299806 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 04:35:42.299941 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:35:42.299961 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:42.299976 | orchestrator | 2026-04-24 04:35:42.299989 | orchestrator | TASK [haproxy-config : Configuring firewall for barbican] ********************** 2026-04-24 04:35:42.300001 | orchestrator | Friday 24 April 2026 04:35:32 +0000 (0:00:01.015) 0:01:15.156 ********** 2026-04-24 04:35:42.300013 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:42.300048 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:42.300061 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:42.300073 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:42.300084 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:42.300095 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:42.300106 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:42.300118 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:42.300129 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:42.300140 | orchestrator | 2026-04-24 04:35:42.300151 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL users config] *********** 2026-04-24 04:35:42.300162 | orchestrator | Friday 24 April 2026 04:35:33 +0000 (0:00:00.887) 0:01:16.044 ********** 2026-04-24 04:35:42.300173 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:35:42.300185 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:35:42.300196 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:35:42.300206 | orchestrator | 2026-04-24 04:35:42.300217 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL rules config] *********** 2026-04-24 04:35:42.300229 | orchestrator | Friday 24 April 2026 04:35:34 +0000 (0:00:01.178) 0:01:17.223 ********** 2026-04-24 04:35:42.300240 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:35:42.300250 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:35:42.300261 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:35:42.300273 | orchestrator | 2026-04-24 04:35:42.300285 | orchestrator | TASK [include_role : blazar] *************************************************** 2026-04-24 04:35:42.300299 | orchestrator | Friday 24 April 2026 04:35:36 +0000 (0:00:02.087) 0:01:19.310 ********** 2026-04-24 04:35:42.300312 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:42.300324 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:42.300337 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:42.300350 | orchestrator | 2026-04-24 04:35:42.300362 | orchestrator | TASK [include_role : ceph-rgw] ************************************************* 2026-04-24 04:35:42.300390 | orchestrator | Friday 24 April 2026 04:35:37 +0000 (0:00:00.547) 0:01:19.857 ********** 2026-04-24 04:35:42.300404 | orchestrator | included: ceph-rgw for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:35:42.300416 | orchestrator | 2026-04-24 04:35:42.300429 | orchestrator | TASK [haproxy-config : Copying over ceph-rgw haproxy config] ******************* 2026-04-24 04:35:42.300442 | orchestrator | Friday 24 April 2026 04:35:38 +0000 (0:00:00.761) 0:01:20.619 ********** 2026-04-24 04:35:42.300458 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-24 04:35:42.300488 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-24 04:35:42.300502 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-24 04:35:42.300515 | orchestrator | 2026-04-24 04:35:42.300528 | orchestrator | TASK [haproxy-config : Add configuration for ceph-rgw when using single external frontend] *** 2026-04-24 04:35:42.300541 | orchestrator | Friday 24 April 2026 04:35:41 +0000 (0:00:03.028) 0:01:23.648 ********** 2026-04-24 04:35:42.300555 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-24 04:35:42.300567 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:42.300590 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-24 04:35:50.553150 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:50.553284 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-24 04:35:50.553303 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:50.553315 | orchestrator | 2026-04-24 04:35:50.553328 | orchestrator | TASK [haproxy-config : Configuring firewall for ceph-rgw] ********************** 2026-04-24 04:35:50.553340 | orchestrator | Friday 24 April 2026 04:35:42 +0000 (0:00:01.500) 0:01:25.148 ********** 2026-04-24 04:35:50.553353 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-24 04:35:50.553367 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-24 04:35:50.553380 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:50.553391 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-24 04:35:50.553403 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-24 04:35:50.553414 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:50.553425 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-24 04:35:50.553437 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-24 04:35:50.553473 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:50.553485 | orchestrator | 2026-04-24 04:35:50.553496 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL users config] *********** 2026-04-24 04:35:50.553507 | orchestrator | Friday 24 April 2026 04:35:44 +0000 (0:00:01.815) 0:01:26.964 ********** 2026-04-24 04:35:50.553518 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:50.553528 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:50.553539 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:50.553550 | orchestrator | 2026-04-24 04:35:50.553561 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL rules config] *********** 2026-04-24 04:35:50.553590 | orchestrator | Friday 24 April 2026 04:35:45 +0000 (0:00:00.722) 0:01:27.686 ********** 2026-04-24 04:35:50.553602 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:50.553692 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:50.553717 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:50.553737 | orchestrator | 2026-04-24 04:35:50.553754 | orchestrator | TASK [include_role : cinder] *************************************************** 2026-04-24 04:35:50.553771 | orchestrator | Friday 24 April 2026 04:35:46 +0000 (0:00:01.319) 0:01:29.006 ********** 2026-04-24 04:35:50.553789 | orchestrator | included: cinder for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:35:50.553807 | orchestrator | 2026-04-24 04:35:50.553824 | orchestrator | TASK [haproxy-config : Copying over cinder haproxy config] ********************* 2026-04-24 04:35:50.553843 | orchestrator | Friday 24 April 2026 04:35:47 +0000 (0:00:00.763) 0:01:29.769 ********** 2026-04-24 04:35:50.553876 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:50.553900 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:35:50.553922 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 04:35:50.553956 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 04:35:50.553992 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:51.341515 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:35:51.341703 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:35:51.341731 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:35:51.341779 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 04:35:51.341798 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 04:35:51.341848 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 04:35:51.341867 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 04:35:51.341884 | orchestrator | 2026-04-24 04:35:51.341902 | orchestrator | TASK [haproxy-config : Add configuration for cinder when using single external frontend] *** 2026-04-24 04:35:51.341920 | orchestrator | Friday 24 April 2026 04:35:50 +0000 (0:00:03.768) 0:01:33.538 ********** 2026-04-24 04:35:51.341939 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:51.341967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:35:51.341984 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 04:35:51.342086 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 04:35:52.323550 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:52.324448 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:52.324482 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:35:52.324517 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 04:35:52.324529 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 04:35:52.324542 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:52.324590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:35:52.324604 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:35:52.324629 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 04:35:52.324648 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 04:35:52.324659 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:35:52.324670 | orchestrator | 2026-04-24 04:35:52.324682 | orchestrator | TASK [haproxy-config : Configuring firewall for cinder] ************************ 2026-04-24 04:35:52.324695 | orchestrator | Friday 24 April 2026 04:35:51 +0000 (0:00:00.742) 0:01:34.280 ********** 2026-04-24 04:35:52.324706 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:52.324718 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:52.324731 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:35:52.324742 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:52.324753 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:52.324764 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:35:52.324779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:35:52.324798 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:01.975385 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:01.975474 | orchestrator | 2026-04-24 04:36:01.975483 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL users config] ************* 2026-04-24 04:36:01.975491 | orchestrator | Friday 24 April 2026 04:35:52 +0000 (0:00:00.963) 0:01:35.244 ********** 2026-04-24 04:36:01.975498 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:01.975505 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:01.975512 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:01.975518 | orchestrator | 2026-04-24 04:36:01.975525 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL rules config] ************* 2026-04-24 04:36:01.975550 | orchestrator | Friday 24 April 2026 04:35:54 +0000 (0:00:02.029) 0:01:37.273 ********** 2026-04-24 04:36:01.975557 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:01.975563 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:01.975569 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:01.975575 | orchestrator | 2026-04-24 04:36:01.975581 | orchestrator | TASK [include_role : cloudkitty] *********************************************** 2026-04-24 04:36:01.975588 | orchestrator | Friday 24 April 2026 04:35:56 +0000 (0:00:02.098) 0:01:39.371 ********** 2026-04-24 04:36:01.975594 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:01.975600 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:01.975606 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:01.975654 | orchestrator | 2026-04-24 04:36:01.975661 | orchestrator | TASK [include_role : cyborg] *************************************************** 2026-04-24 04:36:01.975667 | orchestrator | Friday 24 April 2026 04:35:57 +0000 (0:00:00.338) 0:01:39.710 ********** 2026-04-24 04:36:01.975673 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:01.975679 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:01.975685 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:01.975691 | orchestrator | 2026-04-24 04:36:01.975697 | orchestrator | TASK [include_role : designate] ************************************************ 2026-04-24 04:36:01.975704 | orchestrator | Friday 24 April 2026 04:35:57 +0000 (0:00:00.295) 0:01:40.005 ********** 2026-04-24 04:36:01.975710 | orchestrator | included: designate for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:36:01.975716 | orchestrator | 2026-04-24 04:36:01.975722 | orchestrator | TASK [haproxy-config : Copying over designate haproxy config] ****************** 2026-04-24 04:36:01.975728 | orchestrator | Friday 24 April 2026 04:35:58 +0000 (0:00:01.013) 0:01:41.019 ********** 2026-04-24 04:36:01.975739 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:36:01.975749 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 04:36:01.975770 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 04:36:01.975796 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 04:36:01.975804 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:36:01.975811 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 04:36:01.975818 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 04:36:01.975824 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:36:01.975834 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 04:36:01.975851 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.738782 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.738882 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.738897 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:36:02.738911 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.738971 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 04:36:02.739020 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.739032 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.739042 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.739052 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.739062 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.739077 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.739095 | orchestrator | 2026-04-24 04:36:02.739106 | orchestrator | TASK [haproxy-config : Add configuration for designate when using single external frontend] *** 2026-04-24 04:36:02.739117 | orchestrator | Friday 24 April 2026 04:36:02 +0000 (0:00:03.850) 0:01:44.869 ********** 2026-04-24 04:36:02.739135 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:36:02.911801 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 04:36:02.911896 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.911911 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.911923 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.911971 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.912001 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:36:02.912016 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.912029 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:02.912042 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 04:36:02.912054 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.912074 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.912091 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.912103 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:36:02.912121 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 04:36:13.539460 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:13.539690 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:36:13.539733 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 04:36:13.539785 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 04:36:13.539824 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 04:36:13.539846 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 04:36:13.539889 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:36:13.539910 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-24 04:36:13.539929 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:13.539948 | orchestrator | 2026-04-24 04:36:13.539969 | orchestrator | TASK [haproxy-config : Configuring firewall for designate] ********************* 2026-04-24 04:36:13.539990 | orchestrator | Friday 24 April 2026 04:36:03 +0000 (0:00:01.058) 0:01:45.928 ********** 2026-04-24 04:36:13.540025 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:13.540051 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:13.540073 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:13.540097 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:13.540119 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:13.540143 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:13.540162 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:13.540189 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:13.540207 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:13.540229 | orchestrator | 2026-04-24 04:36:13.540251 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL users config] ********** 2026-04-24 04:36:13.540274 | orchestrator | Friday 24 April 2026 04:36:04 +0000 (0:00:01.303) 0:01:47.231 ********** 2026-04-24 04:36:13.540296 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:13.540319 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:13.540339 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:13.540357 | orchestrator | 2026-04-24 04:36:13.540376 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL rules config] ********** 2026-04-24 04:36:13.540395 | orchestrator | Friday 24 April 2026 04:36:05 +0000 (0:00:01.161) 0:01:48.393 ********** 2026-04-24 04:36:13.540413 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:13.540431 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:13.540449 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:13.540466 | orchestrator | 2026-04-24 04:36:13.540485 | orchestrator | TASK [include_role : etcd] ***************************************************** 2026-04-24 04:36:13.540502 | orchestrator | Friday 24 April 2026 04:36:07 +0000 (0:00:02.050) 0:01:50.444 ********** 2026-04-24 04:36:13.540519 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:13.540536 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:13.540553 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:13.540570 | orchestrator | 2026-04-24 04:36:13.540588 | orchestrator | TASK [include_role : glance] *************************************************** 2026-04-24 04:36:13.540605 | orchestrator | Friday 24 April 2026 04:36:08 +0000 (0:00:00.564) 0:01:51.009 ********** 2026-04-24 04:36:13.540656 | orchestrator | included: glance for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:36:13.540675 | orchestrator | 2026-04-24 04:36:13.540693 | orchestrator | TASK [haproxy-config : Copying over glance haproxy config] ********************* 2026-04-24 04:36:13.540711 | orchestrator | Friday 24 April 2026 04:36:09 +0000 (0:00:00.837) 0:01:51.846 ********** 2026-04-24 04:36:13.540754 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 04:36:13.733209 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 04:36:13.733311 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 04:36:13.733372 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 04:36:13.733386 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 04:36:13.733417 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 04:36:17.740264 | orchestrator | 2026-04-24 04:36:17.740361 | orchestrator | TASK [haproxy-config : Add configuration for glance when using single external frontend] *** 2026-04-24 04:36:17.740377 | orchestrator | Friday 24 April 2026 04:36:13 +0000 (0:00:04.598) 0:01:56.444 ********** 2026-04-24 04:36:17.740393 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 04:36:17.740449 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 04:36:17.740463 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:17.740517 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 04:36:17.740551 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 04:36:17.740564 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:17.740590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 04:36:29.889783 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-24 04:36:29.889903 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:29.889920 | orchestrator | 2026-04-24 04:36:29.889933 | orchestrator | TASK [haproxy-config : Configuring firewall for glance] ************************ 2026-04-24 04:36:29.889945 | orchestrator | Friday 24 April 2026 04:36:17 +0000 (0:00:04.029) 0:02:00.474 ********** 2026-04-24 04:36:29.889974 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 04:36:29.889989 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 04:36:29.890001 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:29.890070 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 04:36:29.890127 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 04:36:29.890140 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:29.890151 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 04:36:29.890163 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-24 04:36:29.890174 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:29.890184 | orchestrator | 2026-04-24 04:36:29.890196 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL users config] ************* 2026-04-24 04:36:29.890207 | orchestrator | Friday 24 April 2026 04:36:21 +0000 (0:00:03.814) 0:02:04.288 ********** 2026-04-24 04:36:29.890218 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:29.890230 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:29.890241 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:29.890251 | orchestrator | 2026-04-24 04:36:29.890262 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL rules config] ************* 2026-04-24 04:36:29.890273 | orchestrator | Friday 24 April 2026 04:36:23 +0000 (0:00:01.456) 0:02:05.744 ********** 2026-04-24 04:36:29.890283 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:29.890294 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:29.890306 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:29.890319 | orchestrator | 2026-04-24 04:36:29.890331 | orchestrator | TASK [include_role : gnocchi] ************************************************** 2026-04-24 04:36:29.890344 | orchestrator | Friday 24 April 2026 04:36:25 +0000 (0:00:02.128) 0:02:07.872 ********** 2026-04-24 04:36:29.890356 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:29.890369 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:29.890382 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:29.890395 | orchestrator | 2026-04-24 04:36:29.890407 | orchestrator | TASK [include_role : grafana] ************************************************** 2026-04-24 04:36:29.890419 | orchestrator | Friday 24 April 2026 04:36:25 +0000 (0:00:00.389) 0:02:08.262 ********** 2026-04-24 04:36:29.890432 | orchestrator | included: grafana for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:36:29.890444 | orchestrator | 2026-04-24 04:36:29.890457 | orchestrator | TASK [haproxy-config : Copying over grafana haproxy config] ******************** 2026-04-24 04:36:29.890475 | orchestrator | Friday 24 April 2026 04:36:26 +0000 (0:00:01.052) 0:02:09.315 ********** 2026-04-24 04:36:29.890490 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:36:29.890520 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:36:39.775887 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:36:39.775967 | orchestrator | 2026-04-24 04:36:39.775977 | orchestrator | TASK [haproxy-config : Add configuration for grafana when using single external frontend] *** 2026-04-24 04:36:39.775985 | orchestrator | Friday 24 April 2026 04:36:30 +0000 (0:00:03.339) 0:02:12.654 ********** 2026-04-24 04:36:39.775992 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:36:39.776000 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:36:39.776024 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:39.776032 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:39.776039 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:36:39.776046 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:39.776052 | orchestrator | 2026-04-24 04:36:39.776058 | orchestrator | TASK [haproxy-config : Configuring firewall for grafana] *********************** 2026-04-24 04:36:39.776064 | orchestrator | Friday 24 April 2026 04:36:30 +0000 (0:00:00.448) 0:02:13.103 ********** 2026-04-24 04:36:39.776072 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:39.776081 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:39.776088 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:39.776116 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:39.776123 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:39.776129 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:39.776135 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:39.776142 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:36:39.776148 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:39.776154 | orchestrator | 2026-04-24 04:36:39.776160 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL users config] ************ 2026-04-24 04:36:39.776167 | orchestrator | Friday 24 April 2026 04:36:31 +0000 (0:00:00.893) 0:02:13.997 ********** 2026-04-24 04:36:39.776173 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:39.776180 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:39.776186 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:39.776192 | orchestrator | 2026-04-24 04:36:39.776199 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL rules config] ************ 2026-04-24 04:36:39.776205 | orchestrator | Friday 24 April 2026 04:36:32 +0000 (0:00:01.200) 0:02:15.197 ********** 2026-04-24 04:36:39.776211 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:39.776217 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:39.776223 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:39.776229 | orchestrator | 2026-04-24 04:36:39.776240 | orchestrator | TASK [include_role : heat] ***************************************************** 2026-04-24 04:36:39.776246 | orchestrator | Friday 24 April 2026 04:36:34 +0000 (0:00:02.136) 0:02:17.333 ********** 2026-04-24 04:36:39.776252 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:39.776258 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:39.776264 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:39.776270 | orchestrator | 2026-04-24 04:36:39.776307 | orchestrator | TASK [include_role : horizon] ************************************************** 2026-04-24 04:36:39.776314 | orchestrator | Friday 24 April 2026 04:36:35 +0000 (0:00:00.350) 0:02:17.683 ********** 2026-04-24 04:36:39.776320 | orchestrator | included: horizon for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:36:39.776326 | orchestrator | 2026-04-24 04:36:39.776332 | orchestrator | TASK [haproxy-config : Copying over horizon haproxy config] ******************** 2026-04-24 04:36:39.776338 | orchestrator | Friday 24 April 2026 04:36:36 +0000 (0:00:01.161) 0:02:18.845 ********** 2026-04-24 04:36:39.776358 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 04:36:40.518726 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 04:36:40.518868 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 04:36:40.518886 | orchestrator | 2026-04-24 04:36:40.518898 | orchestrator | TASK [haproxy-config : Add configuration for horizon when using single external frontend] *** 2026-04-24 04:36:40.518909 | orchestrator | Friday 24 April 2026 04:36:40 +0000 (0:00:03.780) 0:02:22.626 ********** 2026-04-24 04:36:40.518928 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 04:36:40.518947 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:40.518969 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 04:36:46.407514 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:46.407698 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 04:36:46.407718 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:46.407739 | orchestrator | 2026-04-24 04:36:46.407749 | orchestrator | TASK [haproxy-config : Configuring firewall for horizon] *********************** 2026-04-24 04:36:46.407760 | orchestrator | Friday 24 April 2026 04:36:40 +0000 (0:00:00.982) 0:02:23.608 ********** 2026-04-24 04:36:46.407770 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-24 04:36:46.407781 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 04:36:46.407792 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-24 04:36:46.407818 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 04:36:46.407843 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-24 04:36:46.407852 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-24 04:36:46.407862 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:46.407870 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 04:36:46.407878 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-24 04:36:46.407891 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 04:36:46.407899 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-24 04:36:46.407907 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:46.407916 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-24 04:36:46.407924 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 04:36:46.407932 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-24 04:36:46.407940 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-24 04:36:46.407948 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-24 04:36:46.407961 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:46.407970 | orchestrator | 2026-04-24 04:36:46.407978 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL users config] ************ 2026-04-24 04:36:46.407986 | orchestrator | Friday 24 April 2026 04:36:42 +0000 (0:00:01.357) 0:02:24.966 ********** 2026-04-24 04:36:46.407994 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:46.408003 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:46.408011 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:46.408018 | orchestrator | 2026-04-24 04:36:46.408026 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL rules config] ************ 2026-04-24 04:36:46.408036 | orchestrator | Friday 24 April 2026 04:36:43 +0000 (0:00:01.175) 0:02:26.142 ********** 2026-04-24 04:36:46.408046 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:36:46.408055 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:36:46.408064 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:36:46.408073 | orchestrator | 2026-04-24 04:36:46.408082 | orchestrator | TASK [include_role : influxdb] ************************************************* 2026-04-24 04:36:46.408091 | orchestrator | Friday 24 April 2026 04:36:45 +0000 (0:00:02.195) 0:02:28.338 ********** 2026-04-24 04:36:46.408100 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:46.408109 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:46.408118 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:46.408127 | orchestrator | 2026-04-24 04:36:46.408136 | orchestrator | TASK [include_role : ironic] *************************************************** 2026-04-24 04:36:46.408145 | orchestrator | Friday 24 April 2026 04:36:46 +0000 (0:00:00.569) 0:02:28.908 ********** 2026-04-24 04:36:46.408159 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:51.711575 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:51.711774 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:51.711794 | orchestrator | 2026-04-24 04:36:51.711808 | orchestrator | TASK [include_role : keystone] ************************************************* 2026-04-24 04:36:51.711821 | orchestrator | Friday 24 April 2026 04:36:46 +0000 (0:00:00.322) 0:02:29.230 ********** 2026-04-24 04:36:51.711833 | orchestrator | included: keystone for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:36:51.711843 | orchestrator | 2026-04-24 04:36:51.711854 | orchestrator | TASK [haproxy-config : Copying over keystone haproxy config] ******************* 2026-04-24 04:36:51.711865 | orchestrator | Friday 24 April 2026 04:36:47 +0000 (0:00:00.995) 0:02:30.226 ********** 2026-04-24 04:36:51.711903 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 04:36:51.711930 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 04:36:51.711981 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 04:36:51.711997 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 04:36:51.712031 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 04:36:51.712044 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 04:36:51.712064 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 04:36:51.712085 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 04:36:51.712100 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 04:36:51.712113 | orchestrator | 2026-04-24 04:36:51.712145 | orchestrator | TASK [haproxy-config : Add configuration for keystone when using single external frontend] *** 2026-04-24 04:36:51.712163 | orchestrator | Friday 24 April 2026 04:36:51 +0000 (0:00:03.807) 0:02:34.033 ********** 2026-04-24 04:36:51.712186 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 04:36:53.180825 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 04:36:53.180936 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 04:36:53.180976 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:53.180994 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 04:36:53.181008 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 04:36:53.181020 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 04:36:53.181031 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:53.181069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 04:36:53.181082 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 04:36:53.181102 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 04:36:53.181113 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:53.181124 | orchestrator | 2026-04-24 04:36:53.181136 | orchestrator | TASK [haproxy-config : Configuring firewall for keystone] ********************** 2026-04-24 04:36:53.181149 | orchestrator | Friday 24 April 2026 04:36:52 +0000 (0:00:00.631) 0:02:34.665 ********** 2026-04-24 04:36:53.181161 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-24 04:36:53.181175 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-24 04:36:53.181215 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:36:53.181228 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-24 04:36:53.181239 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-24 04:36:53.181250 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:36:53.181261 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-24 04:36:53.181273 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-24 04:36:53.181284 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:36:53.181295 | orchestrator | 2026-04-24 04:36:53.181306 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL users config] *********** 2026-04-24 04:36:53.181327 | orchestrator | Friday 24 April 2026 04:36:53 +0000 (0:00:01.124) 0:02:35.790 ********** 2026-04-24 04:37:02.287903 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:37:02.288012 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:37:02.288038 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:37:02.288055 | orchestrator | 2026-04-24 04:37:02.288099 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL rules config] *********** 2026-04-24 04:37:02.288115 | orchestrator | Friday 24 April 2026 04:36:54 +0000 (0:00:01.268) 0:02:37.058 ********** 2026-04-24 04:37:02.288127 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:37:02.288139 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:37:02.288151 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:37:02.288164 | orchestrator | 2026-04-24 04:37:02.288192 | orchestrator | TASK [include_role : letsencrypt] ********************************************** 2026-04-24 04:37:02.288206 | orchestrator | Friday 24 April 2026 04:36:56 +0000 (0:00:02.136) 0:02:39.194 ********** 2026-04-24 04:37:02.288221 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:02.288236 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:02.288250 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:02.288264 | orchestrator | 2026-04-24 04:37:02.288279 | orchestrator | TASK [include_role : magnum] *************************************************** 2026-04-24 04:37:02.288292 | orchestrator | Friday 24 April 2026 04:36:56 +0000 (0:00:00.341) 0:02:39.536 ********** 2026-04-24 04:37:02.288308 | orchestrator | included: magnum for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:37:02.288321 | orchestrator | 2026-04-24 04:37:02.288337 | orchestrator | TASK [haproxy-config : Copying over magnum haproxy config] ********************* 2026-04-24 04:37:02.288347 | orchestrator | Friday 24 April 2026 04:36:58 +0000 (0:00:01.287) 0:02:40.823 ********** 2026-04-24 04:37:02.288362 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:02.288377 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:37:02.288388 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:02.288431 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:37:02.288442 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:02.288454 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:37:02.288464 | orchestrator | 2026-04-24 04:37:02.288475 | orchestrator | TASK [haproxy-config : Add configuration for magnum when using single external frontend] *** 2026-04-24 04:37:02.288486 | orchestrator | Friday 24 April 2026 04:37:01 +0000 (0:00:03.686) 0:02:44.509 ********** 2026-04-24 04:37:02.288496 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:02.288520 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:37:12.328768 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:12.328879 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:12.328898 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:37:12.328909 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:12.328919 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:12.328929 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:37:12.328956 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:12.328966 | orchestrator | 2026-04-24 04:37:12.328975 | orchestrator | TASK [haproxy-config : Configuring firewall for magnum] ************************ 2026-04-24 04:37:12.328985 | orchestrator | Friday 24 April 2026 04:37:02 +0000 (0:00:00.705) 0:02:45.215 ********** 2026-04-24 04:37:12.329009 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:12.329026 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:12.329037 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:12.329046 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:12.329056 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:12.329065 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:12.329074 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:12.329083 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:12.329091 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:12.329100 | orchestrator | 2026-04-24 04:37:12.329109 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL users config] ************* 2026-04-24 04:37:12.329118 | orchestrator | Friday 24 April 2026 04:37:04 +0000 (0:00:01.555) 0:02:46.770 ********** 2026-04-24 04:37:12.329126 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:37:12.329151 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:37:12.329170 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:37:12.329178 | orchestrator | 2026-04-24 04:37:12.329187 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL rules config] ************* 2026-04-24 04:37:12.329196 | orchestrator | Friday 24 April 2026 04:37:05 +0000 (0:00:01.194) 0:02:47.965 ********** 2026-04-24 04:37:12.329204 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:37:12.329213 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:37:12.329222 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:37:12.329230 | orchestrator | 2026-04-24 04:37:12.329239 | orchestrator | TASK [include_role : manila] *************************************************** 2026-04-24 04:37:12.329247 | orchestrator | Friday 24 April 2026 04:37:07 +0000 (0:00:02.146) 0:02:50.112 ********** 2026-04-24 04:37:12.329258 | orchestrator | included: manila for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:37:12.329274 | orchestrator | 2026-04-24 04:37:12.329285 | orchestrator | TASK [haproxy-config : Copying over manila haproxy config] ********************* 2026-04-24 04:37:12.329295 | orchestrator | Friday 24 April 2026 04:37:08 +0000 (0:00:01.363) 0:02:51.475 ********** 2026-04-24 04:37:12.329307 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:12.329319 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:37:12.329342 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 04:37:13.049254 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 04:37:13.049370 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:13.049423 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:37:13.049443 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 04:37:13.049478 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:13.049522 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 04:37:13.049541 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:37:13.049558 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 04:37:13.049586 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 04:37:13.049722 | orchestrator | 2026-04-24 04:37:13.049744 | orchestrator | TASK [haproxy-config : Add configuration for manila when using single external frontend] *** 2026-04-24 04:37:13.049763 | orchestrator | Friday 24 April 2026 04:37:12 +0000 (0:00:03.831) 0:02:55.307 ********** 2026-04-24 04:37:13.049785 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:13.049818 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174088 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174283 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174332 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:14.174349 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:14.174362 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174375 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174413 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174426 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:14.174437 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:14.174456 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174468 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174479 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 04:37:14.174490 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:14.174502 | orchestrator | 2026-04-24 04:37:14.174513 | orchestrator | TASK [haproxy-config : Configuring firewall for manila] ************************ 2026-04-24 04:37:14.174526 | orchestrator | Friday 24 April 2026 04:37:13 +0000 (0:00:00.694) 0:02:56.001 ********** 2026-04-24 04:37:14.174539 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:14.174560 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:14.174574 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:14.174587 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:14.174642 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:25.371252 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:25.371373 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:25.371415 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:37:25.371430 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:25.371442 | orchestrator | 2026-04-24 04:37:25.371455 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL users config] ************* 2026-04-24 04:37:25.371485 | orchestrator | Friday 24 April 2026 04:37:14 +0000 (0:00:01.308) 0:02:57.310 ********** 2026-04-24 04:37:25.371496 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:37:25.371508 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:37:25.371518 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:37:25.371529 | orchestrator | 2026-04-24 04:37:25.371540 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL rules config] ************* 2026-04-24 04:37:25.371551 | orchestrator | Friday 24 April 2026 04:37:15 +0000 (0:00:01.218) 0:02:58.529 ********** 2026-04-24 04:37:25.371562 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:37:25.371573 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:37:25.371583 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:37:25.371594 | orchestrator | 2026-04-24 04:37:25.371645 | orchestrator | TASK [include_role : mariadb] ************************************************** 2026-04-24 04:37:25.371656 | orchestrator | Friday 24 April 2026 04:37:18 +0000 (0:00:02.141) 0:03:00.671 ********** 2026-04-24 04:37:25.371667 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:37:25.371677 | orchestrator | 2026-04-24 04:37:25.371688 | orchestrator | TASK [mariadb : Ensure mysql monitor user exist] ******************************* 2026-04-24 04:37:25.371699 | orchestrator | Friday 24 April 2026 04:37:19 +0000 (0:00:01.700) 0:03:02.372 ********** 2026-04-24 04:37:25.371711 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 04:37:25.371721 | orchestrator | 2026-04-24 04:37:25.371732 | orchestrator | TASK [haproxy-config : Copying over mariadb haproxy config] ******************** 2026-04-24 04:37:25.371743 | orchestrator | Friday 24 April 2026 04:37:22 +0000 (0:00:03.167) 0:03:05.539 ********** 2026-04-24 04:37:25.371774 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:37:25.371824 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:37:25.371841 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 04:37:25.371855 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:25.371868 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 04:37:25.371881 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:25.371909 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:37:28.187151 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 04:37:28.187255 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:28.187271 | orchestrator | 2026-04-24 04:37:28.187284 | orchestrator | TASK [haproxy-config : Add configuration for mariadb when using single external frontend] *** 2026-04-24 04:37:28.187296 | orchestrator | Friday 24 April 2026 04:37:25 +0000 (0:00:02.534) 0:03:08.074 ********** 2026-04-24 04:37:28.187311 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:37:28.187345 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 04:37:28.187379 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:28.187412 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:37:28.187426 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 04:37:28.187437 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:28.187454 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:37:28.187480 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-24 04:37:38.973341 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:38.973441 | orchestrator | 2026-04-24 04:37:38.973453 | orchestrator | TASK [haproxy-config : Configuring firewall for mariadb] *********************** 2026-04-24 04:37:38.973463 | orchestrator | Friday 24 April 2026 04:37:28 +0000 (0:00:03.113) 0:03:11.187 ********** 2026-04-24 04:37:38.973474 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 04:37:38.973486 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 04:37:38.973495 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:38.973505 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 04:37:38.973514 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 04:37:38.973541 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:38.973562 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 04:37:38.973572 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-24 04:37:38.973579 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:38.973587 | orchestrator | 2026-04-24 04:37:38.973669 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL users config] ************ 2026-04-24 04:37:38.973684 | orchestrator | Friday 24 April 2026 04:37:31 +0000 (0:00:02.921) 0:03:14.109 ********** 2026-04-24 04:37:38.973692 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:37:38.973716 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:37:38.973724 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:37:38.973732 | orchestrator | 2026-04-24 04:37:38.973740 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL rules config] ************ 2026-04-24 04:37:38.973748 | orchestrator | Friday 24 April 2026 04:37:33 +0000 (0:00:02.025) 0:03:16.135 ********** 2026-04-24 04:37:38.973756 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:38.973764 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:38.973771 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:38.973779 | orchestrator | 2026-04-24 04:37:38.973787 | orchestrator | TASK [include_role : masakari] ************************************************* 2026-04-24 04:37:38.973795 | orchestrator | Friday 24 April 2026 04:37:35 +0000 (0:00:01.661) 0:03:17.797 ********** 2026-04-24 04:37:38.973802 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:38.973810 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:38.973818 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:38.973826 | orchestrator | 2026-04-24 04:37:38.973833 | orchestrator | TASK [include_role : memcached] ************************************************ 2026-04-24 04:37:38.973841 | orchestrator | Friday 24 April 2026 04:37:35 +0000 (0:00:00.609) 0:03:18.407 ********** 2026-04-24 04:37:38.973849 | orchestrator | included: memcached for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:37:38.973856 | orchestrator | 2026-04-24 04:37:38.973864 | orchestrator | TASK [haproxy-config : Copying over memcached haproxy config] ****************** 2026-04-24 04:37:38.973872 | orchestrator | Friday 24 April 2026 04:37:36 +0000 (0:00:01.180) 0:03:19.587 ********** 2026-04-24 04:37:38.973890 | orchestrator | ok: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 04:37:38.973910 | orchestrator | ok: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 04:37:38.973925 | orchestrator | ok: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 04:37:38.973934 | orchestrator | 2026-04-24 04:37:38.973943 | orchestrator | TASK [haproxy-config : Add configuration for memcached when using single external frontend] *** 2026-04-24 04:37:38.973953 | orchestrator | Friday 24 April 2026 04:37:38 +0000 (0:00:01.869) 0:03:21.456 ********** 2026-04-24 04:37:38.973969 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 04:37:48.104961 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 04:37:48.105075 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:48.105093 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:48.105130 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 04:37:48.105142 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:48.105153 | orchestrator | 2026-04-24 04:37:48.105165 | orchestrator | TASK [haproxy-config : Configuring firewall for memcached] ********************* 2026-04-24 04:37:48.105177 | orchestrator | Friday 24 April 2026 04:37:39 +0000 (0:00:00.428) 0:03:21.885 ********** 2026-04-24 04:37:48.105190 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-24 04:37:48.105202 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:48.105213 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-24 04:37:48.105224 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:48.105235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-24 04:37:48.105246 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:48.105257 | orchestrator | 2026-04-24 04:37:48.105282 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL users config] ********** 2026-04-24 04:37:48.105293 | orchestrator | Friday 24 April 2026 04:37:39 +0000 (0:00:00.645) 0:03:22.530 ********** 2026-04-24 04:37:48.105304 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:48.105315 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:48.105325 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:48.105336 | orchestrator | 2026-04-24 04:37:48.105347 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL rules config] ********** 2026-04-24 04:37:48.105357 | orchestrator | Friday 24 April 2026 04:37:40 +0000 (0:00:00.840) 0:03:23.370 ********** 2026-04-24 04:37:48.105368 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:48.105378 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:48.105389 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:48.105399 | orchestrator | 2026-04-24 04:37:48.105410 | orchestrator | TASK [include_role : mistral] ************************************************** 2026-04-24 04:37:48.105421 | orchestrator | Friday 24 April 2026 04:37:42 +0000 (0:00:01.414) 0:03:24.785 ********** 2026-04-24 04:37:48.105431 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:48.105442 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:48.105452 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:37:48.105463 | orchestrator | 2026-04-24 04:37:48.105473 | orchestrator | TASK [include_role : neutron] ************************************************** 2026-04-24 04:37:48.105486 | orchestrator | Friday 24 April 2026 04:37:42 +0000 (0:00:00.369) 0:03:25.154 ********** 2026-04-24 04:37:48.105499 | orchestrator | included: neutron for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:37:48.105511 | orchestrator | 2026-04-24 04:37:48.105523 | orchestrator | TASK [haproxy-config : Copying over neutron haproxy config] ******************** 2026-04-24 04:37:48.105545 | orchestrator | Friday 24 April 2026 04:37:44 +0000 (0:00:01.470) 0:03:26.624 ********** 2026-04-24 04:37:48.105580 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:48.105632 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.105657 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-24 04:37:48.105687 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-24 04:37:48.105724 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.267152 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:48.267260 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:48.267283 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 04:37:48.267336 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:48.267357 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.267375 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-24 04:37:48.267425 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:48.267437 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.267450 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:48.267467 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 04:37:48.267507 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.267532 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:48.423232 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-24 04:37:48.423362 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-24 04:37:48.423401 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.423438 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:48.423452 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:48.423484 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 04:37:48.423497 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:37:48.423510 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:48.423529 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.423549 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.423568 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-24 04:37:48.546233 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-24 04:37:48.546314 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:48.546337 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-24 04:37:48.546382 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.546398 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:48.546426 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 04:37:48.546438 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:48.546448 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:48.546464 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:48.546482 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 04:37:48.546493 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:48.546510 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:49.700756 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-24 04:37:49.700861 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:49.700876 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:49.700914 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 04:37:49.700928 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:49.700939 | orchestrator | 2026-04-24 04:37:49.700950 | orchestrator | TASK [haproxy-config : Add configuration for neutron when using single external frontend] *** 2026-04-24 04:37:49.700961 | orchestrator | Friday 24 April 2026 04:37:48 +0000 (0:00:04.719) 0:03:31.344 ********** 2026-04-24 04:37:49.700991 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:49.701046 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:49.701071 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-24 04:37:49.701083 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-24 04:37:49.701101 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.101500 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:50.101632 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:50.101697 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 04:37:50.101722 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:50.101748 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.101777 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-24 04:37:50.101817 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:50.101837 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.101882 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 04:37:50.101905 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:50.101924 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:37:50.101946 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:50.101979 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.225987 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-24 04:37:50.226175 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-24 04:37:50.226194 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.226208 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:50.226239 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:37:50.226260 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:50.226277 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.226290 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 04:37:50.226302 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-24 04:37:50.226314 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:50.226334 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-24 04:37:50.338079 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.338180 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.338197 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-24 04:37:50.338210 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:50.338223 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:50.338256 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:37:50.338287 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.338307 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 04:37:50.338321 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 04:37:50.338335 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:50.338348 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-24 04:37:50.338369 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:37:50.338381 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:37:50.338408 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-24 04:38:00.868727 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-24 04:38:00.868844 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-24 04:38:00.868865 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-24 04:38:00.868910 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-24 04:38:00.868924 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:00.868937 | orchestrator | 2026-04-24 04:38:00.868950 | orchestrator | TASK [haproxy-config : Configuring firewall for neutron] *********************** 2026-04-24 04:38:00.868962 | orchestrator | Friday 24 April 2026 04:37:50 +0000 (0:00:01.764) 0:03:33.109 ********** 2026-04-24 04:38:00.868975 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:00.868990 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:00.869003 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:00.869029 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:00.869059 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:00.869071 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:00.869082 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:00.869094 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:00.869105 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:00.869115 | orchestrator | 2026-04-24 04:38:00.869127 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL users config] ************ 2026-04-24 04:38:00.869137 | orchestrator | Friday 24 April 2026 04:37:52 +0000 (0:00:01.908) 0:03:35.017 ********** 2026-04-24 04:38:00.869148 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:00.869159 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:00.869170 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:00.869181 | orchestrator | 2026-04-24 04:38:00.869191 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL rules config] ************ 2026-04-24 04:38:00.869202 | orchestrator | Friday 24 April 2026 04:37:53 +0000 (0:00:01.221) 0:03:36.239 ********** 2026-04-24 04:38:00.869213 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:00.869227 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:00.869239 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:00.869252 | orchestrator | 2026-04-24 04:38:00.869264 | orchestrator | TASK [include_role : placement] ************************************************ 2026-04-24 04:38:00.869277 | orchestrator | Friday 24 April 2026 04:37:55 +0000 (0:00:02.194) 0:03:38.434 ********** 2026-04-24 04:38:00.869299 | orchestrator | included: placement for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:38:00.869313 | orchestrator | 2026-04-24 04:38:00.869325 | orchestrator | TASK [haproxy-config : Copying over placement haproxy config] ****************** 2026-04-24 04:38:00.869338 | orchestrator | Friday 24 April 2026 04:37:57 +0000 (0:00:01.506) 0:03:39.941 ********** 2026-04-24 04:38:00.869353 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 04:38:00.869369 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 04:38:00.869397 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 04:38:11.688958 | orchestrator | 2026-04-24 04:38:11.689822 | orchestrator | TASK [haproxy-config : Add configuration for placement when using single external frontend] *** 2026-04-24 04:38:11.689857 | orchestrator | Friday 24 April 2026 04:38:00 +0000 (0:00:03.646) 0:03:43.587 ********** 2026-04-24 04:38:11.689875 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 04:38:11.689918 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:11.689932 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 04:38:11.689944 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:11.689970 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 04:38:11.689982 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:11.689994 | orchestrator | 2026-04-24 04:38:11.690005 | orchestrator | TASK [haproxy-config : Configuring firewall for placement] ********************* 2026-04-24 04:38:11.690070 | orchestrator | Friday 24 April 2026 04:38:01 +0000 (0:00:00.531) 0:03:44.119 ********** 2026-04-24 04:38:11.690085 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:38:11.690121 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:38:11.690144 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:11.690155 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:38:11.690166 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:38:11.690177 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:11.690188 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:38:11.690199 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:38:11.690210 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:11.690220 | orchestrator | 2026-04-24 04:38:11.690231 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL users config] ********** 2026-04-24 04:38:11.690242 | orchestrator | Friday 24 April 2026 04:38:02 +0000 (0:00:01.193) 0:03:45.312 ********** 2026-04-24 04:38:11.690253 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:11.690264 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:11.690275 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:11.690285 | orchestrator | 2026-04-24 04:38:11.690296 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL rules config] ********** 2026-04-24 04:38:11.690307 | orchestrator | Friday 24 April 2026 04:38:03 +0000 (0:00:01.209) 0:03:46.521 ********** 2026-04-24 04:38:11.690317 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:11.690328 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:11.690339 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:11.690349 | orchestrator | 2026-04-24 04:38:11.690360 | orchestrator | TASK [include_role : nova] ***************************************************** 2026-04-24 04:38:11.690370 | orchestrator | Friday 24 April 2026 04:38:06 +0000 (0:00:02.215) 0:03:48.737 ********** 2026-04-24 04:38:11.690381 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:38:11.690392 | orchestrator | 2026-04-24 04:38:11.690403 | orchestrator | TASK [haproxy-config : Copying over nova haproxy config] *********************** 2026-04-24 04:38:11.690413 | orchestrator | Friday 24 April 2026 04:38:07 +0000 (0:00:01.656) 0:03:50.394 ********** 2026-04-24 04:38:11.690431 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:38:11.690452 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:38:13.847094 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:38:13.847204 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:38:13.847222 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:38:13.847252 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:38:13.847321 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:38:13.847347 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:38:13.847367 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:38:13.847388 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:38:13.847407 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:38:13.847429 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:38:13.847450 | orchestrator | 2026-04-24 04:38:13.847498 | orchestrator | TASK [haproxy-config : Add configuration for nova when using single external frontend] *** 2026-04-24 04:38:13.847525 | orchestrator | Friday 24 April 2026 04:38:13 +0000 (0:00:06.064) 0:03:56.458 ********** 2026-04-24 04:38:14.944304 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:38:14.944412 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:38:14.944430 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:38:14.944482 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:38:14.944497 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:14.944530 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:38:14.944545 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:38:14.944557 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:38:14.944568 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:38:14.944643 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:14.944663 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:38:14.944687 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:38:28.754568 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 04:38:28.754743 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 04:38:28.754762 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:28.754775 | orchestrator | 2026-04-24 04:38:28.754788 | orchestrator | TASK [haproxy-config : Configuring firewall for nova] ************************** 2026-04-24 04:38:28.754825 | orchestrator | Friday 24 April 2026 04:38:15 +0000 (0:00:01.509) 0:03:57.968 ********** 2026-04-24 04:38:28.754837 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754852 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754879 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754892 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754903 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:28.754914 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754926 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754937 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754948 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754958 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:28.754969 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.754997 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.755009 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.755020 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:38:28.755031 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:28.755042 | orchestrator | 2026-04-24 04:38:28.755053 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL users config] *************** 2026-04-24 04:38:28.755064 | orchestrator | Friday 24 April 2026 04:38:16 +0000 (0:00:01.175) 0:03:59.143 ********** 2026-04-24 04:38:28.755082 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:28.755094 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:28.755107 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:28.755119 | orchestrator | 2026-04-24 04:38:28.755131 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL rules config] *************** 2026-04-24 04:38:28.755144 | orchestrator | Friday 24 April 2026 04:38:17 +0000 (0:00:01.236) 0:04:00.380 ********** 2026-04-24 04:38:28.755157 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:28.755170 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:28.755182 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:28.755194 | orchestrator | 2026-04-24 04:38:28.755207 | orchestrator | TASK [include_role : nova-cell] ************************************************ 2026-04-24 04:38:28.755219 | orchestrator | Friday 24 April 2026 04:38:19 +0000 (0:00:02.223) 0:04:02.604 ********** 2026-04-24 04:38:28.755230 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:38:28.755241 | orchestrator | 2026-04-24 04:38:28.755252 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-novncproxy] ****************** 2026-04-24 04:38:28.755262 | orchestrator | Friday 24 April 2026 04:38:21 +0000 (0:00:02.010) 0:04:04.614 ********** 2026-04-24 04:38:28.755274 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-novncproxy) 2026-04-24 04:38:28.755285 | orchestrator | 2026-04-24 04:38:28.755296 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config] *** 2026-04-24 04:38:28.755307 | orchestrator | Friday 24 April 2026 04:38:23 +0000 (0:00:01.565) 0:04:06.179 ********** 2026-04-24 04:38:28.755324 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-24 04:38:28.755338 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-24 04:38:28.755349 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-24 04:38:28.755361 | orchestrator | 2026-04-24 04:38:28.755373 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-novncproxy when using single external frontend] *** 2026-04-24 04:38:28.755385 | orchestrator | Friday 24 April 2026 04:38:27 +0000 (0:00:04.024) 0:04:10.204 ********** 2026-04-24 04:38:28.755397 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:28.755423 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:45.368804 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:45.368921 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:45.368940 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:45.368953 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:45.368964 | orchestrator | 2026-04-24 04:38:45.368976 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-novncproxy] ***** 2026-04-24 04:38:45.368988 | orchestrator | Friday 24 April 2026 04:38:29 +0000 (0:00:01.483) 0:04:11.688 ********** 2026-04-24 04:38:45.369000 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 04:38:45.369014 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 04:38:45.369027 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:45.369040 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 04:38:45.369068 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 04:38:45.369080 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:45.369091 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 04:38:45.369102 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-24 04:38:45.369113 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:45.369124 | orchestrator | 2026-04-24 04:38:45.369135 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-24 04:38:45.369146 | orchestrator | Friday 24 April 2026 04:38:31 +0000 (0:00:02.242) 0:04:13.931 ********** 2026-04-24 04:38:45.369157 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:45.369169 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:45.369180 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:45.369191 | orchestrator | 2026-04-24 04:38:45.369202 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-24 04:38:45.369213 | orchestrator | Friday 24 April 2026 04:38:33 +0000 (0:00:02.464) 0:04:16.396 ********** 2026-04-24 04:38:45.369223 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:45.369255 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:45.369266 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:45.369277 | orchestrator | 2026-04-24 04:38:45.369288 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-spicehtml5proxy] ************* 2026-04-24 04:38:45.369299 | orchestrator | Friday 24 April 2026 04:38:37 +0000 (0:00:03.220) 0:04:19.616 ********** 2026-04-24 04:38:45.369310 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-spicehtml5proxy) 2026-04-24 04:38:45.369323 | orchestrator | 2026-04-24 04:38:45.369334 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-spicehtml5proxy haproxy config] *** 2026-04-24 04:38:45.369345 | orchestrator | Friday 24 April 2026 04:38:37 +0000 (0:00:00.971) 0:04:20.588 ********** 2026-04-24 04:38:45.369374 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:45.369387 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:45.369399 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:45.369410 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:45.369421 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:45.369432 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:45.369443 | orchestrator | 2026-04-24 04:38:45.369454 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-spicehtml5proxy when using single external frontend] *** 2026-04-24 04:38:45.369465 | orchestrator | Friday 24 April 2026 04:38:39 +0000 (0:00:01.511) 0:04:22.100 ********** 2026-04-24 04:38:45.369477 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:45.369488 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:45.369499 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:45.369518 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:45.369547 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-24 04:38:45.369569 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:45.369598 | orchestrator | 2026-04-24 04:38:45.369609 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-spicehtml5proxy] *** 2026-04-24 04:38:45.369620 | orchestrator | Friday 24 April 2026 04:38:40 +0000 (0:00:01.394) 0:04:23.494 ********** 2026-04-24 04:38:45.369631 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:38:45.369642 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:38:45.369653 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:38:45.369664 | orchestrator | 2026-04-24 04:38:45.369674 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-24 04:38:45.369685 | orchestrator | Friday 24 April 2026 04:38:42 +0000 (0:00:01.681) 0:04:25.176 ********** 2026-04-24 04:38:45.369696 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:38:45.369707 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:38:45.369722 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:38:45.369733 | orchestrator | 2026-04-24 04:38:45.369744 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-24 04:38:45.369755 | orchestrator | Friday 24 April 2026 04:38:45 +0000 (0:00:02.798) 0:04:27.974 ********** 2026-04-24 04:39:05.297202 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:39:05.297294 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:39:05.297303 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:39:05.297310 | orchestrator | 2026-04-24 04:39:05.297318 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-serialproxy] ***************** 2026-04-24 04:39:05.297326 | orchestrator | Friday 24 April 2026 04:38:48 +0000 (0:00:03.174) 0:04:31.148 ********** 2026-04-24 04:39:05.297332 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-serialproxy) 2026-04-24 04:39:05.297340 | orchestrator | 2026-04-24 04:39:05.297385 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-serialproxy haproxy config] *** 2026-04-24 04:39:05.297394 | orchestrator | Friday 24 April 2026 04:38:49 +0000 (0:00:00.902) 0:04:32.051 ********** 2026-04-24 04:39:05.297403 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 04:39:05.297413 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:05.297422 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 04:39:05.297428 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:05.297458 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 04:39:05.297466 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:05.297472 | orchestrator | 2026-04-24 04:39:05.297478 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-serialproxy when using single external frontend] *** 2026-04-24 04:39:05.297486 | orchestrator | Friday 24 April 2026 04:38:50 +0000 (0:00:01.416) 0:04:33.468 ********** 2026-04-24 04:39:05.297492 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 04:39:05.297499 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:05.297506 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 04:39:05.297512 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:05.297534 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-24 04:39:05.297541 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:05.297548 | orchestrator | 2026-04-24 04:39:05.297554 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-serialproxy] **** 2026-04-24 04:39:05.297560 | orchestrator | Friday 24 April 2026 04:38:52 +0000 (0:00:01.517) 0:04:34.986 ********** 2026-04-24 04:39:05.297567 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:05.297573 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:05.297619 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:05.297625 | orchestrator | 2026-04-24 04:39:05.297632 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-24 04:39:05.297638 | orchestrator | Friday 24 April 2026 04:38:54 +0000 (0:00:01.652) 0:04:36.638 ********** 2026-04-24 04:39:05.297644 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:39:05.297651 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:39:05.297657 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:39:05.297663 | orchestrator | 2026-04-24 04:39:05.297670 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-24 04:39:05.297676 | orchestrator | Friday 24 April 2026 04:38:56 +0000 (0:00:02.517) 0:04:39.155 ********** 2026-04-24 04:39:05.297682 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:39:05.297688 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:39:05.297694 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:39:05.297706 | orchestrator | 2026-04-24 04:39:05.297712 | orchestrator | TASK [include_role : octavia] ************************************************** 2026-04-24 04:39:05.297718 | orchestrator | Friday 24 April 2026 04:39:00 +0000 (0:00:03.807) 0:04:42.962 ********** 2026-04-24 04:39:05.297724 | orchestrator | included: octavia for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:39:05.297730 | orchestrator | 2026-04-24 04:39:05.297737 | orchestrator | TASK [haproxy-config : Copying over octavia haproxy config] ******************** 2026-04-24 04:39:05.297743 | orchestrator | Friday 24 April 2026 04:39:01 +0000 (0:00:01.386) 0:04:44.349 ********** 2026-04-24 04:39:05.297755 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 04:39:05.297764 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 04:39:05.297774 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 04:39:05.297787 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.303446 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:39:06.303572 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 04:39:06.303673 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 04:39:06.303688 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.303701 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.303713 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:39:06.303742 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 04:39:06.303763 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 04:39:06.303779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.303791 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.303803 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:39:06.303815 | orchestrator | 2026-04-24 04:39:06.303828 | orchestrator | TASK [haproxy-config : Add configuration for octavia when using single external frontend] *** 2026-04-24 04:39:06.303840 | orchestrator | Friday 24 April 2026 04:39:05 +0000 (0:00:03.855) 0:04:48.205 ********** 2026-04-24 04:39:06.303860 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 04:39:06.575489 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 04:39:06.575641 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.575677 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.575691 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:39:06.575703 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:06.575717 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 04:39:06.575732 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 04:39:06.575783 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.575797 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 04:39:06.575814 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:39:06.575825 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:06.575837 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 04:39:06.575850 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 04:39:06.575875 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 04:39:18.823909 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 04:39:18.824013 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 04:39:18.824028 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:18.824040 | orchestrator | 2026-04-24 04:39:18.824050 | orchestrator | TASK [haproxy-config : Configuring firewall for octavia] *********************** 2026-04-24 04:39:18.824075 | orchestrator | Friday 24 April 2026 04:39:06 +0000 (0:00:01.140) 0:04:49.345 ********** 2026-04-24 04:39:18.824086 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 04:39:18.824098 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 04:39:18.824109 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:18.824118 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 04:39:18.824127 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 04:39:18.824135 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:18.824144 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 04:39:18.824153 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-24 04:39:18.824181 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:18.824190 | orchestrator | 2026-04-24 04:39:18.824199 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL users config] ************ 2026-04-24 04:39:18.824208 | orchestrator | Friday 24 April 2026 04:39:07 +0000 (0:00:01.103) 0:04:50.449 ********** 2026-04-24 04:39:18.824217 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:39:18.824226 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:39:18.824235 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:39:18.824244 | orchestrator | 2026-04-24 04:39:18.824252 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL rules config] ************ 2026-04-24 04:39:18.824261 | orchestrator | Friday 24 April 2026 04:39:09 +0000 (0:00:01.522) 0:04:51.971 ********** 2026-04-24 04:39:18.824270 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:39:18.824279 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:39:18.824287 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:39:18.824296 | orchestrator | 2026-04-24 04:39:18.824305 | orchestrator | TASK [include_role : opensearch] *********************************************** 2026-04-24 04:39:18.824313 | orchestrator | Friday 24 April 2026 04:39:11 +0000 (0:00:02.185) 0:04:54.157 ********** 2026-04-24 04:39:18.824323 | orchestrator | included: opensearch for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:39:18.824333 | orchestrator | 2026-04-24 04:39:18.824342 | orchestrator | TASK [haproxy-config : Copying over opensearch haproxy config] ***************** 2026-04-24 04:39:18.824350 | orchestrator | Friday 24 April 2026 04:39:12 +0000 (0:00:01.433) 0:04:55.590 ********** 2026-04-24 04:39:18.824374 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:39:18.824391 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:39:18.824401 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:39:18.824418 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:39:18.824437 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:39:20.492455 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:39:20.492560 | orchestrator | 2026-04-24 04:39:20.492657 | orchestrator | TASK [haproxy-config : Add configuration for opensearch when using single external frontend] *** 2026-04-24 04:39:20.492673 | orchestrator | Friday 24 April 2026 04:39:19 +0000 (0:00:06.342) 0:05:01.932 ********** 2026-04-24 04:39:20.492709 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:39:20.492723 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:39:20.492736 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:20.492769 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:39:20.492789 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:39:20.492809 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:20.492821 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:39:20.492833 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:39:20.492844 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:20.492855 | orchestrator | 2026-04-24 04:39:20.492867 | orchestrator | TASK [haproxy-config : Configuring firewall for opensearch] ******************** 2026-04-24 04:39:20.492879 | orchestrator | Friday 24 April 2026 04:39:20 +0000 (0:00:00.717) 0:05:02.649 ********** 2026-04-24 04:39:20.492891 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:20.492910 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-24 04:39:27.376861 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-24 04:39:27.376959 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:27.376992 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:27.377023 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-24 04:39:27.377035 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-24 04:39:27.377044 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:27.377054 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:27.377063 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-24 04:39:27.377072 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-24 04:39:27.377080 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:27.377089 | orchestrator | 2026-04-24 04:39:27.377099 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL users config] ********* 2026-04-24 04:39:27.377109 | orchestrator | Friday 24 April 2026 04:39:21 +0000 (0:00:01.006) 0:05:03.656 ********** 2026-04-24 04:39:27.377117 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:27.377126 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:27.377135 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:27.377143 | orchestrator | 2026-04-24 04:39:27.377152 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL rules config] ********* 2026-04-24 04:39:27.377161 | orchestrator | Friday 24 April 2026 04:39:21 +0000 (0:00:00.899) 0:05:04.555 ********** 2026-04-24 04:39:27.377169 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:27.377178 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:27.377186 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:27.377195 | orchestrator | 2026-04-24 04:39:27.377203 | orchestrator | TASK [include_role : prometheus] *********************************************** 2026-04-24 04:39:27.377212 | orchestrator | Friday 24 April 2026 04:39:23 +0000 (0:00:01.479) 0:05:06.035 ********** 2026-04-24 04:39:27.377221 | orchestrator | included: prometheus for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:39:27.377230 | orchestrator | 2026-04-24 04:39:27.377239 | orchestrator | TASK [haproxy-config : Copying over prometheus haproxy config] ***************** 2026-04-24 04:39:27.377248 | orchestrator | Friday 24 April 2026 04:39:24 +0000 (0:00:01.443) 0:05:07.478 ********** 2026-04-24 04:39:27.377278 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-24 04:39:27.377303 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 04:39:27.377314 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:27.377325 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:27.377335 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-24 04:39:27.377346 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 04:39:27.377355 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 04:39:27.377378 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:29.388139 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:29.388244 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-24 04:39:29.388264 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 04:39:29.388277 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 04:39:29.388290 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:29.388324 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:29.388362 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 04:39:29.388376 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:39:29.388389 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-24 04:39:29.388402 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:29.388413 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:29.388445 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:39:30.071840 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 04:39:30.071946 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-24 04:39:30.071964 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.071980 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:39:30.072020 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.072067 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-24 04:39:30.072080 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 04:39:30.072092 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.072104 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.072116 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 04:39:30.072136 | orchestrator | 2026-04-24 04:39:30.072150 | orchestrator | TASK [haproxy-config : Add configuration for prometheus when using single external frontend] *** 2026-04-24 04:39:30.072163 | orchestrator | Friday 24 April 2026 04:39:29 +0000 (0:00:04.761) 0:05:12.240 ********** 2026-04-24 04:39:30.072181 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-24 04:39:30.072204 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 04:39:30.218427 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.218516 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.218530 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 04:39:30.218543 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:39:30.218630 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-24 04:39:30.218659 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.218670 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-24 04:39:30.218680 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.218696 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 04:39:30.218705 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 04:39:30.218715 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:30.218725 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.218739 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.218756 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 04:39:30.380146 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:39:30.380266 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-24 04:39:30.380283 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.380297 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.380348 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-24 04:39:30.380362 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 04:39:30.380375 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:30.380388 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 04:39:30.380408 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.380420 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:30.380431 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 04:39:30.380449 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:39:30.380470 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-24 04:39:37.872237 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:37.872345 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:39:37.872363 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 04:39:37.872376 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:37.872389 | orchestrator | 2026-04-24 04:39:37.872401 | orchestrator | TASK [haproxy-config : Configuring firewall for prometheus] ******************** 2026-04-24 04:39:37.872414 | orchestrator | Friday 24 April 2026 04:39:30 +0000 (0:00:00.906) 0:05:13.147 ********** 2026-04-24 04:39:37.872426 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-24 04:39:37.872441 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-24 04:39:37.872455 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:37.872466 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:37.872478 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:37.872489 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-24 04:39:37.872525 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-24 04:39:37.872554 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:37.872566 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:37.872647 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:37.872658 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-24 04:39:37.872718 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-24 04:39:37.872732 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:37.872743 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-24 04:39:37.872754 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:37.872767 | orchestrator | 2026-04-24 04:39:37.872780 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL users config] ********* 2026-04-24 04:39:37.872793 | orchestrator | Friday 24 April 2026 04:39:31 +0000 (0:00:01.420) 0:05:14.567 ********** 2026-04-24 04:39:37.872806 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:37.872823 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:37.872835 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:37.872848 | orchestrator | 2026-04-24 04:39:37.872860 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL rules config] ********* 2026-04-24 04:39:37.872872 | orchestrator | Friday 24 April 2026 04:39:32 +0000 (0:00:00.538) 0:05:15.106 ********** 2026-04-24 04:39:37.872885 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:37.872897 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:37.872910 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:37.872922 | orchestrator | 2026-04-24 04:39:37.872934 | orchestrator | TASK [include_role : rabbitmq] ************************************************* 2026-04-24 04:39:37.872947 | orchestrator | Friday 24 April 2026 04:39:34 +0000 (0:00:01.533) 0:05:16.639 ********** 2026-04-24 04:39:37.872960 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:39:37.872982 | orchestrator | 2026-04-24 04:39:37.872995 | orchestrator | TASK [haproxy-config : Copying over rabbitmq haproxy config] ******************* 2026-04-24 04:39:37.873007 | orchestrator | Friday 24 April 2026 04:39:35 +0000 (0:00:01.860) 0:05:18.499 ********** 2026-04-24 04:39:37.873030 | orchestrator | ok: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:39:47.665286 | orchestrator | ok: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:39:47.665398 | orchestrator | ok: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:39:47.665416 | orchestrator | 2026-04-24 04:39:47.665430 | orchestrator | TASK [haproxy-config : Add configuration for rabbitmq when using single external frontend] *** 2026-04-24 04:39:47.665442 | orchestrator | Friday 24 April 2026 04:39:38 +0000 (0:00:02.734) 0:05:21.233 ********** 2026-04-24 04:39:47.665473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:39:47.665510 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:47.665541 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:39:47.665555 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:47.665637 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:39:47.665655 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:47.665666 | orchestrator | 2026-04-24 04:39:47.665677 | orchestrator | TASK [haproxy-config : Configuring firewall for rabbitmq] ********************** 2026-04-24 04:39:47.665688 | orchestrator | Friday 24 April 2026 04:39:39 +0000 (0:00:00.454) 0:05:21.688 ********** 2026-04-24 04:39:47.665700 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-24 04:39:47.665712 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:47.665723 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-24 04:39:47.665733 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:47.665744 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-24 04:39:47.665785 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:47.665798 | orchestrator | 2026-04-24 04:39:47.665811 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL users config] *********** 2026-04-24 04:39:47.665824 | orchestrator | Friday 24 April 2026 04:39:40 +0000 (0:00:01.085) 0:05:22.774 ********** 2026-04-24 04:39:47.665847 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:47.665859 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:47.665872 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:47.665884 | orchestrator | 2026-04-24 04:39:47.665896 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL rules config] *********** 2026-04-24 04:39:47.665915 | orchestrator | Friday 24 April 2026 04:39:40 +0000 (0:00:00.546) 0:05:23.320 ********** 2026-04-24 04:39:47.665927 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:47.665940 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:39:47.665953 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:39:47.665965 | orchestrator | 2026-04-24 04:39:47.665977 | orchestrator | TASK [include_role : skyline] ************************************************** 2026-04-24 04:39:47.665990 | orchestrator | Friday 24 April 2026 04:39:42 +0000 (0:00:01.462) 0:05:24.782 ********** 2026-04-24 04:39:47.666002 | orchestrator | included: skyline for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:39:47.666014 | orchestrator | 2026-04-24 04:39:47.666090 | orchestrator | TASK [haproxy-config : Copying over skyline haproxy config] ******************** 2026-04-24 04:39:47.666103 | orchestrator | Friday 24 April 2026 04:39:43 +0000 (0:00:01.821) 0:05:26.604 ********** 2026-04-24 04:39:47.666116 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 04:39:47.666144 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 04:39:51.605799 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 04:39:51.605900 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 04:39:51.605908 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 04:39:51.605923 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 04:39:51.605928 | orchestrator | 2026-04-24 04:39:51.605934 | orchestrator | TASK [haproxy-config : Add configuration for skyline when using single external frontend] *** 2026-04-24 04:39:51.605939 | orchestrator | Friday 24 April 2026 04:39:51 +0000 (0:00:07.133) 0:05:33.737 ********** 2026-04-24 04:39:51.605944 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 04:39:51.605955 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 04:39:51.605959 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:39:51.605963 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 04:39:51.605972 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 04:40:02.315664 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:40:02.315795 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 04:40:02.315817 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 04:40:02.315831 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:40:02.315843 | orchestrator | 2026-04-24 04:40:02.315855 | orchestrator | TASK [haproxy-config : Configuring firewall for skyline] *********************** 2026-04-24 04:40:02.315867 | orchestrator | Friday 24 April 2026 04:39:51 +0000 (0:00:00.676) 0:05:34.413 ********** 2026-04-24 04:40:02.315881 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-24 04:40:02.315895 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-24 04:40:02.315908 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:40:02.315921 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:40:02.315932 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:40:02.315943 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-24 04:40:02.315978 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-24 04:40:02.316008 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:40:02.316021 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:40:02.316032 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:40:02.316043 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-24 04:40:02.316060 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-24 04:40:02.316071 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:40:02.316082 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-24 04:40:02.316093 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:40:02.316104 | orchestrator | 2026-04-24 04:40:02.316115 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL users config] ************ 2026-04-24 04:40:02.316127 | orchestrator | Friday 24 April 2026 04:39:53 +0000 (0:00:01.873) 0:05:36.287 ********** 2026-04-24 04:40:02.316138 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:40:02.316151 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:40:02.316164 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:40:02.316176 | orchestrator | 2026-04-24 04:40:02.316189 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL rules config] ************ 2026-04-24 04:40:02.316202 | orchestrator | Friday 24 April 2026 04:39:54 +0000 (0:00:01.202) 0:05:37.490 ********** 2026-04-24 04:40:02.316215 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:40:02.316228 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:40:02.316240 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:40:02.316252 | orchestrator | 2026-04-24 04:40:02.316266 | orchestrator | TASK [include_role : tacker] *************************************************** 2026-04-24 04:40:02.316278 | orchestrator | Friday 24 April 2026 04:39:57 +0000 (0:00:02.229) 0:05:39.719 ********** 2026-04-24 04:40:02.316291 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:40:02.316304 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:40:02.316317 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:40:02.316330 | orchestrator | 2026-04-24 04:40:02.316343 | orchestrator | TASK [include_role : trove] **************************************************** 2026-04-24 04:40:02.316355 | orchestrator | Friday 24 April 2026 04:39:57 +0000 (0:00:00.369) 0:05:40.089 ********** 2026-04-24 04:40:02.316368 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:40:02.316380 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:40:02.316402 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:40:02.316415 | orchestrator | 2026-04-24 04:40:02.316431 | orchestrator | TASK [include_role : venus] **************************************************** 2026-04-24 04:40:02.316449 | orchestrator | Friday 24 April 2026 04:39:58 +0000 (0:00:00.721) 0:05:40.810 ********** 2026-04-24 04:40:02.316469 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:40:02.316486 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:40:02.316504 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:40:02.316523 | orchestrator | 2026-04-24 04:40:02.316540 | orchestrator | TASK [include_role : watcher] ************************************************** 2026-04-24 04:40:02.316558 | orchestrator | Friday 24 April 2026 04:39:58 +0000 (0:00:00.353) 0:05:41.164 ********** 2026-04-24 04:40:02.316608 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:40:02.316628 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:40:02.316645 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:40:02.316663 | orchestrator | 2026-04-24 04:40:02.316681 | orchestrator | TASK [include_role : zun] ****************************************************** 2026-04-24 04:40:02.316699 | orchestrator | Friday 24 April 2026 04:39:58 +0000 (0:00:00.363) 0:05:41.528 ********** 2026-04-24 04:40:02.316718 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:40:02.316730 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:40:02.316740 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:40:02.316751 | orchestrator | 2026-04-24 04:40:02.316762 | orchestrator | TASK [include_role : loadbalancer] ********************************************* 2026-04-24 04:40:02.316772 | orchestrator | Friday 24 April 2026 04:39:59 +0000 (0:00:00.339) 0:05:41.868 ********** 2026-04-24 04:40:02.316830 | orchestrator | included: loadbalancer for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:40:02.316843 | orchestrator | 2026-04-24 04:40:02.316854 | orchestrator | TASK [service-check-containers : loadbalancer | Check containers] ************** 2026-04-24 04:40:02.316865 | orchestrator | Friday 24 April 2026 04:40:01 +0000 (0:00:01.945) 0:05:43.813 ********** 2026-04-24 04:40:02.316889 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-24 04:40:05.773796 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-24 04:40:05.773907 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-24 04:40:05.773946 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:40:05.773959 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:40:05.773971 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-24 04:40:05.773983 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:40:05.774075 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:40:05.774098 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-24 04:40:05.774110 | orchestrator | 2026-04-24 04:40:05.774123 | orchestrator | TASK [service-check-containers : loadbalancer | Notify handlers to restart containers] *** 2026-04-24 04:40:05.774135 | orchestrator | Friday 24 April 2026 04:40:04 +0000 (0:00:03.320) 0:05:47.133 ********** 2026-04-24 04:40:05.774147 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:40:05.774160 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:40:05.774179 | orchestrator | } 2026-04-24 04:40:05.774190 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:40:05.774200 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:40:05.774211 | orchestrator | } 2026-04-24 04:40:05.774222 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:40:05.774232 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:40:05.774244 | orchestrator | } 2026-04-24 04:40:05.774255 | orchestrator | 2026-04-24 04:40:05.774266 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:40:05.774277 | orchestrator | Friday 24 April 2026 04:40:05 +0000 (0:00:00.777) 0:05:47.911 ********** 2026-04-24 04:40:05.774292 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-24 04:40:05.774306 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:40:05.774320 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:40:05.774334 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:40:05.774347 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-24 04:40:05.774374 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:41:49.083739 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:41:49.083889 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:41:49.083910 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-24 04:41:49.083924 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-24 04:41:49.083936 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-24 04:41:49.083948 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:41:49.083960 | orchestrator | 2026-04-24 04:41:49.083972 | orchestrator | RUNNING HANDLER [loadbalancer : Check IP addresses on the API interface] ******* 2026-04-24 04:41:49.083985 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 04:41:49.083997 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 04:41:49.084018 | orchestrator | Friday 24 April 2026 04:40:06 +0000 (0:00:01.611) 0:05:49.522 ********** 2026-04-24 04:41:49.084029 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:41:49.084041 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:41:49.084051 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:41:49.084062 | orchestrator | 2026-04-24 04:41:49.084073 | orchestrator | RUNNING HANDLER [loadbalancer : Group HA nodes by status] ********************** 2026-04-24 04:41:49.084084 | orchestrator | Friday 24 April 2026 04:40:07 +0000 (0:00:00.684) 0:05:50.207 ********** 2026-04-24 04:41:49.084095 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:41:49.084106 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:41:49.084116 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:41:49.084127 | orchestrator | 2026-04-24 04:41:49.084139 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup keepalived container] ************** 2026-04-24 04:41:49.084150 | orchestrator | Friday 24 April 2026 04:40:07 +0000 (0:00:00.339) 0:05:50.547 ********** 2026-04-24 04:41:49.084161 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:41:49.084181 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:41:49.084193 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:41:49.084203 | orchestrator | 2026-04-24 04:41:49.084214 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup haproxy container] ***************** 2026-04-24 04:41:49.084225 | orchestrator | Friday 24 April 2026 04:40:14 +0000 (0:00:06.304) 0:05:56.851 ********** 2026-04-24 04:41:49.084236 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:41:49.084247 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:41:49.084258 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:41:49.084271 | orchestrator | 2026-04-24 04:41:49.084284 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup proxysql container] **************** 2026-04-24 04:41:49.084297 | orchestrator | Friday 24 April 2026 04:40:20 +0000 (0:00:06.079) 0:06:02.931 ********** 2026-04-24 04:41:49.084310 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:41:49.084324 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:41:49.084336 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:41:49.084349 | orchestrator | 2026-04-24 04:41:49.084395 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup haproxy container] **************** 2026-04-24 04:41:49.084409 | orchestrator | Friday 24 April 2026 04:40:26 +0000 (0:00:06.070) 0:06:09.002 ********** 2026-04-24 04:41:49.084422 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:41:49.084435 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:41:49.084448 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:41:49.084461 | orchestrator | 2026-04-24 04:41:49.084474 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup haproxy to start] ************** 2026-04-24 04:41:49.084487 | orchestrator | Friday 24 April 2026 04:40:32 +0000 (0:00:06.545) 0:06:15.547 ********** 2026-04-24 04:41:49.084499 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:41:49.084512 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:41:49.084524 | orchestrator | 2026-04-24 04:41:49.084537 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup proxysql container] *************** 2026-04-24 04:41:49.084576 | orchestrator | Friday 24 April 2026 04:40:36 +0000 (0:00:03.234) 0:06:18.782 ********** 2026-04-24 04:41:49.084588 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:41:49.084601 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:41:49.084612 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:41:49.084623 | orchestrator | 2026-04-24 04:41:49.084634 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup proxysql to start] ************* 2026-04-24 04:41:49.084645 | orchestrator | Friday 24 April 2026 04:40:48 +0000 (0:00:12.184) 0:06:30.966 ********** 2026-04-24 04:41:49.084656 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:41:49.084666 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:41:49.084677 | orchestrator | 2026-04-24 04:41:49.084688 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup keepalived container] ************* 2026-04-24 04:41:49.084699 | orchestrator | Friday 24 April 2026 04:40:52 +0000 (0:00:03.693) 0:06:34.660 ********** 2026-04-24 04:41:49.084710 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:41:49.084721 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:41:49.084732 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:41:49.084742 | orchestrator | 2026-04-24 04:41:49.084753 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master haproxy container] ***************** 2026-04-24 04:41:49.084764 | orchestrator | Friday 24 April 2026 04:40:57 +0000 (0:00:05.813) 0:06:40.473 ********** 2026-04-24 04:41:49.084775 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:41:49.084786 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:41:49.084796 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:41:49.084807 | orchestrator | 2026-04-24 04:41:49.084818 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master proxysql container] **************** 2026-04-24 04:41:49.084829 | orchestrator | Friday 24 April 2026 04:41:03 +0000 (0:00:05.838) 0:06:46.312 ********** 2026-04-24 04:41:49.084840 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:41:49.084851 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:41:49.084862 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:41:49.084873 | orchestrator | 2026-04-24 04:41:49.084884 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master keepalived container] ************** 2026-04-24 04:41:49.084902 | orchestrator | Friday 24 April 2026 04:41:09 +0000 (0:00:05.826) 0:06:52.138 ********** 2026-04-24 04:41:49.084913 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:41:49.084924 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:41:49.084934 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:41:49.084945 | orchestrator | 2026-04-24 04:41:49.084956 | orchestrator | RUNNING HANDLER [loadbalancer : Start master haproxy container] **************** 2026-04-24 04:41:49.084967 | orchestrator | Friday 24 April 2026 04:41:15 +0000 (0:00:05.822) 0:06:57.961 ********** 2026-04-24 04:41:49.084978 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:41:49.084988 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:41:49.084999 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:41:49.085010 | orchestrator | 2026-04-24 04:41:49.085021 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for master haproxy to start] ************** 2026-04-24 04:41:49.085032 | orchestrator | Friday 24 April 2026 04:41:21 +0000 (0:00:06.224) 0:07:04.186 ********** 2026-04-24 04:41:49.085043 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:41:49.085054 | orchestrator | 2026-04-24 04:41:49.085065 | orchestrator | RUNNING HANDLER [loadbalancer : Start master proxysql container] *************** 2026-04-24 04:41:49.085076 | orchestrator | Friday 24 April 2026 04:41:24 +0000 (0:00:03.368) 0:07:07.555 ********** 2026-04-24 04:41:49.085086 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:41:49.085097 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:41:49.085108 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:41:49.085119 | orchestrator | 2026-04-24 04:41:49.085130 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for master proxysql to start] ************* 2026-04-24 04:41:49.085140 | orchestrator | Friday 24 April 2026 04:41:36 +0000 (0:00:11.392) 0:07:18.947 ********** 2026-04-24 04:41:49.085151 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:41:49.085162 | orchestrator | 2026-04-24 04:41:49.085173 | orchestrator | RUNNING HANDLER [loadbalancer : Start master keepalived container] ************* 2026-04-24 04:41:49.085184 | orchestrator | Friday 24 April 2026 04:41:40 +0000 (0:00:04.592) 0:07:23.540 ********** 2026-04-24 04:41:49.085195 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:41:49.085206 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:41:49.085217 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:41:49.085228 | orchestrator | 2026-04-24 04:41:49.085238 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for haproxy to listen on VIP] ************* 2026-04-24 04:41:49.085249 | orchestrator | Friday 24 April 2026 04:41:46 +0000 (0:00:05.895) 0:07:29.436 ********** 2026-04-24 04:41:49.085260 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:41:49.085271 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:41:49.085282 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:41:49.085293 | orchestrator | 2026-04-24 04:41:49.085304 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for proxysql to listen on VIP] ************ 2026-04-24 04:41:49.085314 | orchestrator | Friday 24 April 2026 04:41:47 +0000 (0:00:00.981) 0:07:30.417 ********** 2026-04-24 04:41:49.085325 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:41:49.085341 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:41:49.085360 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:41:49.085378 | orchestrator | 2026-04-24 04:41:49.085397 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:41:49.085418 | orchestrator | testbed-node-0 : ok=129  changed=30  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-24 04:41:49.085453 | orchestrator | testbed-node-1 : ok=128  changed=29  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-24 04:41:50.661521 | orchestrator | testbed-node-2 : ok=128  changed=29  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-24 04:41:50.661668 | orchestrator | 2026-04-24 04:41:50.661690 | orchestrator | 2026-04-24 04:41:50.661705 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:41:50.661759 | orchestrator | Friday 24 April 2026 04:41:49 +0000 (0:00:02.003) 0:07:32.421 ********** 2026-04-24 04:41:50.661778 | orchestrator | =============================================================================== 2026-04-24 04:41:50.661794 | orchestrator | loadbalancer : Start backup proxysql container ------------------------- 12.18s 2026-04-24 04:41:50.661809 | orchestrator | loadbalancer : Start master proxysql container ------------------------- 11.39s 2026-04-24 04:41:50.661824 | orchestrator | haproxy-config : Copying over skyline haproxy config -------------------- 7.13s 2026-04-24 04:41:50.661840 | orchestrator | loadbalancer : Start backup haproxy container --------------------------- 6.55s 2026-04-24 04:41:50.661856 | orchestrator | haproxy-config : Copying over opensearch haproxy config ----------------- 6.34s 2026-04-24 04:41:50.661872 | orchestrator | loadbalancer : Stop backup keepalived container ------------------------- 6.31s 2026-04-24 04:41:50.661889 | orchestrator | loadbalancer : Start master haproxy container --------------------------- 6.22s 2026-04-24 04:41:50.661904 | orchestrator | loadbalancer : Stop backup haproxy container ---------------------------- 6.08s 2026-04-24 04:41:50.661920 | orchestrator | loadbalancer : Stop backup proxysql container --------------------------- 6.07s 2026-04-24 04:41:50.661933 | orchestrator | haproxy-config : Copying over nova haproxy config ----------------------- 6.06s 2026-04-24 04:41:50.661943 | orchestrator | loadbalancer : Start master keepalived container ------------------------ 5.90s 2026-04-24 04:41:50.661953 | orchestrator | loadbalancer : Stop master haproxy container ---------------------------- 5.84s 2026-04-24 04:41:50.661962 | orchestrator | loadbalancer : Stop master proxysql container --------------------------- 5.83s 2026-04-24 04:41:50.661972 | orchestrator | loadbalancer : Stop master keepalived container ------------------------- 5.82s 2026-04-24 04:41:50.661982 | orchestrator | loadbalancer : Start backup keepalived container ------------------------ 5.81s 2026-04-24 04:41:50.661991 | orchestrator | haproxy-config : Copying over prometheus haproxy config ----------------- 4.76s 2026-04-24 04:41:50.662000 | orchestrator | haproxy-config : Copying over neutron haproxy config -------------------- 4.72s 2026-04-24 04:41:50.662010 | orchestrator | haproxy-config : Copying over glance haproxy config --------------------- 4.60s 2026-04-24 04:41:50.662084 | orchestrator | loadbalancer : Wait for master proxysql to start ------------------------ 4.59s 2026-04-24 04:41:50.662098 | orchestrator | haproxy-config : Copying over barbican haproxy config ------------------- 4.36s 2026-04-24 04:41:50.846884 | orchestrator | + osism apply -a upgrade opensearch 2026-04-24 04:41:52.136082 | orchestrator | 2026-04-24 04:41:52 | INFO  | Prepare task for execution of opensearch. 2026-04-24 04:41:52.210102 | orchestrator | 2026-04-24 04:41:52 | INFO  | Task 3d0a24dc-fff8-4674-8b5e-42e790236fd5 (opensearch) was prepared for execution. 2026-04-24 04:41:52.210208 | orchestrator | 2026-04-24 04:41:52 | INFO  | It takes a moment until task 3d0a24dc-fff8-4674-8b5e-42e790236fd5 (opensearch) has been started and output is visible here. 2026-04-24 04:42:10.295169 | orchestrator | 2026-04-24 04:42:10.295305 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:42:10.295322 | orchestrator | 2026-04-24 04:42:10.295334 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:42:10.295345 | orchestrator | Friday 24 April 2026 04:41:57 +0000 (0:00:01.760) 0:00:01.760 ********** 2026-04-24 04:42:10.295356 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:42:10.295368 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:42:10.295378 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:42:10.295389 | orchestrator | 2026-04-24 04:42:10.295400 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:42:10.295411 | orchestrator | Friday 24 April 2026 04:41:58 +0000 (0:00:01.739) 0:00:03.499 ********** 2026-04-24 04:42:10.295423 | orchestrator | ok: [testbed-node-0] => (item=enable_opensearch_True) 2026-04-24 04:42:10.295434 | orchestrator | ok: [testbed-node-1] => (item=enable_opensearch_True) 2026-04-24 04:42:10.295444 | orchestrator | ok: [testbed-node-2] => (item=enable_opensearch_True) 2026-04-24 04:42:10.295481 | orchestrator | 2026-04-24 04:42:10.295493 | orchestrator | PLAY [Apply role opensearch] *************************************************** 2026-04-24 04:42:10.295503 | orchestrator | 2026-04-24 04:42:10.295514 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-24 04:42:10.295525 | orchestrator | Friday 24 April 2026 04:42:00 +0000 (0:00:01.895) 0:00:05.395 ********** 2026-04-24 04:42:10.295536 | orchestrator | included: /ansible/roles/opensearch/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:42:10.295571 | orchestrator | 2026-04-24 04:42:10.295582 | orchestrator | TASK [opensearch : Setting sysctl values] ************************************** 2026-04-24 04:42:10.295593 | orchestrator | Friday 24 April 2026 04:42:04 +0000 (0:00:03.299) 0:00:08.695 ********** 2026-04-24 04:42:10.295603 | orchestrator | ok: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 04:42:10.295614 | orchestrator | ok: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 04:42:10.295625 | orchestrator | ok: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-24 04:42:10.295635 | orchestrator | 2026-04-24 04:42:10.295661 | orchestrator | TASK [opensearch : Ensuring config directories exist] ************************** 2026-04-24 04:42:10.295673 | orchestrator | Friday 24 April 2026 04:42:07 +0000 (0:00:02.908) 0:00:11.603 ********** 2026-04-24 04:42:10.295687 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:10.295703 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:10.295734 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:10.295759 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:10.295782 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:10.295798 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:10.295812 | orchestrator | 2026-04-24 04:42:10.295824 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-24 04:42:10.295837 | orchestrator | Friday 24 April 2026 04:42:09 +0000 (0:00:02.505) 0:00:14.109 ********** 2026-04-24 04:42:10.295849 | orchestrator | included: /ansible/roles/opensearch/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:42:10.295869 | orchestrator | 2026-04-24 04:42:10.295889 | orchestrator | TASK [service-cert-copy : opensearch | Copying over extra CA certificates] ***** 2026-04-24 04:42:16.033344 | orchestrator | Friday 24 April 2026 04:42:11 +0000 (0:00:01.785) 0:00:15.895 ********** 2026-04-24 04:42:16.033452 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:16.033488 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:16.033504 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:16.033536 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:16.033620 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:16.033640 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:16.033653 | orchestrator | 2026-04-24 04:42:16.033665 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS certificate] *** 2026-04-24 04:42:16.033677 | orchestrator | Friday 24 April 2026 04:42:15 +0000 (0:00:04.182) 0:00:20.078 ********** 2026-04-24 04:42:16.033689 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:42:16.033707 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:42:18.360950 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:42:18.361022 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:42:18.361041 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:42:18.361046 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:42:18.361051 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:42:18.361079 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:42:18.361083 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:42:18.361087 | orchestrator | 2026-04-24 04:42:18.361092 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS key] *** 2026-04-24 04:42:18.361097 | orchestrator | Friday 24 April 2026 04:42:17 +0000 (0:00:02.002) 0:00:22.081 ********** 2026-04-24 04:42:18.361104 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:42:18.361108 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:42:18.361112 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:42:18.361116 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:42:18.361129 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:42:21.847984 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:42:21.848097 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:42:21.848116 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:42:21.848150 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:42:21.848162 | orchestrator | 2026-04-24 04:42:21.848174 | orchestrator | TASK [opensearch : Copying over config.json files for services] **************** 2026-04-24 04:42:21.848187 | orchestrator | Friday 24 April 2026 04:42:19 +0000 (0:00:02.014) 0:00:24.096 ********** 2026-04-24 04:42:21.848199 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:21.848228 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:21.848247 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:21.848259 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:21.848280 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:21.848302 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:35.919437 | orchestrator | 2026-04-24 04:42:35.919599 | orchestrator | TASK [opensearch : Copying over opensearch service config file] **************** 2026-04-24 04:42:35.919639 | orchestrator | Friday 24 April 2026 04:42:22 +0000 (0:00:03.418) 0:00:27.515 ********** 2026-04-24 04:42:35.919652 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:42:35.919667 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:42:35.919686 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:42:35.919705 | orchestrator | 2026-04-24 04:42:35.919724 | orchestrator | TASK [opensearch : Copying over opensearch-dashboards config file] ************* 2026-04-24 04:42:35.919742 | orchestrator | Friday 24 April 2026 04:42:27 +0000 (0:00:04.367) 0:00:31.882 ********** 2026-04-24 04:42:35.919761 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:42:35.919778 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:42:35.919796 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:42:35.919815 | orchestrator | 2026-04-24 04:42:35.919834 | orchestrator | TASK [service-check-containers : opensearch | Check containers] **************** 2026-04-24 04:42:35.919853 | orchestrator | Friday 24 April 2026 04:42:30 +0000 (0:00:03.323) 0:00:35.206 ********** 2026-04-24 04:42:35.919876 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:35.919932 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:35.919956 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 04:42:35.920017 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:35.920044 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:35.920070 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-24 04:42:35.920083 | orchestrator | 2026-04-24 04:42:35.920097 | orchestrator | TASK [service-check-containers : opensearch | Notify handlers to restart containers] *** 2026-04-24 04:42:35.920110 | orchestrator | Friday 24 April 2026 04:42:34 +0000 (0:00:03.532) 0:00:38.738 ********** 2026-04-24 04:42:35.920123 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:42:35.920137 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:42:35.920149 | orchestrator | } 2026-04-24 04:42:35.920162 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:42:35.920175 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:42:35.920187 | orchestrator | } 2026-04-24 04:42:35.920199 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:42:35.920212 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:42:35.920224 | orchestrator | } 2026-04-24 04:42:35.920236 | orchestrator | 2026-04-24 04:42:35.920249 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:42:35.920262 | orchestrator | Friday 24 April 2026 04:42:35 +0000 (0:00:01.388) 0:00:40.127 ********** 2026-04-24 04:42:35.920291 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:45:44.473265 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:45:44.473408 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:45:44.473427 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:45:44.473442 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:45:44.473454 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:45:44.473499 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 04:45:44.473525 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-24 04:45:44.473537 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:45:44.473548 | orchestrator | 2026-04-24 04:45:44.473639 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-24 04:45:44.473652 | orchestrator | Friday 24 April 2026 04:42:38 +0000 (0:00:02.454) 0:00:42.581 ********** 2026-04-24 04:45:44.473663 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:45:44.473673 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:45:44.473684 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:45:44.473695 | orchestrator | 2026-04-24 04:45:44.473706 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-24 04:45:44.473717 | orchestrator | Friday 24 April 2026 04:42:39 +0000 (0:00:01.447) 0:00:44.029 ********** 2026-04-24 04:45:44.473727 | orchestrator | 2026-04-24 04:45:44.473738 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-24 04:45:44.473749 | orchestrator | Friday 24 April 2026 04:42:39 +0000 (0:00:00.440) 0:00:44.470 ********** 2026-04-24 04:45:44.473759 | orchestrator | 2026-04-24 04:45:44.473770 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-24 04:45:44.473781 | orchestrator | Friday 24 April 2026 04:42:40 +0000 (0:00:00.467) 0:00:44.937 ********** 2026-04-24 04:45:44.473792 | orchestrator | 2026-04-24 04:45:44.473805 | orchestrator | RUNNING HANDLER [opensearch : Disable shard allocation] ************************ 2026-04-24 04:45:44.473817 | orchestrator | Friday 24 April 2026 04:42:41 +0000 (0:00:00.808) 0:00:45.746 ********** 2026-04-24 04:45:44.473829 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:45:44.473843 | orchestrator | 2026-04-24 04:45:44.473855 | orchestrator | RUNNING HANDLER [opensearch : Perform a flush] ********************************* 2026-04-24 04:45:44.473867 | orchestrator | Friday 24 April 2026 04:42:44 +0000 (0:00:03.492) 0:00:49.239 ********** 2026-04-24 04:45:44.473880 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:45:44.473892 | orchestrator | 2026-04-24 04:45:44.473905 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch container] ******************** 2026-04-24 04:45:44.473917 | orchestrator | Friday 24 April 2026 04:42:51 +0000 (0:00:06.623) 0:00:55.862 ********** 2026-04-24 04:45:44.473929 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:45:44.473941 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:45:44.473954 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:45:44.473966 | orchestrator | 2026-04-24 04:45:44.473978 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch-dashboards container] ********* 2026-04-24 04:45:44.473991 | orchestrator | Friday 24 April 2026 04:44:00 +0000 (0:01:09.454) 0:02:05.317 ********** 2026-04-24 04:45:44.474011 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:45:44.474093 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:45:44.474106 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:45:44.474118 | orchestrator | 2026-04-24 04:45:44.474131 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-24 04:45:44.474144 | orchestrator | Friday 24 April 2026 04:45:32 +0000 (0:01:31.795) 0:03:37.113 ********** 2026-04-24 04:45:44.474156 | orchestrator | included: /ansible/roles/opensearch/tasks/post-config.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:45:44.474167 | orchestrator | 2026-04-24 04:45:44.474177 | orchestrator | TASK [opensearch : Wait for OpenSearch to become ready] ************************ 2026-04-24 04:45:44.474188 | orchestrator | Friday 24 April 2026 04:45:34 +0000 (0:00:01.936) 0:03:39.050 ********** 2026-04-24 04:45:44.474199 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:45:44.474210 | orchestrator | 2026-04-24 04:45:44.474221 | orchestrator | TASK [opensearch : Wait for OpenSearch cluster to become healthy] ************** 2026-04-24 04:45:44.474231 | orchestrator | Friday 24 April 2026 04:45:37 +0000 (0:00:03.358) 0:03:42.408 ********** 2026-04-24 04:45:44.474242 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:45:44.474253 | orchestrator | 2026-04-24 04:45:44.474263 | orchestrator | TASK [opensearch : Check if a log retention policy exists] ********************* 2026-04-24 04:45:44.474274 | orchestrator | Friday 24 April 2026 04:45:41 +0000 (0:00:03.294) 0:03:45.703 ********** 2026-04-24 04:45:44.474285 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:45:44.474296 | orchestrator | 2026-04-24 04:45:44.474307 | orchestrator | TASK [opensearch : Create new log retention policy] **************************** 2026-04-24 04:45:44.474326 | orchestrator | Friday 24 April 2026 04:45:44 +0000 (0:00:03.314) 0:03:49.018 ********** 2026-04-24 04:45:48.013981 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:45:48.014135 | orchestrator | 2026-04-24 04:45:48.014152 | orchestrator | TASK [opensearch : Apply retention policy to existing indices] ***************** 2026-04-24 04:45:48.014166 | orchestrator | Friday 24 April 2026 04:45:45 +0000 (0:00:01.212) 0:03:50.230 ********** 2026-04-24 04:45:48.014177 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:45:48.014189 | orchestrator | 2026-04-24 04:45:48.014200 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:45:48.014212 | orchestrator | testbed-node-0 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:45:48.014225 | orchestrator | testbed-node-1 : ok=15  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 04:45:48.014236 | orchestrator | testbed-node-2 : ok=15  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 04:45:48.014247 | orchestrator | 2026-04-24 04:45:48.014258 | orchestrator | 2026-04-24 04:45:48.014269 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:45:48.014280 | orchestrator | Friday 24 April 2026 04:45:47 +0000 (0:00:01.884) 0:03:52.115 ********** 2026-04-24 04:45:48.014291 | orchestrator | =============================================================================== 2026-04-24 04:45:48.014301 | orchestrator | opensearch : Restart opensearch-dashboards container ------------------- 91.80s 2026-04-24 04:45:48.014312 | orchestrator | opensearch : Restart opensearch container ------------------------------ 69.46s 2026-04-24 04:45:48.014323 | orchestrator | opensearch : Perform a flush -------------------------------------------- 6.62s 2026-04-24 04:45:48.014333 | orchestrator | opensearch : Copying over opensearch service config file ---------------- 4.37s 2026-04-24 04:45:48.014344 | orchestrator | service-cert-copy : opensearch | Copying over extra CA certificates ----- 4.18s 2026-04-24 04:45:48.014355 | orchestrator | service-check-containers : opensearch | Check containers ---------------- 3.53s 2026-04-24 04:45:48.014367 | orchestrator | opensearch : Disable shard allocation ----------------------------------- 3.49s 2026-04-24 04:45:48.014378 | orchestrator | opensearch : Copying over config.json files for services ---------------- 3.42s 2026-04-24 04:45:48.014434 | orchestrator | opensearch : Wait for OpenSearch to become ready ------------------------ 3.36s 2026-04-24 04:45:48.014458 | orchestrator | opensearch : Copying over opensearch-dashboards config file ------------- 3.32s 2026-04-24 04:45:48.014469 | orchestrator | opensearch : Check if a log retention policy exists --------------------- 3.32s 2026-04-24 04:45:48.014480 | orchestrator | opensearch : include_tasks ---------------------------------------------- 3.30s 2026-04-24 04:45:48.014491 | orchestrator | opensearch : Wait for OpenSearch cluster to become healthy -------------- 3.29s 2026-04-24 04:45:48.014502 | orchestrator | opensearch : Setting sysctl values -------------------------------------- 2.91s 2026-04-24 04:45:48.014513 | orchestrator | opensearch : Ensuring config directories exist -------------------------- 2.51s 2026-04-24 04:45:48.014607 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.45s 2026-04-24 04:45:48.014623 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS key --- 2.01s 2026-04-24 04:45:48.014637 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS certificate --- 2.00s 2026-04-24 04:45:48.014650 | orchestrator | opensearch : include_tasks ---------------------------------------------- 1.94s 2026-04-24 04:45:48.014663 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.90s 2026-04-24 04:45:48.297019 | orchestrator | + osism apply -a upgrade memcached 2026-04-24 04:45:49.620895 | orchestrator | 2026-04-24 04:45:49 | INFO  | Prepare task for execution of memcached. 2026-04-24 04:45:49.685658 | orchestrator | 2026-04-24 04:45:49 | INFO  | Task 0c3707d9-dcd0-4192-92f3-efb6185dd400 (memcached) was prepared for execution. 2026-04-24 04:45:49.685742 | orchestrator | 2026-04-24 04:45:49 | INFO  | It takes a moment until task 0c3707d9-dcd0-4192-92f3-efb6185dd400 (memcached) has been started and output is visible here. 2026-04-24 04:46:11.830420 | orchestrator | 2026-04-24 04:46:11.830548 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:46:11.830651 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 04:46:11.830673 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 04:46:11.830709 | orchestrator | 2026-04-24 04:46:11.830729 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:46:11.830747 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 04:46:11.830765 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 04:46:11.830791 | orchestrator | Friday 24 April 2026 04:45:54 +0000 (0:00:01.079) 0:00:01.079 ********** 2026-04-24 04:46:11.830802 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:46:11.830830 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:46:11.830841 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:46:11.830852 | orchestrator | 2026-04-24 04:46:11.830863 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:46:11.830874 | orchestrator | Friday 24 April 2026 04:45:55 +0000 (0:00:00.877) 0:00:01.957 ********** 2026-04-24 04:46:11.830885 | orchestrator | ok: [testbed-node-0] => (item=enable_memcached_True) 2026-04-24 04:46:11.830896 | orchestrator | ok: [testbed-node-1] => (item=enable_memcached_True) 2026-04-24 04:46:11.830907 | orchestrator | ok: [testbed-node-2] => (item=enable_memcached_True) 2026-04-24 04:46:11.830919 | orchestrator | 2026-04-24 04:46:11.830932 | orchestrator | PLAY [Apply role memcached] **************************************************** 2026-04-24 04:46:11.830945 | orchestrator | 2026-04-24 04:46:11.830957 | orchestrator | TASK [memcached : include_tasks] *********************************************** 2026-04-24 04:46:11.830970 | orchestrator | Friday 24 April 2026 04:45:55 +0000 (0:00:00.791) 0:00:02.748 ********** 2026-04-24 04:46:11.830982 | orchestrator | included: /ansible/roles/memcached/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:46:11.831021 | orchestrator | 2026-04-24 04:46:11.831034 | orchestrator | TASK [memcached : Ensuring config directories exist] *************************** 2026-04-24 04:46:11.831046 | orchestrator | Friday 24 April 2026 04:45:57 +0000 (0:00:01.431) 0:00:04.180 ********** 2026-04-24 04:46:11.831059 | orchestrator | ok: [testbed-node-1] => (item=memcached) 2026-04-24 04:46:11.831072 | orchestrator | ok: [testbed-node-0] => (item=memcached) 2026-04-24 04:46:11.831084 | orchestrator | ok: [testbed-node-2] => (item=memcached) 2026-04-24 04:46:11.831095 | orchestrator | 2026-04-24 04:46:11.831106 | orchestrator | TASK [memcached : Copying over config.json files for services] ***************** 2026-04-24 04:46:11.831118 | orchestrator | Friday 24 April 2026 04:45:58 +0000 (0:00:01.281) 0:00:05.462 ********** 2026-04-24 04:46:11.831129 | orchestrator | ok: [testbed-node-1] => (item=memcached) 2026-04-24 04:46:11.831140 | orchestrator | ok: [testbed-node-2] => (item=memcached) 2026-04-24 04:46:11.831151 | orchestrator | ok: [testbed-node-0] => (item=memcached) 2026-04-24 04:46:11.831162 | orchestrator | 2026-04-24 04:46:11.831173 | orchestrator | TASK [service-check-containers : memcached | Check containers] ***************** 2026-04-24 04:46:11.831185 | orchestrator | Friday 24 April 2026 04:46:00 +0000 (0:00:01.699) 0:00:07.161 ********** 2026-04-24 04:46:11.831200 | orchestrator | changed: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 04:46:11.831215 | orchestrator | changed: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 04:46:11.831244 | orchestrator | changed: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-24 04:46:11.831256 | orchestrator | 2026-04-24 04:46:11.831268 | orchestrator | TASK [service-check-containers : memcached | Notify handlers to restart containers] *** 2026-04-24 04:46:11.831279 | orchestrator | Friday 24 April 2026 04:46:01 +0000 (0:00:01.268) 0:00:08.430 ********** 2026-04-24 04:46:11.831295 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:46:11.831311 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:46:11.831321 | orchestrator | } 2026-04-24 04:46:11.831331 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:46:11.831340 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:46:11.831349 | orchestrator | } 2026-04-24 04:46:11.831359 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:46:11.831369 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:46:11.831378 | orchestrator | } 2026-04-24 04:46:11.831388 | orchestrator | 2026-04-24 04:46:11.831397 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:46:11.831407 | orchestrator | Friday 24 April 2026 04:46:01 +0000 (0:00:00.325) 0:00:08.755 ********** 2026-04-24 04:46:11.831417 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 04:46:11.831427 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:46:11.831437 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 04:46:11.831447 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:46:11.831457 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-24 04:46:11.831467 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:46:11.831476 | orchestrator | 2026-04-24 04:46:11.831486 | orchestrator | RUNNING HANDLER [memcached : Restart memcached container] ********************** 2026-04-24 04:46:11.831496 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 04:46:11.831506 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 04:46:11.831525 | orchestrator | Friday 24 April 2026 04:46:02 +0000 (0:00:01.136) 0:00:09.892 ********** 2026-04-24 04:46:11.831534 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:46:11.831544 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:46:11.831584 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:46:12.924787 | orchestrator | 2026-04-24 04:46:12.924891 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:46:12.924909 | orchestrator | testbed-node-0 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 04:46:12.924923 | orchestrator | testbed-node-1 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 04:46:12.924934 | orchestrator | testbed-node-2 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 04:46:12.924945 | orchestrator | 2026-04-24 04:46:12.924956 | orchestrator | 2026-04-24 04:46:12.924967 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:46:12.924996 | orchestrator | Friday 24 April 2026 04:46:12 +0000 (0:00:09.625) 0:00:19.518 ********** 2026-04-24 04:46:12.925008 | orchestrator | =============================================================================== 2026-04-24 04:46:12.925019 | orchestrator | memcached : Restart memcached container --------------------------------- 9.63s 2026-04-24 04:46:12.925030 | orchestrator | memcached : Copying over config.json files for services ----------------- 1.70s 2026-04-24 04:46:12.925040 | orchestrator | memcached : include_tasks ----------------------------------------------- 1.43s 2026-04-24 04:46:12.925051 | orchestrator | memcached : Ensuring config directories exist --------------------------- 1.28s 2026-04-24 04:46:12.925061 | orchestrator | service-check-containers : memcached | Check containers ----------------- 1.27s 2026-04-24 04:46:12.925072 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.14s 2026-04-24 04:46:12.925082 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.88s 2026-04-24 04:46:12.925093 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.79s 2026-04-24 04:46:12.925104 | orchestrator | service-check-containers : memcached | Notify handlers to restart containers --- 0.33s 2026-04-24 04:46:13.117144 | orchestrator | + osism apply -a upgrade redis 2026-04-24 04:46:14.408638 | orchestrator | 2026-04-24 04:46:14 | INFO  | Prepare task for execution of redis. 2026-04-24 04:46:14.481486 | orchestrator | 2026-04-24 04:46:14 | INFO  | Task 923bb7c6-7867-49c0-bb95-7ce63e83d41b (redis) was prepared for execution. 2026-04-24 04:46:14.481655 | orchestrator | 2026-04-24 04:46:14 | INFO  | It takes a moment until task 923bb7c6-7867-49c0-bb95-7ce63e83d41b (redis) has been started and output is visible here. 2026-04-24 04:46:24.952510 | orchestrator | 2026-04-24 04:46:24.952674 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:46:24.952693 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 04:46:24.952707 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 04:46:24.952742 | orchestrator | 2026-04-24 04:46:24.952753 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:46:24.952763 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 04:46:24.952785 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 04:46:24.952805 | orchestrator | Friday 24 April 2026 04:46:18 +0000 (0:00:01.130) 0:00:01.130 ********** 2026-04-24 04:46:24.952815 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:46:24.952837 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:46:24.952847 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:46:24.952856 | orchestrator | 2026-04-24 04:46:24.952866 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:46:24.952876 | orchestrator | Friday 24 April 2026 04:46:19 +0000 (0:00:00.712) 0:00:01.843 ********** 2026-04-24 04:46:24.952910 | orchestrator | ok: [testbed-node-0] => (item=enable_redis_True) 2026-04-24 04:46:24.952921 | orchestrator | ok: [testbed-node-1] => (item=enable_redis_True) 2026-04-24 04:46:24.952930 | orchestrator | ok: [testbed-node-2] => (item=enable_redis_True) 2026-04-24 04:46:24.952940 | orchestrator | 2026-04-24 04:46:24.952950 | orchestrator | PLAY [Apply role redis] ******************************************************** 2026-04-24 04:46:24.952960 | orchestrator | 2026-04-24 04:46:24.952970 | orchestrator | TASK [redis : include_tasks] *************************************************** 2026-04-24 04:46:24.952980 | orchestrator | Friday 24 April 2026 04:46:20 +0000 (0:00:00.764) 0:00:02.607 ********** 2026-04-24 04:46:24.952989 | orchestrator | included: /ansible/roles/redis/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:46:24.953000 | orchestrator | 2026-04-24 04:46:24.953010 | orchestrator | TASK [redis : Ensuring config directories exist] ******************************* 2026-04-24 04:46:24.953019 | orchestrator | Friday 24 April 2026 04:46:21 +0000 (0:00:01.089) 0:00:03.697 ********** 2026-04-24 04:46:24.953032 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953047 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953075 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953087 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953118 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953139 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953152 | orchestrator | 2026-04-24 04:46:24.953163 | orchestrator | TASK [redis : Copying over default config.json files] ************************** 2026-04-24 04:46:24.953175 | orchestrator | Friday 24 April 2026 04:46:22 +0000 (0:00:01.487) 0:00:05.185 ********** 2026-04-24 04:46:24.953186 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953198 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953214 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953227 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:24.953246 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.341729 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.341839 | orchestrator | 2026-04-24 04:46:30.341856 | orchestrator | TASK [redis : Copying over redis config files] ********************************* 2026-04-24 04:46:30.341869 | orchestrator | Friday 24 April 2026 04:46:25 +0000 (0:00:02.177) 0:00:07.363 ********** 2026-04-24 04:46:30.341882 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.341895 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.341925 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.341937 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.341949 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.342002 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.342077 | orchestrator | 2026-04-24 04:46:30.342092 | orchestrator | TASK [service-check-containers : redis | Check containers] ********************* 2026-04-24 04:46:30.342112 | orchestrator | Friday 24 April 2026 04:46:28 +0000 (0:00:03.316) 0:00:10.680 ********** 2026-04-24 04:46:30.342124 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.342136 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.342154 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.342166 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.342187 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:30.342207 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-24 04:46:52.292887 | orchestrator | 2026-04-24 04:46:52.292995 | orchestrator | TASK [service-check-containers : redis | Notify handlers to restart containers] *** 2026-04-24 04:46:52.293011 | orchestrator | Friday 24 April 2026 04:46:30 +0000 (0:00:02.014) 0:00:12.694 ********** 2026-04-24 04:46:52.293024 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:46:52.293037 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:46:52.293048 | orchestrator | } 2026-04-24 04:46:52.293059 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:46:52.293070 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:46:52.293081 | orchestrator | } 2026-04-24 04:46:52.293092 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:46:52.293103 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:46:52.293114 | orchestrator | } 2026-04-24 04:46:52.293125 | orchestrator | 2026-04-24 04:46:52.293136 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:46:52.293147 | orchestrator | Friday 24 April 2026 04:46:30 +0000 (0:00:00.354) 0:00:13.048 ********** 2026-04-24 04:46:52.293160 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-24 04:46:52.293194 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-24 04:46:52.293207 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:46:52.293219 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-24 04:46:52.293257 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-24 04:46:52.293269 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:46:52.293280 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-24 04:46:52.293310 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-24 04:46:52.293322 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:46:52.293333 | orchestrator | 2026-04-24 04:46:52.293344 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-24 04:46:52.293355 | orchestrator | Friday 24 April 2026 04:46:31 +0000 (0:00:01.174) 0:00:14.223 ********** 2026-04-24 04:46:52.293366 | orchestrator | 2026-04-24 04:46:52.293377 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-24 04:46:52.293388 | orchestrator | Friday 24 April 2026 04:46:32 +0000 (0:00:00.077) 0:00:14.301 ********** 2026-04-24 04:46:52.293399 | orchestrator | 2026-04-24 04:46:52.293409 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-24 04:46:52.293420 | orchestrator | Friday 24 April 2026 04:46:32 +0000 (0:00:00.073) 0:00:14.375 ********** 2026-04-24 04:46:52.293433 | orchestrator | 2026-04-24 04:46:52.293446 | orchestrator | RUNNING HANDLER [redis : Restart redis container] ****************************** 2026-04-24 04:46:52.293459 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 04:46:52.293471 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 04:46:52.293495 | orchestrator | Friday 24 April 2026 04:46:32 +0000 (0:00:00.084) 0:00:14.459 ********** 2026-04-24 04:46:52.293508 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:46:52.293528 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:46:52.293541 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:46:52.293553 | orchestrator | 2026-04-24 04:46:52.293566 | orchestrator | RUNNING HANDLER [redis : Restart redis-sentinel container] ********************* 2026-04-24 04:46:52.293605 | orchestrator | Friday 24 April 2026 04:46:41 +0000 (0:00:09.382) 0:00:23.842 ********** 2026-04-24 04:46:52.293624 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:46:52.293637 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:46:52.293649 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:46:52.293661 | orchestrator | 2026-04-24 04:46:52.293674 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:46:52.293687 | orchestrator | testbed-node-0 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 04:46:52.293702 | orchestrator | testbed-node-1 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 04:46:52.293715 | orchestrator | testbed-node-2 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 04:46:52.293728 | orchestrator | 2026-04-24 04:46:52.293740 | orchestrator | 2026-04-24 04:46:52.293754 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:46:52.293766 | orchestrator | Friday 24 April 2026 04:46:51 +0000 (0:00:10.421) 0:00:34.263 ********** 2026-04-24 04:46:52.293779 | orchestrator | =============================================================================== 2026-04-24 04:46:52.293790 | orchestrator | redis : Restart redis-sentinel container ------------------------------- 10.42s 2026-04-24 04:46:52.293801 | orchestrator | redis : Restart redis container ----------------------------------------- 9.38s 2026-04-24 04:46:52.293812 | orchestrator | redis : Copying over redis config files --------------------------------- 3.32s 2026-04-24 04:46:52.293823 | orchestrator | redis : Copying over default config.json files -------------------------- 2.18s 2026-04-24 04:46:52.293833 | orchestrator | service-check-containers : redis | Check containers --------------------- 2.01s 2026-04-24 04:46:52.293844 | orchestrator | redis : Ensuring config directories exist ------------------------------- 1.49s 2026-04-24 04:46:52.293855 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.18s 2026-04-24 04:46:52.293866 | orchestrator | redis : include_tasks --------------------------------------------------- 1.09s 2026-04-24 04:46:52.293876 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.76s 2026-04-24 04:46:52.293887 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.71s 2026-04-24 04:46:52.293898 | orchestrator | service-check-containers : redis | Notify handlers to restart containers --- 0.35s 2026-04-24 04:46:52.293908 | orchestrator | redis : Flush handlers -------------------------------------------------- 0.24s 2026-04-24 04:46:52.470278 | orchestrator | + osism apply -a upgrade mariadb 2026-04-24 04:46:53.760828 | orchestrator | 2026-04-24 04:46:53 | INFO  | Prepare task for execution of mariadb. 2026-04-24 04:46:53.828917 | orchestrator | 2026-04-24 04:46:53 | INFO  | Task a0432c51-e43a-4709-911e-f2ab0f4ff16d (mariadb) was prepared for execution. 2026-04-24 04:46:53.829007 | orchestrator | 2026-04-24 04:46:53 | INFO  | It takes a moment until task a0432c51-e43a-4709-911e-f2ab0f4ff16d (mariadb) has been started and output is visible here. 2026-04-24 04:47:20.883245 | orchestrator | 2026-04-24 04:47:20.883386 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:47:20.883406 | orchestrator | 2026-04-24 04:47:20.883418 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:47:20.883430 | orchestrator | Friday 24 April 2026 04:46:58 +0000 (0:00:01.430) 0:00:01.430 ********** 2026-04-24 04:47:20.883441 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:47:20.883453 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:47:20.883491 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:47:20.883503 | orchestrator | 2026-04-24 04:47:20.883513 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:47:20.883524 | orchestrator | Friday 24 April 2026 04:47:00 +0000 (0:00:01.839) 0:00:03.269 ********** 2026-04-24 04:47:20.883535 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-24 04:47:20.883549 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-24 04:47:20.883567 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-24 04:47:20.883594 | orchestrator | 2026-04-24 04:47:20.883615 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-24 04:47:20.883706 | orchestrator | 2026-04-24 04:47:20.883732 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-24 04:47:20.883751 | orchestrator | Friday 24 April 2026 04:47:03 +0000 (0:00:03.091) 0:00:06.360 ********** 2026-04-24 04:47:20.883840 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 04:47:20.883855 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 04:47:20.883867 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 04:47:20.883879 | orchestrator | 2026-04-24 04:47:20.883892 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 04:47:20.883904 | orchestrator | Friday 24 April 2026 04:47:05 +0000 (0:00:02.056) 0:00:08.417 ********** 2026-04-24 04:47:20.883916 | orchestrator | included: /ansible/roles/mariadb/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:47:20.883931 | orchestrator | 2026-04-24 04:47:20.883943 | orchestrator | TASK [mariadb : Remove mariadb-clustercheck] *********************************** 2026-04-24 04:47:20.883955 | orchestrator | Friday 24 April 2026 04:47:07 +0000 (0:00:01.864) 0:00:10.282 ********** 2026-04-24 04:47:20.883968 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:47:20.883980 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:47:20.883993 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:47:20.884005 | orchestrator | 2026-04-24 04:47:20.884017 | orchestrator | TASK [mariadb : Ensuring config directories exist] ***************************** 2026-04-24 04:47:20.884045 | orchestrator | Friday 24 April 2026 04:47:10 +0000 (0:00:02.786) 0:00:13.069 ********** 2026-04-24 04:47:20.884065 | orchestrator | ok: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:47:20.884122 | orchestrator | ok: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:47:20.884142 | orchestrator | ok: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:47:20.884155 | orchestrator | 2026-04-24 04:47:20.884166 | orchestrator | TASK [mariadb : Ensuring database backup config directory exists] ************** 2026-04-24 04:47:20.884178 | orchestrator | Friday 24 April 2026 04:47:13 +0000 (0:00:03.653) 0:00:16.723 ********** 2026-04-24 04:47:20.884189 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:47:20.884208 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:47:20.884219 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:47:20.884230 | orchestrator | 2026-04-24 04:47:20.884241 | orchestrator | TASK [mariadb : Copying over my.cnf for mariabackup] *************************** 2026-04-24 04:47:20.884252 | orchestrator | Friday 24 April 2026 04:47:15 +0000 (0:00:01.745) 0:00:18.469 ********** 2026-04-24 04:47:20.884263 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:47:20.884274 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:47:20.884291 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:47:20.884315 | orchestrator | 2026-04-24 04:47:20.884340 | orchestrator | TASK [mariadb : Copying over config.json files for services] ******************* 2026-04-24 04:47:20.884360 | orchestrator | Friday 24 April 2026 04:47:17 +0000 (0:00:02.232) 0:00:20.701 ********** 2026-04-24 04:47:20.884395 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:47:33.363741 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:47:33.363883 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:47:33.363903 | orchestrator | 2026-04-24 04:47:33.363916 | orchestrator | TASK [mariadb : Copying over config.json files for mariabackup] **************** 2026-04-24 04:47:33.363928 | orchestrator | Friday 24 April 2026 04:47:22 +0000 (0:00:04.311) 0:00:25.012 ********** 2026-04-24 04:47:33.363939 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:47:33.363951 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:47:33.363962 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:47:33.363973 | orchestrator | 2026-04-24 04:47:33.363984 | orchestrator | TASK [mariadb : Copying over galera.cnf] *************************************** 2026-04-24 04:47:33.364014 | orchestrator | Friday 24 April 2026 04:47:24 +0000 (0:00:02.018) 0:00:27.031 ********** 2026-04-24 04:47:33.364025 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:47:33.364036 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:47:33.364054 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:47:33.364065 | orchestrator | 2026-04-24 04:47:33.364076 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 04:47:33.364087 | orchestrator | Friday 24 April 2026 04:47:29 +0000 (0:00:05.007) 0:00:32.039 ********** 2026-04-24 04:47:33.364099 | orchestrator | included: /ansible/roles/mariadb/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:47:33.364110 | orchestrator | 2026-04-24 04:47:33.364120 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-24 04:47:33.364131 | orchestrator | Friday 24 April 2026 04:47:31 +0000 (0:00:01.904) 0:00:33.943 ********** 2026-04-24 04:47:33.364143 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:33.364164 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:47:33.364192 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:40.248120 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:47:40.248270 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:40.248330 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:47:40.248344 | orchestrator | 2026-04-24 04:47:40.248356 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-24 04:47:40.248368 | orchestrator | Friday 24 April 2026 04:47:34 +0000 (0:00:03.423) 0:00:37.366 ********** 2026-04-24 04:47:40.248382 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:40.248394 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:47:40.248446 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:40.248469 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:47:40.248481 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:40.248493 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:47:40.248504 | orchestrator | 2026-04-24 04:47:40.248515 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-24 04:47:40.248531 | orchestrator | Friday 24 April 2026 04:47:37 +0000 (0:00:03.425) 0:00:40.792 ********** 2026-04-24 04:47:40.248563 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:45.032115 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:47:45.032208 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:45.032227 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:47:45.032256 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:47:45.032305 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:47:45.032324 | orchestrator | 2026-04-24 04:47:45.032339 | orchestrator | TASK [service-check-containers : mariadb | Check containers] ******************* 2026-04-24 04:47:45.032355 | orchestrator | Friday 24 April 2026 04:47:41 +0000 (0:00:03.943) 0:00:44.735 ********** 2026-04-24 04:47:45.032394 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:47:45.032420 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:47:45.032459 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-24 04:48:00.418454 | orchestrator | 2026-04-24 04:48:00.418572 | orchestrator | TASK [service-check-containers : mariadb | Notify handlers to restart containers] *** 2026-04-24 04:48:00.418590 | orchestrator | Friday 24 April 2026 04:47:46 +0000 (0:00:04.289) 0:00:49.025 ********** 2026-04-24 04:48:00.418604 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:48:00.418617 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:48:00.418628 | orchestrator | } 2026-04-24 04:48:00.418640 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:48:00.418651 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:48:00.418662 | orchestrator | } 2026-04-24 04:48:00.418673 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:48:00.418684 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:48:00.418694 | orchestrator | } 2026-04-24 04:48:00.418775 | orchestrator | 2026-04-24 04:48:00.418790 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:48:00.418801 | orchestrator | Friday 24 April 2026 04:47:47 +0000 (0:00:01.361) 0:00:50.387 ********** 2026-04-24 04:48:00.418876 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:00.418895 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:00.418928 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:00.418941 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:00.418959 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:00.418979 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:00.418991 | orchestrator | 2026-04-24 04:48:00.419004 | orchestrator | TASK [mariadb : Checking for mariadb cluster] ********************************** 2026-04-24 04:48:00.419017 | orchestrator | Friday 24 April 2026 04:47:51 +0000 (0:00:03.759) 0:00:54.147 ********** 2026-04-24 04:48:00.419030 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:00.419043 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:00.419055 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:00.419068 | orchestrator | 2026-04-24 04:48:00.419081 | orchestrator | TASK [mariadb : Cleaning up temp file on localhost] **************************** 2026-04-24 04:48:00.419094 | orchestrator | Friday 24 April 2026 04:47:53 +0000 (0:00:01.727) 0:00:55.875 ********** 2026-04-24 04:48:00.419107 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:00.419119 | orchestrator | 2026-04-24 04:48:00.419132 | orchestrator | TASK [mariadb : Stop MariaDB containers] *************************************** 2026-04-24 04:48:00.419145 | orchestrator | Friday 24 April 2026 04:47:54 +0000 (0:00:01.123) 0:00:56.999 ********** 2026-04-24 04:48:00.419158 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:00.419171 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:00.419183 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:00.419195 | orchestrator | 2026-04-24 04:48:00.419208 | orchestrator | TASK [mariadb : Run MariaDB wsrep recovery] ************************************ 2026-04-24 04:48:00.419221 | orchestrator | Friday 24 April 2026 04:47:55 +0000 (0:00:01.408) 0:00:58.407 ********** 2026-04-24 04:48:00.419233 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:00.419247 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:00.419259 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:00.419271 | orchestrator | 2026-04-24 04:48:00.419284 | orchestrator | TASK [mariadb : Copying MariaDB log file to /tmp] ****************************** 2026-04-24 04:48:00.419297 | orchestrator | Friday 24 April 2026 04:47:56 +0000 (0:00:01.459) 0:00:59.867 ********** 2026-04-24 04:48:00.419310 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:00.419322 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:00.419334 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:00.419347 | orchestrator | 2026-04-24 04:48:00.419359 | orchestrator | TASK [mariadb : Get MariaDB wsrep recovery seqno] ****************************** 2026-04-24 04:48:00.419370 | orchestrator | Friday 24 April 2026 04:47:58 +0000 (0:00:01.581) 0:01:01.448 ********** 2026-04-24 04:48:00.419387 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:00.419397 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:00.419408 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:00.419419 | orchestrator | 2026-04-24 04:48:00.419429 | orchestrator | TASK [mariadb : Removing MariaDB log file from /tmp] *************************** 2026-04-24 04:48:00.419440 | orchestrator | Friday 24 April 2026 04:48:00 +0000 (0:00:01.449) 0:01:02.898 ********** 2026-04-24 04:48:00.419451 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:00.419461 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:00.419472 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:00.419483 | orchestrator | 2026-04-24 04:48:00.419501 | orchestrator | TASK [mariadb : Registering MariaDB seqno variable] **************************** 2026-04-24 04:48:18.204498 | orchestrator | Friday 24 April 2026 04:48:01 +0000 (0:00:01.374) 0:01:04.272 ********** 2026-04-24 04:48:18.204609 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.204626 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.204638 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.204649 | orchestrator | 2026-04-24 04:48:18.204661 | orchestrator | TASK [mariadb : Comparing seqno value on all mariadb hosts] ******************** 2026-04-24 04:48:18.204673 | orchestrator | Friday 24 April 2026 04:48:02 +0000 (0:00:01.430) 0:01:05.702 ********** 2026-04-24 04:48:18.204684 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 04:48:18.204695 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 04:48:18.204706 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 04:48:18.204716 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.204727 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 04:48:18.204737 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 04:48:18.204813 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 04:48:18.204824 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.204835 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 04:48:18.204845 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 04:48:18.204856 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 04:48:18.204866 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.204877 | orchestrator | 2026-04-24 04:48:18.204888 | orchestrator | TASK [mariadb : Writing hostname of host with the largest seqno to temp file] *** 2026-04-24 04:48:18.204915 | orchestrator | Friday 24 April 2026 04:48:04 +0000 (0:00:01.618) 0:01:07.321 ********** 2026-04-24 04:48:18.204926 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.204937 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.204948 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.204958 | orchestrator | 2026-04-24 04:48:18.204969 | orchestrator | TASK [mariadb : Registering mariadb_recover_inventory_name from temp file] ***** 2026-04-24 04:48:18.204980 | orchestrator | Friday 24 April 2026 04:48:05 +0000 (0:00:01.388) 0:01:08.709 ********** 2026-04-24 04:48:18.204991 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.205001 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.205012 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.205023 | orchestrator | 2026-04-24 04:48:18.205033 | orchestrator | TASK [mariadb : Store bootstrap and master hostnames into facts] *************** 2026-04-24 04:48:18.205044 | orchestrator | Friday 24 April 2026 04:48:07 +0000 (0:00:01.345) 0:01:10.054 ********** 2026-04-24 04:48:18.205055 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.205065 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.205076 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.205087 | orchestrator | 2026-04-24 04:48:18.205097 | orchestrator | TASK [mariadb : Set grastate.dat file from MariaDB container in bootstrap host] *** 2026-04-24 04:48:18.205109 | orchestrator | Friday 24 April 2026 04:48:08 +0000 (0:00:01.357) 0:01:11.412 ********** 2026-04-24 04:48:18.205141 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.205152 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.205163 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.205173 | orchestrator | 2026-04-24 04:48:18.205184 | orchestrator | TASK [mariadb : Starting first MariaDB container] ****************************** 2026-04-24 04:48:18.205195 | orchestrator | Friday 24 April 2026 04:48:09 +0000 (0:00:01.377) 0:01:12.790 ********** 2026-04-24 04:48:18.205206 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.205216 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.205227 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.205238 | orchestrator | 2026-04-24 04:48:18.205248 | orchestrator | TASK [mariadb : Wait for first MariaDB container] ****************************** 2026-04-24 04:48:18.205259 | orchestrator | Friday 24 April 2026 04:48:11 +0000 (0:00:01.503) 0:01:14.293 ********** 2026-04-24 04:48:18.205270 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.205281 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.205292 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.205303 | orchestrator | 2026-04-24 04:48:18.205313 | orchestrator | TASK [mariadb : Set first MariaDB container as primary] ************************ 2026-04-24 04:48:18.205324 | orchestrator | Friday 24 April 2026 04:48:12 +0000 (0:00:01.369) 0:01:15.662 ********** 2026-04-24 04:48:18.205335 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.205346 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.205356 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.205367 | orchestrator | 2026-04-24 04:48:18.205378 | orchestrator | TASK [mariadb : Wait for MariaDB to become operational] ************************ 2026-04-24 04:48:18.205388 | orchestrator | Friday 24 April 2026 04:48:14 +0000 (0:00:01.581) 0:01:17.244 ********** 2026-04-24 04:48:18.205399 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.205409 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.205420 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:18.205431 | orchestrator | 2026-04-24 04:48:18.205441 | orchestrator | TASK [mariadb : Restart slave MariaDB container(s)] **************************** 2026-04-24 04:48:18.205452 | orchestrator | Friday 24 April 2026 04:48:15 +0000 (0:00:01.469) 0:01:18.713 ********** 2026-04-24 04:48:18.205497 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:18.205523 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:18.205536 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:18.205548 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:18.205568 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:36.423270 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:36.423394 | orchestrator | 2026-04-24 04:48:36.423413 | orchestrator | TASK [mariadb : Wait for slave MariaDB] **************************************** 2026-04-24 04:48:36.423461 | orchestrator | Friday 24 April 2026 04:48:19 +0000 (0:00:03.416) 0:01:22.130 ********** 2026-04-24 04:48:36.423473 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:36.423485 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:36.423510 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:36.423522 | orchestrator | 2026-04-24 04:48:36.423533 | orchestrator | TASK [mariadb : Restart master MariaDB container(s)] *************************** 2026-04-24 04:48:36.423544 | orchestrator | Friday 24 April 2026 04:48:20 +0000 (0:00:01.375) 0:01:23.505 ********** 2026-04-24 04:48:36.423560 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:36.423575 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:36.423606 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:36.423628 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:36.423645 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-24 04:48:36.423657 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:36.423668 | orchestrator | 2026-04-24 04:48:36.423680 | orchestrator | TASK [mariadb : Wait for master mariadb] *************************************** 2026-04-24 04:48:36.423691 | orchestrator | Friday 24 April 2026 04:48:24 +0000 (0:00:03.694) 0:01:27.200 ********** 2026-04-24 04:48:36.423702 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:36.423713 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:36.423723 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:36.423734 | orchestrator | 2026-04-24 04:48:36.423745 | orchestrator | TASK [service-check : mariadb | Get container facts] *************************** 2026-04-24 04:48:36.423756 | orchestrator | Friday 24 April 2026 04:48:26 +0000 (0:00:01.809) 0:01:29.009 ********** 2026-04-24 04:48:36.423767 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:36.423803 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:36.423814 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:36.423826 | orchestrator | 2026-04-24 04:48:36.423836 | orchestrator | TASK [service-check : mariadb | Fail if containers are missing or not running] *** 2026-04-24 04:48:36.423849 | orchestrator | Friday 24 April 2026 04:48:27 +0000 (0:00:01.385) 0:01:30.395 ********** 2026-04-24 04:48:36.423860 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:36.423871 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:36.423882 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:36.423893 | orchestrator | 2026-04-24 04:48:36.423904 | orchestrator | TASK [service-check : mariadb | Fail if containers are unhealthy] ************** 2026-04-24 04:48:36.423914 | orchestrator | Friday 24 April 2026 04:48:28 +0000 (0:00:01.452) 0:01:31.847 ********** 2026-04-24 04:48:36.423925 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:36.423936 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:36.423947 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:36.423965 | orchestrator | 2026-04-24 04:48:36.423976 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-24 04:48:36.423987 | orchestrator | Friday 24 April 2026 04:48:30 +0000 (0:00:01.867) 0:01:33.715 ********** 2026-04-24 04:48:36.423998 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:48:36.424008 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:48:36.424019 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:48:36.424030 | orchestrator | 2026-04-24 04:48:36.424041 | orchestrator | TASK [mariadb : Create MariaDB volume] ***************************************** 2026-04-24 04:48:36.424052 | orchestrator | Friday 24 April 2026 04:48:32 +0000 (0:00:01.750) 0:01:35.465 ********** 2026-04-24 04:48:36.424063 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:48:36.424075 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:48:36.424086 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:48:36.424096 | orchestrator | 2026-04-24 04:48:36.424107 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB volume availability] ************* 2026-04-24 04:48:36.424118 | orchestrator | Friday 24 April 2026 04:48:34 +0000 (0:00:02.224) 0:01:37.690 ********** 2026-04-24 04:48:36.424129 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:48:36.424140 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:48:36.424151 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:48:36.424162 | orchestrator | 2026-04-24 04:48:36.424173 | orchestrator | TASK [mariadb : Establish whether the cluster has already existed] ************* 2026-04-24 04:48:36.424184 | orchestrator | Friday 24 April 2026 04:48:36 +0000 (0:00:01.457) 0:01:39.147 ********** 2026-04-24 04:48:36.424203 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.817166 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.817308 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.817335 | orchestrator | 2026-04-24 04:51:12.817357 | orchestrator | TASK [mariadb : Check MariaDB service port liveness] *************************** 2026-04-24 04:51:12.817378 | orchestrator | Friday 24 April 2026 04:48:37 +0000 (0:00:01.421) 0:01:40.569 ********** 2026-04-24 04:51:12.817397 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.817439 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.817460 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.817479 | orchestrator | 2026-04-24 04:51:12.817499 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service port liveness] *********** 2026-04-24 04:51:12.817519 | orchestrator | Friday 24 April 2026 04:48:39 +0000 (0:00:01.844) 0:01:42.413 ********** 2026-04-24 04:51:12.817539 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.817556 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.817573 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.817590 | orchestrator | 2026-04-24 04:51:12.817607 | orchestrator | TASK [mariadb : Fail on existing but stopped cluster] ************************** 2026-04-24 04:51:12.817626 | orchestrator | Friday 24 April 2026 04:48:41 +0000 (0:00:01.696) 0:01:44.110 ********** 2026-04-24 04:51:12.817648 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:51:12.817669 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.817687 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.817703 | orchestrator | 2026-04-24 04:51:12.817720 | orchestrator | TASK [mariadb : Check MariaDB service WSREP sync status] *********************** 2026-04-24 04:51:12.817738 | orchestrator | Friday 24 April 2026 04:48:42 +0000 (0:00:01.357) 0:01:45.467 ********** 2026-04-24 04:51:12.817756 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.817773 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.817790 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.817805 | orchestrator | 2026-04-24 04:51:12.817822 | orchestrator | TASK [mariadb : Extract MariaDB service WSREP sync status] ********************* 2026-04-24 04:51:12.817838 | orchestrator | Friday 24 April 2026 04:48:45 +0000 (0:00:03.317) 0:01:48.785 ********** 2026-04-24 04:51:12.817854 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.817871 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.817886 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.817904 | orchestrator | 2026-04-24 04:51:12.817920 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service WSREP sync status] ******* 2026-04-24 04:51:12.817937 | orchestrator | Friday 24 April 2026 04:48:47 +0000 (0:00:01.380) 0:01:50.165 ********** 2026-04-24 04:51:12.817984 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.818002 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.818125 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.818147 | orchestrator | 2026-04-24 04:51:12.818164 | orchestrator | TASK [mariadb : Fail when MariaDB services are not synced across the whole cluster] *** 2026-04-24 04:51:12.818182 | orchestrator | Friday 24 April 2026 04:48:48 +0000 (0:00:01.439) 0:01:51.605 ********** 2026-04-24 04:51:12.818198 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:51:12.818214 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.818230 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.818247 | orchestrator | 2026-04-24 04:51:12.818263 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 04:51:12.818280 | orchestrator | Friday 24 April 2026 04:48:50 +0000 (0:00:01.866) 0:01:53.471 ********** 2026-04-24 04:51:12.818295 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:51:12.818310 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.818326 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.818343 | orchestrator | 2026-04-24 04:51:12.818360 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 04:51:12.818375 | orchestrator | Friday 24 April 2026 04:48:51 +0000 (0:00:01.374) 0:01:54.845 ********** 2026-04-24 04:51:12.818391 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:51:12.818406 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.818422 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.818439 | orchestrator | 2026-04-24 04:51:12.818456 | orchestrator | RUNNING HANDLER [mariadb : Restart MariaDB on existing cluster members] ******** 2026-04-24 04:51:12.818471 | orchestrator | Friday 24 April 2026 04:48:53 +0000 (0:00:01.801) 0:01:56.647 ********** 2026-04-24 04:51:12.818488 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:51:12.818505 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:51:12.818523 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:51:12.818540 | orchestrator | 2026-04-24 04:51:12.818556 | orchestrator | RUNNING HANDLER [mariadb : Start MariaDB on new nodes] ************************* 2026-04-24 04:51:12.818571 | orchestrator | Friday 24 April 2026 04:48:55 +0000 (0:00:01.540) 0:01:58.188 ********** 2026-04-24 04:51:12.818587 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:51:12.818603 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.818620 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.818635 | orchestrator | 2026-04-24 04:51:12.818651 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-24 04:51:12.818666 | orchestrator | 2026-04-24 04:51:12.818682 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-24 04:51:12.818699 | orchestrator | Friday 24 April 2026 04:48:57 +0000 (0:00:01.793) 0:01:59.981 ********** 2026-04-24 04:51:12.818715 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:51:12.818733 | orchestrator | 2026-04-24 04:51:12.818748 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-24 04:51:12.818765 | orchestrator | Friday 24 April 2026 04:49:22 +0000 (0:00:25.384) 0:02:25.366 ********** 2026-04-24 04:51:12.818780 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.818796 | orchestrator | 2026-04-24 04:51:12.818811 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-24 04:51:12.818827 | orchestrator | Friday 24 April 2026 04:49:27 +0000 (0:00:04.662) 0:02:30.028 ********** 2026-04-24 04:51:12.818843 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.818860 | orchestrator | 2026-04-24 04:51:12.818875 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-24 04:51:12.818891 | orchestrator | 2026-04-24 04:51:12.818903 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-24 04:51:12.818913 | orchestrator | Friday 24 April 2026 04:49:30 +0000 (0:00:02.984) 0:02:33.013 ********** 2026-04-24 04:51:12.818922 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:51:12.818932 | orchestrator | 2026-04-24 04:51:12.818954 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-24 04:51:12.818985 | orchestrator | Friday 24 April 2026 04:49:55 +0000 (0:00:25.068) 0:02:58.082 ********** 2026-04-24 04:51:12.818995 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Wait for MariaDB service port liveness (10 retries left). 2026-04-24 04:51:12.819006 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.819016 | orchestrator | 2026-04-24 04:51:12.819025 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-24 04:51:12.819076 | orchestrator | Friday 24 April 2026 04:50:03 +0000 (0:00:08.034) 0:03:06.116 ********** 2026-04-24 04:51:12.819087 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.819096 | orchestrator | 2026-04-24 04:51:12.819106 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-24 04:51:12.819115 | orchestrator | 2026-04-24 04:51:12.819125 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-24 04:51:12.819134 | orchestrator | Friday 24 April 2026 04:50:06 +0000 (0:00:02.987) 0:03:09.104 ********** 2026-04-24 04:51:12.819144 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:51:12.819154 | orchestrator | 2026-04-24 04:51:12.819163 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-24 04:51:12.819173 | orchestrator | Friday 24 April 2026 04:50:31 +0000 (0:00:25.694) 0:03:34.799 ********** 2026-04-24 04:51:12.819182 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Wait for MariaDB service port liveness (10 retries left). 2026-04-24 04:51:12.819192 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.819201 | orchestrator | 2026-04-24 04:51:12.819217 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-24 04:51:12.819233 | orchestrator | Friday 24 April 2026 04:50:39 +0000 (0:00:08.016) 0:03:42.815 ********** 2026-04-24 04:51:12.819249 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.819266 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-24 04:51:12.819283 | orchestrator | 2026-04-24 04:51:12.819300 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-24 04:51:12.819317 | orchestrator | skipping: no hosts matched 2026-04-24 04:51:12.819336 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-24 04:51:12.819353 | orchestrator | mariadb_bootstrap_restart 2026-04-24 04:51:12.819371 | orchestrator | 2026-04-24 04:51:12.819388 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-24 04:51:12.819405 | orchestrator | skipping: no hosts matched 2026-04-24 04:51:12.819422 | orchestrator | 2026-04-24 04:51:12.819439 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-24 04:51:12.819456 | orchestrator | 2026-04-24 04:51:12.819473 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-24 04:51:12.819490 | orchestrator | Friday 24 April 2026 04:50:43 +0000 (0:00:04.016) 0:03:46.832 ********** 2026-04-24 04:51:12.819507 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:51:12.819521 | orchestrator | 2026-04-24 04:51:12.819535 | orchestrator | TASK [mariadb : Creating shard root mysql user] ******************************** 2026-04-24 04:51:12.819549 | orchestrator | Friday 24 April 2026 04:50:45 +0000 (0:00:01.819) 0:03:48.652 ********** 2026-04-24 04:51:12.819562 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.819576 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.819590 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.819603 | orchestrator | 2026-04-24 04:51:12.819616 | orchestrator | TASK [mariadb : Creating mysql monitor user] *********************************** 2026-04-24 04:51:12.819629 | orchestrator | Friday 24 April 2026 04:50:48 +0000 (0:00:03.171) 0:03:51.823 ********** 2026-04-24 04:51:12.819642 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.819656 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.819669 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:51:12.819683 | orchestrator | 2026-04-24 04:51:12.819696 | orchestrator | TASK [mariadb : Creating database backup user and setting permissions] ********* 2026-04-24 04:51:12.819722 | orchestrator | Friday 24 April 2026 04:50:52 +0000 (0:00:03.230) 0:03:55.054 ********** 2026-04-24 04:51:12.819736 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.819749 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.819763 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.819776 | orchestrator | 2026-04-24 04:51:12.819789 | orchestrator | TASK [mariadb : Granting permissions on Mariabackup database to backup user] *** 2026-04-24 04:51:12.819803 | orchestrator | Friday 24 April 2026 04:50:55 +0000 (0:00:03.103) 0:03:58.157 ********** 2026-04-24 04:51:12.819816 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.819830 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.819844 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:51:12.819858 | orchestrator | 2026-04-24 04:51:12.819872 | orchestrator | TASK [service-check : mariadb | Get container facts] *************************** 2026-04-24 04:51:12.819886 | orchestrator | Friday 24 April 2026 04:50:58 +0000 (0:00:03.260) 0:04:01.418 ********** 2026-04-24 04:51:12.819900 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.819914 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.819928 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.819942 | orchestrator | 2026-04-24 04:51:12.819956 | orchestrator | TASK [service-check : mariadb | Fail if containers are missing or not running] *** 2026-04-24 04:51:12.819970 | orchestrator | Friday 24 April 2026 04:51:05 +0000 (0:00:06.732) 0:04:08.150 ********** 2026-04-24 04:51:12.819984 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.819999 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.820012 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:51:12.820026 | orchestrator | 2026-04-24 04:51:12.820142 | orchestrator | TASK [service-check : mariadb | Fail if containers are unhealthy] ************** 2026-04-24 04:51:12.820157 | orchestrator | Friday 24 April 2026 04:51:08 +0000 (0:00:03.304) 0:04:11.455 ********** 2026-04-24 04:51:12.820170 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:51:12.820183 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:51:12.820197 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:51:12.820222 | orchestrator | 2026-04-24 04:51:12.820236 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-24 04:51:12.820250 | orchestrator | Friday 24 April 2026 04:51:10 +0000 (0:00:01.427) 0:04:12.882 ********** 2026-04-24 04:51:12.820264 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:51:12.820279 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:51:12.820293 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:51:12.820307 | orchestrator | 2026-04-24 04:51:12.820337 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-24 04:51:33.146224 | orchestrator | Friday 24 April 2026 04:51:13 +0000 (0:00:03.585) 0:04:16.468 ********** 2026-04-24 04:51:33.146362 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:51:33.146389 | orchestrator | 2026-04-24 04:51:33.146436 | orchestrator | TASK [mariadb : Run upgrade in MariaDB container] ****************************** 2026-04-24 04:51:33.146457 | orchestrator | Friday 24 April 2026 04:51:15 +0000 (0:00:01.890) 0:04:18.358 ********** 2026-04-24 04:51:33.146477 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:51:33.146498 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:51:33.146518 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:51:33.146538 | orchestrator | 2026-04-24 04:51:33.146557 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:51:33.146579 | orchestrator | testbed-node-0 : ok=35  changed=8  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-24 04:51:33.146600 | orchestrator | testbed-node-1 : ok=27  changed=6  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-24 04:51:33.146620 | orchestrator | testbed-node-2 : ok=27  changed=6  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-24 04:51:33.146670 | orchestrator | 2026-04-24 04:51:33.146690 | orchestrator | 2026-04-24 04:51:33.146710 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:51:33.146728 | orchestrator | Friday 24 April 2026 04:51:32 +0000 (0:00:17.261) 0:04:35.619 ********** 2026-04-24 04:51:33.146746 | orchestrator | =============================================================================== 2026-04-24 04:51:33.146764 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 76.15s 2026-04-24 04:51:33.146782 | orchestrator | mariadb : Wait for MariaDB service port liveness ----------------------- 20.71s 2026-04-24 04:51:33.146800 | orchestrator | mariadb : Run upgrade in MariaDB container ----------------------------- 17.26s 2026-04-24 04:51:33.146819 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ------------------------ 9.99s 2026-04-24 04:51:33.146837 | orchestrator | service-check : mariadb | Get container facts --------------------------- 6.73s 2026-04-24 04:51:33.146856 | orchestrator | mariadb : Copying over galera.cnf --------------------------------------- 5.01s 2026-04-24 04:51:33.146874 | orchestrator | mariadb : Copying over config.json files for services ------------------- 4.31s 2026-04-24 04:51:33.146894 | orchestrator | service-check-containers : mariadb | Check containers ------------------- 4.29s 2026-04-24 04:51:33.146914 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS key ----- 3.94s 2026-04-24 04:51:33.146932 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.76s 2026-04-24 04:51:33.146948 | orchestrator | mariadb : Restart master MariaDB container(s) --------------------------- 3.69s 2026-04-24 04:51:33.146966 | orchestrator | mariadb : Ensuring config directories exist ----------------------------- 3.65s 2026-04-24 04:51:33.146984 | orchestrator | mariadb : Wait for MariaDB service to be ready through VIP -------------- 3.59s 2026-04-24 04:51:33.147002 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS certificate --- 3.43s 2026-04-24 04:51:33.147021 | orchestrator | service-cert-copy : mariadb | Copying over extra CA certificates -------- 3.42s 2026-04-24 04:51:33.147040 | orchestrator | mariadb : Restart slave MariaDB container(s) ---------------------------- 3.42s 2026-04-24 04:51:33.147147 | orchestrator | mariadb : Check MariaDB service WSREP sync status ----------------------- 3.32s 2026-04-24 04:51:33.147166 | orchestrator | service-check : mariadb | Fail if containers are missing or not running --- 3.30s 2026-04-24 04:51:33.147177 | orchestrator | mariadb : Granting permissions on Mariabackup database to backup user --- 3.26s 2026-04-24 04:51:33.147188 | orchestrator | mariadb : Creating mysql monitor user ----------------------------------- 3.23s 2026-04-24 04:51:33.337774 | orchestrator | + osism apply -a upgrade rabbitmq 2026-04-24 04:51:34.726297 | orchestrator | 2026-04-24 04:51:34 | INFO  | Prepare task for execution of rabbitmq. 2026-04-24 04:51:34.791236 | orchestrator | 2026-04-24 04:51:34 | INFO  | Task 30e0d0e4-ff87-4037-a6dd-4c19609caaf7 (rabbitmq) was prepared for execution. 2026-04-24 04:51:34.791323 | orchestrator | 2026-04-24 04:51:34 | INFO  | It takes a moment until task 30e0d0e4-ff87-4037-a6dd-4c19609caaf7 (rabbitmq) has been started and output is visible here. 2026-04-24 04:52:17.582676 | orchestrator | 2026-04-24 04:52:17.582798 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:52:17.582816 | orchestrator | 2026-04-24 04:52:17.582829 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:52:17.582840 | orchestrator | Friday 24 April 2026 04:51:39 +0000 (0:00:01.769) 0:00:01.769 ********** 2026-04-24 04:52:17.582851 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:52:17.582863 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:52:17.582874 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:52:17.582885 | orchestrator | 2026-04-24 04:52:17.582896 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:52:17.582907 | orchestrator | Friday 24 April 2026 04:51:41 +0000 (0:00:01.873) 0:00:03.643 ********** 2026-04-24 04:52:17.582918 | orchestrator | ok: [testbed-node-0] => (item=enable_rabbitmq_True) 2026-04-24 04:52:17.582929 | orchestrator | ok: [testbed-node-1] => (item=enable_rabbitmq_True) 2026-04-24 04:52:17.582964 | orchestrator | ok: [testbed-node-2] => (item=enable_rabbitmq_True) 2026-04-24 04:52:17.582976 | orchestrator | 2026-04-24 04:52:17.582987 | orchestrator | PLAY [Apply role rabbitmq] ***************************************************** 2026-04-24 04:52:17.582997 | orchestrator | 2026-04-24 04:52:17.583008 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-24 04:52:17.583019 | orchestrator | Friday 24 April 2026 04:51:44 +0000 (0:00:02.301) 0:00:05.944 ********** 2026-04-24 04:52:17.583030 | orchestrator | included: /ansible/roles/rabbitmq/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:52:17.583042 | orchestrator | 2026-04-24 04:52:17.583053 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-24 04:52:17.583064 | orchestrator | Friday 24 April 2026 04:51:47 +0000 (0:00:03.272) 0:00:09.217 ********** 2026-04-24 04:52:17.583074 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:52:17.583085 | orchestrator | 2026-04-24 04:52:17.583096 | orchestrator | TASK [rabbitmq : Get current RabbitMQ version] ********************************* 2026-04-24 04:52:17.583107 | orchestrator | Friday 24 April 2026 04:51:49 +0000 (0:00:02.693) 0:00:11.910 ********** 2026-04-24 04:52:17.583118 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:52:17.583154 | orchestrator | 2026-04-24 04:52:17.583166 | orchestrator | TASK [rabbitmq : Get new RabbitMQ version] ************************************* 2026-04-24 04:52:17.583176 | orchestrator | Friday 24 April 2026 04:51:53 +0000 (0:00:03.112) 0:00:15.023 ********** 2026-04-24 04:52:17.583187 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:52:17.583199 | orchestrator | 2026-04-24 04:52:17.583214 | orchestrator | TASK [rabbitmq : Check if running RabbitMQ is at most one version behind] ****** 2026-04-24 04:52:17.583226 | orchestrator | Friday 24 April 2026 04:52:02 +0000 (0:00:09.460) 0:00:24.483 ********** 2026-04-24 04:52:17.583239 | orchestrator | ok: [testbed-node-0] => { 2026-04-24 04:52:17.583252 | orchestrator |  "changed": false, 2026-04-24 04:52:17.583264 | orchestrator |  "msg": "All assertions passed" 2026-04-24 04:52:17.583276 | orchestrator | } 2026-04-24 04:52:17.583289 | orchestrator | 2026-04-24 04:52:17.583301 | orchestrator | TASK [rabbitmq : Catch when RabbitMQ is being downgraded] ********************** 2026-04-24 04:52:17.583314 | orchestrator | Friday 24 April 2026 04:52:03 +0000 (0:00:01.327) 0:00:25.810 ********** 2026-04-24 04:52:17.583324 | orchestrator | ok: [testbed-node-0] => { 2026-04-24 04:52:17.583335 | orchestrator |  "changed": false, 2026-04-24 04:52:17.583346 | orchestrator |  "msg": "All assertions passed" 2026-04-24 04:52:17.583357 | orchestrator | } 2026-04-24 04:52:17.583367 | orchestrator | 2026-04-24 04:52:17.583378 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-24 04:52:17.583389 | orchestrator | Friday 24 April 2026 04:52:05 +0000 (0:00:01.667) 0:00:27.478 ********** 2026-04-24 04:52:17.583400 | orchestrator | included: /ansible/roles/rabbitmq/tasks/remove-ha-all-policy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:52:17.583411 | orchestrator | 2026-04-24 04:52:17.583422 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-24 04:52:17.583432 | orchestrator | Friday 24 April 2026 04:52:07 +0000 (0:00:01.887) 0:00:29.366 ********** 2026-04-24 04:52:17.583443 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:52:17.583454 | orchestrator | 2026-04-24 04:52:17.583465 | orchestrator | TASK [rabbitmq : List RabbitMQ policies] *************************************** 2026-04-24 04:52:17.583475 | orchestrator | Friday 24 April 2026 04:52:09 +0000 (0:00:02.247) 0:00:31.613 ********** 2026-04-24 04:52:17.583486 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:52:17.583497 | orchestrator | 2026-04-24 04:52:17.583507 | orchestrator | TASK [rabbitmq : Remove ha-all policy from RabbitMQ] *************************** 2026-04-24 04:52:17.583518 | orchestrator | Friday 24 April 2026 04:52:12 +0000 (0:00:02.718) 0:00:34.332 ********** 2026-04-24 04:52:17.583529 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:52:17.583540 | orchestrator | 2026-04-24 04:52:17.583550 | orchestrator | TASK [rabbitmq : Ensuring config directories exist] **************************** 2026-04-24 04:52:17.583569 | orchestrator | Friday 24 April 2026 04:52:14 +0000 (0:00:01.642) 0:00:35.974 ********** 2026-04-24 04:52:17.583656 | orchestrator | ok: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:17.583682 | orchestrator | ok: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:17.583696 | orchestrator | ok: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:17.583708 | orchestrator | 2026-04-24 04:52:17.583719 | orchestrator | TASK [rabbitmq : Copying over config.json files for services] ****************** 2026-04-24 04:52:17.583730 | orchestrator | Friday 24 April 2026 04:52:16 +0000 (0:00:02.175) 0:00:38.150 ********** 2026-04-24 04:52:17.583742 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:17.583772 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:37.459894 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:37.460003 | orchestrator | 2026-04-24 04:52:37.460020 | orchestrator | TASK [rabbitmq : Copying over rabbitmq-env.conf] ******************************* 2026-04-24 04:52:37.460048 | orchestrator | Friday 24 April 2026 04:52:18 +0000 (0:00:02.532) 0:00:40.683 ********** 2026-04-24 04:52:37.460060 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-24 04:52:37.460072 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-24 04:52:37.460083 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-24 04:52:37.460094 | orchestrator | 2026-04-24 04:52:37.460105 | orchestrator | TASK [rabbitmq : Copying over rabbitmq.conf] *********************************** 2026-04-24 04:52:37.460116 | orchestrator | Friday 24 April 2026 04:52:21 +0000 (0:00:02.427) 0:00:43.110 ********** 2026-04-24 04:52:37.460127 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-24 04:52:37.460138 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-24 04:52:37.460224 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-24 04:52:37.460263 | orchestrator | 2026-04-24 04:52:37.460274 | orchestrator | TASK [rabbitmq : Copying over erl_inetrc] ************************************** 2026-04-24 04:52:37.460285 | orchestrator | Friday 24 April 2026 04:52:23 +0000 (0:00:02.729) 0:00:45.839 ********** 2026-04-24 04:52:37.460296 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-24 04:52:37.460307 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-24 04:52:37.460318 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-24 04:52:37.460329 | orchestrator | 2026-04-24 04:52:37.460339 | orchestrator | TASK [rabbitmq : Copying over advanced.config] ********************************* 2026-04-24 04:52:37.460350 | orchestrator | Friday 24 April 2026 04:52:26 +0000 (0:00:02.271) 0:00:48.111 ********** 2026-04-24 04:52:37.460361 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-24 04:52:37.460372 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-24 04:52:37.460383 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-24 04:52:37.460393 | orchestrator | 2026-04-24 04:52:37.460404 | orchestrator | TASK [rabbitmq : Copying over definitions.json] ******************************** 2026-04-24 04:52:37.460415 | orchestrator | Friday 24 April 2026 04:52:28 +0000 (0:00:02.518) 0:00:50.629 ********** 2026-04-24 04:52:37.460426 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-24 04:52:37.460437 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-24 04:52:37.460447 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-24 04:52:37.460458 | orchestrator | 2026-04-24 04:52:37.460469 | orchestrator | TASK [rabbitmq : Copying over enabled_plugins] ********************************* 2026-04-24 04:52:37.460480 | orchestrator | Friday 24 April 2026 04:52:30 +0000 (0:00:02.206) 0:00:52.836 ********** 2026-04-24 04:52:37.460490 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-24 04:52:37.460501 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-24 04:52:37.460512 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-24 04:52:37.460549 | orchestrator | 2026-04-24 04:52:37.460561 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-24 04:52:37.460571 | orchestrator | Friday 24 April 2026 04:52:33 +0000 (0:00:02.312) 0:00:55.148 ********** 2026-04-24 04:52:37.460582 | orchestrator | included: /ansible/roles/rabbitmq/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:52:37.460593 | orchestrator | 2026-04-24 04:52:37.460623 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over extra CA certificates] ******* 2026-04-24 04:52:37.460635 | orchestrator | Friday 24 April 2026 04:52:35 +0000 (0:00:01.856) 0:00:57.005 ********** 2026-04-24 04:52:37.460656 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:37.460678 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:37.460692 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:37.460704 | orchestrator | 2026-04-24 04:52:37.460715 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over backend internal TLS certificate] *** 2026-04-24 04:52:37.460726 | orchestrator | Friday 24 April 2026 04:52:37 +0000 (0:00:02.273) 0:00:59.279 ********** 2026-04-24 04:52:37.460751 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:52:45.618846 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:52:45.618960 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:52:45.619003 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:52:45.619017 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:52:45.619029 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:52:45.619040 | orchestrator | 2026-04-24 04:52:45.619052 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over backend internal TLS key] **** 2026-04-24 04:52:45.619065 | orchestrator | Friday 24 April 2026 04:52:38 +0000 (0:00:01.490) 0:01:00.769 ********** 2026-04-24 04:52:45.619077 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:52:45.619088 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:52:45.619132 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:52:45.619153 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:52:45.619223 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:52:45.619236 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:52:45.619247 | orchestrator | 2026-04-24 04:52:45.619258 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-24 04:52:45.619269 | orchestrator | Friday 24 April 2026 04:52:40 +0000 (0:00:01.992) 0:01:02.761 ********** 2026-04-24 04:52:45.619280 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:52:45.619292 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:52:45.619302 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:52:45.619313 | orchestrator | 2026-04-24 04:52:45.619323 | orchestrator | TASK [service-check-containers : rabbitmq | Check containers] ****************** 2026-04-24 04:52:45.619334 | orchestrator | Friday 24 April 2026 04:52:44 +0000 (0:00:03.791) 0:01:06.553 ********** 2026-04-24 04:52:45.619346 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:52:45.619372 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:54:29.456644 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-24 04:54:29.456787 | orchestrator | 2026-04-24 04:54:29.456806 | orchestrator | TASK [service-check-containers : rabbitmq | Notify handlers to restart containers] *** 2026-04-24 04:54:29.456819 | orchestrator | Friday 24 April 2026 04:52:46 +0000 (0:00:02.246) 0:01:08.800 ********** 2026-04-24 04:54:29.456832 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:54:29.456844 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:54:29.456855 | orchestrator | } 2026-04-24 04:54:29.456867 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:54:29.456878 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:54:29.456888 | orchestrator | } 2026-04-24 04:54:29.456899 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:54:29.456910 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:54:29.456921 | orchestrator | } 2026-04-24 04:54:29.456932 | orchestrator | 2026-04-24 04:54:29.456943 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:54:29.456955 | orchestrator | Friday 24 April 2026 04:52:48 +0000 (0:00:01.710) 0:01:10.510 ********** 2026-04-24 04:54:29.456967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:54:29.456979 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:54:29.457008 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:54:29.457046 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:54:29.457077 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-24 04:54:29.457090 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:54:29.457101 | orchestrator | 2026-04-24 04:54:29.457112 | orchestrator | RUNNING HANDLER [rabbitmq : Restart rabbitmq container] ************************ 2026-04-24 04:54:29.457123 | orchestrator | Friday 24 April 2026 04:52:50 +0000 (0:00:02.045) 0:01:12.556 ********** 2026-04-24 04:54:29.457134 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:54:29.457145 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:54:29.457155 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:54:29.457166 | orchestrator | 2026-04-24 04:54:29.457177 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-24 04:54:29.457191 | orchestrator | 2026-04-24 04:54:29.457203 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-24 04:54:29.457216 | orchestrator | Friday 24 April 2026 04:52:52 +0000 (0:00:01.531) 0:01:14.087 ********** 2026-04-24 04:54:29.457228 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:54:29.457241 | orchestrator | 2026-04-24 04:54:29.457253 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-24 04:54:29.457267 | orchestrator | Friday 24 April 2026 04:52:54 +0000 (0:00:02.028) 0:01:16.116 ********** 2026-04-24 04:54:29.457279 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:54:29.457311 | orchestrator | 2026-04-24 04:54:29.457322 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-24 04:54:29.457333 | orchestrator | Friday 24 April 2026 04:53:03 +0000 (0:00:09.564) 0:01:25.680 ********** 2026-04-24 04:54:29.457344 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:54:29.457354 | orchestrator | 2026-04-24 04:54:29.457365 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-24 04:54:29.457376 | orchestrator | Friday 24 April 2026 04:53:12 +0000 (0:00:09.120) 0:01:34.801 ********** 2026-04-24 04:54:29.457386 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:54:29.457397 | orchestrator | 2026-04-24 04:54:29.457408 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-24 04:54:29.457427 | orchestrator | 2026-04-24 04:54:29.457438 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-24 04:54:29.457448 | orchestrator | Friday 24 April 2026 04:53:22 +0000 (0:00:09.406) 0:01:44.209 ********** 2026-04-24 04:54:29.457459 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:54:29.457470 | orchestrator | 2026-04-24 04:54:29.457481 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-24 04:54:29.457492 | orchestrator | Friday 24 April 2026 04:53:24 +0000 (0:00:01.778) 0:01:45.988 ********** 2026-04-24 04:54:29.457503 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:54:29.457514 | orchestrator | 2026-04-24 04:54:29.457524 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-24 04:54:29.457535 | orchestrator | Friday 24 April 2026 04:53:32 +0000 (0:00:08.587) 0:01:54.575 ********** 2026-04-24 04:54:29.457546 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:54:29.457556 | orchestrator | 2026-04-24 04:54:29.457567 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-24 04:54:29.457578 | orchestrator | Friday 24 April 2026 04:53:46 +0000 (0:00:13.934) 0:02:08.510 ********** 2026-04-24 04:54:29.457589 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:54:29.457599 | orchestrator | 2026-04-24 04:54:29.457610 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-24 04:54:29.457620 | orchestrator | 2026-04-24 04:54:29.457631 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-24 04:54:29.457642 | orchestrator | Friday 24 April 2026 04:53:55 +0000 (0:00:09.168) 0:02:17.679 ********** 2026-04-24 04:54:29.457652 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:54:29.457663 | orchestrator | 2026-04-24 04:54:29.457674 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-24 04:54:29.457684 | orchestrator | Friday 24 April 2026 04:53:57 +0000 (0:00:01.691) 0:02:19.370 ********** 2026-04-24 04:54:29.457695 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:54:29.457706 | orchestrator | 2026-04-24 04:54:29.457716 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-24 04:54:29.457727 | orchestrator | Friday 24 April 2026 04:54:06 +0000 (0:00:09.031) 0:02:28.402 ********** 2026-04-24 04:54:29.457737 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:54:29.457748 | orchestrator | 2026-04-24 04:54:29.457759 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-24 04:54:29.457775 | orchestrator | Friday 24 April 2026 04:54:20 +0000 (0:00:13.753) 0:02:42.156 ********** 2026-04-24 04:54:29.457787 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:54:29.457797 | orchestrator | 2026-04-24 04:54:29.457808 | orchestrator | PLAY [Apply rabbitmq post-configuration] *************************************** 2026-04-24 04:54:29.457819 | orchestrator | 2026-04-24 04:54:29.457830 | orchestrator | TASK [Include rabbitmq post-deploy.yml] **************************************** 2026-04-24 04:54:29.457848 | orchestrator | Friday 24 April 2026 04:54:29 +0000 (0:00:09.227) 0:02:51.384 ********** 2026-04-24 04:54:35.557897 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:54:35.558007 | orchestrator | 2026-04-24 04:54:35.558086 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-24 04:54:35.558100 | orchestrator | Friday 24 April 2026 04:54:30 +0000 (0:00:01.546) 0:02:52.930 ********** 2026-04-24 04:54:35.558112 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:54:35.558125 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:54:35.558136 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:54:35.558148 | orchestrator | 2026-04-24 04:54:35.558160 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:54:35.558173 | orchestrator | testbed-node-0 : ok=31  changed=11  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 04:54:35.558186 | orchestrator | testbed-node-1 : ok=24  changed=10  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 04:54:35.558223 | orchestrator | testbed-node-2 : ok=24  changed=10  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 04:54:35.558235 | orchestrator | 2026-04-24 04:54:35.558247 | orchestrator | 2026-04-24 04:54:35.558259 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:54:35.558271 | orchestrator | Friday 24 April 2026 04:54:35 +0000 (0:00:04.155) 0:02:57.086 ********** 2026-04-24 04:54:35.558282 | orchestrator | =============================================================================== 2026-04-24 04:54:35.558348 | orchestrator | rabbitmq : Restart rabbitmq container ---------------------------------- 36.81s 2026-04-24 04:54:35.558359 | orchestrator | rabbitmq : Waiting for rabbitmq to start ------------------------------- 27.81s 2026-04-24 04:54:35.558370 | orchestrator | rabbitmq : Put RabbitMQ node into maintenance mode --------------------- 27.18s 2026-04-24 04:54:35.558381 | orchestrator | rabbitmq : Get new RabbitMQ version ------------------------------------- 9.46s 2026-04-24 04:54:35.558392 | orchestrator | rabbitmq : Get info on RabbitMQ container ------------------------------- 5.49s 2026-04-24 04:54:35.558403 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 4.16s 2026-04-24 04:54:35.558414 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 3.79s 2026-04-24 04:54:35.558424 | orchestrator | rabbitmq : include_tasks ------------------------------------------------ 3.27s 2026-04-24 04:54:35.558435 | orchestrator | rabbitmq : Get current RabbitMQ version --------------------------------- 3.11s 2026-04-24 04:54:35.558448 | orchestrator | rabbitmq : Copying over rabbitmq.conf ----------------------------------- 2.73s 2026-04-24 04:54:35.558461 | orchestrator | rabbitmq : List RabbitMQ policies --------------------------------------- 2.72s 2026-04-24 04:54:35.558474 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 2.69s 2026-04-24 04:54:35.558487 | orchestrator | rabbitmq : Copying over config.json files for services ------------------ 2.53s 2026-04-24 04:54:35.558500 | orchestrator | rabbitmq : Copying over advanced.config --------------------------------- 2.52s 2026-04-24 04:54:35.558513 | orchestrator | rabbitmq : Copying over rabbitmq-env.conf ------------------------------- 2.43s 2026-04-24 04:54:35.558525 | orchestrator | rabbitmq : Copying over enabled_plugins --------------------------------- 2.31s 2026-04-24 04:54:35.558537 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.30s 2026-04-24 04:54:35.558550 | orchestrator | service-cert-copy : rabbitmq | Copying over extra CA certificates ------- 2.27s 2026-04-24 04:54:35.558562 | orchestrator | rabbitmq : Copying over erl_inetrc -------------------------------------- 2.27s 2026-04-24 04:54:35.558575 | orchestrator | service-check-containers : rabbitmq | Check containers ------------------ 2.25s 2026-04-24 04:54:35.739814 | orchestrator | + osism apply -a upgrade openvswitch 2026-04-24 04:54:37.105813 | orchestrator | 2026-04-24 04:54:37 | INFO  | Prepare task for execution of openvswitch. 2026-04-24 04:54:37.173924 | orchestrator | 2026-04-24 04:54:37 | INFO  | Task cdcb88f3-d7a4-4e9d-b9f0-edc673c76027 (openvswitch) was prepared for execution. 2026-04-24 04:54:37.174070 | orchestrator | 2026-04-24 04:54:37 | INFO  | It takes a moment until task cdcb88f3-d7a4-4e9d-b9f0-edc673c76027 (openvswitch) has been started and output is visible here. 2026-04-24 04:55:02.791405 | orchestrator | 2026-04-24 04:55:02.791574 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:55:02.791609 | orchestrator | 2026-04-24 04:55:02.791623 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:55:02.791635 | orchestrator | Friday 24 April 2026 04:54:42 +0000 (0:00:01.575) 0:00:01.575 ********** 2026-04-24 04:55:02.791646 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:55:02.791658 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:55:02.791669 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:55:02.791680 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:55:02.791691 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:55:02.791733 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:55:02.791752 | orchestrator | 2026-04-24 04:55:02.791771 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:55:02.791807 | orchestrator | Friday 24 April 2026 04:54:44 +0000 (0:00:02.587) 0:00:04.163 ********** 2026-04-24 04:55:02.791826 | orchestrator | ok: [testbed-node-0] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 04:55:02.791845 | orchestrator | ok: [testbed-node-1] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 04:55:02.791864 | orchestrator | ok: [testbed-node-2] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 04:55:02.791882 | orchestrator | ok: [testbed-node-3] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 04:55:02.791899 | orchestrator | ok: [testbed-node-4] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 04:55:02.791915 | orchestrator | ok: [testbed-node-5] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-24 04:55:02.791932 | orchestrator | 2026-04-24 04:55:02.791949 | orchestrator | PLAY [Apply role openvswitch] ************************************************** 2026-04-24 04:55:02.791967 | orchestrator | 2026-04-24 04:55:02.791985 | orchestrator | TASK [openvswitch : include_tasks] ********************************************* 2026-04-24 04:55:02.792002 | orchestrator | Friday 24 April 2026 04:54:46 +0000 (0:00:02.161) 0:00:06.324 ********** 2026-04-24 04:55:02.792022 | orchestrator | included: /ansible/roles/openvswitch/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 04:55:02.792041 | orchestrator | 2026-04-24 04:55:02.792060 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-24 04:55:02.792079 | orchestrator | Friday 24 April 2026 04:54:50 +0000 (0:00:03.277) 0:00:09.602 ********** 2026-04-24 04:55:02.792096 | orchestrator | ok: [testbed-node-1] => (item=openvswitch) 2026-04-24 04:55:02.792116 | orchestrator | ok: [testbed-node-0] => (item=openvswitch) 2026-04-24 04:55:02.792134 | orchestrator | ok: [testbed-node-2] => (item=openvswitch) 2026-04-24 04:55:02.792152 | orchestrator | ok: [testbed-node-3] => (item=openvswitch) 2026-04-24 04:55:02.792169 | orchestrator | ok: [testbed-node-4] => (item=openvswitch) 2026-04-24 04:55:02.792187 | orchestrator | ok: [testbed-node-5] => (item=openvswitch) 2026-04-24 04:55:02.792204 | orchestrator | 2026-04-24 04:55:02.792223 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-24 04:55:02.792241 | orchestrator | Friday 24 April 2026 04:54:53 +0000 (0:00:03.740) 0:00:13.342 ********** 2026-04-24 04:55:02.792259 | orchestrator | ok: [testbed-node-0] => (item=openvswitch) 2026-04-24 04:55:02.792277 | orchestrator | ok: [testbed-node-2] => (item=openvswitch) 2026-04-24 04:55:02.792296 | orchestrator | ok: [testbed-node-1] => (item=openvswitch) 2026-04-24 04:55:02.792347 | orchestrator | ok: [testbed-node-3] => (item=openvswitch) 2026-04-24 04:55:02.792367 | orchestrator | ok: [testbed-node-4] => (item=openvswitch) 2026-04-24 04:55:02.792386 | orchestrator | ok: [testbed-node-5] => (item=openvswitch) 2026-04-24 04:55:02.792403 | orchestrator | 2026-04-24 04:55:02.792422 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-24 04:55:02.792440 | orchestrator | Friday 24 April 2026 04:54:56 +0000 (0:00:03.079) 0:00:16.422 ********** 2026-04-24 04:55:02.792458 | orchestrator | skipping: [testbed-node-0] => (item=openvswitch)  2026-04-24 04:55:02.792476 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:55:02.792495 | orchestrator | skipping: [testbed-node-1] => (item=openvswitch)  2026-04-24 04:55:02.792513 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:55:02.792530 | orchestrator | skipping: [testbed-node-2] => (item=openvswitch)  2026-04-24 04:55:02.792547 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:55:02.792565 | orchestrator | skipping: [testbed-node-3] => (item=openvswitch)  2026-04-24 04:55:02.792584 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:55:02.792602 | orchestrator | skipping: [testbed-node-4] => (item=openvswitch)  2026-04-24 04:55:02.792642 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:55:02.792661 | orchestrator | skipping: [testbed-node-5] => (item=openvswitch)  2026-04-24 04:55:02.792679 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:55:02.792697 | orchestrator | 2026-04-24 04:55:02.792715 | orchestrator | TASK [openvswitch : Create /run/openvswitch directory on host] ***************** 2026-04-24 04:55:02.792734 | orchestrator | Friday 24 April 2026 04:54:59 +0000 (0:00:02.426) 0:00:18.848 ********** 2026-04-24 04:55:02.792753 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:55:02.792771 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:55:02.792788 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:55:02.792807 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:55:02.792825 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:55:02.792844 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:55:02.792863 | orchestrator | 2026-04-24 04:55:02.792881 | orchestrator | TASK [openvswitch : Ensuring config directories exist] ************************* 2026-04-24 04:55:02.792900 | orchestrator | Friday 24 April 2026 04:55:01 +0000 (0:00:02.517) 0:00:21.366 ********** 2026-04-24 04:55:02.792956 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:02.792999 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:02.793019 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:02.793037 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:02.793074 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:02.793096 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:02.793139 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156582 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156690 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156712 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156746 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156758 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156770 | orchestrator | 2026-04-24 04:55:06.156802 | orchestrator | TASK [openvswitch : Copying over config.json files for services] *************** 2026-04-24 04:55:06.156825 | orchestrator | Friday 24 April 2026 04:55:04 +0000 (0:00:02.611) 0:00:23.978 ********** 2026-04-24 04:55:06.156866 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156880 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156892 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156910 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156922 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156938 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:06.156958 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687586 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687699 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687711 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687720 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687741 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687750 | orchestrator | 2026-04-24 04:55:11.687759 | orchestrator | TASK [openvswitch : Copying over ovs-vsctl wrapper] **************************** 2026-04-24 04:55:11.687769 | orchestrator | Friday 24 April 2026 04:55:07 +0000 (0:00:03.571) 0:00:27.550 ********** 2026-04-24 04:55:11.687778 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:55:11.687787 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:55:11.687795 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:55:11.687803 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:55:11.687810 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:55:11.687818 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:55:11.687826 | orchestrator | 2026-04-24 04:55:11.687834 | orchestrator | TASK [service-check-containers : openvswitch | Check containers] *************** 2026-04-24 04:55:11.687857 | orchestrator | Friday 24 April 2026 04:55:10 +0000 (0:00:02.218) 0:00:29.768 ********** 2026-04-24 04:55:11.687866 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687882 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687891 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687899 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687911 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:11.687926 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-24 04:55:15.922382 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:15.922487 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:15.922505 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:15.922518 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:15.922547 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:15.922577 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-24 04:55:15.922613 | orchestrator | 2026-04-24 04:55:15.922626 | orchestrator | TASK [service-check-containers : openvswitch | Notify handlers to restart containers] *** 2026-04-24 04:55:15.922640 | orchestrator | Friday 24 April 2026 04:55:13 +0000 (0:00:03.290) 0:00:33.059 ********** 2026-04-24 04:55:15.922652 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:55:15.922664 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:55:15.922675 | orchestrator | } 2026-04-24 04:55:15.922687 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:55:15.922697 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:55:15.922708 | orchestrator | } 2026-04-24 04:55:15.922719 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:55:15.922730 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:55:15.922741 | orchestrator | } 2026-04-24 04:55:15.922751 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 04:55:15.922762 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:55:15.922773 | orchestrator | } 2026-04-24 04:55:15.922784 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 04:55:15.922794 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:55:15.922805 | orchestrator | } 2026-04-24 04:55:15.922816 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 04:55:15.922826 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:55:15.922837 | orchestrator | } 2026-04-24 04:55:15.922848 | orchestrator | 2026-04-24 04:55:15.922859 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:55:15.922871 | orchestrator | Friday 24 April 2026 04:55:15 +0000 (0:00:01.925) 0:00:34.984 ********** 2026-04-24 04:55:15.922885 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-24 04:55:15.922900 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-24 04:55:15.922913 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:55:15.922932 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-24 04:55:15.922953 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-24 04:55:15.922975 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-24 04:55:49.608253 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-24 04:55:49.608413 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:55:49.608432 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:55:49.608445 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-24 04:55:49.608459 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-24 04:55:49.608495 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:55:49.608521 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-24 04:55:49.608533 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-24 04:55:49.608545 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:55:49.608575 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-24 04:55:49.608588 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-24 04:55:49.608599 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:55:49.608610 | orchestrator | 2026-04-24 04:55:49.608622 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 04:55:49.608635 | orchestrator | Friday 24 April 2026 04:55:18 +0000 (0:00:02.642) 0:00:37.627 ********** 2026-04-24 04:55:49.608646 | orchestrator | 2026-04-24 04:55:49.608657 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 04:55:49.608668 | orchestrator | Friday 24 April 2026 04:55:18 +0000 (0:00:00.700) 0:00:38.328 ********** 2026-04-24 04:55:49.608679 | orchestrator | 2026-04-24 04:55:49.608689 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 04:55:49.608708 | orchestrator | Friday 24 April 2026 04:55:19 +0000 (0:00:00.519) 0:00:38.847 ********** 2026-04-24 04:55:49.608719 | orchestrator | 2026-04-24 04:55:49.608730 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 04:55:49.608741 | orchestrator | Friday 24 April 2026 04:55:19 +0000 (0:00:00.519) 0:00:39.366 ********** 2026-04-24 04:55:49.608752 | orchestrator | 2026-04-24 04:55:49.608764 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 04:55:49.608774 | orchestrator | Friday 24 April 2026 04:55:20 +0000 (0:00:00.520) 0:00:39.887 ********** 2026-04-24 04:55:49.608785 | orchestrator | 2026-04-24 04:55:49.608798 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-24 04:55:49.608811 | orchestrator | Friday 24 April 2026 04:55:20 +0000 (0:00:00.530) 0:00:40.417 ********** 2026-04-24 04:55:49.608823 | orchestrator | 2026-04-24 04:55:49.608835 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-db-server container] ******** 2026-04-24 04:55:49.608854 | orchestrator | Friday 24 April 2026 04:55:21 +0000 (0:00:00.839) 0:00:41.256 ********** 2026-04-24 04:55:49.608868 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:55:49.608881 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:55:49.608893 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:55:49.608906 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:55:49.608918 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:55:49.608931 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:55:49.608943 | orchestrator | 2026-04-24 04:55:49.608955 | orchestrator | RUNNING HANDLER [openvswitch : Waiting for openvswitch_db service to be ready] *** 2026-04-24 04:55:49.608969 | orchestrator | Friday 24 April 2026 04:55:33 +0000 (0:00:11.823) 0:00:53.080 ********** 2026-04-24 04:55:49.608981 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:55:49.608994 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:55:49.609007 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:55:49.609019 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:55:49.609031 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:55:49.609043 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:55:49.609055 | orchestrator | 2026-04-24 04:55:49.609068 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-24 04:55:49.609081 | orchestrator | Friday 24 April 2026 04:55:35 +0000 (0:00:02.338) 0:00:55.419 ********** 2026-04-24 04:55:49.609093 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:55:49.609106 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:55:49.609119 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:55:49.609132 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:55:49.609144 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:55:49.609155 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:55:49.609166 | orchestrator | 2026-04-24 04:55:49.609177 | orchestrator | TASK [openvswitch : Set system-id, hostname and hw-offload] ******************** 2026-04-24 04:55:49.609188 | orchestrator | Friday 24 April 2026 04:55:46 +0000 (0:00:10.928) 0:01:06.348 ********** 2026-04-24 04:55:49.609199 | orchestrator | ok: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-0'}) 2026-04-24 04:55:49.609211 | orchestrator | ok: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-1'}) 2026-04-24 04:55:49.609222 | orchestrator | ok: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-2'}) 2026-04-24 04:55:49.609233 | orchestrator | ok: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-3'}) 2026-04-24 04:55:49.609244 | orchestrator | ok: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-4'}) 2026-04-24 04:55:49.609261 | orchestrator | ok: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-5'}) 2026-04-24 04:56:02.420942 | orchestrator | ok: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-3'}) 2026-04-24 04:56:02.421091 | orchestrator | ok: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-0'}) 2026-04-24 04:56:02.421117 | orchestrator | ok: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-1'}) 2026-04-24 04:56:02.421129 | orchestrator | ok: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-2'}) 2026-04-24 04:56:02.421140 | orchestrator | ok: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-4'}) 2026-04-24 04:56:02.421151 | orchestrator | ok: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-5'}) 2026-04-24 04:56:02.421161 | orchestrator | ok: [testbed-node-3] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 04:56:02.421171 | orchestrator | ok: [testbed-node-1] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 04:56:02.421181 | orchestrator | ok: [testbed-node-0] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 04:56:02.421191 | orchestrator | ok: [testbed-node-2] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 04:56:02.421201 | orchestrator | ok: [testbed-node-4] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 04:56:02.421211 | orchestrator | ok: [testbed-node-5] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-24 04:56:02.421221 | orchestrator | 2026-04-24 04:56:02.421232 | orchestrator | TASK [openvswitch : Ensuring OVS bridge is properly setup] ********************* 2026-04-24 04:56:02.421243 | orchestrator | Friday 24 April 2026 04:55:54 +0000 (0:00:07.786) 0:01:14.135 ********** 2026-04-24 04:56:02.421253 | orchestrator | skipping: [testbed-node-3] => (item=br-ex)  2026-04-24 04:56:02.421264 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:56:02.421275 | orchestrator | skipping: [testbed-node-4] => (item=br-ex)  2026-04-24 04:56:02.421285 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:56:02.421294 | orchestrator | skipping: [testbed-node-5] => (item=br-ex)  2026-04-24 04:56:02.421304 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:56:02.421314 | orchestrator | ok: [testbed-node-1] => (item=br-ex) 2026-04-24 04:56:02.421324 | orchestrator | ok: [testbed-node-0] => (item=br-ex) 2026-04-24 04:56:02.421333 | orchestrator | ok: [testbed-node-2] => (item=br-ex) 2026-04-24 04:56:02.421343 | orchestrator | 2026-04-24 04:56:02.421353 | orchestrator | TASK [openvswitch : Ensuring OVS ports are properly setup] ********************* 2026-04-24 04:56:02.421386 | orchestrator | Friday 24 April 2026 04:55:57 +0000 (0:00:03.378) 0:01:17.513 ********** 2026-04-24 04:56:02.421397 | orchestrator | skipping: [testbed-node-3] => (item=['br-ex', 'vxlan0'])  2026-04-24 04:56:02.421406 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:56:02.421431 | orchestrator | skipping: [testbed-node-4] => (item=['br-ex', 'vxlan0'])  2026-04-24 04:56:02.421442 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:56:02.421451 | orchestrator | skipping: [testbed-node-5] => (item=['br-ex', 'vxlan0'])  2026-04-24 04:56:02.421461 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:56:02.421471 | orchestrator | ok: [testbed-node-1] => (item=['br-ex', 'vxlan0']) 2026-04-24 04:56:02.421483 | orchestrator | ok: [testbed-node-2] => (item=['br-ex', 'vxlan0']) 2026-04-24 04:56:02.421494 | orchestrator | ok: [testbed-node-0] => (item=['br-ex', 'vxlan0']) 2026-04-24 04:56:02.421506 | orchestrator | 2026-04-24 04:56:02.421517 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 04:56:02.421530 | orchestrator | testbed-node-0 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 04:56:02.421543 | orchestrator | testbed-node-1 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 04:56:02.421564 | orchestrator | testbed-node-2 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 04:56:02.421575 | orchestrator | testbed-node-3 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:56:02.421587 | orchestrator | testbed-node-4 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:56:02.421599 | orchestrator | testbed-node-5 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 04:56:02.421611 | orchestrator | 2026-04-24 04:56:02.421622 | orchestrator | 2026-04-24 04:56:02.421632 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 04:56:02.421642 | orchestrator | Friday 24 April 2026 04:56:02 +0000 (0:00:04.059) 0:01:21.573 ********** 2026-04-24 04:56:02.421652 | orchestrator | =============================================================================== 2026-04-24 04:56:02.421661 | orchestrator | openvswitch : Restart openvswitch-db-server container ------------------ 11.82s 2026-04-24 04:56:02.421687 | orchestrator | openvswitch : Restart openvswitch-vswitchd container ------------------- 10.93s 2026-04-24 04:56:02.421698 | orchestrator | openvswitch : Set system-id, hostname and hw-offload -------------------- 7.79s 2026-04-24 04:56:02.421707 | orchestrator | openvswitch : Ensuring OVS ports are properly setup --------------------- 4.06s 2026-04-24 04:56:02.421717 | orchestrator | module-load : Load modules ---------------------------------------------- 3.74s 2026-04-24 04:56:02.421726 | orchestrator | openvswitch : Flush Handlers -------------------------------------------- 3.63s 2026-04-24 04:56:02.421736 | orchestrator | openvswitch : Copying over config.json files for services --------------- 3.57s 2026-04-24 04:56:02.421745 | orchestrator | openvswitch : Ensuring OVS bridge is properly setup --------------------- 3.38s 2026-04-24 04:56:02.421755 | orchestrator | service-check-containers : openvswitch | Check containers --------------- 3.29s 2026-04-24 04:56:02.421765 | orchestrator | openvswitch : include_tasks --------------------------------------------- 3.28s 2026-04-24 04:56:02.421774 | orchestrator | module-load : Persist modules via modules-load.d ------------------------ 3.08s 2026-04-24 04:56:02.421784 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.64s 2026-04-24 04:56:02.421793 | orchestrator | openvswitch : Ensuring config directories exist ------------------------- 2.61s 2026-04-24 04:56:02.421803 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.59s 2026-04-24 04:56:02.421813 | orchestrator | openvswitch : Create /run/openvswitch directory on host ----------------- 2.52s 2026-04-24 04:56:02.421822 | orchestrator | module-load : Drop module persistence ----------------------------------- 2.43s 2026-04-24 04:56:02.421832 | orchestrator | openvswitch : Waiting for openvswitch_db service to be ready ------------ 2.34s 2026-04-24 04:56:02.421841 | orchestrator | openvswitch : Copying over ovs-vsctl wrapper ---------------------------- 2.22s 2026-04-24 04:56:02.421851 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.16s 2026-04-24 04:56:02.421861 | orchestrator | service-check-containers : openvswitch | Notify handlers to restart containers --- 1.93s 2026-04-24 04:56:02.601698 | orchestrator | + osism apply -a upgrade ovn 2026-04-24 04:56:03.928056 | orchestrator | 2026-04-24 04:56:03 | INFO  | Prepare task for execution of ovn. 2026-04-24 04:56:04.005056 | orchestrator | 2026-04-24 04:56:04 | INFO  | Task 3b1d9c7e-6254-4f39-af9e-e3824e59a267 (ovn) was prepared for execution. 2026-04-24 04:56:04.005147 | orchestrator | 2026-04-24 04:56:04 | INFO  | It takes a moment until task 3b1d9c7e-6254-4f39-af9e-e3824e59a267 (ovn) has been started and output is visible here. 2026-04-24 04:56:25.961173 | orchestrator | 2026-04-24 04:56:25.961290 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 04:56:25.961310 | orchestrator | 2026-04-24 04:56:25.961323 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 04:56:25.961358 | orchestrator | Friday 24 April 2026 04:56:08 +0000 (0:00:01.704) 0:00:01.704 ********** 2026-04-24 04:56:25.961369 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:56:25.961434 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:56:25.961447 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:56:25.961473 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:56:25.961484 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:56:25.961494 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:56:25.961505 | orchestrator | 2026-04-24 04:56:25.961515 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 04:56:25.961526 | orchestrator | Friday 24 April 2026 04:56:12 +0000 (0:00:03.611) 0:00:05.315 ********** 2026-04-24 04:56:25.961537 | orchestrator | ok: [testbed-node-0] => (item=enable_ovn_True) 2026-04-24 04:56:25.961548 | orchestrator | ok: [testbed-node-1] => (item=enable_ovn_True) 2026-04-24 04:56:25.961559 | orchestrator | ok: [testbed-node-2] => (item=enable_ovn_True) 2026-04-24 04:56:25.961569 | orchestrator | ok: [testbed-node-3] => (item=enable_ovn_True) 2026-04-24 04:56:25.961580 | orchestrator | ok: [testbed-node-4] => (item=enable_ovn_True) 2026-04-24 04:56:25.961590 | orchestrator | ok: [testbed-node-5] => (item=enable_ovn_True) 2026-04-24 04:56:25.961600 | orchestrator | 2026-04-24 04:56:25.961611 | orchestrator | PLAY [Apply role ovn-controller] *********************************************** 2026-04-24 04:56:25.961621 | orchestrator | 2026-04-24 04:56:25.961632 | orchestrator | TASK [ovn-controller : include_tasks] ****************************************** 2026-04-24 04:56:25.961643 | orchestrator | Friday 24 April 2026 04:56:16 +0000 (0:00:03.424) 0:00:08.740 ********** 2026-04-24 04:56:25.961654 | orchestrator | included: /ansible/roles/ovn-controller/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 04:56:25.961666 | orchestrator | 2026-04-24 04:56:25.961677 | orchestrator | TASK [ovn-controller : Ensuring config directories exist] ********************** 2026-04-24 04:56:25.961688 | orchestrator | Friday 24 April 2026 04:56:20 +0000 (0:00:04.000) 0:00:12.741 ********** 2026-04-24 04:56:25.961703 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961719 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961732 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961745 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961758 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961799 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961812 | orchestrator | 2026-04-24 04:56:25.961825 | orchestrator | TASK [ovn-controller : Copying over config.json files for services] ************ 2026-04-24 04:56:25.961837 | orchestrator | Friday 24 April 2026 04:56:22 +0000 (0:00:02.685) 0:00:15.426 ********** 2026-04-24 04:56:25.961855 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961868 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961881 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961894 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961908 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961920 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.961936 | orchestrator | 2026-04-24 04:56:25.961955 | orchestrator | TASK [ovn-controller : Ensuring systemd override directory exists] ************* 2026-04-24 04:56:25.961985 | orchestrator | Friday 24 April 2026 04:56:25 +0000 (0:00:02.619) 0:00:18.046 ********** 2026-04-24 04:56:25.962005 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.962101 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:25.962137 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150499 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150632 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150658 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150679 | orchestrator | 2026-04-24 04:56:35.150699 | orchestrator | TASK [ovn-controller : Copying over systemd override] ************************** 2026-04-24 04:56:35.150719 | orchestrator | Friday 24 April 2026 04:56:27 +0000 (0:00:02.143) 0:00:20.190 ********** 2026-04-24 04:56:35.150736 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150754 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150801 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150823 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150842 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150894 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150915 | orchestrator | 2026-04-24 04:56:35.150934 | orchestrator | TASK [service-check-containers : ovn_controller | Check containers] ************ 2026-04-24 04:56:35.150954 | orchestrator | Friday 24 April 2026 04:56:30 +0000 (0:00:03.213) 0:00:23.403 ********** 2026-04-24 04:56:35.150976 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.150999 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.151039 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.151058 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.151085 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.151099 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:56:35.151113 | orchestrator | 2026-04-24 04:56:35.151133 | orchestrator | TASK [service-check-containers : ovn_controller | Notify handlers to restart containers] *** 2026-04-24 04:56:35.151154 | orchestrator | Friday 24 April 2026 04:56:33 +0000 (0:00:02.562) 0:00:25.966 ********** 2026-04-24 04:56:35.151174 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 04:56:35.151195 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:56:35.151225 | orchestrator | } 2026-04-24 04:56:35.151247 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 04:56:35.151260 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:56:35.151276 | orchestrator | } 2026-04-24 04:56:35.151295 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 04:56:35.151315 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:56:35.151334 | orchestrator | } 2026-04-24 04:56:35.151352 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 04:56:35.151369 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:56:35.151414 | orchestrator | } 2026-04-24 04:56:35.151435 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 04:56:35.151454 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:56:35.151472 | orchestrator | } 2026-04-24 04:56:35.151489 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 04:56:35.151500 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 04:56:35.151511 | orchestrator | } 2026-04-24 04:56:35.151521 | orchestrator | 2026-04-24 04:56:35.151532 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 04:56:35.151543 | orchestrator | Friday 24 April 2026 04:56:35 +0000 (0:00:01.813) 0:00:27.779 ********** 2026-04-24 04:56:35.151573 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:56:57.947078 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:56:57.947168 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:56:57.947181 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:56:57.947188 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:56:57.947213 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:56:57.947220 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:56:57.947225 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:56:57.947231 | orchestrator | skipping: [testbed-node-3] 2026-04-24 04:56:57.947236 | orchestrator | skipping: [testbed-node-4] 2026-04-24 04:56:57.947242 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:56:57.947248 | orchestrator | skipping: [testbed-node-5] 2026-04-24 04:56:57.947254 | orchestrator | 2026-04-24 04:56:57.947260 | orchestrator | TASK [ovn-controller : Create br-int bridge on OpenvSwitch] ******************** 2026-04-24 04:56:57.947267 | orchestrator | Friday 24 April 2026 04:56:37 +0000 (0:00:02.457) 0:00:30.237 ********** 2026-04-24 04:56:57.947272 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:56:57.947278 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:56:57.947284 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:56:57.947289 | orchestrator | ok: [testbed-node-3] 2026-04-24 04:56:57.947294 | orchestrator | ok: [testbed-node-4] 2026-04-24 04:56:57.947300 | orchestrator | ok: [testbed-node-5] 2026-04-24 04:56:57.947305 | orchestrator | 2026-04-24 04:56:57.947311 | orchestrator | TASK [ovn-controller : Configure OVN in OVSDB] ********************************* 2026-04-24 04:56:57.947316 | orchestrator | Friday 24 April 2026 04:56:41 +0000 (0:00:03.870) 0:00:34.108 ********** 2026-04-24 04:56:57.947322 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.11'}) 2026-04-24 04:56:57.947328 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.10'}) 2026-04-24 04:56:57.947334 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.12'}) 2026-04-24 04:56:57.947339 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.13'}) 2026-04-24 04:56:57.947344 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.14'}) 2026-04-24 04:56:57.947350 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.15'}) 2026-04-24 04:56:57.947356 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 04:56:57.947361 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 04:56:57.947367 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 04:56:57.947385 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 04:56:57.947391 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 04:56:57.947455 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-24 04:56:57.947468 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-24 04:56:57.947476 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-24 04:56:57.947481 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-24 04:56:57.947486 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-24 04:56:57.947492 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-24 04:56:57.947497 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-24 04:56:57.947503 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 04:56:57.947509 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 04:56:57.947514 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 04:56:57.947519 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 04:56:57.947525 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 04:56:57.947530 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-24 04:56:57.947535 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 04:56:57.947541 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 04:56:57.947546 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 04:56:57.947551 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 04:56:57.947557 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 04:56:57.947562 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-24 04:56:57.947567 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 04:56:57.947573 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 04:56:57.947578 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 04:56:57.947583 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 04:56:57.947589 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 04:56:57.947594 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-24 04:56:57.947599 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-24 04:56:57.947605 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-24 04:56:57.947610 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-24 04:56:57.947615 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-24 04:56:57.947621 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-24 04:56:57.947630 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-24 04:56:57.947637 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:29:4a:9b', 'state': 'absent'}) 2026-04-24 04:56:57.947646 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:89:18:56', 'state': 'present'}) 2026-04-24 04:56:57.947652 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:33:12:50', 'state': 'absent'}) 2026-04-24 04:56:57.947662 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:2f:fa:44', 'state': 'present'}) 2026-04-24 04:56:57.947669 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:52:c1:40', 'state': 'absent'}) 2026-04-24 04:56:57.947678 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:71:3a:c3', 'state': 'present'}) 2026-04-24 04:59:50.680297 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-24 04:59:50.680418 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-24 04:59:50.680435 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-24 04:59:50.680447 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-24 04:59:50.680458 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-24 04:59:50.680469 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-24 04:59:50.680480 | orchestrator | 2026-04-24 04:59:50.680491 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 04:59:50.680503 | orchestrator | Friday 24 April 2026 04:57:01 +0000 (0:00:19.839) 0:00:53.948 ********** 2026-04-24 04:59:50.680572 | orchestrator | 2026-04-24 04:59:50.680585 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 04:59:50.680596 | orchestrator | Friday 24 April 2026 04:57:01 +0000 (0:00:00.440) 0:00:54.388 ********** 2026-04-24 04:59:50.680607 | orchestrator | 2026-04-24 04:59:50.680618 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 04:59:50.680628 | orchestrator | Friday 24 April 2026 04:57:02 +0000 (0:00:00.445) 0:00:54.834 ********** 2026-04-24 04:59:50.680639 | orchestrator | 2026-04-24 04:59:50.680650 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 04:59:50.680660 | orchestrator | Friday 24 April 2026 04:57:02 +0000 (0:00:00.626) 0:00:55.460 ********** 2026-04-24 04:59:50.680671 | orchestrator | 2026-04-24 04:59:50.680681 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 04:59:50.680692 | orchestrator | Friday 24 April 2026 04:57:03 +0000 (0:00:00.469) 0:00:55.929 ********** 2026-04-24 04:59:50.680702 | orchestrator | 2026-04-24 04:59:50.680713 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-24 04:59:50.680724 | orchestrator | Friday 24 April 2026 04:57:03 +0000 (0:00:00.480) 0:00:56.409 ********** 2026-04-24 04:59:50.680734 | orchestrator | 2026-04-24 04:59:50.680745 | orchestrator | RUNNING HANDLER [ovn-controller : Restart ovn-controller container] ************ 2026-04-24 04:59:50.680756 | orchestrator | Friday 24 April 2026 04:57:04 +0000 (0:00:00.849) 0:00:57.260 ********** 2026-04-24 04:59:50.680766 | orchestrator | 2026-04-24 04:59:50.680777 | orchestrator | STILL ALIVE [task 'ovn-controller : Restart ovn-controller container' is running] *** 2026-04-24 04:59:50.680789 | orchestrator | changed: [testbed-node-3] 2026-04-24 04:59:50.680801 | orchestrator | changed: [testbed-node-5] 2026-04-24 04:59:50.680837 | orchestrator | changed: [testbed-node-4] 2026-04-24 04:59:50.680850 | orchestrator | changed: [testbed-node-0] 2026-04-24 04:59:50.680863 | orchestrator | changed: [testbed-node-2] 2026-04-24 04:59:50.680875 | orchestrator | changed: [testbed-node-1] 2026-04-24 04:59:50.680887 | orchestrator | 2026-04-24 04:59:50.680900 | orchestrator | PLAY [Apply role ovn-db] ******************************************************* 2026-04-24 04:59:50.680912 | orchestrator | 2026-04-24 04:59:50.680925 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-24 04:59:50.680937 | orchestrator | Friday 24 April 2026 04:59:16 +0000 (0:02:11.871) 0:03:09.131 ********** 2026-04-24 04:59:50.680949 | orchestrator | included: /ansible/roles/ovn-db/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:59:50.680961 | orchestrator | 2026-04-24 04:59:50.680973 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-24 04:59:50.680984 | orchestrator | Friday 24 April 2026 04:59:18 +0000 (0:00:01.960) 0:03:11.092 ********** 2026-04-24 04:59:50.680997 | orchestrator | included: /ansible/roles/ovn-db/tasks/lookup_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 04:59:50.681010 | orchestrator | 2026-04-24 04:59:50.681022 | orchestrator | TASK [ovn-db : Checking for any existing OVN DB container volumes] ************* 2026-04-24 04:59:50.681035 | orchestrator | Friday 24 April 2026 04:59:20 +0000 (0:00:01.903) 0:03:12.995 ********** 2026-04-24 04:59:50.681047 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681060 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681072 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681084 | orchestrator | 2026-04-24 04:59:50.681096 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB volume availability] *************** 2026-04-24 04:59:50.681108 | orchestrator | Friday 24 April 2026 04:59:22 +0000 (0:00:01.830) 0:03:14.826 ********** 2026-04-24 04:59:50.681121 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681134 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681147 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681159 | orchestrator | 2026-04-24 04:59:50.681171 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB volume availability] *************** 2026-04-24 04:59:50.681183 | orchestrator | Friday 24 April 2026 04:59:23 +0000 (0:00:01.634) 0:03:16.461 ********** 2026-04-24 04:59:50.681195 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681206 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681216 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681227 | orchestrator | 2026-04-24 04:59:50.681237 | orchestrator | TASK [ovn-db : Establish whether the OVN NB cluster has already existed] ******* 2026-04-24 04:59:50.681248 | orchestrator | Friday 24 April 2026 04:59:25 +0000 (0:00:01.409) 0:03:17.870 ********** 2026-04-24 04:59:50.681259 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681284 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681295 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681305 | orchestrator | 2026-04-24 04:59:50.681316 | orchestrator | TASK [ovn-db : Establish whether the OVN SB cluster has already existed] ******* 2026-04-24 04:59:50.681327 | orchestrator | Friday 24 April 2026 04:59:26 +0000 (0:00:01.348) 0:03:19.219 ********** 2026-04-24 04:59:50.681338 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681367 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681379 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681389 | orchestrator | 2026-04-24 04:59:50.681400 | orchestrator | TASK [ovn-db : Check if running on all OVN NB DB hosts] ************************ 2026-04-24 04:59:50.681411 | orchestrator | Friday 24 April 2026 04:59:27 +0000 (0:00:01.355) 0:03:20.575 ********** 2026-04-24 04:59:50.681422 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:59:50.681432 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:59:50.681443 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:59:50.681454 | orchestrator | 2026-04-24 04:59:50.681464 | orchestrator | TASK [ovn-db : Check OVN NB service port liveness] ***************************** 2026-04-24 04:59:50.681475 | orchestrator | Friday 24 April 2026 04:59:29 +0000 (0:00:01.551) 0:03:22.127 ********** 2026-04-24 04:59:50.681493 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681504 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681534 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681546 | orchestrator | 2026-04-24 04:59:50.681557 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB service port liveness] ************* 2026-04-24 04:59:50.681568 | orchestrator | Friday 24 April 2026 04:59:31 +0000 (0:00:01.787) 0:03:23.914 ********** 2026-04-24 04:59:50.681578 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681589 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681599 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681610 | orchestrator | 2026-04-24 04:59:50.681620 | orchestrator | TASK [ovn-db : Get OVN NB database information] ******************************** 2026-04-24 04:59:50.681631 | orchestrator | Friday 24 April 2026 04:59:32 +0000 (0:00:01.442) 0:03:25.356 ********** 2026-04-24 04:59:50.681641 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681652 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681663 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681673 | orchestrator | 2026-04-24 04:59:50.681684 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB leader/follower role] ************** 2026-04-24 04:59:50.681694 | orchestrator | Friday 24 April 2026 04:59:34 +0000 (0:00:01.898) 0:03:27.254 ********** 2026-04-24 04:59:50.681705 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681716 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681726 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681737 | orchestrator | 2026-04-24 04:59:50.681747 | orchestrator | TASK [ovn-db : Fail on existing OVN NB cluster with no leader] ***************** 2026-04-24 04:59:50.681758 | orchestrator | Friday 24 April 2026 04:59:36 +0000 (0:00:01.621) 0:03:28.876 ********** 2026-04-24 04:59:50.681769 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:59:50.681779 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:59:50.681790 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:59:50.681800 | orchestrator | 2026-04-24 04:59:50.681811 | orchestrator | TASK [ovn-db : Check if running on all OVN SB DB hosts] ************************ 2026-04-24 04:59:50.681821 | orchestrator | Friday 24 April 2026 04:59:37 +0000 (0:00:01.333) 0:03:30.210 ********** 2026-04-24 04:59:50.681832 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:59:50.681843 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:59:50.681853 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:59:50.681864 | orchestrator | 2026-04-24 04:59:50.681874 | orchestrator | TASK [ovn-db : Check OVN SB service port liveness] ***************************** 2026-04-24 04:59:50.681885 | orchestrator | Friday 24 April 2026 04:59:38 +0000 (0:00:01.348) 0:03:31.558 ********** 2026-04-24 04:59:50.681895 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681906 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681917 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681927 | orchestrator | 2026-04-24 04:59:50.681938 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB service port liveness] ************* 2026-04-24 04:59:50.681948 | orchestrator | Friday 24 April 2026 04:59:40 +0000 (0:00:02.075) 0:03:33.633 ********** 2026-04-24 04:59:50.681959 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.681969 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.681980 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.681990 | orchestrator | 2026-04-24 04:59:50.682001 | orchestrator | TASK [ovn-db : Get OVN SB database information] ******************************** 2026-04-24 04:59:50.682011 | orchestrator | Friday 24 April 2026 04:59:42 +0000 (0:00:01.383) 0:03:35.017 ********** 2026-04-24 04:59:50.682085 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.682096 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.682107 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.682117 | orchestrator | 2026-04-24 04:59:50.682138 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB leader/follower role] ************** 2026-04-24 04:59:50.682149 | orchestrator | Friday 24 April 2026 04:59:44 +0000 (0:00:01.950) 0:03:36.968 ********** 2026-04-24 04:59:50.682159 | orchestrator | ok: [testbed-node-0] 2026-04-24 04:59:50.682170 | orchestrator | ok: [testbed-node-1] 2026-04-24 04:59:50.682181 | orchestrator | ok: [testbed-node-2] 2026-04-24 04:59:50.682199 | orchestrator | 2026-04-24 04:59:50.682210 | orchestrator | TASK [ovn-db : Fail on existing OVN SB cluster with no leader] ***************** 2026-04-24 04:59:50.682220 | orchestrator | Friday 24 April 2026 04:59:45 +0000 (0:00:01.415) 0:03:38.383 ********** 2026-04-24 04:59:50.682231 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:59:50.682242 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:59:50.682252 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:59:50.682263 | orchestrator | 2026-04-24 04:59:50.682273 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-24 04:59:50.682284 | orchestrator | Friday 24 April 2026 04:59:47 +0000 (0:00:01.580) 0:03:39.964 ********** 2026-04-24 04:59:50.682295 | orchestrator | skipping: [testbed-node-0] 2026-04-24 04:59:50.682305 | orchestrator | skipping: [testbed-node-1] 2026-04-24 04:59:50.682316 | orchestrator | skipping: [testbed-node-2] 2026-04-24 04:59:50.682326 | orchestrator | 2026-04-24 04:59:50.682337 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-24 04:59:50.682348 | orchestrator | Friday 24 April 2026 04:59:48 +0000 (0:00:01.709) 0:03:41.673 ********** 2026-04-24 04:59:50.682376 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181310 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181419 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181436 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181448 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181459 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181495 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181577 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:59:57.181611 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181623 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:59:57.181635 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181646 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 04:59:57.181658 | orchestrator | 2026-04-24 04:59:57.181671 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-24 04:59:57.181685 | orchestrator | Friday 24 April 2026 04:59:52 +0000 (0:00:03.817) 0:03:45.491 ********** 2026-04-24 04:59:57.181697 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181716 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181728 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181745 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 04:59:57.181764 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.229820 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.229913 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.229925 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:12.229955 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.229964 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:12.229972 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.229980 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:12.229988 | orchestrator | 2026-04-24 05:00:12.229997 | orchestrator | TASK [ovn-db : Ensure configuration for relays exists] ************************* 2026-04-24 05:00:12.230006 | orchestrator | Friday 24 April 2026 04:59:59 +0000 (0:00:06.585) 0:03:52.076 ********** 2026-04-24 05:00:12.230061 | orchestrator | included: /ansible/roles/ovn-db/tasks/config-relay.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=1) 2026-04-24 05:00:12.230071 | orchestrator | 2026-04-24 05:00:12.230079 | orchestrator | TASK [ovn-db : Ensuring config directories exist for OVN relay containers] ***** 2026-04-24 05:00:12.230086 | orchestrator | Friday 24 April 2026 05:00:01 +0000 (0:00:01.989) 0:03:54.067 ********** 2026-04-24 05:00:12.230094 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:00:12.230102 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:00:12.230121 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:00:12.230129 | orchestrator | 2026-04-24 05:00:12.230137 | orchestrator | TASK [ovn-db : Copying over config.json files for OVN relay services] ********** 2026-04-24 05:00:12.230144 | orchestrator | Friday 24 April 2026 05:00:03 +0000 (0:00:01.699) 0:03:55.766 ********** 2026-04-24 05:00:12.230151 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:00:12.230159 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:00:12.230239 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:00:12.230252 | orchestrator | 2026-04-24 05:00:12.230260 | orchestrator | TASK [ovn-db : Generate config files for OVN relay services] ******************* 2026-04-24 05:00:12.230267 | orchestrator | Friday 24 April 2026 05:00:06 +0000 (0:00:03.043) 0:03:58.810 ********** 2026-04-24 05:00:12.230274 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:00:12.230289 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:00:12.230296 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:00:12.230303 | orchestrator | 2026-04-24 05:00:12.230310 | orchestrator | TASK [service-check-containers : ovn_db | Check containers] ******************** 2026-04-24 05:00:12.230318 | orchestrator | Friday 24 April 2026 05:00:08 +0000 (0:00:02.515) 0:04:01.326 ********** 2026-04-24 05:00:12.230326 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.230335 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.230343 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.230351 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.230363 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.230370 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:12.230387 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:17.499761 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.500678 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:17.500749 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:00:17.500773 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.500792 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.500813 | orchestrator | 2026-04-24 05:00:17.500834 | orchestrator | TASK [service-check-containers : ovn_db | Notify handlers to restart containers] *** 2026-04-24 05:00:17.500854 | orchestrator | Friday 24 April 2026 05:00:13 +0000 (0:00:05.108) 0:04:06.434 ********** 2026-04-24 05:00:17.500895 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 05:00:17.500914 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 05:00:17.500932 | orchestrator | } 2026-04-24 05:00:17.500949 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 05:00:17.500965 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 05:00:17.500980 | orchestrator | } 2026-04-24 05:00:17.500997 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 05:00:17.501013 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 05:00:17.501029 | orchestrator | } 2026-04-24 05:00:17.501046 | orchestrator | 2026-04-24 05:00:17.501065 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 05:00:17.501082 | orchestrator | Friday 24 April 2026 05:00:15 +0000 (0:00:01.452) 0:04:07.887 ********** 2026-04-24 05:00:17.501101 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501178 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501201 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501220 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501238 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501257 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501301 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501321 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501353 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 05:00:17.501386 | orchestrator | included: /ansible/roles/service-check-containers/tasks/iterated.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 05:02:09.914513 | orchestrator | 2026-04-24 05:02:09.914652 | orchestrator | TASK [service-check-containers : ovn_db | Check containers with iteration] ***** 2026-04-24 05:02:09.914671 | orchestrator | Friday 24 April 2026 05:00:18 +0000 (0:00:03.600) 0:04:11.487 ********** 2026-04-24 05:02:09.914682 | orchestrator | changed: [testbed-node-0] => (item=1) 2026-04-24 05:02:09.914694 | orchestrator | changed: [testbed-node-1] => (item=1) 2026-04-24 05:02:09.914704 | orchestrator | changed: [testbed-node-2] => (item=1) 2026-04-24 05:02:09.914714 | orchestrator | 2026-04-24 05:02:09.914724 | orchestrator | TASK [service-check-containers : ovn_db | Notify handlers to restart containers] *** 2026-04-24 05:02:09.914735 | orchestrator | Friday 24 April 2026 05:00:40 +0000 (0:00:21.487) 0:04:32.975 ********** 2026-04-24 05:02:09.914745 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 05:02:09.914755 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 05:02:09.914765 | orchestrator | } 2026-04-24 05:02:09.914775 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 05:02:09.914785 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 05:02:09.914794 | orchestrator | } 2026-04-24 05:02:09.914804 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 05:02:09.914814 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 05:02:09.914823 | orchestrator | } 2026-04-24 05:02:09.914833 | orchestrator | 2026-04-24 05:02:09.914843 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 05:02:09.914852 | orchestrator | Friday 24 April 2026 05:00:41 +0000 (0:00:01.554) 0:04:34.529 ********** 2026-04-24 05:02:09.914862 | orchestrator | 2026-04-24 05:02:09.914872 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 05:02:09.914882 | orchestrator | Friday 24 April 2026 05:00:42 +0000 (0:00:00.454) 0:04:34.984 ********** 2026-04-24 05:02:09.914891 | orchestrator | 2026-04-24 05:02:09.914901 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-24 05:02:09.914911 | orchestrator | Friday 24 April 2026 05:00:42 +0000 (0:00:00.482) 0:04:35.467 ********** 2026-04-24 05:02:09.914920 | orchestrator | 2026-04-24 05:02:09.914930 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-24 05:02:09.914939 | orchestrator | Friday 24 April 2026 05:00:43 +0000 (0:00:00.795) 0:04:36.263 ********** 2026-04-24 05:02:09.914949 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:02:09.914959 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:02:09.914993 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:02:09.915004 | orchestrator | 2026-04-24 05:02:09.915013 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-24 05:02:09.915023 | orchestrator | Friday 24 April 2026 05:00:59 +0000 (0:00:16.424) 0:04:52.687 ********** 2026-04-24 05:02:09.915034 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:02:09.915046 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:02:09.915057 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:02:09.915070 | orchestrator | 2026-04-24 05:02:09.915082 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db-relay container] ******************* 2026-04-24 05:02:09.915093 | orchestrator | Friday 24 April 2026 05:01:16 +0000 (0:00:16.312) 0:05:09.000 ********** 2026-04-24 05:02:09.915105 | orchestrator | changed: [testbed-node-0] => (item=1) 2026-04-24 05:02:09.915116 | orchestrator | changed: [testbed-node-2] => (item=1) 2026-04-24 05:02:09.915127 | orchestrator | changed: [testbed-node-1] => (item=1) 2026-04-24 05:02:09.915138 | orchestrator | 2026-04-24 05:02:09.915150 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-24 05:02:09.915176 | orchestrator | Friday 24 April 2026 05:01:32 +0000 (0:00:15.789) 0:05:24.789 ********** 2026-04-24 05:02:09.915187 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:02:09.915198 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:02:09.915210 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:02:09.915221 | orchestrator | 2026-04-24 05:02:09.915233 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-24 05:02:09.915244 | orchestrator | Friday 24 April 2026 05:01:49 +0000 (0:00:17.115) 0:05:41.904 ********** 2026-04-24 05:02:09.915256 | orchestrator | Pausing for 5 seconds 2026-04-24 05:02:09.915268 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:02:09.915279 | orchestrator | 2026-04-24 05:02:09.915290 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-24 05:02:09.915301 | orchestrator | Friday 24 April 2026 05:01:55 +0000 (0:00:06.187) 0:05:48.092 ********** 2026-04-24 05:02:09.915313 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:02:09.915325 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:02:09.915336 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:02:09.915347 | orchestrator | 2026-04-24 05:02:09.915359 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-24 05:02:09.915371 | orchestrator | Friday 24 April 2026 05:01:57 +0000 (0:00:01.856) 0:05:49.948 ********** 2026-04-24 05:02:09.915383 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:02:09.915395 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:02:09.915404 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:02:09.915414 | orchestrator | 2026-04-24 05:02:09.915423 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-24 05:02:09.915433 | orchestrator | Friday 24 April 2026 05:01:59 +0000 (0:00:02.010) 0:05:51.959 ********** 2026-04-24 05:02:09.915443 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:02:09.915452 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:02:09.915462 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:02:09.915472 | orchestrator | 2026-04-24 05:02:09.915481 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-24 05:02:09.915491 | orchestrator | Friday 24 April 2026 05:02:01 +0000 (0:00:01.813) 0:05:53.772 ********** 2026-04-24 05:02:09.915500 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:02:09.915510 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:02:09.915520 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:02:09.915529 | orchestrator | 2026-04-24 05:02:09.915539 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-24 05:02:09.915549 | orchestrator | Friday 24 April 2026 05:02:02 +0000 (0:00:01.758) 0:05:55.531 ********** 2026-04-24 05:02:09.915558 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:02:09.915568 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:02:09.915577 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:02:09.915587 | orchestrator | 2026-04-24 05:02:09.915596 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-24 05:02:09.915656 | orchestrator | Friday 24 April 2026 05:02:04 +0000 (0:00:02.017) 0:05:57.548 ********** 2026-04-24 05:02:09.915668 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:02:09.915678 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:02:09.915688 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:02:09.915697 | orchestrator | 2026-04-24 05:02:09.915707 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db-relay] *************************************** 2026-04-24 05:02:09.915716 | orchestrator | Friday 24 April 2026 05:02:06 +0000 (0:00:02.087) 0:05:59.635 ********** 2026-04-24 05:02:09.915726 | orchestrator | ok: [testbed-node-0] => (item=1) 2026-04-24 05:02:09.915736 | orchestrator | ok: [testbed-node-1] => (item=1) 2026-04-24 05:02:09.915746 | orchestrator | ok: [testbed-node-2] => (item=1) 2026-04-24 05:02:09.915755 | orchestrator | 2026-04-24 05:02:09.915765 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 05:02:09.915775 | orchestrator | testbed-node-0 : ok=48  changed=15  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-24 05:02:09.915786 | orchestrator | testbed-node-1 : ok=49  changed=17  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 05:02:09.915795 | orchestrator | testbed-node-2 : ok=47  changed=15  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-24 05:02:09.915805 | orchestrator | testbed-node-3 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 05:02:09.915815 | orchestrator | testbed-node-4 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 05:02:09.915824 | orchestrator | testbed-node-5 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 05:02:09.915834 | orchestrator | 2026-04-24 05:02:09.915843 | orchestrator | 2026-04-24 05:02:09.915853 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 05:02:09.915863 | orchestrator | Friday 24 April 2026 05:02:09 +0000 (0:00:02.617) 0:06:02.253 ********** 2026-04-24 05:02:09.915873 | orchestrator | =============================================================================== 2026-04-24 05:02:09.915882 | orchestrator | ovn-controller : Restart ovn-controller container --------------------- 131.87s 2026-04-24 05:02:09.915892 | orchestrator | service-check-containers : ovn_db | Check containers with iteration ---- 21.49s 2026-04-24 05:02:09.915901 | orchestrator | ovn-controller : Configure OVN in OVSDB -------------------------------- 19.84s 2026-04-24 05:02:09.915911 | orchestrator | ovn-db : Restart ovn-northd container ---------------------------------- 17.12s 2026-04-24 05:02:09.915920 | orchestrator | ovn-db : Restart ovn-nb-db container ----------------------------------- 16.42s 2026-04-24 05:02:09.915930 | orchestrator | ovn-db : Restart ovn-sb-db container ----------------------------------- 16.31s 2026-04-24 05:02:09.915944 | orchestrator | ovn-db : Restart ovn-sb-db-relay container ----------------------------- 15.79s 2026-04-24 05:02:09.915954 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 6.59s 2026-04-24 05:02:09.915964 | orchestrator | ovn-db : Wait for leader election --------------------------------------- 6.19s 2026-04-24 05:02:09.915973 | orchestrator | service-check-containers : ovn_db | Check containers -------------------- 5.11s 2026-04-24 05:02:09.915983 | orchestrator | ovn-controller : include_tasks ------------------------------------------ 4.00s 2026-04-24 05:02:09.915992 | orchestrator | ovn-controller : Create br-int bridge on OpenvSwitch -------------------- 3.87s 2026-04-24 05:02:09.916002 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 3.82s 2026-04-24 05:02:09.916011 | orchestrator | Group hosts based on Kolla action --------------------------------------- 3.61s 2026-04-24 05:02:09.916021 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.60s 2026-04-24 05:02:09.916037 | orchestrator | Group hosts based on enabled services ----------------------------------- 3.42s 2026-04-24 05:02:09.916046 | orchestrator | ovn-controller : Flush handlers ----------------------------------------- 3.31s 2026-04-24 05:02:09.916056 | orchestrator | ovn-controller : Copying over systemd override -------------------------- 3.21s 2026-04-24 05:02:09.916065 | orchestrator | ovn-db : Copying over config.json files for OVN relay services ---------- 3.04s 2026-04-24 05:02:09.916075 | orchestrator | ovn-controller : Ensuring config directories exist ---------------------- 2.69s 2026-04-24 05:02:10.092218 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-24 05:02:10.092306 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-24 05:02:10.092320 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/100-ceph-with-ansible.sh 2026-04-24 05:02:10.100442 | orchestrator | + set -e 2026-04-24 05:02:10.100496 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 05:02:10.100502 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 05:02:10.100508 | orchestrator | ++ INTERACTIVE=false 2026-04-24 05:02:10.100513 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 05:02:10.100517 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 05:02:10.100522 | orchestrator | + osism apply ceph-rolling_update -e ireallymeanit=yes 2026-04-24 05:02:11.357758 | orchestrator | 2026-04-24 05:02:11 | INFO  | Prepare task for execution of ceph-rolling_update. 2026-04-24 05:02:11.419969 | orchestrator | 2026-04-24 05:02:11 | INFO  | Task 84a0e888-4164-4fc2-9f4d-86383481892e (ceph-rolling_update) was prepared for execution. 2026-04-24 05:02:11.420054 | orchestrator | 2026-04-24 05:02:11 | INFO  | It takes a moment until task 84a0e888-4164-4fc2-9f4d-86383481892e (ceph-rolling_update) has been started and output is visible here. 2026-04-24 05:03:35.061015 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-24 05:03:35.061130 | orchestrator | 2.16.14 2026-04-24 05:03:35.061142 | orchestrator | 2026-04-24 05:03:35.061151 | orchestrator | PLAY [Confirm whether user really meant to upgrade the cluster] **************** 2026-04-24 05:03:35.061160 | orchestrator | 2026-04-24 05:03:35.061168 | orchestrator | TASK [Exit playbook, if user did not mean to upgrade cluster] ****************** 2026-04-24 05:03:35.061175 | orchestrator | Friday 24 April 2026 05:02:20 +0000 (0:00:02.270) 0:00:02.270 ********** 2026-04-24 05:03:35.061183 | orchestrator | skipping: [localhost] 2026-04-24 05:03:35.061190 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: rbdmirrors 2026-04-24 05:03:35.061199 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: nfss 2026-04-24 05:03:35.061206 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: clients 2026-04-24 05:03:35.061213 | orchestrator | 2026-04-24 05:03:35.061220 | orchestrator | PLAY [Gather facts and check the init system] ********************************** 2026-04-24 05:03:35.061227 | orchestrator | 2026-04-24 05:03:35.061235 | orchestrator | TASK [Gather facts on all Ceph hosts for following reference] ****************** 2026-04-24 05:03:35.061242 | orchestrator | Friday 24 April 2026 05:02:23 +0000 (0:00:03.375) 0:00:05.645 ********** 2026-04-24 05:03:35.061249 | orchestrator | ok: [testbed-node-0] => { 2026-04-24 05:03:35.061256 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-24 05:03:35.061264 | orchestrator | } 2026-04-24 05:03:35.061271 | orchestrator | ok: [testbed-node-1] => { 2026-04-24 05:03:35.061279 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-24 05:03:35.061286 | orchestrator | } 2026-04-24 05:03:35.061293 | orchestrator | ok: [testbed-node-2] => { 2026-04-24 05:03:35.061300 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-24 05:03:35.061307 | orchestrator | } 2026-04-24 05:03:35.061315 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 05:03:35.061322 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-24 05:03:35.061329 | orchestrator | } 2026-04-24 05:03:35.061336 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 05:03:35.061343 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-24 05:03:35.061372 | orchestrator | } 2026-04-24 05:03:35.061380 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 05:03:35.061387 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-24 05:03:35.061395 | orchestrator | } 2026-04-24 05:03:35.061402 | orchestrator | ok: [testbed-manager] => { 2026-04-24 05:03:35.061409 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-24 05:03:35.061416 | orchestrator | } 2026-04-24 05:03:35.061424 | orchestrator | 2026-04-24 05:03:35.061431 | orchestrator | TASK [Gather facts] ************************************************************ 2026-04-24 05:03:35.061438 | orchestrator | Friday 24 April 2026 05:02:28 +0000 (0:00:04.834) 0:00:10.480 ********** 2026-04-24 05:03:35.061445 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:35.061452 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:03:35.061459 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:03:35.061466 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:03:35.061473 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:03:35.061481 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:03:35.061488 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.061495 | orchestrator | 2026-04-24 05:03:35.061514 | orchestrator | TASK [Gather and delegate facts] *********************************************** 2026-04-24 05:03:35.061521 | orchestrator | Friday 24 April 2026 05:02:34 +0000 (0:00:05.860) 0:00:16.340 ********** 2026-04-24 05:03:35.061529 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:03:35.061536 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:03:35.061543 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:03:35.061550 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:03:35.061558 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:03:35.061565 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:03:35.061572 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:03:35.061581 | orchestrator | 2026-04-24 05:03:35.061589 | orchestrator | TASK [Set_fact rolling_update] ************************************************* 2026-04-24 05:03:35.061598 | orchestrator | Friday 24 April 2026 05:03:05 +0000 (0:00:30.618) 0:00:46.959 ********** 2026-04-24 05:03:35.061606 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.061615 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.061623 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.061631 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.061640 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.061664 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.061671 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.061678 | orchestrator | 2026-04-24 05:03:35.061685 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:03:35.061692 | orchestrator | Friday 24 April 2026 05:03:07 +0000 (0:00:02.159) 0:00:49.119 ********** 2026-04-24 05:03:35.061700 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-24 05:03:35.061709 | orchestrator | 2026-04-24 05:03:35.061716 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:03:35.061723 | orchestrator | Friday 24 April 2026 05:03:10 +0000 (0:00:02.666) 0:00:51.786 ********** 2026-04-24 05:03:35.061731 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.061738 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.061745 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.061752 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.061759 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.061766 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.061773 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.061786 | orchestrator | 2026-04-24 05:03:35.061806 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:03:35.061814 | orchestrator | Friday 24 April 2026 05:03:12 +0000 (0:00:02.600) 0:00:54.387 ********** 2026-04-24 05:03:35.061821 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.061828 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.061835 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.061843 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.061850 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.061857 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.061864 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.061871 | orchestrator | 2026-04-24 05:03:35.061879 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:03:35.061886 | orchestrator | Friday 24 April 2026 05:03:14 +0000 (0:00:02.006) 0:00:56.393 ********** 2026-04-24 05:03:35.061893 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.061900 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.061907 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.061914 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.061921 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.061928 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.061936 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.061943 | orchestrator | 2026-04-24 05:03:35.061950 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:03:35.061957 | orchestrator | Friday 24 April 2026 05:03:17 +0000 (0:00:02.465) 0:00:58.859 ********** 2026-04-24 05:03:35.061964 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.061972 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.061979 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.061986 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.061993 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.062000 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.062007 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.062059 | orchestrator | 2026-04-24 05:03:35.062070 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:03:35.062077 | orchestrator | Friday 24 April 2026 05:03:19 +0000 (0:00:01.912) 0:01:00.771 ********** 2026-04-24 05:03:35.062084 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.062092 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.062099 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.062106 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.062113 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.062121 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.062128 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.062135 | orchestrator | 2026-04-24 05:03:35.062142 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:03:35.062149 | orchestrator | Friday 24 April 2026 05:03:21 +0000 (0:00:02.158) 0:01:02.930 ********** 2026-04-24 05:03:35.062157 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.062164 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.062171 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.062178 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.062185 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.062193 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.062200 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.062207 | orchestrator | 2026-04-24 05:03:35.062214 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:03:35.062222 | orchestrator | Friday 24 April 2026 05:03:23 +0000 (0:00:01.905) 0:01:04.836 ********** 2026-04-24 05:03:35.062229 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:35.062236 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:03:35.062244 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:03:35.062255 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:03:35.062262 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:03:35.062270 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:03:35.062277 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:03:35.062290 | orchestrator | 2026-04-24 05:03:35.062297 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:03:35.062304 | orchestrator | Friday 24 April 2026 05:03:25 +0000 (0:00:02.445) 0:01:07.281 ********** 2026-04-24 05:03:35.062312 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.062319 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.062326 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.062333 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.062341 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.062348 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.062355 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.062362 | orchestrator | 2026-04-24 05:03:35.062369 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:03:35.062377 | orchestrator | Friday 24 April 2026 05:03:27 +0000 (0:00:01.989) 0:01:09.270 ********** 2026-04-24 05:03:35.062384 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:03:35.062391 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:03:35.062399 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:03:35.062406 | orchestrator | 2026-04-24 05:03:35.062413 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:03:35.062420 | orchestrator | Friday 24 April 2026 05:03:29 +0000 (0:00:01.926) 0:01:11.197 ********** 2026-04-24 05:03:35.062428 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:35.062435 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:35.062442 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:35.062449 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:35.062456 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:35.062464 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:35.062471 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:35.062478 | orchestrator | 2026-04-24 05:03:35.062485 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:03:35.062492 | orchestrator | Friday 24 April 2026 05:03:31 +0000 (0:00:02.107) 0:01:13.305 ********** 2026-04-24 05:03:35.062500 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:03:35.062507 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:03:35.062515 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:03:35.062522 | orchestrator | 2026-04-24 05:03:35.062529 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:03:35.062536 | orchestrator | Friday 24 April 2026 05:03:34 +0000 (0:00:03.314) 0:01:16.619 ********** 2026-04-24 05:03:35.062549 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:03:57.280386 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:03:57.280489 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:03:57.280503 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:57.280514 | orchestrator | 2026-04-24 05:03:57.280525 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:03:57.280536 | orchestrator | Friday 24 April 2026 05:03:36 +0000 (0:00:01.397) 0:01:18.017 ********** 2026-04-24 05:03:57.280548 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:03:57.280560 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:03:57.280570 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:03:57.280602 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:57.280612 | orchestrator | 2026-04-24 05:03:57.280622 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:03:57.280632 | orchestrator | Friday 24 April 2026 05:03:38 +0000 (0:00:01.888) 0:01:19.905 ********** 2026-04-24 05:03:57.280706 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:03:57.280722 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:03:57.280747 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:03:57.280758 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:57.280768 | orchestrator | 2026-04-24 05:03:57.280778 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:03:57.280788 | orchestrator | Friday 24 April 2026 05:03:39 +0000 (0:00:01.156) 0:01:21.062 ********** 2026-04-24 05:03:57.280800 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'a3168a73d7f5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:03:32.292232', 'end': '2026-04-24 05:03:32.348085', 'delta': '0:00:00.055853', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['a3168a73d7f5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:03:57.280831 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'cb6ff5b25438', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:03:32.876661', 'end': '2026-04-24 05:03:32.938192', 'delta': '0:00:00.061531', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['cb6ff5b25438'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:03:57.280843 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '4af70b8ccc8b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:03:33.712867', 'end': '2026-04-24 05:03:33.761288', 'delta': '0:00:00.048421', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['4af70b8ccc8b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:03:57.280860 | orchestrator | 2026-04-24 05:03:57.280871 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:03:57.280881 | orchestrator | Friday 24 April 2026 05:03:40 +0000 (0:00:01.200) 0:01:22.262 ********** 2026-04-24 05:03:57.280891 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:57.280902 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:57.280912 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:57.280921 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:57.280933 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:57.280944 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:57.280956 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:57.280968 | orchestrator | 2026-04-24 05:03:57.280979 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:03:57.280990 | orchestrator | Friday 24 April 2026 05:03:42 +0000 (0:00:02.164) 0:01:24.426 ********** 2026-04-24 05:03:57.281002 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:57.281013 | orchestrator | 2026-04-24 05:03:57.281024 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:03:57.281035 | orchestrator | Friday 24 April 2026 05:03:43 +0000 (0:00:01.245) 0:01:25.672 ********** 2026-04-24 05:03:57.281047 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:57.281058 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:57.281069 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:57.281080 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:57.281091 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:57.281103 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:57.281114 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:57.281124 | orchestrator | 2026-04-24 05:03:57.281134 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:03:57.281143 | orchestrator | Friday 24 April 2026 05:03:46 +0000 (0:00:02.170) 0:01:27.842 ********** 2026-04-24 05:03:57.281153 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:57.281163 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:03:57.281178 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:03:57.281187 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:03:57.281197 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:03:57.281207 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:03:57.281216 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-24 05:03:57.281226 | orchestrator | 2026-04-24 05:03:57.281235 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:03:57.281245 | orchestrator | Friday 24 April 2026 05:03:49 +0000 (0:00:03.340) 0:01:31.183 ********** 2026-04-24 05:03:57.281255 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:03:57.281264 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:03:57.281274 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:03:57.281284 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:03:57.281293 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:03:57.281303 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:03:57.281312 | orchestrator | ok: [testbed-manager] 2026-04-24 05:03:57.281322 | orchestrator | 2026-04-24 05:03:57.281331 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:03:57.281341 | orchestrator | Friday 24 April 2026 05:03:51 +0000 (0:00:02.191) 0:01:33.374 ********** 2026-04-24 05:03:57.281351 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:57.281360 | orchestrator | 2026-04-24 05:03:57.281370 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:03:57.281380 | orchestrator | Friday 24 April 2026 05:03:52 +0000 (0:00:01.100) 0:01:34.475 ********** 2026-04-24 05:03:57.281395 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:57.281405 | orchestrator | 2026-04-24 05:03:57.281415 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:03:57.281425 | orchestrator | Friday 24 April 2026 05:03:54 +0000 (0:00:01.245) 0:01:35.720 ********** 2026-04-24 05:03:57.281434 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:57.281444 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:03:57.281454 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:03:57.281464 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:03:57.281473 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:03:57.281483 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:03:57.281492 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:03:57.281502 | orchestrator | 2026-04-24 05:03:57.281512 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:03:57.281522 | orchestrator | Friday 24 April 2026 05:03:56 +0000 (0:00:02.477) 0:01:38.198 ********** 2026-04-24 05:03:57.281531 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:03:57.281541 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:03:57.281550 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:03:57.281560 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:03:57.281569 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:03:57.281579 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:03:57.281595 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:09.065215 | orchestrator | 2026-04-24 05:04:09.065324 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:04:09.065342 | orchestrator | Friday 24 April 2026 05:03:58 +0000 (0:00:01.979) 0:01:40.178 ********** 2026-04-24 05:04:09.065355 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:09.065367 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:09.065379 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:09.065390 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:09.065401 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:09.065412 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:09.065464 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:09.065485 | orchestrator | 2026-04-24 05:04:09.065503 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:04:09.065520 | orchestrator | Friday 24 April 2026 05:04:00 +0000 (0:00:02.175) 0:01:42.353 ********** 2026-04-24 05:04:09.065537 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:09.065557 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:09.065574 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:09.065592 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:09.065611 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:09.065630 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:09.065693 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:09.065708 | orchestrator | 2026-04-24 05:04:09.065719 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:04:09.065731 | orchestrator | Friday 24 April 2026 05:04:02 +0000 (0:00:01.937) 0:01:44.291 ********** 2026-04-24 05:04:09.065742 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:09.065756 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:09.065769 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:09.065783 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:09.065796 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:09.065809 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:09.065820 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:09.065831 | orchestrator | 2026-04-24 05:04:09.065842 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:04:09.065853 | orchestrator | Friday 24 April 2026 05:04:04 +0000 (0:00:02.137) 0:01:46.428 ********** 2026-04-24 05:04:09.065864 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:09.065875 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:09.065913 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:09.065924 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:09.065935 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:09.065946 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:09.065957 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:09.065968 | orchestrator | 2026-04-24 05:04:09.065979 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:04:09.065991 | orchestrator | Friday 24 April 2026 05:04:06 +0000 (0:00:02.019) 0:01:48.448 ********** 2026-04-24 05:04:09.066002 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:09.066075 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:09.066089 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:09.066100 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:09.066111 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:09.066122 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:09.066181 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:09.066195 | orchestrator | 2026-04-24 05:04:09.066206 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:04:09.066217 | orchestrator | Friday 24 April 2026 05:04:08 +0000 (0:00:02.107) 0:01:50.556 ********** 2026-04-24 05:04:09.066232 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.066247 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.066259 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.066293 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-10-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:04:09.066307 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.066319 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.066341 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.066364 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '890efc9d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:09.066379 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.066399 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238054 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238145 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238181 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238194 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-08-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:04:09.238221 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238232 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238242 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238275 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '922a5bfc', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:09.238297 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238312 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238323 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:09.238335 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238345 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238355 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.238365 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-07-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:04:09.238382 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.436711 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.436807 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.436843 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f837a177', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:09.436861 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.436873 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.436905 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:09.436937 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.436981 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'uuids': ['6d15df4f-c4ce-4002-ae8a-c5ea103b6315'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R']}})  2026-04-24 05:04:09.436996 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '92dd2642', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:09.437014 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3']}})  2026-04-24 05:04:09.437027 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.437039 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.437051 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-05-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:04:09.437079 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.620496 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx', 'dm-uuid-CRYPT-LUKS2-7bd2335635b44d1cb53d2df716853f40-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:04:09.620615 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.620711 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:09.620747 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'uuids': ['7bd23356-35b4-4d1c-b53d-2df716853f40'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx']}})  2026-04-24 05:04:09.620762 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f']}})  2026-04-24 05:04:09.620775 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.620811 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3ccf7d33', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:09.620854 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.620872 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.620884 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.620896 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R', 'dm-uuid-CRYPT-LUKS2-6d15df4fc4ce4002ae8ac5ea103b6315-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:04:09.620908 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'uuids': ['69ee4aae-da3e-49ce-8e1d-04f23a1ac1f1'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13']}})  2026-04-24 05:04:09.620935 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '36b4f46e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:09.810711 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:09.810828 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1']}})  2026-04-24 05:04:09.810855 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.810896 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.810917 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:04:09.810937 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.810983 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.811002 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF', 'dm-uuid-CRYPT-LUKS2-57e78844afcf406497404f4a368c2f85-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:04:09.811044 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.811068 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'uuids': ['57e78844-afcf-4064-9740-4f4a368c2f85'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF']}})  2026-04-24 05:04:09.811095 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'uuids': ['6d348d92-84de-4a0c-bfda-a8ce4c95c396'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve']}})  2026-04-24 05:04:09.811113 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3']}})  2026-04-24 05:04:09.811131 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.811176 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8aa3c015', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:09.948119 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '076ca587', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:09.948236 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948256 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71']}})  2026-04-24 05:04:09.948319 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948333 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948344 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948356 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13', 'dm-uuid-CRYPT-LUKS2-69ee4aaeda3e49ce8e1d04f23a1ac1f1-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948370 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:09.948401 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-04-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:04:09.948414 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948431 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948442 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7', 'dm-uuid-CRYPT-LUKS2-99c37d5f37cf4f86bc5baee17726ca8d-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948463 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948474 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948485 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948496 | orchestrator | skipping: [testbed-manager] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-35-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1060', 'sectorsize': '2048', 'size': '530.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:04:09.948508 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:09.948528 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'uuids': ['99c37d5f-37cf-4f86-bc5b-aee17726ca8d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7']}})  2026-04-24 05:04:10.030421 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:10.030510 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:10.030547 | orchestrator | skipping: [testbed-manager] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0df50765', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part16', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part14', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part15', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part1', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:10.030562 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:10.030589 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f']}})  2026-04-24 05:04:10.030606 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:10.030624 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:10.030669 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:10.030681 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '457a59b4', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:04:10.030692 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:10.030702 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:04:10.030731 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve', 'dm-uuid-CRYPT-LUKS2-6d348d9284de4a0cbfdaa8ce4c95c396-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:04:11.528256 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:11.528359 | orchestrator | 2026-04-24 05:04:11.528375 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:04:11.528390 | orchestrator | Friday 24 April 2026 05:04:11 +0000 (0:00:02.300) 0:01:52.856 ********** 2026-04-24 05:04:11.528404 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528418 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528450 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528475 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-10-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528488 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528515 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528566 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528583 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '890efc9d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528597 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.528628 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840554 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:11.840708 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840739 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840760 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840782 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-08-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840803 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840874 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840920 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840945 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '922a5bfc', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.840969 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.841011 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:11.841031 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:11.841053 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.055728 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.055829 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.055846 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-07-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.055859 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.055911 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.055924 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.055961 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f837a177', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.055978 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.056001 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.056014 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:12.056028 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.056049 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'uuids': ['6d15df4f-c4ce-4002-ae8a-c5ea103b6315'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233674 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '92dd2642', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233748 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233791 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233799 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233806 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-05-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233824 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233831 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx', 'dm-uuid-CRYPT-LUKS2-7bd2335635b44d1cb53d2df716853f40-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233836 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233850 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'uuids': ['7bd23356-35b4-4d1c-b53d-2df716853f40'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233856 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.233866 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310384 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'uuids': ['69ee4aae-da3e-49ce-8e1d-04f23a1ac1f1'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310506 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310539 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '36b4f46e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310553 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310589 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3ccf7d33', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310612 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'uuids': ['6d348d92-84de-4a0c-bfda-a8ce4c95c396'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310630 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310696 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '076ca587', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.310718 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406623 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406808 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406825 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406837 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406848 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406859 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406936 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R', 'dm-uuid-CRYPT-LUKS2-6d15df4fc4ce4002ae8ac5ea103b6315-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406959 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-04-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.406972 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:12.406991 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.407002 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.407014 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7', 'dm-uuid-CRYPT-LUKS2-99c37d5f37cf4f86bc5baee17726ca8d-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.407033 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480427 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF', 'dm-uuid-CRYPT-LUKS2-57e78844afcf406497404f4a368c2f85-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480519 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480552 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480566 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'uuids': ['57e78844-afcf-4064-9740-4f4a368c2f85'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480580 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480676 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'uuids': ['99c37d5f-37cf-4f86-bc5b-aee17726ca8d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480700 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480728 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.480761 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8aa3c015', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.548864 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.548972 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.548991 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.549004 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.549016 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.549046 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.549076 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13', 'dm-uuid-CRYPT-LUKS2-69ee4aaeda3e49ce8e1d04f23a1ac1f1-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.549097 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '457a59b4', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.549111 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-35-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1060', 'sectorsize': '2048', 'size': '530.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:12.549130 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:12.549177 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068130 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068261 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068279 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068292 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068305 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve', 'dm-uuid-CRYPT-LUKS2-6d348d9284de4a0cbfdaa8ce4c95c396-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068340 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:21.068385 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0df50765', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part16', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part14', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part15', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part1', 'scsi-SQEMU_QEMU_HARDDISK_0df50765-4d8a-4916-b175-030c2009f2f3-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068401 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068413 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:04:21.068432 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:21.068466 | orchestrator | 2026-04-24 05:04:21.068487 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:04:21.068507 | orchestrator | Friday 24 April 2026 05:04:13 +0000 (0:00:02.614) 0:01:55.471 ********** 2026-04-24 05:04:21.068525 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:04:21.068538 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:04:21.068548 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:04:21.068559 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:04:21.068570 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:04:21.068580 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:04:21.068591 | orchestrator | ok: [testbed-manager] 2026-04-24 05:04:21.068602 | orchestrator | 2026-04-24 05:04:21.068613 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:04:21.068623 | orchestrator | Friday 24 April 2026 05:04:16 +0000 (0:00:02.608) 0:01:58.079 ********** 2026-04-24 05:04:21.068660 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:04:21.068674 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:04:21.068688 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:04:21.068700 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:04:21.068712 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:04:21.068724 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:04:21.068737 | orchestrator | ok: [testbed-manager] 2026-04-24 05:04:21.068750 | orchestrator | 2026-04-24 05:04:21.068763 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:04:21.068775 | orchestrator | Friday 24 April 2026 05:04:18 +0000 (0:00:02.067) 0:02:00.146 ********** 2026-04-24 05:04:21.068788 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:04:21.068800 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:04:21.068813 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:04:21.068825 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:04:21.068838 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:21.068851 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:04:21.068864 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:04:21.068876 | orchestrator | 2026-04-24 05:04:21.068890 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:04:21.068911 | orchestrator | Friday 24 April 2026 05:04:21 +0000 (0:00:02.624) 0:02:02.771 ********** 2026-04-24 05:04:50.104284 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:50.104431 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:50.104458 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:50.104477 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.104496 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:50.104515 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:50.104533 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:50.104552 | orchestrator | 2026-04-24 05:04:50.104571 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:04:50.104592 | orchestrator | Friday 24 April 2026 05:04:22 +0000 (0:00:01.922) 0:02:04.693 ********** 2026-04-24 05:04:50.104612 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:50.104699 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:50.104718 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:50.104736 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.104754 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:50.104775 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:50.104895 | orchestrator | ok: [testbed-manager -> testbed-node-2(192.168.16.12)] 2026-04-24 05:04:50.104918 | orchestrator | 2026-04-24 05:04:50.104938 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:04:50.104957 | orchestrator | Friday 24 April 2026 05:04:25 +0000 (0:00:02.711) 0:02:07.404 ********** 2026-04-24 05:04:50.104974 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:50.105027 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:50.105050 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:50.105069 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.105088 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:50.105106 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:50.105125 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:50.105143 | orchestrator | 2026-04-24 05:04:50.105181 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:04:50.105200 | orchestrator | Friday 24 April 2026 05:04:27 +0000 (0:00:02.242) 0:02:09.646 ********** 2026-04-24 05:04:50.105220 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:04:50.105238 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-24 05:04:50.105257 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 05:04:50.105276 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-24 05:04:50.105296 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-24 05:04:50.105349 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:04:50.105369 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-24 05:04:50.105388 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-24 05:04:50.105407 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 05:04:50.105426 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:04:50.105445 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-24 05:04:50.105463 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-24 05:04:50.105482 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-24 05:04:50.105501 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-24 05:04:50.105521 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-24 05:04:50.105539 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-24 05:04:50.105558 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-24 05:04:50.105576 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-24 05:04:50.105595 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-24 05:04:50.105638 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-24 05:04:50.105660 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-24 05:04:50.105677 | orchestrator | 2026-04-24 05:04:50.105688 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:04:50.105699 | orchestrator | Friday 24 April 2026 05:04:31 +0000 (0:00:03.544) 0:02:13.191 ********** 2026-04-24 05:04:50.105710 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:04:50.105721 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:04:50.105731 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:04:50.105742 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:50.105753 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 05:04:50.105763 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 05:04:50.105774 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 05:04:50.105784 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:50.105795 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 05:04:50.105805 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 05:04:50.105817 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 05:04:50.105827 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:50.105838 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 05:04:50.105848 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 05:04:50.105859 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 05:04:50.105869 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.105896 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 05:04:50.105906 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 05:04:50.105917 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 05:04:50.105927 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:50.105938 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 05:04:50.105948 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 05:04:50.105959 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 05:04:50.105970 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:50.106004 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-24 05:04:50.106079 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-24 05:04:50.106091 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-24 05:04:50.106102 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:50.106113 | orchestrator | 2026-04-24 05:04:50.106124 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:04:50.106135 | orchestrator | Friday 24 April 2026 05:04:33 +0000 (0:00:02.255) 0:02:15.446 ********** 2026-04-24 05:04:50.106145 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:04:50.106156 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:04:50.106167 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:04:50.106177 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:04:50.106189 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 05:04:50.106200 | orchestrator | 2026-04-24 05:04:50.106211 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:04:50.106223 | orchestrator | Friday 24 April 2026 05:04:35 +0000 (0:00:01.977) 0:02:17.424 ********** 2026-04-24 05:04:50.106234 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.106244 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:50.106255 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:50.106266 | orchestrator | 2026-04-24 05:04:50.106276 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:04:50.106287 | orchestrator | Friday 24 April 2026 05:04:37 +0000 (0:00:01.434) 0:02:18.858 ********** 2026-04-24 05:04:50.106307 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.106318 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:50.106328 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:50.106339 | orchestrator | 2026-04-24 05:04:50.106350 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:04:50.106360 | orchestrator | Friday 24 April 2026 05:04:38 +0000 (0:00:01.327) 0:02:20.186 ********** 2026-04-24 05:04:50.106371 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.106382 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:04:50.106392 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:04:50.106403 | orchestrator | 2026-04-24 05:04:50.106413 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:04:50.106424 | orchestrator | Friday 24 April 2026 05:04:39 +0000 (0:00:01.401) 0:02:21.587 ********** 2026-04-24 05:04:50.106435 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:04:50.106446 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:04:50.106457 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:04:50.106467 | orchestrator | 2026-04-24 05:04:50.106478 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:04:50.106489 | orchestrator | Friday 24 April 2026 05:04:41 +0000 (0:00:01.545) 0:02:23.133 ********** 2026-04-24 05:04:50.106499 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:04:50.106510 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:04:50.106521 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:04:50.106539 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.106550 | orchestrator | 2026-04-24 05:04:50.106561 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:04:50.106571 | orchestrator | Friday 24 April 2026 05:04:42 +0000 (0:00:01.364) 0:02:24.497 ********** 2026-04-24 05:04:50.106582 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:04:50.106593 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:04:50.106603 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:04:50.106759 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.106802 | orchestrator | 2026-04-24 05:04:50.106813 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:04:50.106825 | orchestrator | Friday 24 April 2026 05:04:44 +0000 (0:00:01.717) 0:02:26.215 ********** 2026-04-24 05:04:50.106836 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:04:50.106846 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:04:50.106857 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:04:50.106867 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:04:50.106878 | orchestrator | 2026-04-24 05:04:50.106888 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:04:50.106899 | orchestrator | Friday 24 April 2026 05:04:46 +0000 (0:00:01.798) 0:02:28.014 ********** 2026-04-24 05:04:50.106910 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:04:50.106920 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:04:50.106931 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:04:50.106941 | orchestrator | 2026-04-24 05:04:50.106952 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:04:50.106962 | orchestrator | Friday 24 April 2026 05:04:47 +0000 (0:00:01.676) 0:02:29.690 ********** 2026-04-24 05:04:50.106972 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 05:04:50.106981 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 05:04:50.106991 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 05:04:50.107000 | orchestrator | 2026-04-24 05:04:50.107010 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:04:50.107020 | orchestrator | Friday 24 April 2026 05:04:49 +0000 (0:00:01.621) 0:02:31.312 ********** 2026-04-24 05:04:50.107029 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:04:50.107038 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:04:50.107049 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:04:50.107058 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:04:50.107081 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:05:39.563365 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:05:39.563481 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:05:39.563498 | orchestrator | 2026-04-24 05:05:39.563511 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:05:39.563524 | orchestrator | Friday 24 April 2026 05:04:51 +0000 (0:00:01.767) 0:02:33.080 ********** 2026-04-24 05:05:39.563535 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:05:39.563546 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:05:39.563558 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:05:39.563569 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:05:39.563580 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:05:39.563660 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:05:39.563697 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:05:39.563709 | orchestrator | 2026-04-24 05:05:39.563720 | orchestrator | TASK [ceph-infra : Update cache for Debian based OSs] ************************** 2026-04-24 05:05:39.563731 | orchestrator | Friday 24 April 2026 05:04:54 +0000 (0:00:02.994) 0:02:36.075 ********** 2026-04-24 05:05:39.563742 | orchestrator | changed: [testbed-node-3] 2026-04-24 05:05:39.563768 | orchestrator | changed: [testbed-node-4] 2026-04-24 05:05:39.563779 | orchestrator | changed: [testbed-node-5] 2026-04-24 05:05:39.563790 | orchestrator | changed: [testbed-manager] 2026-04-24 05:05:39.563801 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:05:39.563811 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:05:39.563822 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:05:39.563833 | orchestrator | 2026-04-24 05:05:39.563843 | orchestrator | TASK [ceph-infra : Include_tasks configure_firewall.yml] *********************** 2026-04-24 05:05:39.563854 | orchestrator | Friday 24 April 2026 05:05:05 +0000 (0:00:11.274) 0:02:47.349 ********** 2026-04-24 05:05:39.563865 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.563876 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.563886 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.563897 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.563910 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.563924 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.563936 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.563948 | orchestrator | 2026-04-24 05:05:39.563961 | orchestrator | TASK [ceph-infra : Include_tasks setup_ntp.yml] ******************************** 2026-04-24 05:05:39.563974 | orchestrator | Friday 24 April 2026 05:05:07 +0000 (0:00:02.250) 0:02:49.600 ********** 2026-04-24 05:05:39.563986 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.564000 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.564012 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.564025 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.564038 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.564051 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.564063 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.564076 | orchestrator | 2026-04-24 05:05:39.564089 | orchestrator | TASK [ceph-infra : Add logrotate configuration] ******************************** 2026-04-24 05:05:39.564101 | orchestrator | Friday 24 April 2026 05:05:09 +0000 (0:00:01.854) 0:02:51.455 ********** 2026-04-24 05:05:39.564114 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.564128 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:05:39.564140 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:05:39.564153 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:05:39.564166 | orchestrator | changed: [testbed-node-3] 2026-04-24 05:05:39.564179 | orchestrator | changed: [testbed-node-4] 2026-04-24 05:05:39.564191 | orchestrator | changed: [testbed-node-5] 2026-04-24 05:05:39.564204 | orchestrator | 2026-04-24 05:05:39.564217 | orchestrator | TASK [ceph-validate : Include check_system.yml] ******************************** 2026-04-24 05:05:39.564231 | orchestrator | Friday 24 April 2026 05:05:12 +0000 (0:00:03.089) 0:02:54.544 ********** 2026-04-24 05:05:39.564244 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_system.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-24 05:05:39.564259 | orchestrator | 2026-04-24 05:05:39.564270 | orchestrator | TASK [ceph-validate : Fail on unsupported ansible version (1.X)] *************** 2026-04-24 05:05:39.564281 | orchestrator | Friday 24 April 2026 05:05:15 +0000 (0:00:02.984) 0:02:57.528 ********** 2026-04-24 05:05:39.564292 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.564303 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.564313 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.564324 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.564335 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.564353 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.564364 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.564375 | orchestrator | 2026-04-24 05:05:39.564393 | orchestrator | TASK [ceph-validate : Fail on unsupported system] ****************************** 2026-04-24 05:05:39.564411 | orchestrator | Friday 24 April 2026 05:05:17 +0000 (0:00:01.902) 0:02:59.431 ********** 2026-04-24 05:05:39.564430 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.564448 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.564465 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.564482 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.564501 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.564518 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.564535 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.564554 | orchestrator | 2026-04-24 05:05:39.564573 | orchestrator | TASK [ceph-validate : Fail on unsupported architecture] ************************ 2026-04-24 05:05:39.564618 | orchestrator | Friday 24 April 2026 05:05:19 +0000 (0:00:02.088) 0:03:01.520 ********** 2026-04-24 05:05:39.564639 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.564674 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.564685 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.564696 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.564707 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.564717 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.564727 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.564738 | orchestrator | 2026-04-24 05:05:39.564749 | orchestrator | TASK [ceph-validate : Fail on unsupported distribution] ************************ 2026-04-24 05:05:39.564759 | orchestrator | Friday 24 April 2026 05:05:21 +0000 (0:00:02.006) 0:03:03.527 ********** 2026-04-24 05:05:39.564770 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.564780 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.564791 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.564801 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.564812 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.564822 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.564833 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.564843 | orchestrator | 2026-04-24 05:05:39.564854 | orchestrator | TASK [ceph-validate : Fail on unsupported CentOS release] ********************** 2026-04-24 05:05:39.564864 | orchestrator | Friday 24 April 2026 05:05:23 +0000 (0:00:02.117) 0:03:05.644 ********** 2026-04-24 05:05:39.564875 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.564885 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.564896 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.564906 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.564917 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.564927 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.564938 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.564948 | orchestrator | 2026-04-24 05:05:39.564959 | orchestrator | TASK [ceph-validate : Fail on unsupported distribution for ubuntu cloud archive] *** 2026-04-24 05:05:39.564979 | orchestrator | Friday 24 April 2026 05:05:25 +0000 (0:00:01.871) 0:03:07.516 ********** 2026-04-24 05:05:39.564990 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.565000 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.565010 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.565021 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.565031 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.565042 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.565052 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.565063 | orchestrator | 2026-04-24 05:05:39.565074 | orchestrator | TASK [ceph-validate : Fail on unsupported SUSE/openSUSE distribution (only 15.x supported)] *** 2026-04-24 05:05:39.565084 | orchestrator | Friday 24 April 2026 05:05:27 +0000 (0:00:02.074) 0:03:09.591 ********** 2026-04-24 05:05:39.565095 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.565115 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.565125 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.565136 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.565146 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.565157 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.565167 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.565178 | orchestrator | 2026-04-24 05:05:39.565188 | orchestrator | TASK [ceph-validate : Fail if systemd is not present] ************************** 2026-04-24 05:05:39.565199 | orchestrator | Friday 24 April 2026 05:05:29 +0000 (0:00:02.100) 0:03:11.691 ********** 2026-04-24 05:05:39.565210 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.565220 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.565231 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.565241 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.565251 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.565262 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.565272 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.565283 | orchestrator | 2026-04-24 05:05:39.565293 | orchestrator | TASK [ceph-validate : Validate repository variables in non-containerized scenario] *** 2026-04-24 05:05:39.565304 | orchestrator | Friday 24 April 2026 05:05:32 +0000 (0:00:02.378) 0:03:14.069 ********** 2026-04-24 05:05:39.565315 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.565325 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.565335 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.565346 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.565356 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.565366 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.565377 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.565387 | orchestrator | 2026-04-24 05:05:39.565398 | orchestrator | TASK [ceph-validate : Validate osd_objectstore] ******************************** 2026-04-24 05:05:39.565408 | orchestrator | Friday 24 April 2026 05:05:34 +0000 (0:00:02.087) 0:03:16.157 ********** 2026-04-24 05:05:39.565419 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.565430 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.565440 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.565451 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.565461 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.565471 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.565482 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.565492 | orchestrator | 2026-04-24 05:05:39.565503 | orchestrator | TASK [ceph-validate : Validate radosgw network configuration] ****************** 2026-04-24 05:05:39.565513 | orchestrator | Friday 24 April 2026 05:05:36 +0000 (0:00:01.949) 0:03:18.106 ********** 2026-04-24 05:05:39.565524 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.565535 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.565545 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.565556 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.565566 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.565577 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.565587 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.565629 | orchestrator | 2026-04-24 05:05:39.565640 | orchestrator | TASK [ceph-validate : Validate lvm osd scenario] ******************************* 2026-04-24 05:05:39.565651 | orchestrator | Friday 24 April 2026 05:05:38 +0000 (0:00:02.320) 0:03:20.427 ********** 2026-04-24 05:05:39.565662 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:05:39.565673 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:05:39.565683 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:05:39.565694 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:05:39.565704 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:05:39.565715 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:05:39.565725 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:05:39.565736 | orchestrator | 2026-04-24 05:05:39.565754 | orchestrator | TASK [ceph-validate : Validate bluestore lvm osd scenario] ********************* 2026-04-24 05:06:01.011958 | orchestrator | Friday 24 April 2026 05:05:40 +0000 (0:00:01.851) 0:03:22.278 ********** 2026-04-24 05:06:01.012082 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:01.012099 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:01.012108 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:01.012118 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 05:06:01.012128 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 05:06:01.012136 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.012144 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 05:06:01.012153 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 05:06:01.012161 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.012182 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 05:06:01.012191 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 05:06:01.012199 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.012207 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:01.012215 | orchestrator | 2026-04-24 05:06:01.012224 | orchestrator | TASK [ceph-validate : Fail if local scenario is enabled on debian] ************* 2026-04-24 05:06:01.012232 | orchestrator | Friday 24 April 2026 05:05:42 +0000 (0:00:02.191) 0:03:24.469 ********** 2026-04-24 05:06:01.012240 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:01.012248 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:01.012256 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:01.012264 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.012272 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.012280 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.012288 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:01.012296 | orchestrator | 2026-04-24 05:06:01.012304 | orchestrator | TASK [ceph-validate : Fail if rhcs repository is enabled on debian] ************ 2026-04-24 05:06:01.012313 | orchestrator | Friday 24 April 2026 05:05:44 +0000 (0:00:02.036) 0:03:26.506 ********** 2026-04-24 05:06:01.012321 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:01.012329 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:01.012337 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:01.012345 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.012352 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.012360 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.012368 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:01.012376 | orchestrator | 2026-04-24 05:06:01.012385 | orchestrator | TASK [ceph-validate : Check ceph_origin definition on SUSE/openSUSE Leap] ****** 2026-04-24 05:06:01.012393 | orchestrator | Friday 24 April 2026 05:05:46 +0000 (0:00:02.131) 0:03:28.637 ********** 2026-04-24 05:06:01.012401 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:01.012409 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:01.012417 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:01.012425 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.012433 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.012441 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.012449 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:01.012457 | orchestrator | 2026-04-24 05:06:01.012465 | orchestrator | TASK [ceph-validate : Check ceph_repository definition on SUSE/openSUSE Leap] *** 2026-04-24 05:06:01.012494 | orchestrator | Friday 24 April 2026 05:05:48 +0000 (0:00:01.962) 0:03:30.600 ********** 2026-04-24 05:06:01.012505 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:01.012515 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:01.012525 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:01.012535 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.012544 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.012552 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.012562 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:01.012575 | orchestrator | 2026-04-24 05:06:01.012615 | orchestrator | TASK [ceph-validate : Validate ntp daemon type] ******************************** 2026-04-24 05:06:01.012629 | orchestrator | Friday 24 April 2026 05:05:51 +0000 (0:00:02.223) 0:03:32.823 ********** 2026-04-24 05:06:01.012642 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:01.012654 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:01.012666 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:01.012679 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.012693 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.012706 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.012718 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:01.012733 | orchestrator | 2026-04-24 05:06:01.012746 | orchestrator | TASK [ceph-validate : Abort if ntp_daemon_type is ntpd on Atomic] ************** 2026-04-24 05:06:01.012760 | orchestrator | Friday 24 April 2026 05:05:53 +0000 (0:00:02.073) 0:03:34.897 ********** 2026-04-24 05:06:01.012775 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:01.012788 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:01.012798 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:01.012806 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.012814 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.012822 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.012829 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:01.012837 | orchestrator | 2026-04-24 05:06:01.012845 | orchestrator | TASK [ceph-validate : Include check_devices.yml] ******************************* 2026-04-24 05:06:01.012853 | orchestrator | Friday 24 April 2026 05:05:55 +0000 (0:00:01.831) 0:03:36.729 ********** 2026-04-24 05:06:01.012877 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:01.012885 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:01.012893 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:01.012901 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:01.012910 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_devices.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 05:06:01.012918 | orchestrator | 2026-04-24 05:06:01.012926 | orchestrator | TASK [ceph-validate : Set_fact root_device] ************************************ 2026-04-24 05:06:01.012933 | orchestrator | Friday 24 April 2026 05:05:57 +0000 (0:00:02.461) 0:03:39.190 ********** 2026-04-24 05:06:01.012941 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:06:01.012961 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:06:01.012969 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:06:01.012977 | orchestrator | 2026-04-24 05:06:01.012985 | orchestrator | TASK [ceph-validate : Resolve devices in lvm_volumes] ************************** 2026-04-24 05:06:01.012993 | orchestrator | Friday 24 April 2026 05:05:58 +0000 (0:00:01.386) 0:03:40.577 ********** 2026-04-24 05:06:01.013001 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 05:06:01.013009 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 05:06:01.013017 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.013031 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 05:06:01.013039 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 05:06:01.013062 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.013076 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 05:06:01.013090 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 05:06:01.013103 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.013117 | orchestrator | 2026-04-24 05:06:01.013129 | orchestrator | TASK [ceph-validate : Set_fact lvm_volumes_data_devices] *********************** 2026-04-24 05:06:01.013143 | orchestrator | Friday 24 April 2026 05:06:00 +0000 (0:00:01.519) 0:03:42.096 ********** 2026-04-24 05:06:01.013158 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:01.013175 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:01.013189 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:01.013203 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:01.013218 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:01.013232 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:01.013245 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:01.013260 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:01.013274 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:01.013288 | orchestrator | 2026-04-24 05:06:01.013312 | orchestrator | TASK [ceph-validate : Fail if root_device is passed in lvm_volumes or devices] *** 2026-04-24 05:06:11.079968 | orchestrator | Friday 24 April 2026 05:06:02 +0000 (0:00:01.641) 0:03:43.738 ********** 2026-04-24 05:06:11.080083 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:11.080100 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:11.080111 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:11.080123 | orchestrator | 2026-04-24 05:06:11.080136 | orchestrator | TASK [ceph-validate : Get devices information] ********************************* 2026-04-24 05:06:11.080147 | orchestrator | Friday 24 April 2026 05:06:03 +0000 (0:00:01.360) 0:03:45.098 ********** 2026-04-24 05:06:11.080158 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:11.080169 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:11.080204 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:11.080216 | orchestrator | 2026-04-24 05:06:11.080227 | orchestrator | TASK [ceph-validate : Fail if one of the devices is not a device] ************** 2026-04-24 05:06:11.080238 | orchestrator | Friday 24 April 2026 05:06:04 +0000 (0:00:01.346) 0:03:46.445 ********** 2026-04-24 05:06:11.080248 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:11.080259 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:11.080270 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:11.080280 | orchestrator | 2026-04-24 05:06:11.080291 | orchestrator | TASK [ceph-validate : Fail when gpt header found on osd devices] *************** 2026-04-24 05:06:11.080302 | orchestrator | Friday 24 April 2026 05:06:06 +0000 (0:00:01.346) 0:03:47.792 ********** 2026-04-24 05:06:11.080312 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:11.080323 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:11.080334 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:11.080344 | orchestrator | 2026-04-24 05:06:11.080369 | orchestrator | TASK [ceph-validate : Check data logical volume] ******************************* 2026-04-24 05:06:11.080380 | orchestrator | Friday 24 April 2026 05:06:07 +0000 (0:00:01.330) 0:03:49.123 ********** 2026-04-24 05:06:11.080392 | orchestrator | ok: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}) 2026-04-24 05:06:11.080404 | orchestrator | ok: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}) 2026-04-24 05:06:11.080415 | orchestrator | ok: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}) 2026-04-24 05:06:11.080426 | orchestrator | ok: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}) 2026-04-24 05:06:11.080436 | orchestrator | ok: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}) 2026-04-24 05:06:11.080447 | orchestrator | ok: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}) 2026-04-24 05:06:11.080457 | orchestrator | 2026-04-24 05:06:11.080468 | orchestrator | TASK [ceph-validate : Fail if one of the data logical volume is not a device or doesn't exist] *** 2026-04-24 05:06:11.080480 | orchestrator | Friday 24 April 2026 05:06:10 +0000 (0:00:03.345) 0:03:52.468 ********** 2026-04-24 05:06:11.080498 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3/osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 957, 'dev': 6, 'nlink': 1, 'atime': 1776999723.6480644, 'mtime': 1776999723.6430643, 'ctime': 1776999723.6430643, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3/osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:11.080535 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-02e41f6c-bc12-5c7e-a521-6aced039912f/osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 967, 'dev': 6, 'nlink': 1, 'atime': 1776999742.694364, 'mtime': 1776999742.688364, 'ctime': 1776999742.688364, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-02e41f6c-bc12-5c7e-a521-6aced039912f/osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:11.080558 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:11.080575 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1/osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 955, 'dev': 6, 'nlink': 1, 'atime': 1776999723.842355, 'mtime': 1776999723.838355, 'ctime': 1776999723.838355, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1/osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:11.080611 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-33584b54-1593-569e-98b0-f98fe2b18be3/osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 965, 'dev': 6, 'nlink': 1, 'atime': 1776999742.62165, 'mtime': 1776999742.6136498, 'ctime': 1776999742.6136498, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-33584b54-1593-569e-98b0-f98fe2b18be3/osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:11.080624 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:11.080644 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71/osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 957, 'dev': 6, 'nlink': 1, 'atime': 1776999725.5528994, 'mtime': 1776999725.5488994, 'ctime': 1776999725.5488994, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71/osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080047 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-91b687e8-7bed-5064-bb30-d809c43c423f/osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 967, 'dev': 6, 'nlink': 1, 'atime': 1776999744.3971896, 'mtime': 1776999744.3911896, 'ctime': 1776999744.3911896, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-91b687e8-7bed-5064-bb30-d809c43c423f/osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080162 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:17.080180 | orchestrator | 2026-04-24 05:06:17.080193 | orchestrator | TASK [ceph-validate : Check bluestore db logical volume] *********************** 2026-04-24 05:06:17.080207 | orchestrator | Friday 24 April 2026 05:06:12 +0000 (0:00:01.477) 0:03:53.946 ********** 2026-04-24 05:06:17.080220 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 05:06:17.080232 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 05:06:17.080244 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:17.080255 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 05:06:17.080265 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 05:06:17.080276 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:17.080287 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 05:06:17.080298 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 05:06:17.080329 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:17.080341 | orchestrator | 2026-04-24 05:06:17.080352 | orchestrator | TASK [ceph-validate : Fail if one of the bluestore db logical volume is not a device or doesn't exist] *** 2026-04-24 05:06:17.080364 | orchestrator | Friday 24 April 2026 05:06:13 +0000 (0:00:01.390) 0:03:55.336 ********** 2026-04-24 05:06:17.080376 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080389 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080400 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:17.080411 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080440 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080453 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:17.080469 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080481 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080492 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:17.080503 | orchestrator | 2026-04-24 05:06:17.080513 | orchestrator | TASK [ceph-validate : Check bluestore wal logical volume] ********************** 2026-04-24 05:06:17.080524 | orchestrator | Friday 24 April 2026 05:06:15 +0000 (0:00:01.461) 0:03:56.798 ********** 2026-04-24 05:06:17.080535 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'})  2026-04-24 05:06:17.080546 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'})  2026-04-24 05:06:17.080557 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:17.080567 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'})  2026-04-24 05:06:17.080578 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'})  2026-04-24 05:06:17.080615 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:17.080626 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'})  2026-04-24 05:06:17.080645 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'})  2026-04-24 05:06:17.080656 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:17.080667 | orchestrator | 2026-04-24 05:06:17.080677 | orchestrator | TASK [ceph-validate : Fail if one of the bluestore wal logical volume is not a device or doesn't exist] *** 2026-04-24 05:06:17.080688 | orchestrator | Friday 24 April 2026 05:06:16 +0000 (0:00:01.649) 0:03:58.448 ********** 2026-04-24 05:06:17.080699 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-30beaf4b-e88f-5ba2-bed2-60586ab1edc3', 'data_vg': 'ceph-30beaf4b-e88f-5ba2-bed2-60586ab1edc3'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080710 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-02e41f6c-bc12-5c7e-a521-6aced039912f', 'data_vg': 'ceph-02e41f6c-bc12-5c7e-a521-6aced039912f'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080721 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:17.080732 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-d69a3297-462a-55c2-bfb1-0665b5ed4cb1', 'data_vg': 'ceph-d69a3297-462a-55c2-bfb1-0665b5ed4cb1'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080743 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-33584b54-1593-569e-98b0-f98fe2b18be3', 'data_vg': 'ceph-33584b54-1593-569e-98b0-f98fe2b18be3'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080754 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:17.080765 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-010e5db2-c467-553c-8ec0-8c3d6c1ddd71', 'data_vg': 'ceph-010e5db2-c467-553c-8ec0-8c3d6c1ddd71'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:17.080783 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-91b687e8-7bed-5064-bb30-d809c43c423f', 'data_vg': 'ceph-91b687e8-7bed-5064-bb30-d809c43c423f'}, 'ansible_loop_var': 'item'})  2026-04-24 05:06:27.636457 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:27.636573 | orchestrator | 2026-04-24 05:06:27.636655 | orchestrator | TASK [ceph-validate : Include check_eth_rgw.yml] ******************************* 2026-04-24 05:06:27.636672 | orchestrator | Friday 24 April 2026 05:06:18 +0000 (0:00:01.460) 0:03:59.909 ********** 2026-04-24 05:06:27.636683 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:27.636695 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:27.636706 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:27.636717 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:27.636727 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:27.636739 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:27.636759 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:27.636778 | orchestrator | 2026-04-24 05:06:27.636796 | orchestrator | TASK [ceph-validate : Include check_rgw_pools.yml] ***************************** 2026-04-24 05:06:27.636815 | orchestrator | Friday 24 April 2026 05:06:20 +0000 (0:00:01.878) 0:04:01.788 ********** 2026-04-24 05:06:27.636833 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:27.636851 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:27.636870 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:27.636889 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:27.636940 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_rgw_pools.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 05:06:27.636961 | orchestrator | 2026-04-24 05:06:27.636973 | orchestrator | TASK [ceph-validate : Fail if ec_profile is not set for ec pools] ************** 2026-04-24 05:06:27.636984 | orchestrator | Friday 24 April 2026 05:06:22 +0000 (0:00:02.535) 0:04:04.324 ********** 2026-04-24 05:06:27.636996 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637015 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637034 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637053 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637072 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637094 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:27.637114 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637132 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637146 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637159 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637170 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637181 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:27.637192 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637203 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637214 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637224 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637235 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637246 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:27.637257 | orchestrator | 2026-04-24 05:06:27.637268 | orchestrator | TASK [ceph-validate : Fail if ec_k is not set for ec pools] ******************** 2026-04-24 05:06:27.637279 | orchestrator | Friday 24 April 2026 05:06:24 +0000 (0:00:01.463) 0:04:05.787 ********** 2026-04-24 05:06:27.637289 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637300 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637312 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637323 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637358 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637392 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:27.637417 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637434 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637452 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637469 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637486 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637502 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:27.637521 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637539 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637556 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637574 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637625 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637643 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:27.637661 | orchestrator | 2026-04-24 05:06:27.637679 | orchestrator | TASK [ceph-validate : Fail if ec_m is not set for ec pools] ******************** 2026-04-24 05:06:27.637697 | orchestrator | Friday 24 April 2026 05:06:25 +0000 (0:00:01.695) 0:04:07.483 ********** 2026-04-24 05:06:27.637713 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637730 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637747 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637765 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637791 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637818 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:27.637846 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637874 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637900 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637928 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637957 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.637986 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:27.638011 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.638149 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.638227 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.638250 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.638270 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 05:06:27.638288 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:27.638309 | orchestrator | 2026-04-24 05:06:27.638331 | orchestrator | TASK [ceph-validate : Include check_nfs.yml] *********************************** 2026-04-24 05:06:27.638352 | orchestrator | Friday 24 April 2026 05:06:27 +0000 (0:00:01.493) 0:04:08.976 ********** 2026-04-24 05:06:27.638371 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:27.638392 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:27.638434 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:42.764228 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:42.764343 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:42.764374 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:42.764386 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:42.764398 | orchestrator | 2026-04-24 05:06:42.764410 | orchestrator | TASK [ceph-validate : Include check_rbdmirror.yml] ***************************** 2026-04-24 05:06:42.764423 | orchestrator | Friday 24 April 2026 05:06:29 +0000 (0:00:01.942) 0:04:10.918 ********** 2026-04-24 05:06:42.764434 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:42.764445 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:42.764456 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:42.764466 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:42.764477 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:42.764488 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:42.764513 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:42.764524 | orchestrator | 2026-04-24 05:06:42.764536 | orchestrator | TASK [ceph-validate : Fail if monitoring group doesn't exist] ****************** 2026-04-24 05:06:42.764546 | orchestrator | Friday 24 April 2026 05:06:31 +0000 (0:00:02.181) 0:04:13.100 ********** 2026-04-24 05:06:42.764557 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:42.764568 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:42.764578 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:42.764658 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:42.764678 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:42.764691 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:42.764701 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:42.764712 | orchestrator | 2026-04-24 05:06:42.764723 | orchestrator | TASK [ceph-validate : Fail when monitoring doesn't contain at least one node.] *** 2026-04-24 05:06:42.764735 | orchestrator | Friday 24 April 2026 05:06:33 +0000 (0:00:02.413) 0:04:15.513 ********** 2026-04-24 05:06:42.764747 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:42.764758 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:42.764771 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:42.764784 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:42.764796 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:42.764808 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:42.764821 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:42.764834 | orchestrator | 2026-04-24 05:06:42.764845 | orchestrator | TASK [ceph-validate : Fail when dashboard_admin_password and/or grafana_admin_password are not set] *** 2026-04-24 05:06:42.764857 | orchestrator | Friday 24 April 2026 05:06:35 +0000 (0:00:01.885) 0:04:17.399 ********** 2026-04-24 05:06:42.764868 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:42.764901 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:42.764912 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:42.764923 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:42.764934 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:42.764944 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:42.764955 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:42.764965 | orchestrator | 2026-04-24 05:06:42.764976 | orchestrator | TASK [ceph-validate : Validate container registry credentials] ***************** 2026-04-24 05:06:42.764987 | orchestrator | Friday 24 April 2026 05:06:37 +0000 (0:00:02.162) 0:04:19.562 ********** 2026-04-24 05:06:42.764997 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:42.765008 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:42.765018 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:42.765029 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:42.765040 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:42.765050 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:42.765061 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:42.765071 | orchestrator | 2026-04-24 05:06:42.765082 | orchestrator | TASK [ceph-validate : Validate container service and container package] ******** 2026-04-24 05:06:42.765093 | orchestrator | Friday 24 April 2026 05:06:39 +0000 (0:00:01.874) 0:04:21.436 ********** 2026-04-24 05:06:42.765103 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:42.765114 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:42.765125 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:42.765135 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:42.765146 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:42.765156 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:42.765167 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:42.765177 | orchestrator | 2026-04-24 05:06:42.765188 | orchestrator | TASK [ceph-validate : Validate openstack_keys key format] ********************** 2026-04-24 05:06:42.765198 | orchestrator | Friday 24 April 2026 05:06:41 +0000 (0:00:02.205) 0:04:23.641 ********** 2026-04-24 05:06:42.765210 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:42.765223 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:42.765236 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:42.765248 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:42.765259 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:42.765272 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:42.765283 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:42.765318 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:42.765330 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:42.765341 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:42.765352 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:42.765370 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:42.765382 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:42.765393 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:42.765403 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:42.765414 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:42.765425 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:42.765435 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:42.765446 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:42.765457 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:42.765468 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:42.765478 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:42.765489 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:42.765501 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:42.765519 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:42.765536 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:42.765554 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:42.765572 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:42.765636 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:42.765655 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:42.765675 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:47.336378 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:47.336480 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:47.336495 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:47.336509 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:47.336522 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:47.336533 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:47.336544 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:47.336558 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:47.336569 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:47.336641 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:47.336655 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:47.336666 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:47.336677 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:47.336689 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:47.336700 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:47.336711 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:47.336722 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:47.336733 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:47.336744 | orchestrator | 2026-04-24 05:06:47.336756 | orchestrator | TASK [ceph-validate : Validate clients keys key format] ************************ 2026-04-24 05:06:47.336768 | orchestrator | Friday 24 April 2026 05:06:44 +0000 (0:00:02.330) 0:04:25.972 ********** 2026-04-24 05:06:47.336779 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:47.336790 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:47.336801 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:47.336811 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:06:47.336822 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:06:47.336833 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:06:47.336843 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:06:47.336878 | orchestrator | 2026-04-24 05:06:47.336889 | orchestrator | TASK [ceph-validate : Validate openstack_keys caps] **************************** 2026-04-24 05:06:47.336900 | orchestrator | Friday 24 April 2026 05:06:46 +0000 (0:00:02.184) 0:04:28.157 ********** 2026-04-24 05:06:47.336911 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:47.336922 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:47.336933 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:47.336962 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:47.336980 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:47.336992 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:47.337002 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:06:47.337013 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:47.337024 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:47.337035 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:47.337046 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:47.337056 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:47.337067 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:47.337078 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:06:47.337089 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:47.337100 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:47.337110 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:47.337121 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:47.337132 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:06:47.337143 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:06:47.337162 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:06:47.337173 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:47.337184 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:47.337194 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:47.337205 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:06:47.337216 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:06:47.337226 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:06:47.337237 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:06:47.337259 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:07:15.117747 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:07:15.117862 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:07:15.117879 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:07:15.117891 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:07:15.117906 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:07:15.117918 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:07:15.117931 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:07:15.117942 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:07:15.117954 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:07:15.117967 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-24 05:07:15.117978 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-24 05:07:15.117989 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-24 05:07:15.118107 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:07:15.118123 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-24 05:07:15.118135 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:07:15.118146 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:07:15.118157 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:07:15.118168 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-24 05:07:15.118179 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-24 05:07:15.118190 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:07:15.118201 | orchestrator | 2026-04-24 05:07:15.118213 | orchestrator | TASK [ceph-validate : Validate clients keys caps] ****************************** 2026-04-24 05:07:15.118226 | orchestrator | Friday 24 April 2026 05:06:48 +0000 (0:00:02.289) 0:04:30.446 ********** 2026-04-24 05:07:15.118241 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:15.118254 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:07:15.118267 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:07:15.118280 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:07:15.118292 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:07:15.118305 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:07:15.118318 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:07:15.118331 | orchestrator | 2026-04-24 05:07:15.118344 | orchestrator | TASK [ceph-validate : Check virtual_ips is defined] **************************** 2026-04-24 05:07:15.118358 | orchestrator | Friday 24 April 2026 05:06:50 +0000 (0:00:02.134) 0:04:32.581 ********** 2026-04-24 05:07:15.118371 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:15.118384 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:07:15.118397 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:07:15.118410 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:07:15.118424 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:07:15.118437 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:07:15.118449 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:07:15.118461 | orchestrator | 2026-04-24 05:07:15.118490 | orchestrator | TASK [ceph-validate : Validate virtual_ips length] ***************************** 2026-04-24 05:07:15.118522 | orchestrator | Friday 24 April 2026 05:06:53 +0000 (0:00:02.142) 0:04:34.723 ********** 2026-04-24 05:07:15.118536 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:15.118549 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:07:15.118562 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:07:15.118575 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:07:15.118620 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:07:15.118632 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:07:15.118643 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:07:15.118654 | orchestrator | 2026-04-24 05:07:15.118665 | orchestrator | TASK [ceph-container-engine : Include pre_requisites/prerequisites.yml] ******** 2026-04-24 05:07:15.118676 | orchestrator | Friday 24 April 2026 05:06:55 +0000 (0:00:02.553) 0:04:37.277 ********** 2026-04-24 05:07:15.118687 | orchestrator | included: /ansible/roles/ceph-container-engine/tasks/pre_requisites/prerequisites.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-24 05:07:15.118711 | orchestrator | 2026-04-24 05:07:15.118723 | orchestrator | TASK [ceph-container-engine : Include specific variables] ********************** 2026-04-24 05:07:15.118734 | orchestrator | Friday 24 April 2026 05:06:58 +0000 (0:00:02.760) 0:04:40.038 ********** 2026-04-24 05:07:15.118745 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-24 05:07:15.118757 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-24 05:07:15.118768 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-24 05:07:15.118778 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-24 05:07:15.118789 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-24 05:07:15.118800 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-24 05:07:15.118811 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-24 05:07:15.118822 | orchestrator | 2026-04-24 05:07:15.118832 | orchestrator | TASK [ceph-container-engine : Create the systemd docker override directory] **** 2026-04-24 05:07:15.118843 | orchestrator | Friday 24 April 2026 05:07:00 +0000 (0:00:02.291) 0:04:42.330 ********** 2026-04-24 05:07:15.118859 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:15.118870 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:07:15.118881 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:07:15.118892 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:07:15.118903 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:07:15.118914 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:07:15.118924 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:07:15.118935 | orchestrator | 2026-04-24 05:07:15.118946 | orchestrator | TASK [ceph-container-engine : Create the systemd docker override file] ********* 2026-04-24 05:07:15.118957 | orchestrator | Friday 24 April 2026 05:07:02 +0000 (0:00:02.168) 0:04:44.498 ********** 2026-04-24 05:07:15.118968 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:15.118978 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:07:15.118989 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:07:15.119000 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:07:15.119011 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:07:15.119021 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:07:15.119032 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:07:15.119043 | orchestrator | 2026-04-24 05:07:15.119053 | orchestrator | TASK [ceph-container-engine : Remove docker proxy configuration] *************** 2026-04-24 05:07:15.119064 | orchestrator | Friday 24 April 2026 05:07:04 +0000 (0:00:01.988) 0:04:46.487 ********** 2026-04-24 05:07:15.119075 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:15.119086 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:07:15.119097 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:07:15.119108 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:07:15.119118 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:07:15.119129 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:07:15.119140 | orchestrator | ok: [testbed-manager] 2026-04-24 05:07:15.119150 | orchestrator | 2026-04-24 05:07:15.119161 | orchestrator | TASK [ceph-container-engine : Restart docker] ********************************** 2026-04-24 05:07:15.119172 | orchestrator | Friday 24 April 2026 05:07:07 +0000 (0:00:02.631) 0:04:49.118 ********** 2026-04-24 05:07:15.119183 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:15.119193 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:07:15.119204 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:07:15.119215 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:07:15.119226 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:07:15.119236 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:07:15.119247 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:07:15.119258 | orchestrator | 2026-04-24 05:07:15.119273 | orchestrator | TASK [ceph-container-common : Container registry authentication] *************** 2026-04-24 05:07:15.119284 | orchestrator | Friday 24 April 2026 05:07:09 +0000 (0:00:02.302) 0:04:51.421 ********** 2026-04-24 05:07:15.119295 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:15.119306 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:07:15.119316 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:07:15.119327 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:07:15.119338 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:07:15.119348 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:07:15.119359 | orchestrator | skipping: [testbed-manager] 2026-04-24 05:07:15.119370 | orchestrator | 2026-04-24 05:07:15.119380 | orchestrator | TASK [Get the ceph release being deployed] ************************************* 2026-04-24 05:07:15.119391 | orchestrator | Friday 24 April 2026 05:07:12 +0000 (0:00:02.448) 0:04:53.870 ********** 2026-04-24 05:07:15.119402 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:15.119413 | orchestrator | 2026-04-24 05:07:15.119424 | orchestrator | TASK [Check ceph release being deployed] *************************************** 2026-04-24 05:07:15.119434 | orchestrator | Friday 24 April 2026 05:07:14 +0000 (0:00:02.777) 0:04:56.647 ********** 2026-04-24 05:07:15.119451 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:15.119463 | orchestrator | 2026-04-24 05:07:15.119481 | orchestrator | PLAY [Ensure cluster config is applied] **************************************** 2026-04-24 05:07:54.991749 | orchestrator | 2026-04-24 05:07:54.991869 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:07:54.991897 | orchestrator | Friday 24 April 2026 05:07:16 +0000 (0:00:01.381) 0:04:58.028 ********** 2026-04-24 05:07:54.991912 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.991924 | orchestrator | 2026-04-24 05:07:54.991936 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:07:54.991947 | orchestrator | Friday 24 April 2026 05:07:17 +0000 (0:00:01.480) 0:04:59.509 ********** 2026-04-24 05:07:54.991958 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.991969 | orchestrator | 2026-04-24 05:07:54.991980 | orchestrator | TASK [Set cluster configs] ***************************************************** 2026-04-24 05:07:54.991991 | orchestrator | Friday 24 April 2026 05:07:18 +0000 (0:00:01.167) 0:05:00.677 ********** 2026-04-24 05:07:54.992004 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-24 05:07:54.992018 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-24 05:07:54.992030 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-24 05:07:54.992041 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-24 05:07:54.992053 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-24 05:07:54.992093 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}])  2026-04-24 05:07:54.992106 | orchestrator | 2026-04-24 05:07:54.992117 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-24 05:07:54.992127 | orchestrator | 2026-04-24 05:07:54.992138 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-24 05:07:54.992149 | orchestrator | Friday 24 April 2026 05:07:29 +0000 (0:00:10.407) 0:05:11.084 ********** 2026-04-24 05:07:54.992160 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992170 | orchestrator | 2026-04-24 05:07:54.992181 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-24 05:07:54.992192 | orchestrator | Friday 24 April 2026 05:07:30 +0000 (0:00:01.612) 0:05:12.697 ********** 2026-04-24 05:07:54.992202 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992213 | orchestrator | 2026-04-24 05:07:54.992224 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-24 05:07:54.992236 | orchestrator | Friday 24 April 2026 05:07:32 +0000 (0:00:01.128) 0:05:13.826 ********** 2026-04-24 05:07:54.992249 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:54.992263 | orchestrator | 2026-04-24 05:07:54.992276 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-24 05:07:54.992289 | orchestrator | Friday 24 April 2026 05:07:33 +0000 (0:00:01.112) 0:05:14.938 ********** 2026-04-24 05:07:54.992301 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992311 | orchestrator | 2026-04-24 05:07:54.992322 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:07:54.992333 | orchestrator | Friday 24 April 2026 05:07:34 +0000 (0:00:01.185) 0:05:16.123 ********** 2026-04-24 05:07:54.992343 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-24 05:07:54.992354 | orchestrator | 2026-04-24 05:07:54.992380 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:07:54.992409 | orchestrator | Friday 24 April 2026 05:07:35 +0000 (0:00:01.164) 0:05:17.288 ********** 2026-04-24 05:07:54.992421 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992432 | orchestrator | 2026-04-24 05:07:54.992442 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:07:54.992453 | orchestrator | Friday 24 April 2026 05:07:37 +0000 (0:00:01.511) 0:05:18.800 ********** 2026-04-24 05:07:54.992463 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992474 | orchestrator | 2026-04-24 05:07:54.992485 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:07:54.992496 | orchestrator | Friday 24 April 2026 05:07:38 +0000 (0:00:01.132) 0:05:19.932 ********** 2026-04-24 05:07:54.992506 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992517 | orchestrator | 2026-04-24 05:07:54.992528 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:07:54.992538 | orchestrator | Friday 24 April 2026 05:07:39 +0000 (0:00:01.478) 0:05:21.410 ********** 2026-04-24 05:07:54.992549 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992560 | orchestrator | 2026-04-24 05:07:54.992570 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:07:54.992581 | orchestrator | Friday 24 April 2026 05:07:40 +0000 (0:00:01.173) 0:05:22.583 ********** 2026-04-24 05:07:54.992615 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992626 | orchestrator | 2026-04-24 05:07:54.992646 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:07:54.992656 | orchestrator | Friday 24 April 2026 05:07:42 +0000 (0:00:01.142) 0:05:23.726 ********** 2026-04-24 05:07:54.992667 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992678 | orchestrator | 2026-04-24 05:07:54.992688 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:07:54.992700 | orchestrator | Friday 24 April 2026 05:07:43 +0000 (0:00:01.164) 0:05:24.891 ********** 2026-04-24 05:07:54.992711 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:54.992722 | orchestrator | 2026-04-24 05:07:54.992733 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:07:54.992743 | orchestrator | Friday 24 April 2026 05:07:44 +0000 (0:00:01.172) 0:05:26.063 ********** 2026-04-24 05:07:54.992754 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992764 | orchestrator | 2026-04-24 05:07:54.992775 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:07:54.992785 | orchestrator | Friday 24 April 2026 05:07:45 +0000 (0:00:01.161) 0:05:27.225 ********** 2026-04-24 05:07:54.992796 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:07:54.992807 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:07:54.992817 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:07:54.992828 | orchestrator | 2026-04-24 05:07:54.992839 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:07:54.992849 | orchestrator | Friday 24 April 2026 05:07:47 +0000 (0:00:01.657) 0:05:28.883 ********** 2026-04-24 05:07:54.992860 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:07:54.992871 | orchestrator | 2026-04-24 05:07:54.992882 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:07:54.992893 | orchestrator | Friday 24 April 2026 05:07:48 +0000 (0:00:01.262) 0:05:30.146 ********** 2026-04-24 05:07:54.992903 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:07:54.992914 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:07:54.992924 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:07:54.992935 | orchestrator | 2026-04-24 05:07:54.992946 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:07:54.992956 | orchestrator | Friday 24 April 2026 05:07:51 +0000 (0:00:03.149) 0:05:33.295 ********** 2026-04-24 05:07:54.992967 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:07:54.992978 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:07:54.992988 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:07:54.992999 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:54.993009 | orchestrator | 2026-04-24 05:07:54.993020 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:07:54.993030 | orchestrator | Friday 24 April 2026 05:07:52 +0000 (0:00:01.414) 0:05:34.710 ********** 2026-04-24 05:07:54.993043 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:07:54.993056 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:07:54.993067 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:07:54.993079 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:07:54.993096 | orchestrator | 2026-04-24 05:07:54.993107 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:07:54.993118 | orchestrator | Friday 24 April 2026 05:07:54 +0000 (0:00:01.922) 0:05:36.633 ********** 2026-04-24 05:07:54.993142 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:15.030354 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:15.030460 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:15.030474 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.030484 | orchestrator | 2026-04-24 05:08:15.030493 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:08:15.030503 | orchestrator | Friday 24 April 2026 05:07:56 +0000 (0:00:01.163) 0:05:37.797 ********** 2026-04-24 05:08:15.030514 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'a3168a73d7f5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:07:48.978326', 'end': '2026-04-24 05:07:49.036730', 'delta': '0:00:00.058404', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['a3168a73d7f5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:08:15.030526 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'cb6ff5b25438', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:07:49.549645', 'end': '2026-04-24 05:07:49.610643', 'delta': '0:00:00.060998', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['cb6ff5b25438'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:08:15.030535 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '4af70b8ccc8b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:07:50.402679', 'end': '2026-04-24 05:07:50.446594', 'delta': '0:00:00.043915', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['4af70b8ccc8b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:08:15.030568 | orchestrator | 2026-04-24 05:08:15.030577 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:08:15.030585 | orchestrator | Friday 24 April 2026 05:07:57 +0000 (0:00:01.219) 0:05:39.016 ********** 2026-04-24 05:08:15.030634 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:08:15.030644 | orchestrator | 2026-04-24 05:08:15.030652 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:08:15.030660 | orchestrator | Friday 24 April 2026 05:07:58 +0000 (0:00:01.573) 0:05:40.590 ********** 2026-04-24 05:08:15.030668 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.030676 | orchestrator | 2026-04-24 05:08:15.030697 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:08:15.030705 | orchestrator | Friday 24 April 2026 05:08:00 +0000 (0:00:01.277) 0:05:41.867 ********** 2026-04-24 05:08:15.030713 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:08:15.030721 | orchestrator | 2026-04-24 05:08:15.030729 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:08:15.030737 | orchestrator | Friday 24 April 2026 05:08:01 +0000 (0:00:01.143) 0:05:43.011 ********** 2026-04-24 05:08:15.030760 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:08:15.030768 | orchestrator | 2026-04-24 05:08:15.030776 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:08:15.030784 | orchestrator | Friday 24 April 2026 05:08:03 +0000 (0:00:02.049) 0:05:45.061 ********** 2026-04-24 05:08:15.030792 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:08:15.030800 | orchestrator | 2026-04-24 05:08:15.030808 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:08:15.030816 | orchestrator | Friday 24 April 2026 05:08:04 +0000 (0:00:01.143) 0:05:46.205 ********** 2026-04-24 05:08:15.030824 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.030832 | orchestrator | 2026-04-24 05:08:15.030839 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:08:15.030847 | orchestrator | Friday 24 April 2026 05:08:05 +0000 (0:00:01.167) 0:05:47.373 ********** 2026-04-24 05:08:15.030855 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.030865 | orchestrator | 2026-04-24 05:08:15.030874 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:08:15.030884 | orchestrator | Friday 24 April 2026 05:08:06 +0000 (0:00:01.221) 0:05:48.594 ********** 2026-04-24 05:08:15.030894 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.030904 | orchestrator | 2026-04-24 05:08:15.030914 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:08:15.030925 | orchestrator | Friday 24 April 2026 05:08:08 +0000 (0:00:01.121) 0:05:49.716 ********** 2026-04-24 05:08:15.030935 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.030946 | orchestrator | 2026-04-24 05:08:15.030956 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:08:15.030964 | orchestrator | Friday 24 April 2026 05:08:09 +0000 (0:00:01.158) 0:05:50.875 ********** 2026-04-24 05:08:15.030973 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.030982 | orchestrator | 2026-04-24 05:08:15.030990 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:08:15.030999 | orchestrator | Friday 24 April 2026 05:08:10 +0000 (0:00:01.144) 0:05:52.019 ********** 2026-04-24 05:08:15.031008 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.031016 | orchestrator | 2026-04-24 05:08:15.031025 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:08:15.031033 | orchestrator | Friday 24 April 2026 05:08:11 +0000 (0:00:01.140) 0:05:53.160 ********** 2026-04-24 05:08:15.031042 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.031050 | orchestrator | 2026-04-24 05:08:15.031059 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:08:15.031077 | orchestrator | Friday 24 April 2026 05:08:12 +0000 (0:00:01.154) 0:05:54.315 ********** 2026-04-24 05:08:15.031086 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.031094 | orchestrator | 2026-04-24 05:08:15.031103 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:08:15.031113 | orchestrator | Friday 24 April 2026 05:08:13 +0000 (0:00:01.121) 0:05:55.437 ********** 2026-04-24 05:08:15.031121 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:15.031130 | orchestrator | 2026-04-24 05:08:15.031139 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:08:15.031147 | orchestrator | Friday 24 April 2026 05:08:14 +0000 (0:00:01.183) 0:05:56.620 ********** 2026-04-24 05:08:15.031156 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:08:15.031166 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:08:15.031175 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:08:15.031190 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-10-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:08:15.031207 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:08:16.245321 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:08:16.245437 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:08:16.245497 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '890efc9d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:08:16.245529 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:08:16.245542 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:08:16.245554 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:16.245567 | orchestrator | 2026-04-24 05:08:16.245585 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:08:16.245673 | orchestrator | Friday 24 April 2026 05:08:16 +0000 (0:00:01.222) 0:05:57.843 ********** 2026-04-24 05:08:16.245720 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:16.245743 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:16.245778 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:16.245793 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-10-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:16.245805 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:16.245823 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:16.245845 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:41.119180 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '890efc9d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:41.119367 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:41.119402 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:08:41.119416 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:41.119430 | orchestrator | 2026-04-24 05:08:41.119442 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:08:41.119455 | orchestrator | Friday 24 April 2026 05:08:17 +0000 (0:00:01.239) 0:05:59.082 ********** 2026-04-24 05:08:41.119466 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:08:41.119479 | orchestrator | 2026-04-24 05:08:41.119490 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:08:41.119501 | orchestrator | Friday 24 April 2026 05:08:18 +0000 (0:00:01.486) 0:06:00.569 ********** 2026-04-24 05:08:41.119520 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:08:41.119531 | orchestrator | 2026-04-24 05:08:41.119542 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:08:41.119572 | orchestrator | Friday 24 April 2026 05:08:19 +0000 (0:00:01.120) 0:06:01.689 ********** 2026-04-24 05:08:41.119583 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:08:41.119637 | orchestrator | 2026-04-24 05:08:41.119650 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:08:41.119661 | orchestrator | Friday 24 April 2026 05:08:21 +0000 (0:00:01.485) 0:06:03.175 ********** 2026-04-24 05:08:41.119675 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:41.119688 | orchestrator | 2026-04-24 05:08:41.119701 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:08:41.119714 | orchestrator | Friday 24 April 2026 05:08:22 +0000 (0:00:01.187) 0:06:04.363 ********** 2026-04-24 05:08:41.119727 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:41.119740 | orchestrator | 2026-04-24 05:08:41.119752 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:08:41.119765 | orchestrator | Friday 24 April 2026 05:08:23 +0000 (0:00:01.270) 0:06:05.634 ********** 2026-04-24 05:08:41.119777 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:41.119789 | orchestrator | 2026-04-24 05:08:41.119801 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:08:41.119813 | orchestrator | Friday 24 April 2026 05:08:25 +0000 (0:00:01.153) 0:06:06.787 ********** 2026-04-24 05:08:41.119826 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:08:41.119838 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 05:08:41.119851 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 05:08:41.119864 | orchestrator | 2026-04-24 05:08:41.119876 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:08:41.119889 | orchestrator | Friday 24 April 2026 05:08:27 +0000 (0:00:01.983) 0:06:08.770 ********** 2026-04-24 05:08:41.119901 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:08:41.119915 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:08:41.119927 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:08:41.119940 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:41.119952 | orchestrator | 2026-04-24 05:08:41.119965 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:08:41.119977 | orchestrator | Friday 24 April 2026 05:08:28 +0000 (0:00:01.124) 0:06:09.895 ********** 2026-04-24 05:08:41.119990 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:41.120003 | orchestrator | 2026-04-24 05:08:41.120016 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:08:41.120028 | orchestrator | Friday 24 April 2026 05:08:29 +0000 (0:00:01.108) 0:06:11.004 ********** 2026-04-24 05:08:41.120039 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:08:41.120050 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:08:41.120062 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:08:41.120073 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:08:41.120083 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:08:41.120094 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:08:41.120104 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:08:41.120115 | orchestrator | 2026-04-24 05:08:41.120126 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:08:41.120137 | orchestrator | Friday 24 April 2026 05:08:31 +0000 (0:00:02.098) 0:06:13.103 ********** 2026-04-24 05:08:41.120155 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:08:41.120166 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:08:41.120177 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:08:41.120188 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:08:41.120198 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:08:41.120215 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:08:41.120226 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:08:41.120237 | orchestrator | 2026-04-24 05:08:41.120247 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-24 05:08:41.120258 | orchestrator | Friday 24 April 2026 05:08:34 +0000 (0:00:02.831) 0:06:15.934 ********** 2026-04-24 05:08:41.120269 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:08:41.120279 | orchestrator | 2026-04-24 05:08:41.120290 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-24 05:08:41.120301 | orchestrator | Friday 24 April 2026 05:08:36 +0000 (0:00:02.213) 0:06:18.148 ********** 2026-04-24 05:08:41.120311 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:41.120322 | orchestrator | 2026-04-24 05:08:41.120333 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-24 05:08:41.120344 | orchestrator | Friday 24 April 2026 05:08:37 +0000 (0:00:01.244) 0:06:19.393 ********** 2026-04-24 05:08:41.120354 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:08:41.120365 | orchestrator | 2026-04-24 05:08:41.120375 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-24 05:08:41.120386 | orchestrator | Friday 24 April 2026 05:08:38 +0000 (0:00:01.152) 0:06:20.545 ********** 2026-04-24 05:08:41.120397 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:08:41.120407 | orchestrator | 2026-04-24 05:08:41.120418 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-24 05:08:41.120435 | orchestrator | Friday 24 April 2026 05:08:41 +0000 (0:00:02.275) 0:06:22.820 ********** 2026-04-24 05:09:41.683698 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.683824 | orchestrator | 2026-04-24 05:09:41.683842 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-24 05:09:41.683855 | orchestrator | Friday 24 April 2026 05:08:42 +0000 (0:00:01.192) 0:06:24.012 ********** 2026-04-24 05:09:41.683866 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:09:41.683878 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:09:41.683890 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:09:41.683901 | orchestrator | 2026-04-24 05:09:41.683912 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-24 05:09:41.683923 | orchestrator | Friday 24 April 2026 05:08:44 +0000 (0:00:02.487) 0:06:26.500 ********** 2026-04-24 05:09:41.683934 | orchestrator | ok: [testbed-node-0] => (item=['bootstrap-rbd', 'testbed-node-0']) 2026-04-24 05:09:41.683945 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=['bootstrap-rbd', 'testbed-node-1']) 2026-04-24 05:09:41.683957 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=['bootstrap-rbd', 'testbed-node-2']) 2026-04-24 05:09:41.683968 | orchestrator | ok: [testbed-node-0] => (item=['bootstrap-rbd-mirror', 'testbed-node-0']) 2026-04-24 05:09:41.683979 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=['bootstrap-rbd-mirror', 'testbed-node-1']) 2026-04-24 05:09:41.683990 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=['bootstrap-rbd-mirror', 'testbed-node-2']) 2026-04-24 05:09:41.684027 | orchestrator | 2026-04-24 05:09:41.684039 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-24 05:09:41.684049 | orchestrator | Friday 24 April 2026 05:08:57 +0000 (0:00:13.105) 0:06:39.605 ********** 2026-04-24 05:09:41.684060 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:09:41.684071 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:09:41.684082 | orchestrator | 2026-04-24 05:09:41.684092 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-24 05:09:41.684104 | orchestrator | Friday 24 April 2026 05:09:01 +0000 (0:00:03.823) 0:06:43.429 ********** 2026-04-24 05:09:41.684115 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:09:41.684126 | orchestrator | 2026-04-24 05:09:41.684137 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:09:41.684147 | orchestrator | Friday 24 April 2026 05:09:04 +0000 (0:00:02.544) 0:06:45.974 ********** 2026-04-24 05:09:41.684158 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0 2026-04-24 05:09:41.684170 | orchestrator | 2026-04-24 05:09:41.684183 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:09:41.684196 | orchestrator | Friday 24 April 2026 05:09:05 +0000 (0:00:01.479) 0:06:47.454 ********** 2026-04-24 05:09:41.684209 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0 2026-04-24 05:09:41.684222 | orchestrator | 2026-04-24 05:09:41.684234 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:09:41.684247 | orchestrator | Friday 24 April 2026 05:09:07 +0000 (0:00:01.512) 0:06:48.966 ********** 2026-04-24 05:09:41.684259 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:09:41.684272 | orchestrator | 2026-04-24 05:09:41.684284 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:09:41.684297 | orchestrator | Friday 24 April 2026 05:09:08 +0000 (0:00:01.527) 0:06:50.494 ********** 2026-04-24 05:09:41.684309 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.684322 | orchestrator | 2026-04-24 05:09:41.684334 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:09:41.684347 | orchestrator | Friday 24 April 2026 05:09:09 +0000 (0:00:01.099) 0:06:51.593 ********** 2026-04-24 05:09:41.684359 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.684371 | orchestrator | 2026-04-24 05:09:41.684383 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:09:41.684410 | orchestrator | Friday 24 April 2026 05:09:10 +0000 (0:00:01.108) 0:06:52.702 ********** 2026-04-24 05:09:41.684423 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.684435 | orchestrator | 2026-04-24 05:09:41.684448 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:09:41.684460 | orchestrator | Friday 24 April 2026 05:09:12 +0000 (0:00:01.139) 0:06:53.842 ********** 2026-04-24 05:09:41.684473 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:09:41.684486 | orchestrator | 2026-04-24 05:09:41.684498 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:09:41.684511 | orchestrator | Friday 24 April 2026 05:09:13 +0000 (0:00:01.531) 0:06:55.374 ********** 2026-04-24 05:09:41.684523 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.684535 | orchestrator | 2026-04-24 05:09:41.684545 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:09:41.684556 | orchestrator | Friday 24 April 2026 05:09:14 +0000 (0:00:01.152) 0:06:56.527 ********** 2026-04-24 05:09:41.684567 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.684577 | orchestrator | 2026-04-24 05:09:41.684588 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:09:41.684599 | orchestrator | Friday 24 April 2026 05:09:15 +0000 (0:00:01.161) 0:06:57.688 ********** 2026-04-24 05:09:41.684658 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:09:41.684680 | orchestrator | 2026-04-24 05:09:41.684698 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:09:41.684728 | orchestrator | Friday 24 April 2026 05:09:17 +0000 (0:00:01.583) 0:06:59.272 ********** 2026-04-24 05:09:41.684745 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:09:41.684762 | orchestrator | 2026-04-24 05:09:41.684803 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:09:41.684821 | orchestrator | Friday 24 April 2026 05:09:19 +0000 (0:00:01.541) 0:07:00.814 ********** 2026-04-24 05:09:41.684839 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.684855 | orchestrator | 2026-04-24 05:09:41.684873 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:09:41.684890 | orchestrator | Friday 24 April 2026 05:09:20 +0000 (0:00:01.102) 0:07:01.916 ********** 2026-04-24 05:09:41.684906 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:09:41.684923 | orchestrator | 2026-04-24 05:09:41.684940 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:09:41.684958 | orchestrator | Friday 24 April 2026 05:09:21 +0000 (0:00:01.135) 0:07:03.052 ********** 2026-04-24 05:09:41.684976 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.684994 | orchestrator | 2026-04-24 05:09:41.685014 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:09:41.685031 | orchestrator | Friday 24 April 2026 05:09:22 +0000 (0:00:01.121) 0:07:04.173 ********** 2026-04-24 05:09:41.685049 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685066 | orchestrator | 2026-04-24 05:09:41.685083 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:09:41.685102 | orchestrator | Friday 24 April 2026 05:09:23 +0000 (0:00:01.116) 0:07:05.290 ********** 2026-04-24 05:09:41.685120 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685138 | orchestrator | 2026-04-24 05:09:41.685157 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:09:41.685174 | orchestrator | Friday 24 April 2026 05:09:24 +0000 (0:00:01.153) 0:07:06.443 ********** 2026-04-24 05:09:41.685193 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685210 | orchestrator | 2026-04-24 05:09:41.685229 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:09:41.685247 | orchestrator | Friday 24 April 2026 05:09:25 +0000 (0:00:01.130) 0:07:07.574 ********** 2026-04-24 05:09:41.685266 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685285 | orchestrator | 2026-04-24 05:09:41.685304 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:09:41.685322 | orchestrator | Friday 24 April 2026 05:09:26 +0000 (0:00:01.114) 0:07:08.688 ********** 2026-04-24 05:09:41.685341 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:09:41.685360 | orchestrator | 2026-04-24 05:09:41.685379 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:09:41.685398 | orchestrator | Friday 24 April 2026 05:09:28 +0000 (0:00:01.119) 0:07:09.808 ********** 2026-04-24 05:09:41.685417 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:09:41.685436 | orchestrator | 2026-04-24 05:09:41.685455 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:09:41.685474 | orchestrator | Friday 24 April 2026 05:09:29 +0000 (0:00:01.132) 0:07:10.940 ********** 2026-04-24 05:09:41.685493 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:09:41.685512 | orchestrator | 2026-04-24 05:09:41.685531 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:09:41.685549 | orchestrator | Friday 24 April 2026 05:09:30 +0000 (0:00:01.131) 0:07:12.072 ********** 2026-04-24 05:09:41.685568 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685586 | orchestrator | 2026-04-24 05:09:41.685604 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:09:41.685652 | orchestrator | Friday 24 April 2026 05:09:31 +0000 (0:00:01.109) 0:07:13.181 ********** 2026-04-24 05:09:41.685664 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685674 | orchestrator | 2026-04-24 05:09:41.685685 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:09:41.685707 | orchestrator | Friday 24 April 2026 05:09:32 +0000 (0:00:01.120) 0:07:14.301 ********** 2026-04-24 05:09:41.685718 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685728 | orchestrator | 2026-04-24 05:09:41.685739 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:09:41.685750 | orchestrator | Friday 24 April 2026 05:09:33 +0000 (0:00:01.127) 0:07:15.429 ********** 2026-04-24 05:09:41.685760 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685771 | orchestrator | 2026-04-24 05:09:41.685781 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:09:41.685792 | orchestrator | Friday 24 April 2026 05:09:34 +0000 (0:00:01.155) 0:07:16.584 ********** 2026-04-24 05:09:41.685802 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685813 | orchestrator | 2026-04-24 05:09:41.685833 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:09:41.685844 | orchestrator | Friday 24 April 2026 05:09:36 +0000 (0:00:01.163) 0:07:17.747 ********** 2026-04-24 05:09:41.685855 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685865 | orchestrator | 2026-04-24 05:09:41.685876 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:09:41.685886 | orchestrator | Friday 24 April 2026 05:09:37 +0000 (0:00:01.135) 0:07:18.883 ********** 2026-04-24 05:09:41.685897 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685907 | orchestrator | 2026-04-24 05:09:41.685918 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:09:41.685929 | orchestrator | Friday 24 April 2026 05:09:38 +0000 (0:00:01.155) 0:07:20.039 ********** 2026-04-24 05:09:41.685940 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685951 | orchestrator | 2026-04-24 05:09:41.685961 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:09:41.685972 | orchestrator | Friday 24 April 2026 05:09:39 +0000 (0:00:01.120) 0:07:21.160 ********** 2026-04-24 05:09:41.685983 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.685993 | orchestrator | 2026-04-24 05:09:41.686004 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:09:41.686089 | orchestrator | Friday 24 April 2026 05:09:40 +0000 (0:00:01.106) 0:07:22.266 ********** 2026-04-24 05:09:41.686119 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:09:41.686138 | orchestrator | 2026-04-24 05:09:41.686157 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:09:41.686168 | orchestrator | Friday 24 April 2026 05:09:41 +0000 (0:00:01.115) 0:07:23.382 ********** 2026-04-24 05:10:31.803237 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.803351 | orchestrator | 2026-04-24 05:10:31.803370 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:10:31.803384 | orchestrator | Friday 24 April 2026 05:09:42 +0000 (0:00:01.161) 0:07:24.543 ********** 2026-04-24 05:10:31.803395 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.803406 | orchestrator | 2026-04-24 05:10:31.803417 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:10:31.803428 | orchestrator | Friday 24 April 2026 05:09:43 +0000 (0:00:01.121) 0:07:25.665 ********** 2026-04-24 05:10:31.803439 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:10:31.803451 | orchestrator | 2026-04-24 05:10:31.803462 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:10:31.803473 | orchestrator | Friday 24 April 2026 05:09:45 +0000 (0:00:01.989) 0:07:27.654 ********** 2026-04-24 05:10:31.803484 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:10:31.803495 | orchestrator | 2026-04-24 05:10:31.803505 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:10:31.803516 | orchestrator | Friday 24 April 2026 05:09:48 +0000 (0:00:02.328) 0:07:29.982 ********** 2026-04-24 05:10:31.803527 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-0 2026-04-24 05:10:31.803564 | orchestrator | 2026-04-24 05:10:31.803576 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:10:31.803587 | orchestrator | Friday 24 April 2026 05:09:49 +0000 (0:00:01.474) 0:07:31.457 ********** 2026-04-24 05:10:31.803598 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.803609 | orchestrator | 2026-04-24 05:10:31.803693 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:10:31.803716 | orchestrator | Friday 24 April 2026 05:09:50 +0000 (0:00:01.148) 0:07:32.605 ********** 2026-04-24 05:10:31.803728 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.803739 | orchestrator | 2026-04-24 05:10:31.803750 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:10:31.803760 | orchestrator | Friday 24 April 2026 05:09:51 +0000 (0:00:01.093) 0:07:33.699 ********** 2026-04-24 05:10:31.803771 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:10:31.803784 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:10:31.803798 | orchestrator | 2026-04-24 05:10:31.803810 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:10:31.803823 | orchestrator | Friday 24 April 2026 05:09:53 +0000 (0:00:01.853) 0:07:35.553 ********** 2026-04-24 05:10:31.803835 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:10:31.803847 | orchestrator | 2026-04-24 05:10:31.803859 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:10:31.803872 | orchestrator | Friday 24 April 2026 05:09:55 +0000 (0:00:01.612) 0:07:37.165 ********** 2026-04-24 05:10:31.803884 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.803897 | orchestrator | 2026-04-24 05:10:31.803909 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:10:31.803922 | orchestrator | Friday 24 April 2026 05:09:56 +0000 (0:00:01.161) 0:07:38.327 ********** 2026-04-24 05:10:31.803935 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.803947 | orchestrator | 2026-04-24 05:10:31.803959 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:10:31.803972 | orchestrator | Friday 24 April 2026 05:09:57 +0000 (0:00:01.176) 0:07:39.504 ********** 2026-04-24 05:10:31.803985 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.803997 | orchestrator | 2026-04-24 05:10:31.804010 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:10:31.804022 | orchestrator | Friday 24 April 2026 05:09:58 +0000 (0:00:01.122) 0:07:40.627 ********** 2026-04-24 05:10:31.804034 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-0 2026-04-24 05:10:31.804046 | orchestrator | 2026-04-24 05:10:31.804059 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:10:31.804071 | orchestrator | Friday 24 April 2026 05:10:00 +0000 (0:00:01.543) 0:07:42.170 ********** 2026-04-24 05:10:31.804084 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:10:31.804096 | orchestrator | 2026-04-24 05:10:31.804123 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:10:31.804136 | orchestrator | Friday 24 April 2026 05:10:02 +0000 (0:00:01.762) 0:07:43.933 ********** 2026-04-24 05:10:31.804147 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:10:31.804158 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:10:31.804168 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:10:31.804179 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804189 | orchestrator | 2026-04-24 05:10:31.804200 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:10:31.804211 | orchestrator | Friday 24 April 2026 05:10:03 +0000 (0:00:01.121) 0:07:45.055 ********** 2026-04-24 05:10:31.804222 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804232 | orchestrator | 2026-04-24 05:10:31.804253 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:10:31.804264 | orchestrator | Friday 24 April 2026 05:10:04 +0000 (0:00:01.141) 0:07:46.196 ********** 2026-04-24 05:10:31.804274 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804285 | orchestrator | 2026-04-24 05:10:31.804296 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:10:31.804307 | orchestrator | Friday 24 April 2026 05:10:05 +0000 (0:00:01.198) 0:07:47.394 ********** 2026-04-24 05:10:31.804318 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804329 | orchestrator | 2026-04-24 05:10:31.804340 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:10:31.804369 | orchestrator | Friday 24 April 2026 05:10:06 +0000 (0:00:01.168) 0:07:48.563 ********** 2026-04-24 05:10:31.804380 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804391 | orchestrator | 2026-04-24 05:10:31.804402 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:10:31.804413 | orchestrator | Friday 24 April 2026 05:10:08 +0000 (0:00:01.203) 0:07:49.766 ********** 2026-04-24 05:10:31.804424 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804434 | orchestrator | 2026-04-24 05:10:31.804445 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:10:31.804456 | orchestrator | Friday 24 April 2026 05:10:09 +0000 (0:00:01.133) 0:07:50.900 ********** 2026-04-24 05:10:31.804467 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:10:31.804477 | orchestrator | 2026-04-24 05:10:31.804488 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:10:31.804499 | orchestrator | Friday 24 April 2026 05:10:11 +0000 (0:00:02.570) 0:07:53.471 ********** 2026-04-24 05:10:31.804510 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:10:31.804520 | orchestrator | 2026-04-24 05:10:31.804531 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:10:31.804542 | orchestrator | Friday 24 April 2026 05:10:12 +0000 (0:00:01.179) 0:07:54.650 ********** 2026-04-24 05:10:31.804552 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-0 2026-04-24 05:10:31.804563 | orchestrator | 2026-04-24 05:10:31.804574 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:10:31.804585 | orchestrator | Friday 24 April 2026 05:10:14 +0000 (0:00:01.512) 0:07:56.163 ********** 2026-04-24 05:10:31.804595 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804606 | orchestrator | 2026-04-24 05:10:31.804617 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:10:31.804657 | orchestrator | Friday 24 April 2026 05:10:15 +0000 (0:00:01.155) 0:07:57.318 ********** 2026-04-24 05:10:31.804668 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804679 | orchestrator | 2026-04-24 05:10:31.804689 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:10:31.804700 | orchestrator | Friday 24 April 2026 05:10:16 +0000 (0:00:01.105) 0:07:58.424 ********** 2026-04-24 05:10:31.804711 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804721 | orchestrator | 2026-04-24 05:10:31.804732 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:10:31.804824 | orchestrator | Friday 24 April 2026 05:10:17 +0000 (0:00:01.204) 0:07:59.629 ********** 2026-04-24 05:10:31.804837 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804848 | orchestrator | 2026-04-24 05:10:31.804858 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:10:31.804869 | orchestrator | Friday 24 April 2026 05:10:19 +0000 (0:00:01.140) 0:08:00.770 ********** 2026-04-24 05:10:31.804880 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804891 | orchestrator | 2026-04-24 05:10:31.804902 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:10:31.804913 | orchestrator | Friday 24 April 2026 05:10:20 +0000 (0:00:01.126) 0:08:01.897 ********** 2026-04-24 05:10:31.804923 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804943 | orchestrator | 2026-04-24 05:10:31.804954 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:10:31.804965 | orchestrator | Friday 24 April 2026 05:10:21 +0000 (0:00:01.186) 0:08:03.083 ********** 2026-04-24 05:10:31.804975 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.804986 | orchestrator | 2026-04-24 05:10:31.804997 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:10:31.805008 | orchestrator | Friday 24 April 2026 05:10:22 +0000 (0:00:01.133) 0:08:04.217 ********** 2026-04-24 05:10:31.805019 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:10:31.805030 | orchestrator | 2026-04-24 05:10:31.805041 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:10:31.805051 | orchestrator | Friday 24 April 2026 05:10:23 +0000 (0:00:01.175) 0:08:05.392 ********** 2026-04-24 05:10:31.805062 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:10:31.805073 | orchestrator | 2026-04-24 05:10:31.805084 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:10:31.805095 | orchestrator | Friday 24 April 2026 05:10:24 +0000 (0:00:01.244) 0:08:06.637 ********** 2026-04-24 05:10:31.805112 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-0 2026-04-24 05:10:31.805123 | orchestrator | 2026-04-24 05:10:31.805134 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:10:31.805145 | orchestrator | Friday 24 April 2026 05:10:26 +0000 (0:00:01.475) 0:08:08.112 ********** 2026-04-24 05:10:31.805156 | orchestrator | ok: [testbed-node-0] => (item=/etc/ceph) 2026-04-24 05:10:31.805167 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-24 05:10:31.805178 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-24 05:10:31.805189 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-24 05:10:31.805200 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-24 05:10:31.805210 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-24 05:10:31.805221 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-24 05:10:31.805232 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:10:31.805242 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:10:31.805253 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:10:31.805264 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:10:31.805275 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:10:31.805286 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:10:31.805297 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:10:31.805315 | orchestrator | ok: [testbed-node-0] => (item=/var/run/ceph) 2026-04-24 05:11:19.656493 | orchestrator | ok: [testbed-node-0] => (item=/var/log/ceph) 2026-04-24 05:11:19.656609 | orchestrator | 2026-04-24 05:11:19.656627 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:11:19.656688 | orchestrator | Friday 24 April 2026 05:10:33 +0000 (0:00:06.850) 0:08:14.963 ********** 2026-04-24 05:11:19.656701 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.656714 | orchestrator | 2026-04-24 05:11:19.656726 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:11:19.656737 | orchestrator | Friday 24 April 2026 05:10:34 +0000 (0:00:01.123) 0:08:16.086 ********** 2026-04-24 05:11:19.656748 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.656760 | orchestrator | 2026-04-24 05:11:19.656771 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:11:19.656782 | orchestrator | Friday 24 April 2026 05:10:35 +0000 (0:00:01.183) 0:08:17.270 ********** 2026-04-24 05:11:19.656793 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.656804 | orchestrator | 2026-04-24 05:11:19.656815 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:11:19.656851 | orchestrator | Friday 24 April 2026 05:10:36 +0000 (0:00:01.163) 0:08:18.434 ********** 2026-04-24 05:11:19.656863 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.656874 | orchestrator | 2026-04-24 05:11:19.656885 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:11:19.656895 | orchestrator | Friday 24 April 2026 05:10:37 +0000 (0:00:01.160) 0:08:19.595 ********** 2026-04-24 05:11:19.656906 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.656917 | orchestrator | 2026-04-24 05:11:19.656928 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:11:19.656939 | orchestrator | Friday 24 April 2026 05:10:39 +0000 (0:00:01.163) 0:08:20.758 ********** 2026-04-24 05:11:19.656949 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.656960 | orchestrator | 2026-04-24 05:11:19.656971 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:11:19.656983 | orchestrator | Friday 24 April 2026 05:10:40 +0000 (0:00:01.142) 0:08:21.901 ********** 2026-04-24 05:11:19.656994 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657004 | orchestrator | 2026-04-24 05:11:19.657015 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:11:19.657028 | orchestrator | Friday 24 April 2026 05:10:41 +0000 (0:00:01.146) 0:08:23.047 ********** 2026-04-24 05:11:19.657041 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657054 | orchestrator | 2026-04-24 05:11:19.657066 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:11:19.657078 | orchestrator | Friday 24 April 2026 05:10:42 +0000 (0:00:01.193) 0:08:24.241 ********** 2026-04-24 05:11:19.657090 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657103 | orchestrator | 2026-04-24 05:11:19.657115 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:11:19.657128 | orchestrator | Friday 24 April 2026 05:10:43 +0000 (0:00:01.156) 0:08:25.397 ********** 2026-04-24 05:11:19.657140 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657152 | orchestrator | 2026-04-24 05:11:19.657165 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:11:19.657177 | orchestrator | Friday 24 April 2026 05:10:44 +0000 (0:00:01.163) 0:08:26.560 ********** 2026-04-24 05:11:19.657189 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657202 | orchestrator | 2026-04-24 05:11:19.657214 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:11:19.657226 | orchestrator | Friday 24 April 2026 05:10:46 +0000 (0:00:01.167) 0:08:27.728 ********** 2026-04-24 05:11:19.657238 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657250 | orchestrator | 2026-04-24 05:11:19.657264 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:11:19.657277 | orchestrator | Friday 24 April 2026 05:10:47 +0000 (0:00:01.153) 0:08:28.881 ********** 2026-04-24 05:11:19.657289 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657302 | orchestrator | 2026-04-24 05:11:19.657314 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:11:19.657326 | orchestrator | Friday 24 April 2026 05:10:48 +0000 (0:00:01.201) 0:08:30.082 ********** 2026-04-24 05:11:19.657353 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657367 | orchestrator | 2026-04-24 05:11:19.657379 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:11:19.657391 | orchestrator | Friday 24 April 2026 05:10:49 +0000 (0:00:01.124) 0:08:31.207 ********** 2026-04-24 05:11:19.657402 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657412 | orchestrator | 2026-04-24 05:11:19.657423 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:11:19.657434 | orchestrator | Friday 24 April 2026 05:10:50 +0000 (0:00:01.216) 0:08:32.423 ********** 2026-04-24 05:11:19.657452 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657463 | orchestrator | 2026-04-24 05:11:19.657473 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:11:19.657484 | orchestrator | Friday 24 April 2026 05:10:51 +0000 (0:00:01.121) 0:08:33.545 ********** 2026-04-24 05:11:19.657495 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657506 | orchestrator | 2026-04-24 05:11:19.657517 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:11:19.657529 | orchestrator | Friday 24 April 2026 05:10:52 +0000 (0:00:01.121) 0:08:34.667 ********** 2026-04-24 05:11:19.657539 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657550 | orchestrator | 2026-04-24 05:11:19.657561 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:11:19.657571 | orchestrator | Friday 24 April 2026 05:10:54 +0000 (0:00:01.107) 0:08:35.774 ********** 2026-04-24 05:11:19.657582 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657593 | orchestrator | 2026-04-24 05:11:19.657620 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:11:19.657632 | orchestrator | Friday 24 April 2026 05:10:55 +0000 (0:00:01.176) 0:08:36.950 ********** 2026-04-24 05:11:19.657693 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657705 | orchestrator | 2026-04-24 05:11:19.657716 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:11:19.657727 | orchestrator | Friday 24 April 2026 05:10:56 +0000 (0:00:01.119) 0:08:38.069 ********** 2026-04-24 05:11:19.657738 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657749 | orchestrator | 2026-04-24 05:11:19.657759 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:11:19.657770 | orchestrator | Friday 24 April 2026 05:10:57 +0000 (0:00:01.141) 0:08:39.211 ********** 2026-04-24 05:11:19.657781 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:11:19.657792 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:11:19.657803 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:11:19.657813 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657824 | orchestrator | 2026-04-24 05:11:19.657835 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:11:19.657845 | orchestrator | Friday 24 April 2026 05:10:59 +0000 (0:00:01.733) 0:08:40.944 ********** 2026-04-24 05:11:19.657856 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:11:19.657867 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:11:19.657877 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:11:19.657888 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657899 | orchestrator | 2026-04-24 05:11:19.657909 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:11:19.657920 | orchestrator | Friday 24 April 2026 05:11:00 +0000 (0:00:01.391) 0:08:42.335 ********** 2026-04-24 05:11:19.657931 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:11:19.657941 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:11:19.657952 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:11:19.657962 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.657973 | orchestrator | 2026-04-24 05:11:19.657984 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:11:19.657994 | orchestrator | Friday 24 April 2026 05:11:02 +0000 (0:00:01.426) 0:08:43.763 ********** 2026-04-24 05:11:19.658005 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.658075 | orchestrator | 2026-04-24 05:11:19.658090 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:11:19.658101 | orchestrator | Friday 24 April 2026 05:11:03 +0000 (0:00:01.102) 0:08:44.865 ********** 2026-04-24 05:11:19.658112 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-24 05:11:19.658132 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.658143 | orchestrator | 2026-04-24 05:11:19.658154 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:11:19.658164 | orchestrator | Friday 24 April 2026 05:11:04 +0000 (0:00:01.335) 0:08:46.201 ********** 2026-04-24 05:11:19.658175 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:11:19.658186 | orchestrator | 2026-04-24 05:11:19.658197 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:11:19.658208 | orchestrator | Friday 24 April 2026 05:11:06 +0000 (0:00:01.772) 0:08:47.973 ********** 2026-04-24 05:11:19.658219 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:11:19.658230 | orchestrator | 2026-04-24 05:11:19.658240 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-24 05:11:19.658251 | orchestrator | Friday 24 April 2026 05:11:07 +0000 (0:00:01.150) 0:08:49.124 ********** 2026-04-24 05:11:19.658262 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-0 2026-04-24 05:11:19.658274 | orchestrator | 2026-04-24 05:11:19.658285 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-24 05:11:19.658296 | orchestrator | Friday 24 April 2026 05:11:08 +0000 (0:00:01.493) 0:08:50.618 ********** 2026-04-24 05:11:19.658306 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:11:19.658317 | orchestrator | 2026-04-24 05:11:19.658328 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-24 05:11:19.658339 | orchestrator | Friday 24 April 2026 05:11:12 +0000 (0:00:03.120) 0:08:53.738 ********** 2026-04-24 05:11:19.658350 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:11:19.658361 | orchestrator | 2026-04-24 05:11:19.658371 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-24 05:11:19.658382 | orchestrator | Friday 24 April 2026 05:11:13 +0000 (0:00:01.151) 0:08:54.890 ********** 2026-04-24 05:11:19.658393 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:11:19.658404 | orchestrator | 2026-04-24 05:11:19.658415 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-24 05:11:19.658426 | orchestrator | Friday 24 April 2026 05:11:14 +0000 (0:00:01.160) 0:08:56.050 ********** 2026-04-24 05:11:19.658437 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:11:19.658448 | orchestrator | 2026-04-24 05:11:19.658459 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-24 05:11:19.658470 | orchestrator | Friday 24 April 2026 05:11:15 +0000 (0:00:01.197) 0:08:57.248 ********** 2026-04-24 05:11:19.658480 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:11:19.658491 | orchestrator | 2026-04-24 05:11:19.658502 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-24 05:11:19.658513 | orchestrator | Friday 24 April 2026 05:11:17 +0000 (0:00:02.022) 0:08:59.271 ********** 2026-04-24 05:11:19.658524 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:11:19.658534 | orchestrator | 2026-04-24 05:11:19.658545 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-24 05:11:19.658556 | orchestrator | Friday 24 April 2026 05:11:19 +0000 (0:00:01.612) 0:09:00.884 ********** 2026-04-24 05:11:19.658567 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:11:19.658578 | orchestrator | 2026-04-24 05:11:19.658597 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-24 05:12:17.305555 | orchestrator | Friday 24 April 2026 05:11:20 +0000 (0:00:01.467) 0:09:02.351 ********** 2026-04-24 05:12:17.305641 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.305689 | orchestrator | 2026-04-24 05:12:17.305699 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-24 05:12:17.305706 | orchestrator | Friday 24 April 2026 05:11:22 +0000 (0:00:01.495) 0:09:03.846 ********** 2026-04-24 05:12:17.305713 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.305720 | orchestrator | 2026-04-24 05:12:17.305727 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-24 05:12:17.305753 | orchestrator | Friday 24 April 2026 05:11:23 +0000 (0:00:01.741) 0:09:05.588 ********** 2026-04-24 05:12:17.305760 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.305767 | orchestrator | 2026-04-24 05:12:17.305773 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-24 05:12:17.305780 | orchestrator | Friday 24 April 2026 05:11:25 +0000 (0:00:01.750) 0:09:07.339 ********** 2026-04-24 05:12:17.305786 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 05:12:17.305794 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 05:12:17.305801 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 05:12:17.305808 | orchestrator | ok: [testbed-node-0 -> {{ item }}] 2026-04-24 05:12:17.305814 | orchestrator | 2026-04-24 05:12:17.305821 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-24 05:12:17.305828 | orchestrator | Friday 24 April 2026 05:11:29 +0000 (0:00:03.839) 0:09:11.178 ********** 2026-04-24 05:12:17.305834 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:12:17.305841 | orchestrator | 2026-04-24 05:12:17.305885 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-24 05:12:17.305893 | orchestrator | Friday 24 April 2026 05:11:31 +0000 (0:00:01.968) 0:09:13.147 ********** 2026-04-24 05:12:17.305900 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.305906 | orchestrator | 2026-04-24 05:12:17.305913 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-24 05:12:17.305920 | orchestrator | Friday 24 April 2026 05:11:32 +0000 (0:00:01.151) 0:09:14.299 ********** 2026-04-24 05:12:17.305926 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.305933 | orchestrator | 2026-04-24 05:12:17.305939 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-24 05:12:17.305946 | orchestrator | Friday 24 April 2026 05:11:33 +0000 (0:00:01.119) 0:09:15.418 ********** 2026-04-24 05:12:17.305952 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.305959 | orchestrator | 2026-04-24 05:12:17.305965 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-24 05:12:17.305972 | orchestrator | Friday 24 April 2026 05:11:35 +0000 (0:00:02.115) 0:09:17.533 ********** 2026-04-24 05:12:17.305978 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.305985 | orchestrator | 2026-04-24 05:12:17.305991 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-24 05:12:17.305998 | orchestrator | Friday 24 April 2026 05:11:37 +0000 (0:00:01.447) 0:09:18.981 ********** 2026-04-24 05:12:17.306004 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:12:17.306011 | orchestrator | 2026-04-24 05:12:17.306075 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-24 05:12:17.306086 | orchestrator | Friday 24 April 2026 05:11:38 +0000 (0:00:01.139) 0:09:20.120 ********** 2026-04-24 05:12:17.306096 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-0 2026-04-24 05:12:17.306108 | orchestrator | 2026-04-24 05:12:17.306119 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-24 05:12:17.306130 | orchestrator | Friday 24 April 2026 05:11:39 +0000 (0:00:01.469) 0:09:21.590 ********** 2026-04-24 05:12:17.306141 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:12:17.306152 | orchestrator | 2026-04-24 05:12:17.306163 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-24 05:12:17.306174 | orchestrator | Friday 24 April 2026 05:11:40 +0000 (0:00:01.115) 0:09:22.705 ********** 2026-04-24 05:12:17.306185 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:12:17.306196 | orchestrator | 2026-04-24 05:12:17.306208 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-24 05:12:17.306220 | orchestrator | Friday 24 April 2026 05:11:42 +0000 (0:00:01.129) 0:09:23.835 ********** 2026-04-24 05:12:17.306238 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-0 2026-04-24 05:12:17.306250 | orchestrator | 2026-04-24 05:12:17.306262 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-24 05:12:17.306281 | orchestrator | Friday 24 April 2026 05:11:43 +0000 (0:00:01.535) 0:09:25.371 ********** 2026-04-24 05:12:17.306289 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.306296 | orchestrator | 2026-04-24 05:12:17.306304 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-24 05:12:17.306311 | orchestrator | Friday 24 April 2026 05:11:45 +0000 (0:00:02.265) 0:09:27.636 ********** 2026-04-24 05:12:17.306319 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.306327 | orchestrator | 2026-04-24 05:12:17.306334 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-24 05:12:17.306342 | orchestrator | Friday 24 April 2026 05:11:47 +0000 (0:00:01.984) 0:09:29.621 ********** 2026-04-24 05:12:17.306349 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.306357 | orchestrator | 2026-04-24 05:12:17.306364 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-24 05:12:17.306372 | orchestrator | Friday 24 April 2026 05:11:50 +0000 (0:00:02.424) 0:09:32.045 ********** 2026-04-24 05:12:17.306379 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:12:17.306387 | orchestrator | 2026-04-24 05:12:17.306394 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-24 05:12:17.306401 | orchestrator | Friday 24 April 2026 05:11:53 +0000 (0:00:03.215) 0:09:35.261 ********** 2026-04-24 05:12:17.306409 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-0 2026-04-24 05:12:17.306417 | orchestrator | 2026-04-24 05:12:17.306440 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-24 05:12:17.306448 | orchestrator | Friday 24 April 2026 05:11:55 +0000 (0:00:01.539) 0:09:36.801 ********** 2026-04-24 05:12:17.306456 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.306463 | orchestrator | 2026-04-24 05:12:17.306470 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-24 05:12:17.306478 | orchestrator | Friday 24 April 2026 05:11:57 +0000 (0:00:02.304) 0:09:39.105 ********** 2026-04-24 05:12:17.306485 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:17.306493 | orchestrator | 2026-04-24 05:12:17.306501 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-24 05:12:17.306508 | orchestrator | Friday 24 April 2026 05:12:00 +0000 (0:00:03.032) 0:09:42.138 ********** 2026-04-24 05:12:17.306516 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:12:17.306523 | orchestrator | 2026-04-24 05:12:17.306531 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-24 05:12:17.306537 | orchestrator | Friday 24 April 2026 05:12:01 +0000 (0:00:01.107) 0:09:43.246 ********** 2026-04-24 05:12:17.306546 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-24 05:12:17.306555 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-24 05:12:17.306562 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-24 05:12:17.306569 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-24 05:12:17.306583 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-24 05:12:17.306595 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}])  2026-04-24 05:12:17.306603 | orchestrator | 2026-04-24 05:12:17.306610 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-24 05:12:17.306617 | orchestrator | Friday 24 April 2026 05:12:11 +0000 (0:00:09.764) 0:09:53.010 ********** 2026-04-24 05:12:17.306623 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:12:17.306630 | orchestrator | 2026-04-24 05:12:17.306637 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:12:17.306643 | orchestrator | Friday 24 April 2026 05:12:13 +0000 (0:00:02.444) 0:09:55.455 ********** 2026-04-24 05:12:17.306671 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:12:17.306681 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 05:12:17.306687 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 05:12:17.306694 | orchestrator | 2026-04-24 05:12:17.306704 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:12:17.306716 | orchestrator | Friday 24 April 2026 05:12:15 +0000 (0:00:02.200) 0:09:57.655 ********** 2026-04-24 05:12:17.306726 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:12:17.306737 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:12:17.306748 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:12:17.306758 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:12:17.306768 | orchestrator | 2026-04-24 05:12:17.306777 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-24 05:12:17.306794 | orchestrator | Friday 24 April 2026 05:12:17 +0000 (0:00:01.348) 0:09:59.003 ********** 2026-04-24 05:12:45.687950 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:12:45.688084 | orchestrator | 2026-04-24 05:12:45.688101 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-24 05:12:45.688113 | orchestrator | Friday 24 April 2026 05:12:18 +0000 (0:00:01.129) 0:10:00.133 ********** 2026-04-24 05:12:45.688124 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:12:45.688136 | orchestrator | 2026-04-24 05:12:45.688146 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-24 05:12:45.688155 | orchestrator | 2026-04-24 05:12:45.688165 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-24 05:12:45.688175 | orchestrator | Friday 24 April 2026 05:12:20 +0000 (0:00:02.064) 0:10:02.198 ********** 2026-04-24 05:12:45.688185 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688194 | orchestrator | 2026-04-24 05:12:45.688204 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-24 05:12:45.688214 | orchestrator | Friday 24 April 2026 05:12:21 +0000 (0:00:01.133) 0:10:03.331 ********** 2026-04-24 05:12:45.688223 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688233 | orchestrator | 2026-04-24 05:12:45.688243 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-24 05:12:45.688276 | orchestrator | Friday 24 April 2026 05:12:22 +0000 (0:00:00.795) 0:10:04.127 ********** 2026-04-24 05:12:45.688286 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:12:45.688296 | orchestrator | 2026-04-24 05:12:45.688305 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-24 05:12:45.688315 | orchestrator | Friday 24 April 2026 05:12:23 +0000 (0:00:00.831) 0:10:04.958 ********** 2026-04-24 05:12:45.688324 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688334 | orchestrator | 2026-04-24 05:12:45.688343 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:12:45.688353 | orchestrator | Friday 24 April 2026 05:12:24 +0000 (0:00:00.760) 0:10:05.718 ********** 2026-04-24 05:12:45.688362 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-1 2026-04-24 05:12:45.688372 | orchestrator | 2026-04-24 05:12:45.688381 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:12:45.688391 | orchestrator | Friday 24 April 2026 05:12:25 +0000 (0:00:01.128) 0:10:06.847 ********** 2026-04-24 05:12:45.688400 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688409 | orchestrator | 2026-04-24 05:12:45.688419 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:12:45.688429 | orchestrator | Friday 24 April 2026 05:12:26 +0000 (0:00:01.514) 0:10:08.362 ********** 2026-04-24 05:12:45.688438 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688448 | orchestrator | 2026-04-24 05:12:45.688460 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:12:45.688471 | orchestrator | Friday 24 April 2026 05:12:27 +0000 (0:00:01.180) 0:10:09.543 ********** 2026-04-24 05:12:45.688482 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688493 | orchestrator | 2026-04-24 05:12:45.688503 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:12:45.688514 | orchestrator | Friday 24 April 2026 05:12:29 +0000 (0:00:01.488) 0:10:11.032 ********** 2026-04-24 05:12:45.688525 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688536 | orchestrator | 2026-04-24 05:12:45.688547 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:12:45.688559 | orchestrator | Friday 24 April 2026 05:12:30 +0000 (0:00:01.183) 0:10:12.215 ********** 2026-04-24 05:12:45.688575 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688591 | orchestrator | 2026-04-24 05:12:45.688607 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:12:45.688623 | orchestrator | Friday 24 April 2026 05:12:31 +0000 (0:00:01.210) 0:10:13.426 ********** 2026-04-24 05:12:45.688639 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688654 | orchestrator | 2026-04-24 05:12:45.688699 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:12:45.688717 | orchestrator | Friday 24 April 2026 05:12:32 +0000 (0:00:01.135) 0:10:14.562 ********** 2026-04-24 05:12:45.688736 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:12:45.688755 | orchestrator | 2026-04-24 05:12:45.688773 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:12:45.688785 | orchestrator | Friday 24 April 2026 05:12:34 +0000 (0:00:01.164) 0:10:15.726 ********** 2026-04-24 05:12:45.688796 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688808 | orchestrator | 2026-04-24 05:12:45.688833 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:12:45.688843 | orchestrator | Friday 24 April 2026 05:12:35 +0000 (0:00:01.137) 0:10:16.863 ********** 2026-04-24 05:12:45.688853 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:12:45.688863 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:12:45.688872 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:12:45.688884 | orchestrator | 2026-04-24 05:12:45.688901 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:12:45.688917 | orchestrator | Friday 24 April 2026 05:12:36 +0000 (0:00:01.696) 0:10:18.560 ********** 2026-04-24 05:12:45.688946 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:12:45.688961 | orchestrator | 2026-04-24 05:12:45.688977 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:12:45.688993 | orchestrator | Friday 24 April 2026 05:12:38 +0000 (0:00:01.281) 0:10:19.842 ********** 2026-04-24 05:12:45.689010 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:12:45.689026 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:12:45.689043 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:12:45.689060 | orchestrator | 2026-04-24 05:12:45.689075 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:12:45.689093 | orchestrator | Friday 24 April 2026 05:12:41 +0000 (0:00:03.171) 0:10:23.013 ********** 2026-04-24 05:12:45.689122 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 05:12:45.689133 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 05:12:45.689143 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 05:12:45.689152 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:12:45.689162 | orchestrator | 2026-04-24 05:12:45.689171 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:12:45.689180 | orchestrator | Friday 24 April 2026 05:12:42 +0000 (0:00:01.429) 0:10:24.442 ********** 2026-04-24 05:12:45.689192 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:12:45.689205 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:12:45.689214 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:12:45.689224 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:12:45.689233 | orchestrator | 2026-04-24 05:12:45.689243 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:12:45.689253 | orchestrator | Friday 24 April 2026 05:12:44 +0000 (0:00:01.595) 0:10:26.038 ********** 2026-04-24 05:12:45.689265 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:12:45.689278 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:12:45.689288 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:12:45.689298 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:12:45.689316 | orchestrator | 2026-04-24 05:12:45.689326 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:12:45.689335 | orchestrator | Friday 24 April 2026 05:12:45 +0000 (0:00:01.251) 0:10:27.289 ********** 2026-04-24 05:12:45.689353 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:12:38.628420', 'end': '2026-04-24 05:12:38.685928', 'delta': '0:00:00.057508', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:12:45.689374 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': 'cb6ff5b25438', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:12:39.196595', 'end': '2026-04-24 05:12:39.245437', 'delta': '0:00:00.048842', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['cb6ff5b25438'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:13:04.023553 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '4af70b8ccc8b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:12:39.776011', 'end': '2026-04-24 05:12:39.821333', 'delta': '0:00:00.045322', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['4af70b8ccc8b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:13:04.023729 | orchestrator | 2026-04-24 05:13:04.023751 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:13:04.023764 | orchestrator | Friday 24 April 2026 05:12:46 +0000 (0:00:01.241) 0:10:28.530 ********** 2026-04-24 05:13:04.023776 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:13:04.023788 | orchestrator | 2026-04-24 05:13:04.023800 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:13:04.023811 | orchestrator | Friday 24 April 2026 05:12:48 +0000 (0:00:01.281) 0:10:29.812 ********** 2026-04-24 05:13:04.023822 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.023834 | orchestrator | 2026-04-24 05:13:04.023846 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:13:04.023857 | orchestrator | Friday 24 April 2026 05:12:49 +0000 (0:00:01.240) 0:10:31.053 ********** 2026-04-24 05:13:04.023868 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:13:04.023879 | orchestrator | 2026-04-24 05:13:04.023891 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:13:04.023902 | orchestrator | Friday 24 April 2026 05:12:50 +0000 (0:00:01.172) 0:10:32.226 ********** 2026-04-24 05:13:04.023913 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:13:04.023925 | orchestrator | 2026-04-24 05:13:04.023936 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:13:04.023947 | orchestrator | Friday 24 April 2026 05:12:52 +0000 (0:00:01.948) 0:10:34.174 ********** 2026-04-24 05:13:04.023984 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:13:04.023996 | orchestrator | 2026-04-24 05:13:04.024007 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:13:04.024018 | orchestrator | Friday 24 April 2026 05:12:53 +0000 (0:00:01.148) 0:10:35.323 ********** 2026-04-24 05:13:04.024029 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024041 | orchestrator | 2026-04-24 05:13:04.024052 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:13:04.024063 | orchestrator | Friday 24 April 2026 05:12:54 +0000 (0:00:01.152) 0:10:36.475 ********** 2026-04-24 05:13:04.024074 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024085 | orchestrator | 2026-04-24 05:13:04.024096 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:13:04.024108 | orchestrator | Friday 24 April 2026 05:12:55 +0000 (0:00:01.218) 0:10:37.694 ********** 2026-04-24 05:13:04.024119 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024130 | orchestrator | 2026-04-24 05:13:04.024141 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:13:04.024152 | orchestrator | Friday 24 April 2026 05:12:57 +0000 (0:00:01.099) 0:10:38.794 ********** 2026-04-24 05:13:04.024163 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024174 | orchestrator | 2026-04-24 05:13:04.024186 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:13:04.024212 | orchestrator | Friday 24 April 2026 05:12:58 +0000 (0:00:01.084) 0:10:39.879 ********** 2026-04-24 05:13:04.024223 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024235 | orchestrator | 2026-04-24 05:13:04.024246 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:13:04.024257 | orchestrator | Friday 24 April 2026 05:12:59 +0000 (0:00:01.207) 0:10:41.086 ********** 2026-04-24 05:13:04.024268 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024279 | orchestrator | 2026-04-24 05:13:04.024290 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:13:04.024301 | orchestrator | Friday 24 April 2026 05:13:00 +0000 (0:00:01.129) 0:10:42.216 ********** 2026-04-24 05:13:04.024313 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024324 | orchestrator | 2026-04-24 05:13:04.024335 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:13:04.024347 | orchestrator | Friday 24 April 2026 05:13:01 +0000 (0:00:01.135) 0:10:43.351 ********** 2026-04-24 05:13:04.024358 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024369 | orchestrator | 2026-04-24 05:13:04.024380 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:13:04.024392 | orchestrator | Friday 24 April 2026 05:13:02 +0000 (0:00:01.114) 0:10:44.465 ********** 2026-04-24 05:13:04.024403 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:04.024414 | orchestrator | 2026-04-24 05:13:04.024426 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:13:04.024437 | orchestrator | Friday 24 April 2026 05:13:03 +0000 (0:00:01.127) 0:10:45.592 ********** 2026-04-24 05:13:04.024468 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:13:04.024483 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:13:04.024502 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:13:04.024515 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-08-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:13:04.024528 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:13:04.024539 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:13:04.024555 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:13:04.024580 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '922a5bfc', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:13:05.244849 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:13:05.244944 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:13:05.244958 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:05.244967 | orchestrator | 2026-04-24 05:13:05.244977 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:13:05.244986 | orchestrator | Friday 24 April 2026 05:13:05 +0000 (0:00:01.226) 0:10:46.819 ********** 2026-04-24 05:13:05.244996 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:05.245022 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:05.245032 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:05.245041 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-08-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:05.245088 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:05.245098 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:05.245107 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:05.245122 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '922a5bfc', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:05.245145 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:40.585128 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:13:40.585243 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.585261 | orchestrator | 2026-04-24 05:13:40.585272 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:13:40.585284 | orchestrator | Friday 24 April 2026 05:13:06 +0000 (0:00:01.236) 0:10:48.055 ********** 2026-04-24 05:13:40.585294 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:13:40.585305 | orchestrator | 2026-04-24 05:13:40.585315 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:13:40.585325 | orchestrator | Friday 24 April 2026 05:13:07 +0000 (0:00:01.474) 0:10:49.530 ********** 2026-04-24 05:13:40.585334 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:13:40.585344 | orchestrator | 2026-04-24 05:13:40.585354 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:13:40.585364 | orchestrator | Friday 24 April 2026 05:13:08 +0000 (0:00:01.136) 0:10:50.667 ********** 2026-04-24 05:13:40.585373 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:13:40.585383 | orchestrator | 2026-04-24 05:13:40.585393 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:13:40.585403 | orchestrator | Friday 24 April 2026 05:13:10 +0000 (0:00:01.437) 0:10:52.105 ********** 2026-04-24 05:13:40.585413 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.585423 | orchestrator | 2026-04-24 05:13:40.585432 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:13:40.585442 | orchestrator | Friday 24 April 2026 05:13:11 +0000 (0:00:01.099) 0:10:53.204 ********** 2026-04-24 05:13:40.585467 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.585477 | orchestrator | 2026-04-24 05:13:40.585493 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:13:40.585510 | orchestrator | Friday 24 April 2026 05:13:12 +0000 (0:00:01.290) 0:10:54.494 ********** 2026-04-24 05:13:40.585526 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.585543 | orchestrator | 2026-04-24 05:13:40.585561 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:13:40.585577 | orchestrator | Friday 24 April 2026 05:13:13 +0000 (0:00:01.149) 0:10:55.644 ********** 2026-04-24 05:13:40.585621 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-24 05:13:40.585640 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:13:40.585658 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-24 05:13:40.585675 | orchestrator | 2026-04-24 05:13:40.585719 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:13:40.585731 | orchestrator | Friday 24 April 2026 05:13:15 +0000 (0:00:01.720) 0:10:57.364 ********** 2026-04-24 05:13:40.585742 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 05:13:40.585753 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 05:13:40.585764 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 05:13:40.585776 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.585787 | orchestrator | 2026-04-24 05:13:40.585798 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:13:40.585809 | orchestrator | Friday 24 April 2026 05:13:16 +0000 (0:00:01.173) 0:10:58.538 ********** 2026-04-24 05:13:40.585820 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.585831 | orchestrator | 2026-04-24 05:13:40.585842 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:13:40.585853 | orchestrator | Friday 24 April 2026 05:13:17 +0000 (0:00:01.154) 0:10:59.692 ********** 2026-04-24 05:13:40.585863 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:13:40.585875 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:13:40.585886 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:13:40.585899 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:13:40.585910 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:13:40.585921 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:13:40.585932 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:13:40.585943 | orchestrator | 2026-04-24 05:13:40.585954 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:13:40.585964 | orchestrator | Friday 24 April 2026 05:13:20 +0000 (0:00:02.129) 0:11:01.822 ********** 2026-04-24 05:13:40.585975 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:13:40.585986 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:13:40.585998 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:13:40.586008 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:13:40.586104 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:13:40.586115 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:13:40.586125 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:13:40.586135 | orchestrator | 2026-04-24 05:13:40.586144 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-24 05:13:40.586154 | orchestrator | Friday 24 April 2026 05:13:22 +0000 (0:00:02.214) 0:11:04.036 ********** 2026-04-24 05:13:40.586164 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586173 | orchestrator | 2026-04-24 05:13:40.586183 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-24 05:13:40.586192 | orchestrator | Friday 24 April 2026 05:13:23 +0000 (0:00:00.847) 0:11:04.883 ********** 2026-04-24 05:13:40.586202 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586211 | orchestrator | 2026-04-24 05:13:40.586221 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-24 05:13:40.586230 | orchestrator | Friday 24 April 2026 05:13:24 +0000 (0:00:00.869) 0:11:05.753 ********** 2026-04-24 05:13:40.586258 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586275 | orchestrator | 2026-04-24 05:13:40.586291 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-24 05:13:40.586308 | orchestrator | Friday 24 April 2026 05:13:24 +0000 (0:00:00.778) 0:11:06.531 ********** 2026-04-24 05:13:40.586325 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586339 | orchestrator | 2026-04-24 05:13:40.586349 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-24 05:13:40.586359 | orchestrator | Friday 24 April 2026 05:13:25 +0000 (0:00:00.889) 0:11:07.420 ********** 2026-04-24 05:13:40.586368 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586378 | orchestrator | 2026-04-24 05:13:40.586387 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-24 05:13:40.586397 | orchestrator | Friday 24 April 2026 05:13:26 +0000 (0:00:00.781) 0:11:08.202 ********** 2026-04-24 05:13:40.586406 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 05:13:40.586415 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 05:13:40.586425 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 05:13:40.586434 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586444 | orchestrator | 2026-04-24 05:13:40.586460 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-24 05:13:40.586470 | orchestrator | Friday 24 April 2026 05:13:27 +0000 (0:00:01.062) 0:11:09.265 ********** 2026-04-24 05:13:40.586480 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-0'])  2026-04-24 05:13:40.586489 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-1'])  2026-04-24 05:13:40.586499 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-2'])  2026-04-24 05:13:40.586508 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-0'])  2026-04-24 05:13:40.586518 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-1'])  2026-04-24 05:13:40.586528 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-2'])  2026-04-24 05:13:40.586537 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586547 | orchestrator | 2026-04-24 05:13:40.586556 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-24 05:13:40.586566 | orchestrator | Friday 24 April 2026 05:13:28 +0000 (0:00:01.272) 0:11:10.537 ********** 2026-04-24 05:13:40.586575 | orchestrator | changed: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:13:40.586585 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:13:40.586594 | orchestrator | 2026-04-24 05:13:40.586604 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-24 05:13:40.586613 | orchestrator | Friday 24 April 2026 05:13:32 +0000 (0:00:03.285) 0:11:13.822 ********** 2026-04-24 05:13:40.586623 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:13:40.586632 | orchestrator | 2026-04-24 05:13:40.586642 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:13:40.586652 | orchestrator | Friday 24 April 2026 05:13:34 +0000 (0:00:02.352) 0:11:16.175 ********** 2026-04-24 05:13:40.586661 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-1 2026-04-24 05:13:40.586671 | orchestrator | 2026-04-24 05:13:40.586681 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:13:40.586722 | orchestrator | Friday 24 April 2026 05:13:35 +0000 (0:00:01.140) 0:11:17.315 ********** 2026-04-24 05:13:40.586732 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-1 2026-04-24 05:13:40.586741 | orchestrator | 2026-04-24 05:13:40.586751 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:13:40.586761 | orchestrator | Friday 24 April 2026 05:13:36 +0000 (0:00:01.110) 0:11:18.426 ********** 2026-04-24 05:13:40.586779 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:13:40.586789 | orchestrator | 2026-04-24 05:13:40.586799 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:13:40.586808 | orchestrator | Friday 24 April 2026 05:13:38 +0000 (0:00:01.554) 0:11:19.980 ********** 2026-04-24 05:13:40.586818 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586827 | orchestrator | 2026-04-24 05:13:40.586837 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:13:40.586846 | orchestrator | Friday 24 April 2026 05:13:39 +0000 (0:00:01.165) 0:11:21.146 ********** 2026-04-24 05:13:40.586855 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:13:40.586865 | orchestrator | 2026-04-24 05:13:40.586874 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:13:40.586891 | orchestrator | Friday 24 April 2026 05:13:40 +0000 (0:00:01.135) 0:11:22.282 ********** 2026-04-24 05:14:22.570421 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.570538 | orchestrator | 2026-04-24 05:14:22.570555 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:14:22.570569 | orchestrator | Friday 24 April 2026 05:13:41 +0000 (0:00:01.126) 0:11:23.408 ********** 2026-04-24 05:14:22.570581 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.570593 | orchestrator | 2026-04-24 05:14:22.570605 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:14:22.570616 | orchestrator | Friday 24 April 2026 05:13:43 +0000 (0:00:01.585) 0:11:24.993 ********** 2026-04-24 05:14:22.570626 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.570637 | orchestrator | 2026-04-24 05:14:22.570648 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:14:22.570659 | orchestrator | Friday 24 April 2026 05:13:44 +0000 (0:00:01.124) 0:11:26.117 ********** 2026-04-24 05:14:22.570670 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.570681 | orchestrator | 2026-04-24 05:14:22.570691 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:14:22.570752 | orchestrator | Friday 24 April 2026 05:13:45 +0000 (0:00:01.178) 0:11:27.296 ********** 2026-04-24 05:14:22.570764 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.570774 | orchestrator | 2026-04-24 05:14:22.570785 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:14:22.570796 | orchestrator | Friday 24 April 2026 05:13:47 +0000 (0:00:01.706) 0:11:29.002 ********** 2026-04-24 05:14:22.570807 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.570818 | orchestrator | 2026-04-24 05:14:22.570829 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:14:22.570839 | orchestrator | Friday 24 April 2026 05:13:48 +0000 (0:00:01.484) 0:11:30.487 ********** 2026-04-24 05:14:22.570850 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.570861 | orchestrator | 2026-04-24 05:14:22.570872 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:14:22.570882 | orchestrator | Friday 24 April 2026 05:13:49 +0000 (0:00:00.788) 0:11:31.276 ********** 2026-04-24 05:14:22.570893 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.570904 | orchestrator | 2026-04-24 05:14:22.570915 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:14:22.570926 | orchestrator | Friday 24 April 2026 05:13:50 +0000 (0:00:00.808) 0:11:32.085 ********** 2026-04-24 05:14:22.570952 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.570966 | orchestrator | 2026-04-24 05:14:22.570979 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:14:22.570991 | orchestrator | Friday 24 April 2026 05:13:51 +0000 (0:00:00.770) 0:11:32.855 ********** 2026-04-24 05:14:22.571003 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571016 | orchestrator | 2026-04-24 05:14:22.571029 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:14:22.571041 | orchestrator | Friday 24 April 2026 05:13:51 +0000 (0:00:00.763) 0:11:33.619 ********** 2026-04-24 05:14:22.571076 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571089 | orchestrator | 2026-04-24 05:14:22.571102 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:14:22.571114 | orchestrator | Friday 24 April 2026 05:13:52 +0000 (0:00:00.809) 0:11:34.429 ********** 2026-04-24 05:14:22.571127 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571139 | orchestrator | 2026-04-24 05:14:22.571151 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:14:22.571164 | orchestrator | Friday 24 April 2026 05:13:53 +0000 (0:00:00.824) 0:11:35.253 ********** 2026-04-24 05:14:22.571175 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571188 | orchestrator | 2026-04-24 05:14:22.571201 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:14:22.571213 | orchestrator | Friday 24 April 2026 05:13:54 +0000 (0:00:00.775) 0:11:36.028 ********** 2026-04-24 05:14:22.571225 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.571238 | orchestrator | 2026-04-24 05:14:22.571251 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:14:22.571263 | orchestrator | Friday 24 April 2026 05:13:55 +0000 (0:00:00.794) 0:11:36.823 ********** 2026-04-24 05:14:22.571275 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.571288 | orchestrator | 2026-04-24 05:14:22.571301 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:14:22.571313 | orchestrator | Friday 24 April 2026 05:13:55 +0000 (0:00:00.795) 0:11:37.618 ********** 2026-04-24 05:14:22.571324 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.571334 | orchestrator | 2026-04-24 05:14:22.571345 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:14:22.571356 | orchestrator | Friday 24 April 2026 05:13:56 +0000 (0:00:00.804) 0:11:38.423 ********** 2026-04-24 05:14:22.571366 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571377 | orchestrator | 2026-04-24 05:14:22.571388 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:14:22.571399 | orchestrator | Friday 24 April 2026 05:13:57 +0000 (0:00:00.792) 0:11:39.215 ********** 2026-04-24 05:14:22.571409 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571420 | orchestrator | 2026-04-24 05:14:22.571431 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:14:22.571441 | orchestrator | Friday 24 April 2026 05:13:58 +0000 (0:00:00.793) 0:11:40.009 ********** 2026-04-24 05:14:22.571452 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571463 | orchestrator | 2026-04-24 05:14:22.571473 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:14:22.571484 | orchestrator | Friday 24 April 2026 05:13:59 +0000 (0:00:00.775) 0:11:40.784 ********** 2026-04-24 05:14:22.571495 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571505 | orchestrator | 2026-04-24 05:14:22.571516 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:14:22.571527 | orchestrator | Friday 24 April 2026 05:13:59 +0000 (0:00:00.780) 0:11:41.564 ********** 2026-04-24 05:14:22.571538 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571549 | orchestrator | 2026-04-24 05:14:22.571577 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:14:22.571589 | orchestrator | Friday 24 April 2026 05:14:00 +0000 (0:00:00.772) 0:11:42.337 ********** 2026-04-24 05:14:22.571600 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571611 | orchestrator | 2026-04-24 05:14:22.571622 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:14:22.571633 | orchestrator | Friday 24 April 2026 05:14:01 +0000 (0:00:00.763) 0:11:43.101 ********** 2026-04-24 05:14:22.571644 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571655 | orchestrator | 2026-04-24 05:14:22.571665 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:14:22.571765 | orchestrator | Friday 24 April 2026 05:14:02 +0000 (0:00:00.782) 0:11:43.884 ********** 2026-04-24 05:14:22.571789 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571800 | orchestrator | 2026-04-24 05:14:22.571811 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:14:22.571822 | orchestrator | Friday 24 April 2026 05:14:02 +0000 (0:00:00.761) 0:11:44.645 ********** 2026-04-24 05:14:22.571833 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571843 | orchestrator | 2026-04-24 05:14:22.571854 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:14:22.571865 | orchestrator | Friday 24 April 2026 05:14:03 +0000 (0:00:00.811) 0:11:45.457 ********** 2026-04-24 05:14:22.571875 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571886 | orchestrator | 2026-04-24 05:14:22.571896 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:14:22.571907 | orchestrator | Friday 24 April 2026 05:14:04 +0000 (0:00:00.780) 0:11:46.238 ********** 2026-04-24 05:14:22.571918 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571929 | orchestrator | 2026-04-24 05:14:22.571939 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:14:22.571950 | orchestrator | Friday 24 April 2026 05:14:05 +0000 (0:00:00.840) 0:11:47.079 ********** 2026-04-24 05:14:22.571961 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.571971 | orchestrator | 2026-04-24 05:14:22.571982 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:14:22.571993 | orchestrator | Friday 24 April 2026 05:14:06 +0000 (0:00:00.796) 0:11:47.875 ********** 2026-04-24 05:14:22.572003 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.572014 | orchestrator | 2026-04-24 05:14:22.572025 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:14:22.572042 | orchestrator | Friday 24 April 2026 05:14:07 +0000 (0:00:01.588) 0:11:49.464 ********** 2026-04-24 05:14:22.572052 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.572063 | orchestrator | 2026-04-24 05:14:22.572074 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:14:22.572085 | orchestrator | Friday 24 April 2026 05:14:09 +0000 (0:00:02.153) 0:11:51.617 ********** 2026-04-24 05:14:22.572095 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-1 2026-04-24 05:14:22.572107 | orchestrator | 2026-04-24 05:14:22.572118 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:14:22.572129 | orchestrator | Friday 24 April 2026 05:14:11 +0000 (0:00:01.127) 0:11:52.745 ********** 2026-04-24 05:14:22.572139 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.572150 | orchestrator | 2026-04-24 05:14:22.572161 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:14:22.572172 | orchestrator | Friday 24 April 2026 05:14:12 +0000 (0:00:01.178) 0:11:53.924 ********** 2026-04-24 05:14:22.572182 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.572193 | orchestrator | 2026-04-24 05:14:22.572204 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:14:22.572214 | orchestrator | Friday 24 April 2026 05:14:13 +0000 (0:00:01.107) 0:11:55.031 ********** 2026-04-24 05:14:22.572225 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:14:22.572236 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:14:22.572246 | orchestrator | 2026-04-24 05:14:22.572257 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:14:22.572268 | orchestrator | Friday 24 April 2026 05:14:15 +0000 (0:00:01.885) 0:11:56.916 ********** 2026-04-24 05:14:22.572279 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.572289 | orchestrator | 2026-04-24 05:14:22.572300 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:14:22.572311 | orchestrator | Friday 24 April 2026 05:14:16 +0000 (0:00:01.470) 0:11:58.387 ********** 2026-04-24 05:14:22.572321 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.572341 | orchestrator | 2026-04-24 05:14:22.572352 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:14:22.572363 | orchestrator | Friday 24 April 2026 05:14:17 +0000 (0:00:01.194) 0:11:59.582 ********** 2026-04-24 05:14:22.572373 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.572384 | orchestrator | 2026-04-24 05:14:22.572395 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:14:22.572406 | orchestrator | Friday 24 April 2026 05:14:18 +0000 (0:00:00.826) 0:12:00.408 ********** 2026-04-24 05:14:22.572416 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:14:22.572427 | orchestrator | 2026-04-24 05:14:22.572438 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:14:22.572448 | orchestrator | Friday 24 April 2026 05:14:19 +0000 (0:00:00.775) 0:12:01.183 ********** 2026-04-24 05:14:22.572459 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-1 2026-04-24 05:14:22.572470 | orchestrator | 2026-04-24 05:14:22.572480 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:14:22.572491 | orchestrator | Friday 24 April 2026 05:14:20 +0000 (0:00:01.248) 0:12:02.432 ********** 2026-04-24 05:14:22.572501 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:14:22.572512 | orchestrator | 2026-04-24 05:14:22.572523 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:14:22.572542 | orchestrator | Friday 24 April 2026 05:14:22 +0000 (0:00:01.837) 0:12:04.269 ********** 2026-04-24 05:15:02.192286 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:15:02.192373 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:15:02.192383 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:15:02.192390 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192398 | orchestrator | 2026-04-24 05:15:02.192405 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:15:02.192412 | orchestrator | Friday 24 April 2026 05:14:23 +0000 (0:00:01.173) 0:12:05.443 ********** 2026-04-24 05:15:02.192418 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192425 | orchestrator | 2026-04-24 05:15:02.192432 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:15:02.192438 | orchestrator | Friday 24 April 2026 05:14:24 +0000 (0:00:01.124) 0:12:06.567 ********** 2026-04-24 05:15:02.192444 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192451 | orchestrator | 2026-04-24 05:15:02.192457 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:15:02.192463 | orchestrator | Friday 24 April 2026 05:14:26 +0000 (0:00:01.181) 0:12:07.749 ********** 2026-04-24 05:15:02.192469 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192476 | orchestrator | 2026-04-24 05:15:02.192482 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:15:02.192500 | orchestrator | Friday 24 April 2026 05:14:27 +0000 (0:00:01.159) 0:12:08.909 ********** 2026-04-24 05:15:02.192514 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192521 | orchestrator | 2026-04-24 05:15:02.192527 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:15:02.192534 | orchestrator | Friday 24 April 2026 05:14:28 +0000 (0:00:01.141) 0:12:10.051 ********** 2026-04-24 05:15:02.192540 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192546 | orchestrator | 2026-04-24 05:15:02.192552 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:15:02.192559 | orchestrator | Friday 24 April 2026 05:14:29 +0000 (0:00:00.824) 0:12:10.875 ********** 2026-04-24 05:15:02.192565 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:02.192572 | orchestrator | 2026-04-24 05:15:02.192591 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:15:02.192598 | orchestrator | Friday 24 April 2026 05:14:31 +0000 (0:00:02.298) 0:12:13.174 ********** 2026-04-24 05:15:02.192623 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:02.192629 | orchestrator | 2026-04-24 05:15:02.192635 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:15:02.192641 | orchestrator | Friday 24 April 2026 05:14:32 +0000 (0:00:00.778) 0:12:13.953 ********** 2026-04-24 05:15:02.192648 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-1 2026-04-24 05:15:02.192654 | orchestrator | 2026-04-24 05:15:02.192660 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:15:02.192666 | orchestrator | Friday 24 April 2026 05:14:33 +0000 (0:00:01.109) 0:12:15.062 ********** 2026-04-24 05:15:02.192672 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192679 | orchestrator | 2026-04-24 05:15:02.192685 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:15:02.192691 | orchestrator | Friday 24 April 2026 05:14:34 +0000 (0:00:01.175) 0:12:16.238 ********** 2026-04-24 05:15:02.192697 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192703 | orchestrator | 2026-04-24 05:15:02.192710 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:15:02.192782 | orchestrator | Friday 24 April 2026 05:14:35 +0000 (0:00:01.160) 0:12:17.399 ********** 2026-04-24 05:15:02.192789 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192795 | orchestrator | 2026-04-24 05:15:02.192801 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:15:02.192807 | orchestrator | Friday 24 April 2026 05:14:36 +0000 (0:00:01.162) 0:12:18.561 ********** 2026-04-24 05:15:02.192814 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192820 | orchestrator | 2026-04-24 05:15:02.192827 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:15:02.192834 | orchestrator | Friday 24 April 2026 05:14:38 +0000 (0:00:01.164) 0:12:19.725 ********** 2026-04-24 05:15:02.192842 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192849 | orchestrator | 2026-04-24 05:15:02.192856 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:15:02.192864 | orchestrator | Friday 24 April 2026 05:14:39 +0000 (0:00:01.150) 0:12:20.876 ********** 2026-04-24 05:15:02.192871 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192879 | orchestrator | 2026-04-24 05:15:02.192886 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:15:02.192893 | orchestrator | Friday 24 April 2026 05:14:40 +0000 (0:00:01.147) 0:12:22.023 ********** 2026-04-24 05:15:02.192901 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192908 | orchestrator | 2026-04-24 05:15:02.192915 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:15:02.192922 | orchestrator | Friday 24 April 2026 05:14:41 +0000 (0:00:01.125) 0:12:23.149 ********** 2026-04-24 05:15:02.192929 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.192936 | orchestrator | 2026-04-24 05:15:02.192943 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:15:02.192951 | orchestrator | Friday 24 April 2026 05:14:42 +0000 (0:00:01.142) 0:12:24.292 ********** 2026-04-24 05:15:02.192958 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:02.192965 | orchestrator | 2026-04-24 05:15:02.192973 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:15:02.192980 | orchestrator | Friday 24 April 2026 05:14:43 +0000 (0:00:00.867) 0:12:25.160 ********** 2026-04-24 05:15:02.192987 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-1 2026-04-24 05:15:02.192996 | orchestrator | 2026-04-24 05:15:02.193004 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:15:02.193023 | orchestrator | Friday 24 April 2026 05:14:44 +0000 (0:00:01.115) 0:12:26.275 ********** 2026-04-24 05:15:02.193031 | orchestrator | ok: [testbed-node-1] => (item=/etc/ceph) 2026-04-24 05:15:02.193039 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-24 05:15:02.193052 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-24 05:15:02.193060 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-24 05:15:02.193067 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-24 05:15:02.193074 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-24 05:15:02.193082 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-24 05:15:02.193089 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:15:02.193097 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:15:02.193104 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:15:02.193111 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:15:02.193117 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:15:02.193123 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:15:02.193130 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:15:02.193136 | orchestrator | ok: [testbed-node-1] => (item=/var/run/ceph) 2026-04-24 05:15:02.193142 | orchestrator | ok: [testbed-node-1] => (item=/var/log/ceph) 2026-04-24 05:15:02.193148 | orchestrator | 2026-04-24 05:15:02.193154 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:15:02.193160 | orchestrator | Friday 24 April 2026 05:14:51 +0000 (0:00:06.479) 0:12:32.754 ********** 2026-04-24 05:15:02.193166 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193172 | orchestrator | 2026-04-24 05:15:02.193179 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:15:02.193185 | orchestrator | Friday 24 April 2026 05:14:51 +0000 (0:00:00.808) 0:12:33.563 ********** 2026-04-24 05:15:02.193191 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193197 | orchestrator | 2026-04-24 05:15:02.193207 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:15:02.193213 | orchestrator | Friday 24 April 2026 05:14:52 +0000 (0:00:00.775) 0:12:34.338 ********** 2026-04-24 05:15:02.193219 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193226 | orchestrator | 2026-04-24 05:15:02.193232 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:15:02.193238 | orchestrator | Friday 24 April 2026 05:14:53 +0000 (0:00:00.814) 0:12:35.153 ********** 2026-04-24 05:15:02.193244 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193250 | orchestrator | 2026-04-24 05:15:02.193256 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:15:02.193262 | orchestrator | Friday 24 April 2026 05:14:54 +0000 (0:00:00.789) 0:12:35.942 ********** 2026-04-24 05:15:02.193268 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193274 | orchestrator | 2026-04-24 05:15:02.193280 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:15:02.193286 | orchestrator | Friday 24 April 2026 05:14:55 +0000 (0:00:00.793) 0:12:36.736 ********** 2026-04-24 05:15:02.193292 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193298 | orchestrator | 2026-04-24 05:15:02.193305 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:15:02.193311 | orchestrator | Friday 24 April 2026 05:14:55 +0000 (0:00:00.803) 0:12:37.539 ********** 2026-04-24 05:15:02.193317 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193323 | orchestrator | 2026-04-24 05:15:02.193329 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:15:02.193335 | orchestrator | Friday 24 April 2026 05:14:56 +0000 (0:00:00.765) 0:12:38.305 ********** 2026-04-24 05:15:02.193341 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193347 | orchestrator | 2026-04-24 05:15:02.193353 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:15:02.193363 | orchestrator | Friday 24 April 2026 05:14:57 +0000 (0:00:00.792) 0:12:39.098 ********** 2026-04-24 05:15:02.193370 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193376 | orchestrator | 2026-04-24 05:15:02.193382 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:15:02.193388 | orchestrator | Friday 24 April 2026 05:14:58 +0000 (0:00:00.791) 0:12:39.890 ********** 2026-04-24 05:15:02.193394 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193400 | orchestrator | 2026-04-24 05:15:02.193406 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:15:02.193412 | orchestrator | Friday 24 April 2026 05:14:58 +0000 (0:00:00.761) 0:12:40.652 ********** 2026-04-24 05:15:02.193418 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193424 | orchestrator | 2026-04-24 05:15:02.193430 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:15:02.193436 | orchestrator | Friday 24 April 2026 05:14:59 +0000 (0:00:00.768) 0:12:41.420 ********** 2026-04-24 05:15:02.193442 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193448 | orchestrator | 2026-04-24 05:15:02.193454 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:15:02.193461 | orchestrator | Friday 24 April 2026 05:15:00 +0000 (0:00:00.805) 0:12:42.225 ********** 2026-04-24 05:15:02.193467 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193473 | orchestrator | 2026-04-24 05:15:02.193479 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:15:02.193485 | orchestrator | Friday 24 April 2026 05:15:01 +0000 (0:00:00.844) 0:12:43.070 ********** 2026-04-24 05:15:02.193491 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:02.193497 | orchestrator | 2026-04-24 05:15:02.193503 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:15:02.193513 | orchestrator | Friday 24 April 2026 05:15:02 +0000 (0:00:00.818) 0:12:43.888 ********** 2026-04-24 05:15:49.523057 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523174 | orchestrator | 2026-04-24 05:15:49.523193 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:15:49.523207 | orchestrator | Friday 24 April 2026 05:15:03 +0000 (0:00:00.896) 0:12:44.785 ********** 2026-04-24 05:15:49.523219 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523230 | orchestrator | 2026-04-24 05:15:49.523242 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:15:49.523254 | orchestrator | Friday 24 April 2026 05:15:03 +0000 (0:00:00.802) 0:12:45.588 ********** 2026-04-24 05:15:49.523265 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523276 | orchestrator | 2026-04-24 05:15:49.523287 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:15:49.523300 | orchestrator | Friday 24 April 2026 05:15:04 +0000 (0:00:00.815) 0:12:46.403 ********** 2026-04-24 05:15:49.523311 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523322 | orchestrator | 2026-04-24 05:15:49.523333 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:15:49.523344 | orchestrator | Friday 24 April 2026 05:15:05 +0000 (0:00:00.845) 0:12:47.248 ********** 2026-04-24 05:15:49.523355 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523366 | orchestrator | 2026-04-24 05:15:49.523377 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:15:49.523388 | orchestrator | Friday 24 April 2026 05:15:06 +0000 (0:00:00.774) 0:12:48.023 ********** 2026-04-24 05:15:49.523399 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523411 | orchestrator | 2026-04-24 05:15:49.523423 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:15:49.523434 | orchestrator | Friday 24 April 2026 05:15:07 +0000 (0:00:00.794) 0:12:48.817 ********** 2026-04-24 05:15:49.523445 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523481 | orchestrator | 2026-04-24 05:15:49.523493 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:15:49.523504 | orchestrator | Friday 24 April 2026 05:15:07 +0000 (0:00:00.773) 0:12:49.591 ********** 2026-04-24 05:15:49.523529 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:15:49.523540 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:15:49.523551 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:15:49.523561 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523572 | orchestrator | 2026-04-24 05:15:49.523582 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:15:49.523596 | orchestrator | Friday 24 April 2026 05:15:08 +0000 (0:00:01.084) 0:12:50.675 ********** 2026-04-24 05:15:49.523608 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:15:49.523620 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:15:49.523632 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:15:49.523644 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523656 | orchestrator | 2026-04-24 05:15:49.523668 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:15:49.523681 | orchestrator | Friday 24 April 2026 05:15:10 +0000 (0:00:01.059) 0:12:51.734 ********** 2026-04-24 05:15:49.523693 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:15:49.523706 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:15:49.523718 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:15:49.523775 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523797 | orchestrator | 2026-04-24 05:15:49.523817 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:15:49.523835 | orchestrator | Friday 24 April 2026 05:15:11 +0000 (0:00:01.058) 0:12:52.793 ********** 2026-04-24 05:15:49.523850 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523863 | orchestrator | 2026-04-24 05:15:49.523876 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:15:49.523889 | orchestrator | Friday 24 April 2026 05:15:11 +0000 (0:00:00.792) 0:12:53.586 ********** 2026-04-24 05:15:49.523902 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-24 05:15:49.523915 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.523927 | orchestrator | 2026-04-24 05:15:49.523940 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:15:49.523952 | orchestrator | Friday 24 April 2026 05:15:12 +0000 (0:00:00.909) 0:12:54.495 ********** 2026-04-24 05:15:49.523963 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.523973 | orchestrator | 2026-04-24 05:15:49.523984 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:15:49.523995 | orchestrator | Friday 24 April 2026 05:15:14 +0000 (0:00:01.982) 0:12:56.477 ********** 2026-04-24 05:15:49.524005 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524015 | orchestrator | 2026-04-24 05:15:49.524026 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-24 05:15:49.524037 | orchestrator | Friday 24 April 2026 05:15:15 +0000 (0:00:00.852) 0:12:57.330 ********** 2026-04-24 05:15:49.524047 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-1 2026-04-24 05:15:49.524058 | orchestrator | 2026-04-24 05:15:49.524069 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-24 05:15:49.524080 | orchestrator | Friday 24 April 2026 05:15:16 +0000 (0:00:01.134) 0:12:58.465 ********** 2026-04-24 05:15:49.524090 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:15:49.524101 | orchestrator | 2026-04-24 05:15:49.524111 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-24 05:15:49.524122 | orchestrator | Friday 24 April 2026 05:15:19 +0000 (0:00:03.155) 0:13:01.620 ********** 2026-04-24 05:15:49.524142 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.524153 | orchestrator | 2026-04-24 05:15:49.524164 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-24 05:15:49.524193 | orchestrator | Friday 24 April 2026 05:15:21 +0000 (0:00:01.164) 0:13:02.785 ********** 2026-04-24 05:15:49.524204 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524215 | orchestrator | 2026-04-24 05:15:49.524226 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-24 05:15:49.524236 | orchestrator | Friday 24 April 2026 05:15:22 +0000 (0:00:01.125) 0:13:03.911 ********** 2026-04-24 05:15:49.524247 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524258 | orchestrator | 2026-04-24 05:15:49.524268 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-24 05:15:49.524279 | orchestrator | Friday 24 April 2026 05:15:23 +0000 (0:00:01.131) 0:13:05.042 ********** 2026-04-24 05:15:49.524290 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:15:49.524301 | orchestrator | 2026-04-24 05:15:49.524312 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-24 05:15:49.524323 | orchestrator | Friday 24 April 2026 05:15:25 +0000 (0:00:02.028) 0:13:07.071 ********** 2026-04-24 05:15:49.524333 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524344 | orchestrator | 2026-04-24 05:15:49.524355 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-24 05:15:49.524365 | orchestrator | Friday 24 April 2026 05:15:26 +0000 (0:00:01.535) 0:13:08.607 ********** 2026-04-24 05:15:49.524376 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524387 | orchestrator | 2026-04-24 05:15:49.524397 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-24 05:15:49.524408 | orchestrator | Friday 24 April 2026 05:15:28 +0000 (0:00:01.472) 0:13:10.080 ********** 2026-04-24 05:15:49.524419 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524429 | orchestrator | 2026-04-24 05:15:49.524440 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-24 05:15:49.524451 | orchestrator | Friday 24 April 2026 05:15:29 +0000 (0:00:01.504) 0:13:11.584 ********** 2026-04-24 05:15:49.524461 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:15:49.524472 | orchestrator | 2026-04-24 05:15:49.524497 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-24 05:15:49.524508 | orchestrator | Friday 24 April 2026 05:15:31 +0000 (0:00:01.839) 0:13:13.424 ********** 2026-04-24 05:15:49.524525 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:15:49.524536 | orchestrator | 2026-04-24 05:15:49.524547 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-24 05:15:49.524558 | orchestrator | Friday 24 April 2026 05:15:33 +0000 (0:00:01.704) 0:13:15.128 ********** 2026-04-24 05:15:49.524569 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:15:49.524579 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-24 05:15:49.524590 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 05:15:49.524601 | orchestrator | ok: [testbed-node-1 -> {{ item }}] 2026-04-24 05:15:49.524612 | orchestrator | 2026-04-24 05:15:49.524623 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-24 05:15:49.524633 | orchestrator | Friday 24 April 2026 05:15:37 +0000 (0:00:03.834) 0:13:18.963 ********** 2026-04-24 05:15:49.524644 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:15:49.524655 | orchestrator | 2026-04-24 05:15:49.524665 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-24 05:15:49.524676 | orchestrator | Friday 24 April 2026 05:15:39 +0000 (0:00:02.032) 0:13:20.995 ********** 2026-04-24 05:15:49.524687 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524697 | orchestrator | 2026-04-24 05:15:49.524708 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-24 05:15:49.524719 | orchestrator | Friday 24 April 2026 05:15:40 +0000 (0:00:01.125) 0:13:22.120 ********** 2026-04-24 05:15:49.524760 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524772 | orchestrator | 2026-04-24 05:15:49.524783 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-24 05:15:49.524794 | orchestrator | Friday 24 April 2026 05:15:41 +0000 (0:00:01.134) 0:13:23.255 ********** 2026-04-24 05:15:49.524805 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524816 | orchestrator | 2026-04-24 05:15:49.524827 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-24 05:15:49.524837 | orchestrator | Friday 24 April 2026 05:15:43 +0000 (0:00:01.818) 0:13:25.074 ********** 2026-04-24 05:15:49.524848 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:15:49.524859 | orchestrator | 2026-04-24 05:15:49.524870 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-24 05:15:49.524881 | orchestrator | Friday 24 April 2026 05:15:44 +0000 (0:00:01.490) 0:13:26.564 ********** 2026-04-24 05:15:49.524892 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.524903 | orchestrator | 2026-04-24 05:15:49.524914 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-24 05:15:49.524924 | orchestrator | Friday 24 April 2026 05:15:45 +0000 (0:00:00.797) 0:13:27.362 ********** 2026-04-24 05:15:49.524935 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-1 2026-04-24 05:15:49.524946 | orchestrator | 2026-04-24 05:15:49.524957 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-24 05:15:49.524968 | orchestrator | Friday 24 April 2026 05:15:46 +0000 (0:00:01.127) 0:13:28.490 ********** 2026-04-24 05:15:49.524978 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.524989 | orchestrator | 2026-04-24 05:15:49.525000 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-24 05:15:49.525011 | orchestrator | Friday 24 April 2026 05:15:47 +0000 (0:00:01.140) 0:13:29.630 ********** 2026-04-24 05:15:49.525022 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:15:49.525033 | orchestrator | 2026-04-24 05:15:49.525044 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-24 05:15:49.525055 | orchestrator | Friday 24 April 2026 05:15:49 +0000 (0:00:01.098) 0:13:30.729 ********** 2026-04-24 05:15:49.525065 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-1 2026-04-24 05:15:49.525076 | orchestrator | 2026-04-24 05:15:49.525095 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-24 05:16:59.205692 | orchestrator | Friday 24 April 2026 05:15:50 +0000 (0:00:01.184) 0:13:31.914 ********** 2026-04-24 05:16:59.205907 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:16:59.205940 | orchestrator | 2026-04-24 05:16:59.205962 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-24 05:16:59.205981 | orchestrator | Friday 24 April 2026 05:15:52 +0000 (0:00:02.374) 0:13:34.288 ********** 2026-04-24 05:16:59.205999 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:16:59.206090 | orchestrator | 2026-04-24 05:16:59.206115 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-24 05:16:59.206133 | orchestrator | Friday 24 April 2026 05:15:54 +0000 (0:00:01.933) 0:13:36.222 ********** 2026-04-24 05:16:59.206164 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:16:59.206184 | orchestrator | 2026-04-24 05:16:59.206203 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-24 05:16:59.206221 | orchestrator | Friday 24 April 2026 05:15:57 +0000 (0:00:02.533) 0:13:38.755 ********** 2026-04-24 05:16:59.206240 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:16:59.206260 | orchestrator | 2026-04-24 05:16:59.206279 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-24 05:16:59.206299 | orchestrator | Friday 24 April 2026 05:16:01 +0000 (0:00:04.097) 0:13:42.853 ********** 2026-04-24 05:16:59.206319 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-1 2026-04-24 05:16:59.206339 | orchestrator | 2026-04-24 05:16:59.206359 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-24 05:16:59.206412 | orchestrator | Friday 24 April 2026 05:16:02 +0000 (0:00:01.127) 0:13:43.980 ********** 2026-04-24 05:16:59.206432 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-24 05:16:59.206451 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:16:59.206470 | orchestrator | 2026-04-24 05:16:59.206488 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-24 05:16:59.206507 | orchestrator | Friday 24 April 2026 05:16:25 +0000 (0:00:22.892) 0:14:06.872 ********** 2026-04-24 05:16:59.206525 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:16:59.206543 | orchestrator | 2026-04-24 05:16:59.206580 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-24 05:16:59.206600 | orchestrator | Friday 24 April 2026 05:16:27 +0000 (0:00:02.648) 0:14:09.521 ********** 2026-04-24 05:16:59.206618 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:16:59.206637 | orchestrator | 2026-04-24 05:16:59.206654 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-24 05:16:59.206672 | orchestrator | Friday 24 April 2026 05:16:28 +0000 (0:00:00.773) 0:14:10.295 ********** 2026-04-24 05:16:59.206694 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-24 05:16:59.206717 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-24 05:16:59.206736 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-24 05:16:59.206790 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-24 05:16:59.206813 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-24 05:16:59.206862 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}])  2026-04-24 05:16:59.206885 | orchestrator | 2026-04-24 05:16:59.206905 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-24 05:16:59.206924 | orchestrator | Friday 24 April 2026 05:16:38 +0000 (0:00:09.505) 0:14:19.800 ********** 2026-04-24 05:16:59.206943 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:16:59.206961 | orchestrator | 2026-04-24 05:16:59.206978 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:16:59.207016 | orchestrator | Friday 24 April 2026 05:16:40 +0000 (0:00:02.222) 0:14:22.023 ********** 2026-04-24 05:16:59.207034 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:16:59.207051 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-1) 2026-04-24 05:16:59.207068 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-2) 2026-04-24 05:16:59.207085 | orchestrator | 2026-04-24 05:16:59.207102 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:16:59.207120 | orchestrator | Friday 24 April 2026 05:16:41 +0000 (0:00:01.523) 0:14:23.547 ********** 2026-04-24 05:16:59.207139 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 05:16:59.207158 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 05:16:59.207176 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 05:16:59.207194 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:16:59.207213 | orchestrator | 2026-04-24 05:16:59.207232 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-24 05:16:59.207252 | orchestrator | Friday 24 April 2026 05:16:42 +0000 (0:00:01.048) 0:14:24.596 ********** 2026-04-24 05:16:59.207271 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:16:59.207288 | orchestrator | 2026-04-24 05:16:59.207306 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-24 05:16:59.207324 | orchestrator | Friday 24 April 2026 05:16:43 +0000 (0:00:00.776) 0:14:25.373 ********** 2026-04-24 05:16:59.207354 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:16:59.207374 | orchestrator | 2026-04-24 05:16:59.207392 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-24 05:16:59.207407 | orchestrator | 2026-04-24 05:16:59.207420 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-24 05:16:59.207438 | orchestrator | Friday 24 April 2026 05:16:45 +0000 (0:00:02.286) 0:14:27.660 ********** 2026-04-24 05:16:59.207456 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.207474 | orchestrator | 2026-04-24 05:16:59.207491 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-24 05:16:59.207508 | orchestrator | Friday 24 April 2026 05:16:47 +0000 (0:00:01.087) 0:14:28.747 ********** 2026-04-24 05:16:59.207526 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.207543 | orchestrator | 2026-04-24 05:16:59.207560 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-24 05:16:59.207578 | orchestrator | Friday 24 April 2026 05:16:47 +0000 (0:00:00.763) 0:14:29.511 ********** 2026-04-24 05:16:59.207596 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:16:59.207614 | orchestrator | 2026-04-24 05:16:59.207630 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-24 05:16:59.207647 | orchestrator | Friday 24 April 2026 05:16:48 +0000 (0:00:00.763) 0:14:30.275 ********** 2026-04-24 05:16:59.207666 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.207684 | orchestrator | 2026-04-24 05:16:59.207702 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:16:59.207720 | orchestrator | Friday 24 April 2026 05:16:49 +0000 (0:00:00.792) 0:14:31.067 ********** 2026-04-24 05:16:59.207739 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-2 2026-04-24 05:16:59.207787 | orchestrator | 2026-04-24 05:16:59.207808 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:16:59.207819 | orchestrator | Friday 24 April 2026 05:16:50 +0000 (0:00:01.143) 0:14:32.211 ********** 2026-04-24 05:16:59.207830 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.207841 | orchestrator | 2026-04-24 05:16:59.207852 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:16:59.207863 | orchestrator | Friday 24 April 2026 05:16:51 +0000 (0:00:01.477) 0:14:33.689 ********** 2026-04-24 05:16:59.207887 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.207898 | orchestrator | 2026-04-24 05:16:59.207909 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:16:59.207921 | orchestrator | Friday 24 April 2026 05:16:53 +0000 (0:00:01.104) 0:14:34.793 ********** 2026-04-24 05:16:59.207939 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.207957 | orchestrator | 2026-04-24 05:16:59.207975 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:16:59.207992 | orchestrator | Friday 24 April 2026 05:16:54 +0000 (0:00:01.461) 0:14:36.255 ********** 2026-04-24 05:16:59.208010 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.208029 | orchestrator | 2026-04-24 05:16:59.208047 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:16:59.208066 | orchestrator | Friday 24 April 2026 05:16:55 +0000 (0:00:01.176) 0:14:37.432 ********** 2026-04-24 05:16:59.208085 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.208104 | orchestrator | 2026-04-24 05:16:59.208123 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:16:59.208141 | orchestrator | Friday 24 April 2026 05:16:56 +0000 (0:00:01.165) 0:14:38.597 ********** 2026-04-24 05:16:59.208160 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:16:59.208177 | orchestrator | 2026-04-24 05:16:59.208197 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:16:59.208208 | orchestrator | Friday 24 April 2026 05:16:58 +0000 (0:00:01.151) 0:14:39.749 ********** 2026-04-24 05:16:59.208221 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:16:59.208240 | orchestrator | 2026-04-24 05:16:59.208258 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:16:59.208293 | orchestrator | Friday 24 April 2026 05:16:59 +0000 (0:00:01.153) 0:14:40.903 ********** 2026-04-24 05:17:24.733752 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:17:24.733975 | orchestrator | 2026-04-24 05:17:24.734005 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:17:24.734099 | orchestrator | Friday 24 April 2026 05:17:00 +0000 (0:00:01.162) 0:14:42.065 ********** 2026-04-24 05:17:24.734131 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:17:24.734152 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:17:24.734172 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:17:24.734191 | orchestrator | 2026-04-24 05:17:24.734210 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:17:24.734228 | orchestrator | Friday 24 April 2026 05:17:02 +0000 (0:00:02.037) 0:14:44.102 ********** 2026-04-24 05:17:24.734247 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:17:24.734265 | orchestrator | 2026-04-24 05:17:24.734285 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:17:24.734305 | orchestrator | Friday 24 April 2026 05:17:03 +0000 (0:00:01.266) 0:14:45.369 ********** 2026-04-24 05:17:24.734325 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:17:24.734344 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:17:24.734363 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:17:24.734382 | orchestrator | 2026-04-24 05:17:24.734402 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:17:24.734422 | orchestrator | Friday 24 April 2026 05:17:06 +0000 (0:00:03.163) 0:14:48.532 ********** 2026-04-24 05:17:24.734442 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 05:17:24.734462 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 05:17:24.734480 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 05:17:24.734499 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:24.734519 | orchestrator | 2026-04-24 05:17:24.734561 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:17:24.734617 | orchestrator | Friday 24 April 2026 05:17:08 +0000 (0:00:01.832) 0:14:50.365 ********** 2026-04-24 05:17:24.734642 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:17:24.734665 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:17:24.734684 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:17:24.734703 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:24.734721 | orchestrator | 2026-04-24 05:17:24.734739 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:17:24.734757 | orchestrator | Friday 24 April 2026 05:17:10 +0000 (0:00:01.972) 0:14:52.338 ********** 2026-04-24 05:17:24.734805 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:24.734828 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:24.734847 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:24.734866 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:24.734886 | orchestrator | 2026-04-24 05:17:24.734905 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:17:24.734923 | orchestrator | Friday 24 April 2026 05:17:11 +0000 (0:00:01.209) 0:14:53.547 ********** 2026-04-24 05:17:24.734968 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:17:04.211888', 'end': '2026-04-24 05:17:04.255888', 'delta': '0:00:00.044000', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:17:24.734993 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:17:05.102856', 'end': '2026-04-24 05:17:05.148030', 'delta': '0:00:00.045174', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:17:24.735035 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '4af70b8ccc8b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:17:05.634360', 'end': '2026-04-24 05:17:05.679656', 'delta': '0:00:00.045296', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['4af70b8ccc8b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:17:24.735055 | orchestrator | 2026-04-24 05:17:24.735073 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:17:24.735092 | orchestrator | Friday 24 April 2026 05:17:13 +0000 (0:00:01.235) 0:14:54.783 ********** 2026-04-24 05:17:24.735112 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:17:24.735131 | orchestrator | 2026-04-24 05:17:24.735148 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:17:24.735166 | orchestrator | Friday 24 April 2026 05:17:14 +0000 (0:00:01.297) 0:14:56.081 ********** 2026-04-24 05:17:24.735185 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:24.735203 | orchestrator | 2026-04-24 05:17:24.735223 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:17:24.735242 | orchestrator | Friday 24 April 2026 05:17:15 +0000 (0:00:01.284) 0:14:57.366 ********** 2026-04-24 05:17:24.735260 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:17:24.735278 | orchestrator | 2026-04-24 05:17:24.735296 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:17:24.735314 | orchestrator | Friday 24 April 2026 05:17:16 +0000 (0:00:01.191) 0:14:58.557 ********** 2026-04-24 05:17:24.735333 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] 2026-04-24 05:17:24.735352 | orchestrator | 2026-04-24 05:17:24.735370 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:17:24.735388 | orchestrator | Friday 24 April 2026 05:17:18 +0000 (0:00:02.147) 0:15:00.705 ********** 2026-04-24 05:17:24.735406 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:17:24.735424 | orchestrator | 2026-04-24 05:17:24.735443 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:17:24.735461 | orchestrator | Friday 24 April 2026 05:17:20 +0000 (0:00:01.133) 0:15:01.839 ********** 2026-04-24 05:17:24.735480 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:24.735497 | orchestrator | 2026-04-24 05:17:24.735516 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:17:24.735533 | orchestrator | Friday 24 April 2026 05:17:21 +0000 (0:00:01.116) 0:15:02.955 ********** 2026-04-24 05:17:24.735552 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:24.735571 | orchestrator | 2026-04-24 05:17:24.735590 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:17:24.735607 | orchestrator | Friday 24 April 2026 05:17:22 +0000 (0:00:01.214) 0:15:04.170 ********** 2026-04-24 05:17:24.735625 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:24.735643 | orchestrator | 2026-04-24 05:17:24.735662 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:17:24.735681 | orchestrator | Friday 24 April 2026 05:17:23 +0000 (0:00:01.128) 0:15:05.298 ********** 2026-04-24 05:17:24.735700 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:24.735718 | orchestrator | 2026-04-24 05:17:24.735747 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:17:24.735803 | orchestrator | Friday 24 April 2026 05:17:24 +0000 (0:00:01.132) 0:15:06.431 ********** 2026-04-24 05:17:31.775025 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:31.775113 | orchestrator | 2026-04-24 05:17:31.775125 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:17:31.775135 | orchestrator | Friday 24 April 2026 05:17:25 +0000 (0:00:01.154) 0:15:07.585 ********** 2026-04-24 05:17:31.775144 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:31.775152 | orchestrator | 2026-04-24 05:17:31.775160 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:17:31.775168 | orchestrator | Friday 24 April 2026 05:17:26 +0000 (0:00:01.118) 0:15:08.704 ********** 2026-04-24 05:17:31.775176 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:31.775184 | orchestrator | 2026-04-24 05:17:31.775192 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:17:31.775200 | orchestrator | Friday 24 April 2026 05:17:28 +0000 (0:00:01.158) 0:15:09.863 ********** 2026-04-24 05:17:31.775208 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:31.775216 | orchestrator | 2026-04-24 05:17:31.775224 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:17:31.775234 | orchestrator | Friday 24 April 2026 05:17:29 +0000 (0:00:01.121) 0:15:10.984 ********** 2026-04-24 05:17:31.775241 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:31.775249 | orchestrator | 2026-04-24 05:17:31.775257 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:17:31.775265 | orchestrator | Friday 24 April 2026 05:17:30 +0000 (0:00:01.145) 0:15:12.130 ********** 2026-04-24 05:17:31.775289 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:17:31.775300 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:17:31.775309 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:17:31.775318 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-07-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:17:31.775329 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:17:31.775356 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:17:31.775379 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:17:31.775396 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f837a177', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:17:31.775406 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:17:31.775415 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:17:31.775430 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:31.775438 | orchestrator | 2026-04-24 05:17:31.775446 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:17:31.775454 | orchestrator | Friday 24 April 2026 05:17:31 +0000 (0:00:01.252) 0:15:13.383 ********** 2026-04-24 05:17:31.775463 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:31.775480 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589224 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589452 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-07-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589475 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589488 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589520 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589564 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f837a177', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589581 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589592 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:17:40.589612 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:40.589626 | orchestrator | 2026-04-24 05:17:40.589638 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:17:40.589650 | orchestrator | Friday 24 April 2026 05:17:32 +0000 (0:00:01.252) 0:15:14.635 ********** 2026-04-24 05:17:40.589661 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:17:40.589673 | orchestrator | 2026-04-24 05:17:40.589684 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:17:40.589695 | orchestrator | Friday 24 April 2026 05:17:34 +0000 (0:00:01.517) 0:15:16.153 ********** 2026-04-24 05:17:40.589705 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:17:40.589716 | orchestrator | 2026-04-24 05:17:40.589728 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:17:40.589738 | orchestrator | Friday 24 April 2026 05:17:35 +0000 (0:00:01.135) 0:15:17.288 ********** 2026-04-24 05:17:40.589749 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:17:40.589762 | orchestrator | 2026-04-24 05:17:40.589798 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:17:40.589811 | orchestrator | Friday 24 April 2026 05:17:37 +0000 (0:00:01.446) 0:15:18.735 ********** 2026-04-24 05:17:40.589823 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:40.589835 | orchestrator | 2026-04-24 05:17:40.589847 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:17:40.589859 | orchestrator | Friday 24 April 2026 05:17:38 +0000 (0:00:01.137) 0:15:19.873 ********** 2026-04-24 05:17:40.589871 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:40.589883 | orchestrator | 2026-04-24 05:17:40.589896 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:17:40.589908 | orchestrator | Friday 24 April 2026 05:17:39 +0000 (0:00:01.225) 0:15:21.098 ********** 2026-04-24 05:17:40.589920 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:17:40.589932 | orchestrator | 2026-04-24 05:17:40.589946 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:17:40.589966 | orchestrator | Friday 24 April 2026 05:17:40 +0000 (0:00:01.190) 0:15:22.289 ********** 2026-04-24 05:18:19.313765 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-24 05:18:19.313950 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-24 05:18:19.313967 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:18:19.313980 | orchestrator | 2026-04-24 05:18:19.313992 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:18:19.314005 | orchestrator | Friday 24 April 2026 05:17:42 +0000 (0:00:02.032) 0:15:24.321 ********** 2026-04-24 05:18:19.314082 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 05:18:19.314105 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 05:18:19.314126 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 05:18:19.314144 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314161 | orchestrator | 2026-04-24 05:18:19.314172 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:18:19.314183 | orchestrator | Friday 24 April 2026 05:17:43 +0000 (0:00:01.189) 0:15:25.510 ********** 2026-04-24 05:18:19.314195 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314206 | orchestrator | 2026-04-24 05:18:19.314217 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:18:19.314228 | orchestrator | Friday 24 April 2026 05:17:44 +0000 (0:00:01.163) 0:15:26.674 ********** 2026-04-24 05:18:19.314280 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:18:19.314295 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:18:19.314307 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:18:19.314320 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:18:19.314333 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:18:19.314345 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:18:19.314357 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:18:19.314369 | orchestrator | 2026-04-24 05:18:19.314381 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:18:19.314394 | orchestrator | Friday 24 April 2026 05:17:47 +0000 (0:00:02.350) 0:15:29.025 ********** 2026-04-24 05:18:19.314406 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:18:19.314418 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:18:19.314430 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:18:19.314443 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:18:19.314455 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:18:19.314468 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:18:19.314480 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:18:19.314492 | orchestrator | 2026-04-24 05:18:19.314504 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-24 05:18:19.314516 | orchestrator | Friday 24 April 2026 05:17:49 +0000 (0:00:02.205) 0:15:31.230 ********** 2026-04-24 05:18:19.314528 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314540 | orchestrator | 2026-04-24 05:18:19.314553 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-24 05:18:19.314566 | orchestrator | Friday 24 April 2026 05:17:50 +0000 (0:00:00.922) 0:15:32.153 ********** 2026-04-24 05:18:19.314578 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314590 | orchestrator | 2026-04-24 05:18:19.314602 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-24 05:18:19.314615 | orchestrator | Friday 24 April 2026 05:17:51 +0000 (0:00:00.871) 0:15:33.025 ********** 2026-04-24 05:18:19.314628 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314640 | orchestrator | 2026-04-24 05:18:19.314652 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-24 05:18:19.314663 | orchestrator | Friday 24 April 2026 05:17:52 +0000 (0:00:00.758) 0:15:33.783 ********** 2026-04-24 05:18:19.314673 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314684 | orchestrator | 2026-04-24 05:18:19.314694 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-24 05:18:19.314705 | orchestrator | Friday 24 April 2026 05:17:52 +0000 (0:00:00.855) 0:15:34.639 ********** 2026-04-24 05:18:19.314716 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314726 | orchestrator | 2026-04-24 05:18:19.314737 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-24 05:18:19.314747 | orchestrator | Friday 24 April 2026 05:17:53 +0000 (0:00:00.755) 0:15:35.395 ********** 2026-04-24 05:18:19.314758 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 05:18:19.314769 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 05:18:19.314779 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 05:18:19.314790 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314848 | orchestrator | 2026-04-24 05:18:19.314869 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-24 05:18:19.314880 | orchestrator | Friday 24 April 2026 05:17:54 +0000 (0:00:01.056) 0:15:36.451 ********** 2026-04-24 05:18:19.314891 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-0'])  2026-04-24 05:18:19.314902 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-1'])  2026-04-24 05:18:19.314931 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-2'])  2026-04-24 05:18:19.314942 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-0'])  2026-04-24 05:18:19.314953 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-1'])  2026-04-24 05:18:19.314964 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-2'])  2026-04-24 05:18:19.314974 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.314985 | orchestrator | 2026-04-24 05:18:19.314996 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-24 05:18:19.315007 | orchestrator | Friday 24 April 2026 05:17:56 +0000 (0:00:01.642) 0:15:38.094 ********** 2026-04-24 05:18:19.315017 | orchestrator | changed: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:18:19.315028 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:18:19.315038 | orchestrator | 2026-04-24 05:18:19.315049 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-24 05:18:19.315060 | orchestrator | Friday 24 April 2026 05:17:59 +0000 (0:00:03.042) 0:15:41.137 ********** 2026-04-24 05:18:19.315071 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:18:19.315081 | orchestrator | 2026-04-24 05:18:19.315092 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:18:19.315103 | orchestrator | Friday 24 April 2026 05:18:01 +0000 (0:00:02.097) 0:15:43.235 ********** 2026-04-24 05:18:19.315119 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-2 2026-04-24 05:18:19.315131 | orchestrator | 2026-04-24 05:18:19.315142 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:18:19.315152 | orchestrator | Friday 24 April 2026 05:18:02 +0000 (0:00:01.216) 0:15:44.452 ********** 2026-04-24 05:18:19.315163 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-2 2026-04-24 05:18:19.315174 | orchestrator | 2026-04-24 05:18:19.315184 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:18:19.315195 | orchestrator | Friday 24 April 2026 05:18:03 +0000 (0:00:01.140) 0:15:45.592 ********** 2026-04-24 05:18:19.315206 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:19.315217 | orchestrator | 2026-04-24 05:18:19.315227 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:18:19.315238 | orchestrator | Friday 24 April 2026 05:18:05 +0000 (0:00:01.620) 0:15:47.213 ********** 2026-04-24 05:18:19.315249 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.315260 | orchestrator | 2026-04-24 05:18:19.315271 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:18:19.315290 | orchestrator | Friday 24 April 2026 05:18:06 +0000 (0:00:01.108) 0:15:48.321 ********** 2026-04-24 05:18:19.315320 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.315340 | orchestrator | 2026-04-24 05:18:19.315358 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:18:19.315375 | orchestrator | Friday 24 April 2026 05:18:07 +0000 (0:00:01.132) 0:15:49.454 ********** 2026-04-24 05:18:19.315392 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.315410 | orchestrator | 2026-04-24 05:18:19.315428 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:18:19.315447 | orchestrator | Friday 24 April 2026 05:18:08 +0000 (0:00:01.160) 0:15:50.615 ********** 2026-04-24 05:18:19.315464 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:19.315482 | orchestrator | 2026-04-24 05:18:19.315513 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:18:19.315532 | orchestrator | Friday 24 April 2026 05:18:10 +0000 (0:00:01.573) 0:15:52.189 ********** 2026-04-24 05:18:19.315549 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.315568 | orchestrator | 2026-04-24 05:18:19.315585 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:18:19.315603 | orchestrator | Friday 24 April 2026 05:18:11 +0000 (0:00:01.136) 0:15:53.325 ********** 2026-04-24 05:18:19.315620 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.315639 | orchestrator | 2026-04-24 05:18:19.315659 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:18:19.315678 | orchestrator | Friday 24 April 2026 05:18:12 +0000 (0:00:01.194) 0:15:54.520 ********** 2026-04-24 05:18:19.315696 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:19.315713 | orchestrator | 2026-04-24 05:18:19.315724 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:18:19.315735 | orchestrator | Friday 24 April 2026 05:18:14 +0000 (0:00:01.649) 0:15:56.169 ********** 2026-04-24 05:18:19.315745 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:19.315756 | orchestrator | 2026-04-24 05:18:19.315766 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:18:19.315777 | orchestrator | Friday 24 April 2026 05:18:16 +0000 (0:00:01.606) 0:15:57.776 ********** 2026-04-24 05:18:19.315788 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.315827 | orchestrator | 2026-04-24 05:18:19.315839 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:18:19.315849 | orchestrator | Friday 24 April 2026 05:18:16 +0000 (0:00:00.768) 0:15:58.545 ********** 2026-04-24 05:18:19.315860 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:19.315876 | orchestrator | 2026-04-24 05:18:19.315894 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:18:19.315911 | orchestrator | Friday 24 April 2026 05:18:17 +0000 (0:00:00.844) 0:15:59.390 ********** 2026-04-24 05:18:19.315929 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.315947 | orchestrator | 2026-04-24 05:18:19.315965 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:18:19.315983 | orchestrator | Friday 24 April 2026 05:18:18 +0000 (0:00:00.769) 0:16:00.159 ********** 2026-04-24 05:18:19.316002 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:19.316021 | orchestrator | 2026-04-24 05:18:19.316040 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:18:19.316057 | orchestrator | Friday 24 April 2026 05:18:19 +0000 (0:00:00.801) 0:16:00.961 ********** 2026-04-24 05:18:19.316091 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.666766 | orchestrator | 2026-04-24 05:18:59.666925 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:18:59.666944 | orchestrator | Friday 24 April 2026 05:18:20 +0000 (0:00:00.780) 0:16:01.741 ********** 2026-04-24 05:18:59.666956 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.666969 | orchestrator | 2026-04-24 05:18:59.666981 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:18:59.666992 | orchestrator | Friday 24 April 2026 05:18:20 +0000 (0:00:00.782) 0:16:02.524 ********** 2026-04-24 05:18:59.667003 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667014 | orchestrator | 2026-04-24 05:18:59.667025 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:18:59.667036 | orchestrator | Friday 24 April 2026 05:18:21 +0000 (0:00:00.848) 0:16:03.372 ********** 2026-04-24 05:18:59.667047 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.667059 | orchestrator | 2026-04-24 05:18:59.667070 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:18:59.667080 | orchestrator | Friday 24 April 2026 05:18:22 +0000 (0:00:00.789) 0:16:04.162 ********** 2026-04-24 05:18:59.667091 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.667102 | orchestrator | 2026-04-24 05:18:59.667113 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:18:59.667149 | orchestrator | Friday 24 April 2026 05:18:23 +0000 (0:00:00.803) 0:16:04.965 ********** 2026-04-24 05:18:59.667161 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.667171 | orchestrator | 2026-04-24 05:18:59.667195 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:18:59.667206 | orchestrator | Friday 24 April 2026 05:18:24 +0000 (0:00:00.801) 0:16:05.767 ********** 2026-04-24 05:18:59.667217 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667228 | orchestrator | 2026-04-24 05:18:59.667238 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:18:59.667249 | orchestrator | Friday 24 April 2026 05:18:24 +0000 (0:00:00.789) 0:16:06.556 ********** 2026-04-24 05:18:59.667260 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667270 | orchestrator | 2026-04-24 05:18:59.667281 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:18:59.667292 | orchestrator | Friday 24 April 2026 05:18:25 +0000 (0:00:00.802) 0:16:07.359 ********** 2026-04-24 05:18:59.667303 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667316 | orchestrator | 2026-04-24 05:18:59.667328 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:18:59.667341 | orchestrator | Friday 24 April 2026 05:18:26 +0000 (0:00:00.771) 0:16:08.130 ********** 2026-04-24 05:18:59.667353 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667366 | orchestrator | 2026-04-24 05:18:59.667379 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:18:59.667391 | orchestrator | Friday 24 April 2026 05:18:27 +0000 (0:00:00.800) 0:16:08.931 ********** 2026-04-24 05:18:59.667403 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667416 | orchestrator | 2026-04-24 05:18:59.667429 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:18:59.667442 | orchestrator | Friday 24 April 2026 05:18:27 +0000 (0:00:00.756) 0:16:09.688 ********** 2026-04-24 05:18:59.667455 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667468 | orchestrator | 2026-04-24 05:18:59.667480 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:18:59.667493 | orchestrator | Friday 24 April 2026 05:18:28 +0000 (0:00:00.775) 0:16:10.463 ********** 2026-04-24 05:18:59.667505 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667517 | orchestrator | 2026-04-24 05:18:59.667530 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:18:59.667544 | orchestrator | Friday 24 April 2026 05:18:29 +0000 (0:00:00.769) 0:16:11.232 ********** 2026-04-24 05:18:59.667558 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667570 | orchestrator | 2026-04-24 05:18:59.667582 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:18:59.667595 | orchestrator | Friday 24 April 2026 05:18:30 +0000 (0:00:00.792) 0:16:12.024 ********** 2026-04-24 05:18:59.667607 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667620 | orchestrator | 2026-04-24 05:18:59.667632 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:18:59.667645 | orchestrator | Friday 24 April 2026 05:18:31 +0000 (0:00:00.794) 0:16:12.819 ********** 2026-04-24 05:18:59.667657 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667669 | orchestrator | 2026-04-24 05:18:59.667680 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:18:59.667691 | orchestrator | Friday 24 April 2026 05:18:31 +0000 (0:00:00.785) 0:16:13.605 ********** 2026-04-24 05:18:59.667701 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667712 | orchestrator | 2026-04-24 05:18:59.667723 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:18:59.667734 | orchestrator | Friday 24 April 2026 05:18:32 +0000 (0:00:00.762) 0:16:14.368 ********** 2026-04-24 05:18:59.667744 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.667763 | orchestrator | 2026-04-24 05:18:59.667774 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:18:59.667785 | orchestrator | Friday 24 April 2026 05:18:33 +0000 (0:00:00.761) 0:16:15.130 ********** 2026-04-24 05:18:59.667796 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.667806 | orchestrator | 2026-04-24 05:18:59.667845 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:18:59.667865 | orchestrator | Friday 24 April 2026 05:18:35 +0000 (0:00:01.717) 0:16:16.847 ********** 2026-04-24 05:18:59.667882 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.667894 | orchestrator | 2026-04-24 05:18:59.667905 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:18:59.667915 | orchestrator | Friday 24 April 2026 05:18:37 +0000 (0:00:02.101) 0:16:18.949 ********** 2026-04-24 05:18:59.667926 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-2 2026-04-24 05:18:59.667938 | orchestrator | 2026-04-24 05:18:59.667967 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:18:59.667978 | orchestrator | Friday 24 April 2026 05:18:38 +0000 (0:00:01.212) 0:16:20.162 ********** 2026-04-24 05:18:59.667989 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668000 | orchestrator | 2026-04-24 05:18:59.668011 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:18:59.668021 | orchestrator | Friday 24 April 2026 05:18:39 +0000 (0:00:01.121) 0:16:21.284 ********** 2026-04-24 05:18:59.668032 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668043 | orchestrator | 2026-04-24 05:18:59.668053 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:18:59.668064 | orchestrator | Friday 24 April 2026 05:18:40 +0000 (0:00:01.207) 0:16:22.491 ********** 2026-04-24 05:18:59.668075 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:18:59.668086 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:18:59.668097 | orchestrator | 2026-04-24 05:18:59.668107 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:18:59.668118 | orchestrator | Friday 24 April 2026 05:18:42 +0000 (0:00:01.790) 0:16:24.281 ********** 2026-04-24 05:18:59.668129 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.668139 | orchestrator | 2026-04-24 05:18:59.668156 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:18:59.668167 | orchestrator | Friday 24 April 2026 05:18:44 +0000 (0:00:01.516) 0:16:25.798 ********** 2026-04-24 05:18:59.668178 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668188 | orchestrator | 2026-04-24 05:18:59.668199 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:18:59.668210 | orchestrator | Friday 24 April 2026 05:18:45 +0000 (0:00:01.180) 0:16:26.979 ********** 2026-04-24 05:18:59.668220 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668231 | orchestrator | 2026-04-24 05:18:59.668242 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:18:59.668252 | orchestrator | Friday 24 April 2026 05:18:46 +0000 (0:00:00.786) 0:16:27.766 ********** 2026-04-24 05:18:59.668263 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668273 | orchestrator | 2026-04-24 05:18:59.668284 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:18:59.668295 | orchestrator | Friday 24 April 2026 05:18:46 +0000 (0:00:00.792) 0:16:28.559 ********** 2026-04-24 05:18:59.668305 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-2 2026-04-24 05:18:59.668316 | orchestrator | 2026-04-24 05:18:59.668327 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:18:59.668338 | orchestrator | Friday 24 April 2026 05:18:47 +0000 (0:00:01.121) 0:16:29.681 ********** 2026-04-24 05:18:59.668348 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.668359 | orchestrator | 2026-04-24 05:18:59.668379 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:18:59.668390 | orchestrator | Friday 24 April 2026 05:18:49 +0000 (0:00:01.733) 0:16:31.414 ********** 2026-04-24 05:18:59.668401 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:18:59.668412 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:18:59.668423 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:18:59.668434 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668445 | orchestrator | 2026-04-24 05:18:59.668456 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:18:59.668467 | orchestrator | Friday 24 April 2026 05:18:50 +0000 (0:00:01.249) 0:16:32.664 ********** 2026-04-24 05:18:59.668477 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668488 | orchestrator | 2026-04-24 05:18:59.668499 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:18:59.668510 | orchestrator | Friday 24 April 2026 05:18:52 +0000 (0:00:01.101) 0:16:33.766 ********** 2026-04-24 05:18:59.668521 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668531 | orchestrator | 2026-04-24 05:18:59.668542 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:18:59.668553 | orchestrator | Friday 24 April 2026 05:18:53 +0000 (0:00:01.196) 0:16:34.962 ********** 2026-04-24 05:18:59.668563 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668574 | orchestrator | 2026-04-24 05:18:59.668585 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:18:59.668596 | orchestrator | Friday 24 April 2026 05:18:54 +0000 (0:00:01.150) 0:16:36.113 ********** 2026-04-24 05:18:59.668606 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668617 | orchestrator | 2026-04-24 05:18:59.668628 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:18:59.668639 | orchestrator | Friday 24 April 2026 05:18:55 +0000 (0:00:01.193) 0:16:37.306 ********** 2026-04-24 05:18:59.668649 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:18:59.668660 | orchestrator | 2026-04-24 05:18:59.668671 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:18:59.668682 | orchestrator | Friday 24 April 2026 05:18:56 +0000 (0:00:00.822) 0:16:38.129 ********** 2026-04-24 05:18:59.668692 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.668703 | orchestrator | 2026-04-24 05:18:59.668714 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:18:59.668725 | orchestrator | Friday 24 April 2026 05:18:58 +0000 (0:00:02.180) 0:16:40.309 ********** 2026-04-24 05:18:59.668736 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:18:59.668746 | orchestrator | 2026-04-24 05:18:59.668757 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:18:59.668768 | orchestrator | Friday 24 April 2026 05:18:59 +0000 (0:00:00.773) 0:16:41.083 ********** 2026-04-24 05:18:59.668778 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-2 2026-04-24 05:18:59.668789 | orchestrator | 2026-04-24 05:18:59.668806 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:19:36.205392 | orchestrator | Friday 24 April 2026 05:19:00 +0000 (0:00:01.151) 0:16:42.234 ********** 2026-04-24 05:19:36.205531 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.205549 | orchestrator | 2026-04-24 05:19:36.205563 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:19:36.205575 | orchestrator | Friday 24 April 2026 05:19:01 +0000 (0:00:01.149) 0:16:43.383 ********** 2026-04-24 05:19:36.205586 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.205597 | orchestrator | 2026-04-24 05:19:36.205609 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:19:36.205620 | orchestrator | Friday 24 April 2026 05:19:02 +0000 (0:00:01.187) 0:16:44.571 ********** 2026-04-24 05:19:36.205662 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.205677 | orchestrator | 2026-04-24 05:19:36.205688 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:19:36.205699 | orchestrator | Friday 24 April 2026 05:19:04 +0000 (0:00:01.232) 0:16:45.803 ********** 2026-04-24 05:19:36.205710 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.205721 | orchestrator | 2026-04-24 05:19:36.205732 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:19:36.205744 | orchestrator | Friday 24 April 2026 05:19:05 +0000 (0:00:01.210) 0:16:47.014 ********** 2026-04-24 05:19:36.205768 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.205779 | orchestrator | 2026-04-24 05:19:36.205790 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:19:36.205801 | orchestrator | Friday 24 April 2026 05:19:06 +0000 (0:00:01.134) 0:16:48.148 ********** 2026-04-24 05:19:36.205811 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.205822 | orchestrator | 2026-04-24 05:19:36.205887 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:19:36.205900 | orchestrator | Friday 24 April 2026 05:19:07 +0000 (0:00:01.125) 0:16:49.274 ********** 2026-04-24 05:19:36.205911 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.205922 | orchestrator | 2026-04-24 05:19:36.205936 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:19:36.205949 | orchestrator | Friday 24 April 2026 05:19:08 +0000 (0:00:01.143) 0:16:50.417 ********** 2026-04-24 05:19:36.205961 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.205973 | orchestrator | 2026-04-24 05:19:36.205986 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:19:36.205998 | orchestrator | Friday 24 April 2026 05:19:09 +0000 (0:00:01.122) 0:16:51.540 ********** 2026-04-24 05:19:36.206010 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:19:36.206084 | orchestrator | 2026-04-24 05:19:36.206097 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:19:36.206110 | orchestrator | Friday 24 April 2026 05:19:10 +0000 (0:00:00.810) 0:16:52.350 ********** 2026-04-24 05:19:36.206122 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-2 2026-04-24 05:19:36.206136 | orchestrator | 2026-04-24 05:19:36.206149 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:19:36.206162 | orchestrator | Friday 24 April 2026 05:19:11 +0000 (0:00:01.115) 0:16:53.466 ********** 2026-04-24 05:19:36.206174 | orchestrator | ok: [testbed-node-2] => (item=/etc/ceph) 2026-04-24 05:19:36.206186 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-24 05:19:36.206199 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-24 05:19:36.206212 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-24 05:19:36.206224 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-24 05:19:36.206237 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-24 05:19:36.206249 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-24 05:19:36.206262 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:19:36.206275 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:19:36.206286 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:19:36.206297 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:19:36.206307 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:19:36.206318 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:19:36.206329 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:19:36.206340 | orchestrator | ok: [testbed-node-2] => (item=/var/run/ceph) 2026-04-24 05:19:36.206350 | orchestrator | ok: [testbed-node-2] => (item=/var/log/ceph) 2026-04-24 05:19:36.206361 | orchestrator | 2026-04-24 05:19:36.206383 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:19:36.206394 | orchestrator | Friday 24 April 2026 05:19:18 +0000 (0:00:06.280) 0:16:59.747 ********** 2026-04-24 05:19:36.206405 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206415 | orchestrator | 2026-04-24 05:19:36.206426 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:19:36.206441 | orchestrator | Friday 24 April 2026 05:19:18 +0000 (0:00:00.778) 0:17:00.525 ********** 2026-04-24 05:19:36.206461 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206481 | orchestrator | 2026-04-24 05:19:36.206501 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:19:36.206522 | orchestrator | Friday 24 April 2026 05:19:19 +0000 (0:00:00.768) 0:17:01.293 ********** 2026-04-24 05:19:36.206540 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206559 | orchestrator | 2026-04-24 05:19:36.206571 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:19:36.206582 | orchestrator | Friday 24 April 2026 05:19:20 +0000 (0:00:00.773) 0:17:02.067 ********** 2026-04-24 05:19:36.206592 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206603 | orchestrator | 2026-04-24 05:19:36.206614 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:19:36.206643 | orchestrator | Friday 24 April 2026 05:19:21 +0000 (0:00:00.767) 0:17:02.834 ********** 2026-04-24 05:19:36.206654 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206666 | orchestrator | 2026-04-24 05:19:36.206676 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:19:36.206687 | orchestrator | Friday 24 April 2026 05:19:21 +0000 (0:00:00.768) 0:17:03.603 ********** 2026-04-24 05:19:36.206697 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206708 | orchestrator | 2026-04-24 05:19:36.206719 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:19:36.206730 | orchestrator | Friday 24 April 2026 05:19:22 +0000 (0:00:00.750) 0:17:04.353 ********** 2026-04-24 05:19:36.206741 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206751 | orchestrator | 2026-04-24 05:19:36.206762 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:19:36.206773 | orchestrator | Friday 24 April 2026 05:19:23 +0000 (0:00:00.819) 0:17:05.172 ********** 2026-04-24 05:19:36.206783 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206794 | orchestrator | 2026-04-24 05:19:36.206805 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:19:36.206816 | orchestrator | Friday 24 April 2026 05:19:24 +0000 (0:00:00.788) 0:17:05.961 ********** 2026-04-24 05:19:36.206861 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206875 | orchestrator | 2026-04-24 05:19:36.206885 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:19:36.206896 | orchestrator | Friday 24 April 2026 05:19:25 +0000 (0:00:00.787) 0:17:06.749 ********** 2026-04-24 05:19:36.206907 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206918 | orchestrator | 2026-04-24 05:19:36.206929 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:19:36.206940 | orchestrator | Friday 24 April 2026 05:19:25 +0000 (0:00:00.802) 0:17:07.552 ********** 2026-04-24 05:19:36.206951 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.206962 | orchestrator | 2026-04-24 05:19:36.206972 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:19:36.206983 | orchestrator | Friday 24 April 2026 05:19:26 +0000 (0:00:00.795) 0:17:08.347 ********** 2026-04-24 05:19:36.206994 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207005 | orchestrator | 2026-04-24 05:19:36.207015 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:19:36.207026 | orchestrator | Friday 24 April 2026 05:19:27 +0000 (0:00:00.785) 0:17:09.133 ********** 2026-04-24 05:19:36.207045 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207056 | orchestrator | 2026-04-24 05:19:36.207067 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:19:36.207078 | orchestrator | Friday 24 April 2026 05:19:28 +0000 (0:00:00.866) 0:17:09.999 ********** 2026-04-24 05:19:36.207088 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207099 | orchestrator | 2026-04-24 05:19:36.207110 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:19:36.207121 | orchestrator | Friday 24 April 2026 05:19:29 +0000 (0:00:00.758) 0:17:10.758 ********** 2026-04-24 05:19:36.207132 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207143 | orchestrator | 2026-04-24 05:19:36.207153 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:19:36.207164 | orchestrator | Friday 24 April 2026 05:19:29 +0000 (0:00:00.892) 0:17:11.650 ********** 2026-04-24 05:19:36.207175 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207186 | orchestrator | 2026-04-24 05:19:36.207197 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:19:36.207207 | orchestrator | Friday 24 April 2026 05:19:30 +0000 (0:00:00.795) 0:17:12.445 ********** 2026-04-24 05:19:36.207218 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207229 | orchestrator | 2026-04-24 05:19:36.207240 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:19:36.207252 | orchestrator | Friday 24 April 2026 05:19:31 +0000 (0:00:00.765) 0:17:13.211 ********** 2026-04-24 05:19:36.207263 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207274 | orchestrator | 2026-04-24 05:19:36.207285 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:19:36.207296 | orchestrator | Friday 24 April 2026 05:19:32 +0000 (0:00:00.803) 0:17:14.014 ********** 2026-04-24 05:19:36.207307 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207318 | orchestrator | 2026-04-24 05:19:36.207328 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:19:36.207339 | orchestrator | Friday 24 April 2026 05:19:33 +0000 (0:00:00.805) 0:17:14.820 ********** 2026-04-24 05:19:36.207350 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207361 | orchestrator | 2026-04-24 05:19:36.207372 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:19:36.207383 | orchestrator | Friday 24 April 2026 05:19:33 +0000 (0:00:00.858) 0:17:15.678 ********** 2026-04-24 05:19:36.207394 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207404 | orchestrator | 2026-04-24 05:19:36.207415 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:19:36.207426 | orchestrator | Friday 24 April 2026 05:19:34 +0000 (0:00:00.874) 0:17:16.553 ********** 2026-04-24 05:19:36.207437 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:19:36.207448 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:19:36.207459 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:19:36.207469 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:19:36.207486 | orchestrator | 2026-04-24 05:19:36.207505 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:19:36.207524 | orchestrator | Friday 24 April 2026 05:19:35 +0000 (0:00:01.118) 0:17:17.671 ********** 2026-04-24 05:19:36.207544 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:19:36.207571 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:20:56.070912 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:20:56.071029 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.071045 | orchestrator | 2026-04-24 05:20:56.071058 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:20:56.071071 | orchestrator | Friday 24 April 2026 05:19:37 +0000 (0:00:01.068) 0:17:18.740 ********** 2026-04-24 05:20:56.071109 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:20:56.071121 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:20:56.071132 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:20:56.071143 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.071154 | orchestrator | 2026-04-24 05:20:56.071165 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:20:56.071176 | orchestrator | Friday 24 April 2026 05:19:38 +0000 (0:00:01.062) 0:17:19.803 ********** 2026-04-24 05:20:56.071187 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.071198 | orchestrator | 2026-04-24 05:20:56.071209 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:20:56.071220 | orchestrator | Friday 24 April 2026 05:19:38 +0000 (0:00:00.763) 0:17:20.566 ********** 2026-04-24 05:20:56.071246 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-24 05:20:56.071257 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.071268 | orchestrator | 2026-04-24 05:20:56.071279 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:20:56.071289 | orchestrator | Friday 24 April 2026 05:19:39 +0000 (0:00:00.929) 0:17:21.495 ********** 2026-04-24 05:20:56.071300 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.071311 | orchestrator | 2026-04-24 05:20:56.071322 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:20:56.071333 | orchestrator | Friday 24 April 2026 05:19:41 +0000 (0:00:01.435) 0:17:22.930 ********** 2026-04-24 05:20:56.071344 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.071354 | orchestrator | 2026-04-24 05:20:56.071365 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-24 05:20:56.071376 | orchestrator | Friday 24 April 2026 05:19:41 +0000 (0:00:00.777) 0:17:23.708 ********** 2026-04-24 05:20:56.071387 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-2 2026-04-24 05:20:56.071399 | orchestrator | 2026-04-24 05:20:56.071412 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-24 05:20:56.071425 | orchestrator | Friday 24 April 2026 05:19:43 +0000 (0:00:01.123) 0:17:24.832 ********** 2026-04-24 05:20:56.071437 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.071450 | orchestrator | 2026-04-24 05:20:56.071463 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-24 05:20:56.071476 | orchestrator | Friday 24 April 2026 05:19:46 +0000 (0:00:03.462) 0:17:28.294 ********** 2026-04-24 05:20:56.071489 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.071502 | orchestrator | 2026-04-24 05:20:56.071515 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-24 05:20:56.071527 | orchestrator | Friday 24 April 2026 05:19:48 +0000 (0:00:01.540) 0:17:29.834 ********** 2026-04-24 05:20:56.071539 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.071552 | orchestrator | 2026-04-24 05:20:56.071565 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-24 05:20:56.071577 | orchestrator | Friday 24 April 2026 05:19:49 +0000 (0:00:01.157) 0:17:30.992 ********** 2026-04-24 05:20:56.071590 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.071602 | orchestrator | 2026-04-24 05:20:56.071615 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-24 05:20:56.071628 | orchestrator | Friday 24 April 2026 05:19:50 +0000 (0:00:01.167) 0:17:32.159 ********** 2026-04-24 05:20:56.071641 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:20:56.071655 | orchestrator | 2026-04-24 05:20:56.071668 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-24 05:20:56.071680 | orchestrator | Friday 24 April 2026 05:19:52 +0000 (0:00:02.008) 0:17:34.167 ********** 2026-04-24 05:20:56.071694 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.071707 | orchestrator | 2026-04-24 05:20:56.071719 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-24 05:20:56.071740 | orchestrator | Friday 24 April 2026 05:19:54 +0000 (0:00:01.588) 0:17:35.756 ********** 2026-04-24 05:20:56.071754 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.071765 | orchestrator | 2026-04-24 05:20:56.071776 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-24 05:20:56.071786 | orchestrator | Friday 24 April 2026 05:19:55 +0000 (0:00:01.445) 0:17:37.202 ********** 2026-04-24 05:20:56.071797 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.071808 | orchestrator | 2026-04-24 05:20:56.071819 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-24 05:20:56.071830 | orchestrator | Friday 24 April 2026 05:19:57 +0000 (0:00:01.532) 0:17:38.734 ********** 2026-04-24 05:20:56.071840 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:20:56.071871 | orchestrator | 2026-04-24 05:20:56.071882 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-24 05:20:56.071893 | orchestrator | Friday 24 April 2026 05:19:58 +0000 (0:00:01.640) 0:17:40.374 ********** 2026-04-24 05:20:56.071904 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:20:56.071914 | orchestrator | 2026-04-24 05:20:56.071925 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-24 05:20:56.071936 | orchestrator | Friday 24 April 2026 05:20:00 +0000 (0:00:01.665) 0:17:42.040 ********** 2026-04-24 05:20:56.071946 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:20:56.071957 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-24 05:20:56.071968 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-24 05:20:56.071979 | orchestrator | ok: [testbed-node-2 -> {{ item }}] 2026-04-24 05:20:56.071990 | orchestrator | 2026-04-24 05:20:56.072018 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-24 05:20:56.072030 | orchestrator | Friday 24 April 2026 05:20:04 +0000 (0:00:03.962) 0:17:46.003 ********** 2026-04-24 05:20:56.072041 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:20:56.072052 | orchestrator | 2026-04-24 05:20:56.072062 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-24 05:20:56.072073 | orchestrator | Friday 24 April 2026 05:20:06 +0000 (0:00:02.067) 0:17:48.070 ********** 2026-04-24 05:20:56.072084 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072094 | orchestrator | 2026-04-24 05:20:56.072105 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-24 05:20:56.072116 | orchestrator | Friday 24 April 2026 05:20:07 +0000 (0:00:01.126) 0:17:49.196 ********** 2026-04-24 05:20:56.072126 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072137 | orchestrator | 2026-04-24 05:20:56.072148 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-24 05:20:56.072159 | orchestrator | Friday 24 April 2026 05:20:08 +0000 (0:00:01.116) 0:17:50.313 ********** 2026-04-24 05:20:56.072169 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072180 | orchestrator | 2026-04-24 05:20:56.072191 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-24 05:20:56.072202 | orchestrator | Friday 24 April 2026 05:20:10 +0000 (0:00:01.908) 0:17:52.221 ********** 2026-04-24 05:20:56.072218 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072229 | orchestrator | 2026-04-24 05:20:56.072240 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-24 05:20:56.072251 | orchestrator | Friday 24 April 2026 05:20:11 +0000 (0:00:01.391) 0:17:53.612 ********** 2026-04-24 05:20:56.072261 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.072272 | orchestrator | 2026-04-24 05:20:56.072283 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-24 05:20:56.072294 | orchestrator | Friday 24 April 2026 05:20:12 +0000 (0:00:00.772) 0:17:54.385 ********** 2026-04-24 05:20:56.072305 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-2 2026-04-24 05:20:56.072315 | orchestrator | 2026-04-24 05:20:56.072326 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-24 05:20:56.072344 | orchestrator | Friday 24 April 2026 05:20:13 +0000 (0:00:01.129) 0:17:55.515 ********** 2026-04-24 05:20:56.072354 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.072365 | orchestrator | 2026-04-24 05:20:56.072376 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-24 05:20:56.072387 | orchestrator | Friday 24 April 2026 05:20:14 +0000 (0:00:01.113) 0:17:56.628 ********** 2026-04-24 05:20:56.072397 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.072408 | orchestrator | 2026-04-24 05:20:56.072419 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-24 05:20:56.072430 | orchestrator | Friday 24 April 2026 05:20:16 +0000 (0:00:01.129) 0:17:57.758 ********** 2026-04-24 05:20:56.072440 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-2 2026-04-24 05:20:56.072451 | orchestrator | 2026-04-24 05:20:56.072462 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-24 05:20:56.072473 | orchestrator | Friday 24 April 2026 05:20:17 +0000 (0:00:01.151) 0:17:58.910 ********** 2026-04-24 05:20:56.072483 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072494 | orchestrator | 2026-04-24 05:20:56.072505 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-24 05:20:56.072515 | orchestrator | Friday 24 April 2026 05:20:19 +0000 (0:00:02.333) 0:18:01.244 ********** 2026-04-24 05:20:56.072526 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072537 | orchestrator | 2026-04-24 05:20:56.072547 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-24 05:20:56.072558 | orchestrator | Friday 24 April 2026 05:20:21 +0000 (0:00:01.949) 0:18:03.193 ********** 2026-04-24 05:20:56.072569 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072580 | orchestrator | 2026-04-24 05:20:56.072590 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-24 05:20:56.072601 | orchestrator | Friday 24 April 2026 05:20:23 +0000 (0:00:02.415) 0:18:05.609 ********** 2026-04-24 05:20:56.072612 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:20:56.072622 | orchestrator | 2026-04-24 05:20:56.072633 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-24 05:20:56.072644 | orchestrator | Friday 24 April 2026 05:20:26 +0000 (0:00:02.858) 0:18:08.467 ********** 2026-04-24 05:20:56.072655 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-2 2026-04-24 05:20:56.072666 | orchestrator | 2026-04-24 05:20:56.072676 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-24 05:20:56.072687 | orchestrator | Friday 24 April 2026 05:20:28 +0000 (0:00:01.309) 0:18:09.777 ********** 2026-04-24 05:20:56.072698 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-24 05:20:56.072709 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072720 | orchestrator | 2026-04-24 05:20:56.072731 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-24 05:20:56.072741 | orchestrator | Friday 24 April 2026 05:20:50 +0000 (0:00:22.852) 0:18:32.629 ********** 2026-04-24 05:20:56.072752 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:20:56.072763 | orchestrator | 2026-04-24 05:20:56.072774 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-24 05:20:56.072784 | orchestrator | Friday 24 April 2026 05:20:53 +0000 (0:00:02.588) 0:18:35.218 ********** 2026-04-24 05:20:56.072795 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:20:56.072806 | orchestrator | 2026-04-24 05:20:56.072817 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-24 05:20:56.072827 | orchestrator | Friday 24 April 2026 05:20:54 +0000 (0:00:00.820) 0:18:36.038 ********** 2026-04-24 05:20:56.072868 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-24 05:21:37.704527 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-24 05:21:37.704659 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-24 05:21:37.704678 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-24 05:21:37.704692 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-24 05:21:37.704705 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__6bb2a6824366fc2187d9ee08d63ec31b92b9195e'}])  2026-04-24 05:21:37.704719 | orchestrator | 2026-04-24 05:21:37.704760 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-24 05:21:37.704774 | orchestrator | Friday 24 April 2026 05:21:03 +0000 (0:00:09.047) 0:18:45.086 ********** 2026-04-24 05:21:37.704785 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:21:37.704798 | orchestrator | 2026-04-24 05:21:37.704809 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:21:37.704820 | orchestrator | Friday 24 April 2026 05:21:05 +0000 (0:00:02.117) 0:18:47.203 ********** 2026-04-24 05:21:37.704831 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:21:37.704843 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-1) 2026-04-24 05:21:37.704854 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-2) 2026-04-24 05:21:37.704865 | orchestrator | 2026-04-24 05:21:37.704876 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:21:37.704887 | orchestrator | Friday 24 April 2026 05:21:07 +0000 (0:00:01.833) 0:18:49.036 ********** 2026-04-24 05:21:37.704898 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 05:21:37.704909 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 05:21:37.704919 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 05:21:37.704930 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:21:37.704941 | orchestrator | 2026-04-24 05:21:37.704952 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-24 05:21:37.704963 | orchestrator | Friday 24 April 2026 05:21:08 +0000 (0:00:01.036) 0:18:50.072 ********** 2026-04-24 05:21:37.704974 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:21:37.705008 | orchestrator | 2026-04-24 05:21:37.705019 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-24 05:21:37.705030 | orchestrator | Friday 24 April 2026 05:21:09 +0000 (0:00:00.756) 0:18:50.829 ********** 2026-04-24 05:21:37.705041 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:21:37.705053 | orchestrator | 2026-04-24 05:21:37.705065 | orchestrator | PLAY [Reset mon_host] ********************************************************** 2026-04-24 05:21:37.705077 | orchestrator | 2026-04-24 05:21:37.705090 | orchestrator | TASK [Reset mon_host fact] ***************************************************** 2026-04-24 05:21:37.705102 | orchestrator | Friday 24 April 2026 05:21:12 +0000 (0:00:02.889) 0:18:53.718 ********** 2026-04-24 05:21:37.705115 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:21:37.705127 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:21:37.705140 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:21:37.705151 | orchestrator | 2026-04-24 05:21:37.705164 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-24 05:21:37.705177 | orchestrator | 2026-04-24 05:21:37.705189 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-24 05:21:37.705207 | orchestrator | Friday 24 April 2026 05:21:13 +0000 (0:00:01.612) 0:18:55.331 ********** 2026-04-24 05:21:37.705226 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705244 | orchestrator | 2026-04-24 05:21:37.705263 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:21:37.705304 | orchestrator | Friday 24 April 2026 05:21:14 +0000 (0:00:01.169) 0:18:56.501 ********** 2026-04-24 05:21:37.705324 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705342 | orchestrator | 2026-04-24 05:21:37.705360 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:21:37.705378 | orchestrator | Friday 24 April 2026 05:21:15 +0000 (0:00:01.158) 0:18:57.659 ********** 2026-04-24 05:21:37.705396 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705414 | orchestrator | 2026-04-24 05:21:37.705432 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:21:37.705451 | orchestrator | Friday 24 April 2026 05:21:17 +0000 (0:00:01.198) 0:18:58.858 ********** 2026-04-24 05:21:37.705469 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705486 | orchestrator | 2026-04-24 05:21:37.705504 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:21:37.705523 | orchestrator | Friday 24 April 2026 05:21:18 +0000 (0:00:01.133) 0:18:59.992 ********** 2026-04-24 05:21:37.705553 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705571 | orchestrator | 2026-04-24 05:21:37.705588 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:21:37.705606 | orchestrator | Friday 24 April 2026 05:21:19 +0000 (0:00:01.141) 0:19:01.134 ********** 2026-04-24 05:21:37.705625 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705643 | orchestrator | 2026-04-24 05:21:37.705660 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:21:37.705679 | orchestrator | Friday 24 April 2026 05:21:20 +0000 (0:00:01.124) 0:19:02.258 ********** 2026-04-24 05:21:37.705697 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705716 | orchestrator | 2026-04-24 05:21:37.705769 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:21:37.705790 | orchestrator | Friday 24 April 2026 05:21:21 +0000 (0:00:01.102) 0:19:03.361 ********** 2026-04-24 05:21:37.705808 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705820 | orchestrator | 2026-04-24 05:21:37.705831 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:21:37.705843 | orchestrator | Friday 24 April 2026 05:21:22 +0000 (0:00:01.107) 0:19:04.468 ********** 2026-04-24 05:21:37.705862 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705880 | orchestrator | 2026-04-24 05:21:37.705898 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:21:37.705916 | orchestrator | Friday 24 April 2026 05:21:23 +0000 (0:00:01.148) 0:19:05.617 ********** 2026-04-24 05:21:37.705952 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.705971 | orchestrator | 2026-04-24 05:21:37.705990 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:21:37.706008 | orchestrator | Friday 24 April 2026 05:21:24 +0000 (0:00:01.087) 0:19:06.705 ********** 2026-04-24 05:21:37.706096 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706117 | orchestrator | 2026-04-24 05:21:37.706138 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:21:37.706156 | orchestrator | Friday 24 April 2026 05:21:26 +0000 (0:00:01.112) 0:19:07.818 ********** 2026-04-24 05:21:37.706176 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706196 | orchestrator | 2026-04-24 05:21:37.706217 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:21:37.706234 | orchestrator | Friday 24 April 2026 05:21:27 +0000 (0:00:01.161) 0:19:08.979 ********** 2026-04-24 05:21:37.706250 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706261 | orchestrator | 2026-04-24 05:21:37.706271 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:21:37.706282 | orchestrator | Friday 24 April 2026 05:21:28 +0000 (0:00:01.114) 0:19:10.093 ********** 2026-04-24 05:21:37.706293 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706304 | orchestrator | 2026-04-24 05:21:37.706314 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:21:37.706325 | orchestrator | Friday 24 April 2026 05:21:29 +0000 (0:00:01.142) 0:19:11.236 ********** 2026-04-24 05:21:37.706336 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706346 | orchestrator | 2026-04-24 05:21:37.706357 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:21:37.706368 | orchestrator | Friday 24 April 2026 05:21:30 +0000 (0:00:01.202) 0:19:12.438 ********** 2026-04-24 05:21:37.706378 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706389 | orchestrator | 2026-04-24 05:21:37.706400 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:21:37.706411 | orchestrator | Friday 24 April 2026 05:21:31 +0000 (0:00:01.125) 0:19:13.564 ********** 2026-04-24 05:21:37.706421 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706432 | orchestrator | 2026-04-24 05:21:37.706443 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:21:37.706453 | orchestrator | Friday 24 April 2026 05:21:32 +0000 (0:00:01.137) 0:19:14.701 ********** 2026-04-24 05:21:37.706464 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706475 | orchestrator | 2026-04-24 05:21:37.706486 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:21:37.706496 | orchestrator | Friday 24 April 2026 05:21:34 +0000 (0:00:01.245) 0:19:15.947 ********** 2026-04-24 05:21:37.706507 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706517 | orchestrator | 2026-04-24 05:21:37.706528 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:21:37.706539 | orchestrator | Friday 24 April 2026 05:21:35 +0000 (0:00:01.147) 0:19:17.094 ********** 2026-04-24 05:21:37.706550 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706561 | orchestrator | 2026-04-24 05:21:37.706572 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:21:37.706582 | orchestrator | Friday 24 April 2026 05:21:36 +0000 (0:00:01.139) 0:19:18.233 ********** 2026-04-24 05:21:37.706593 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:21:37.706604 | orchestrator | 2026-04-24 05:21:37.706615 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:21:37.706625 | orchestrator | Friday 24 April 2026 05:21:37 +0000 (0:00:01.120) 0:19:19.354 ********** 2026-04-24 05:21:37.706652 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073145 | orchestrator | 2026-04-24 05:22:22.073264 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:22:22.073320 | orchestrator | Friday 24 April 2026 05:21:38 +0000 (0:00:01.134) 0:19:20.489 ********** 2026-04-24 05:22:22.073338 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073356 | orchestrator | 2026-04-24 05:22:22.073373 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:22:22.073388 | orchestrator | Friday 24 April 2026 05:21:39 +0000 (0:00:01.179) 0:19:21.669 ********** 2026-04-24 05:22:22.073404 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073420 | orchestrator | 2026-04-24 05:22:22.073437 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:22:22.073455 | orchestrator | Friday 24 April 2026 05:21:41 +0000 (0:00:01.134) 0:19:22.804 ********** 2026-04-24 05:22:22.073472 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073488 | orchestrator | 2026-04-24 05:22:22.073516 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:22:22.073526 | orchestrator | Friday 24 April 2026 05:21:42 +0000 (0:00:01.137) 0:19:23.942 ********** 2026-04-24 05:22:22.073536 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073545 | orchestrator | 2026-04-24 05:22:22.073555 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:22:22.073564 | orchestrator | Friday 24 April 2026 05:21:43 +0000 (0:00:01.117) 0:19:25.059 ********** 2026-04-24 05:22:22.073574 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073583 | orchestrator | 2026-04-24 05:22:22.073592 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:22:22.073602 | orchestrator | Friday 24 April 2026 05:21:44 +0000 (0:00:01.152) 0:19:26.212 ********** 2026-04-24 05:22:22.073672 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073683 | orchestrator | 2026-04-24 05:22:22.073692 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:22:22.073702 | orchestrator | Friday 24 April 2026 05:21:45 +0000 (0:00:01.117) 0:19:27.329 ********** 2026-04-24 05:22:22.073711 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073721 | orchestrator | 2026-04-24 05:22:22.073730 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:22:22.073740 | orchestrator | Friday 24 April 2026 05:21:46 +0000 (0:00:01.119) 0:19:28.448 ********** 2026-04-24 05:22:22.073749 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073759 | orchestrator | 2026-04-24 05:22:22.073769 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:22:22.073779 | orchestrator | Friday 24 April 2026 05:21:47 +0000 (0:00:01.198) 0:19:29.647 ********** 2026-04-24 05:22:22.073789 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073799 | orchestrator | 2026-04-24 05:22:22.073808 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:22:22.073818 | orchestrator | Friday 24 April 2026 05:21:49 +0000 (0:00:01.170) 0:19:30.817 ********** 2026-04-24 05:22:22.073827 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073837 | orchestrator | 2026-04-24 05:22:22.073846 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:22:22.073856 | orchestrator | Friday 24 April 2026 05:21:50 +0000 (0:00:01.135) 0:19:31.952 ********** 2026-04-24 05:22:22.073865 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073874 | orchestrator | 2026-04-24 05:22:22.073884 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:22:22.073893 | orchestrator | Friday 24 April 2026 05:21:51 +0000 (0:00:01.153) 0:19:33.106 ********** 2026-04-24 05:22:22.073903 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073912 | orchestrator | 2026-04-24 05:22:22.073921 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:22:22.073931 | orchestrator | Friday 24 April 2026 05:21:52 +0000 (0:00:01.197) 0:19:34.303 ********** 2026-04-24 05:22:22.073940 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.073950 | orchestrator | 2026-04-24 05:22:22.073959 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:22:22.073982 | orchestrator | Friday 24 April 2026 05:21:53 +0000 (0:00:01.132) 0:19:35.435 ********** 2026-04-24 05:22:22.073992 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074001 | orchestrator | 2026-04-24 05:22:22.074010 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:22:22.074080 | orchestrator | Friday 24 April 2026 05:21:54 +0000 (0:00:01.145) 0:19:36.581 ********** 2026-04-24 05:22:22.074090 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074100 | orchestrator | 2026-04-24 05:22:22.074109 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:22:22.074119 | orchestrator | Friday 24 April 2026 05:21:56 +0000 (0:00:01.246) 0:19:37.827 ********** 2026-04-24 05:22:22.074158 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074170 | orchestrator | 2026-04-24 05:22:22.074179 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:22:22.074189 | orchestrator | Friday 24 April 2026 05:21:57 +0000 (0:00:01.127) 0:19:38.955 ********** 2026-04-24 05:22:22.074199 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074208 | orchestrator | 2026-04-24 05:22:22.074218 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:22:22.074229 | orchestrator | Friday 24 April 2026 05:21:58 +0000 (0:00:01.143) 0:19:40.098 ********** 2026-04-24 05:22:22.074238 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074248 | orchestrator | 2026-04-24 05:22:22.074257 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:22:22.074267 | orchestrator | Friday 24 April 2026 05:21:59 +0000 (0:00:01.125) 0:19:41.224 ********** 2026-04-24 05:22:22.074277 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074286 | orchestrator | 2026-04-24 05:22:22.074296 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:22:22.074306 | orchestrator | Friday 24 April 2026 05:22:00 +0000 (0:00:01.141) 0:19:42.366 ********** 2026-04-24 05:22:22.074334 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074345 | orchestrator | 2026-04-24 05:22:22.074354 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:22:22.074364 | orchestrator | Friday 24 April 2026 05:22:01 +0000 (0:00:01.106) 0:19:43.472 ********** 2026-04-24 05:22:22.074373 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074383 | orchestrator | 2026-04-24 05:22:22.074392 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:22:22.074402 | orchestrator | Friday 24 April 2026 05:22:02 +0000 (0:00:01.185) 0:19:44.658 ********** 2026-04-24 05:22:22.074411 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074421 | orchestrator | 2026-04-24 05:22:22.074431 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:22:22.074440 | orchestrator | Friday 24 April 2026 05:22:04 +0000 (0:00:01.146) 0:19:45.804 ********** 2026-04-24 05:22:22.074449 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074459 | orchestrator | 2026-04-24 05:22:22.074475 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:22:22.074485 | orchestrator | Friday 24 April 2026 05:22:05 +0000 (0:00:01.152) 0:19:46.957 ********** 2026-04-24 05:22:22.074494 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074504 | orchestrator | 2026-04-24 05:22:22.074513 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:22:22.074523 | orchestrator | Friday 24 April 2026 05:22:06 +0000 (0:00:01.239) 0:19:48.196 ********** 2026-04-24 05:22:22.074532 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074542 | orchestrator | 2026-04-24 05:22:22.074551 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:22:22.074561 | orchestrator | Friday 24 April 2026 05:22:07 +0000 (0:00:01.178) 0:19:49.375 ********** 2026-04-24 05:22:22.074570 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074588 | orchestrator | 2026-04-24 05:22:22.074598 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:22:22.074626 | orchestrator | Friday 24 April 2026 05:22:08 +0000 (0:00:01.216) 0:19:50.591 ********** 2026-04-24 05:22:22.074636 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074646 | orchestrator | 2026-04-24 05:22:22.074655 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:22:22.074665 | orchestrator | Friday 24 April 2026 05:22:10 +0000 (0:00:01.133) 0:19:51.725 ********** 2026-04-24 05:22:22.074674 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074684 | orchestrator | 2026-04-24 05:22:22.074693 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:22:22.074704 | orchestrator | Friday 24 April 2026 05:22:11 +0000 (0:00:01.138) 0:19:52.864 ********** 2026-04-24 05:22:22.074714 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074724 | orchestrator | 2026-04-24 05:22:22.074733 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:22:22.074742 | orchestrator | Friday 24 April 2026 05:22:12 +0000 (0:00:01.154) 0:19:54.018 ********** 2026-04-24 05:22:22.074752 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074762 | orchestrator | 2026-04-24 05:22:22.074771 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:22:22.074781 | orchestrator | Friday 24 April 2026 05:22:13 +0000 (0:00:01.114) 0:19:55.132 ********** 2026-04-24 05:22:22.074790 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074800 | orchestrator | 2026-04-24 05:22:22.074809 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:22:22.074819 | orchestrator | Friday 24 April 2026 05:22:14 +0000 (0:00:01.232) 0:19:56.365 ********** 2026-04-24 05:22:22.074828 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074838 | orchestrator | 2026-04-24 05:22:22.074847 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:22:22.074857 | orchestrator | Friday 24 April 2026 05:22:15 +0000 (0:00:01.123) 0:19:57.489 ********** 2026-04-24 05:22:22.074866 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:22:22.074876 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:22:22.074885 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:22:22.074895 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074904 | orchestrator | 2026-04-24 05:22:22.074914 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:22:22.074923 | orchestrator | Friday 24 April 2026 05:22:17 +0000 (0:00:01.823) 0:19:59.313 ********** 2026-04-24 05:22:22.074933 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:22:22.074942 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:22:22.074952 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:22:22.074961 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.074971 | orchestrator | 2026-04-24 05:22:22.074980 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:22:22.074989 | orchestrator | Friday 24 April 2026 05:22:19 +0000 (0:00:01.771) 0:20:01.084 ********** 2026-04-24 05:22:22.074999 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:22:22.075009 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:22:22.075018 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:22:22.075027 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.075037 | orchestrator | 2026-04-24 05:22:22.075046 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:22:22.075056 | orchestrator | Friday 24 April 2026 05:22:20 +0000 (0:00:01.389) 0:20:02.474 ********** 2026-04-24 05:22:22.075065 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:22.075075 | orchestrator | 2026-04-24 05:22:22.075090 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:22:22.075100 | orchestrator | Friday 24 April 2026 05:22:21 +0000 (0:00:01.120) 0:20:03.594 ********** 2026-04-24 05:22:22.075110 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-24 05:22:22.075126 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:55.989981 | orchestrator | 2026-04-24 05:22:55.990166 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:22:55.990183 | orchestrator | Friday 24 April 2026 05:22:23 +0000 (0:00:01.273) 0:20:04.868 ********** 2026-04-24 05:22:55.990194 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:55.990205 | orchestrator | 2026-04-24 05:22:55.990216 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:22:55.990226 | orchestrator | Friday 24 April 2026 05:22:24 +0000 (0:00:01.138) 0:20:06.007 ********** 2026-04-24 05:22:55.990235 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:22:55.990245 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:22:55.990255 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:22:55.990265 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:55.990275 | orchestrator | 2026-04-24 05:22:55.990299 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-24 05:22:55.990309 | orchestrator | Friday 24 April 2026 05:22:25 +0000 (0:00:01.508) 0:20:07.515 ********** 2026-04-24 05:22:55.990319 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:55.990328 | orchestrator | 2026-04-24 05:22:55.990338 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-24 05:22:55.990348 | orchestrator | Friday 24 April 2026 05:22:26 +0000 (0:00:01.116) 0:20:08.632 ********** 2026-04-24 05:22:55.990357 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:55.990367 | orchestrator | 2026-04-24 05:22:55.990377 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-24 05:22:55.990386 | orchestrator | Friday 24 April 2026 05:22:28 +0000 (0:00:01.172) 0:20:09.805 ********** 2026-04-24 05:22:55.990396 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:55.990406 | orchestrator | 2026-04-24 05:22:55.990415 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-24 05:22:55.990425 | orchestrator | Friday 24 April 2026 05:22:29 +0000 (0:00:01.126) 0:20:10.932 ********** 2026-04-24 05:22:55.990435 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:22:55.990444 | orchestrator | 2026-04-24 05:22:55.990454 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-24 05:22:55.990463 | orchestrator | 2026-04-24 05:22:55.990473 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-24 05:22:55.990482 | orchestrator | Friday 24 April 2026 05:22:30 +0000 (0:00:01.018) 0:20:11.950 ********** 2026-04-24 05:22:55.990492 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990502 | orchestrator | 2026-04-24 05:22:55.990513 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:22:55.990546 | orchestrator | Friday 24 April 2026 05:22:31 +0000 (0:00:00.909) 0:20:12.860 ********** 2026-04-24 05:22:55.990557 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990569 | orchestrator | 2026-04-24 05:22:55.990580 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:22:55.990591 | orchestrator | Friday 24 April 2026 05:22:31 +0000 (0:00:00.773) 0:20:13.634 ********** 2026-04-24 05:22:55.990602 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990613 | orchestrator | 2026-04-24 05:22:55.990625 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:22:55.990636 | orchestrator | Friday 24 April 2026 05:22:32 +0000 (0:00:00.778) 0:20:14.413 ********** 2026-04-24 05:22:55.990647 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990658 | orchestrator | 2026-04-24 05:22:55.990670 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:22:55.990702 | orchestrator | Friday 24 April 2026 05:22:33 +0000 (0:00:00.774) 0:20:15.187 ********** 2026-04-24 05:22:55.990714 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990725 | orchestrator | 2026-04-24 05:22:55.990736 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:22:55.990747 | orchestrator | Friday 24 April 2026 05:22:34 +0000 (0:00:00.821) 0:20:16.010 ********** 2026-04-24 05:22:55.990758 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990769 | orchestrator | 2026-04-24 05:22:55.990780 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:22:55.990791 | orchestrator | Friday 24 April 2026 05:22:35 +0000 (0:00:00.783) 0:20:16.793 ********** 2026-04-24 05:22:55.990802 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990813 | orchestrator | 2026-04-24 05:22:55.990824 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:22:55.990835 | orchestrator | Friday 24 April 2026 05:22:35 +0000 (0:00:00.780) 0:20:17.574 ********** 2026-04-24 05:22:55.990846 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990858 | orchestrator | 2026-04-24 05:22:55.990869 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:22:55.990878 | orchestrator | Friday 24 April 2026 05:22:36 +0000 (0:00:00.780) 0:20:18.355 ********** 2026-04-24 05:22:55.990888 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990897 | orchestrator | 2026-04-24 05:22:55.990906 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:22:55.990916 | orchestrator | Friday 24 April 2026 05:22:37 +0000 (0:00:00.800) 0:20:19.155 ********** 2026-04-24 05:22:55.990925 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990935 | orchestrator | 2026-04-24 05:22:55.990944 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:22:55.990954 | orchestrator | Friday 24 April 2026 05:22:38 +0000 (0:00:00.790) 0:20:19.946 ********** 2026-04-24 05:22:55.990963 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.990973 | orchestrator | 2026-04-24 05:22:55.990982 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:22:55.990992 | orchestrator | Friday 24 April 2026 05:22:39 +0000 (0:00:00.775) 0:20:20.722 ********** 2026-04-24 05:22:55.991001 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991011 | orchestrator | 2026-04-24 05:22:55.991020 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:22:55.991030 | orchestrator | Friday 24 April 2026 05:22:39 +0000 (0:00:00.885) 0:20:21.607 ********** 2026-04-24 05:22:55.991040 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991049 | orchestrator | 2026-04-24 05:22:55.991076 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:22:55.991087 | orchestrator | Friday 24 April 2026 05:22:40 +0000 (0:00:00.788) 0:20:22.396 ********** 2026-04-24 05:22:55.991096 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991106 | orchestrator | 2026-04-24 05:22:55.991115 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:22:55.991125 | orchestrator | Friday 24 April 2026 05:22:41 +0000 (0:00:00.787) 0:20:23.183 ********** 2026-04-24 05:22:55.991134 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991144 | orchestrator | 2026-04-24 05:22:55.991153 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:22:55.991163 | orchestrator | Friday 24 April 2026 05:22:42 +0000 (0:00:00.767) 0:20:23.950 ********** 2026-04-24 05:22:55.991172 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991182 | orchestrator | 2026-04-24 05:22:55.991196 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:22:55.991206 | orchestrator | Friday 24 April 2026 05:22:43 +0000 (0:00:00.767) 0:20:24.718 ********** 2026-04-24 05:22:55.991216 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991225 | orchestrator | 2026-04-24 05:22:55.991235 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:22:55.991252 | orchestrator | Friday 24 April 2026 05:22:43 +0000 (0:00:00.766) 0:20:25.484 ********** 2026-04-24 05:22:55.991261 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991271 | orchestrator | 2026-04-24 05:22:55.991281 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:22:55.991290 | orchestrator | Friday 24 April 2026 05:22:44 +0000 (0:00:00.829) 0:20:26.313 ********** 2026-04-24 05:22:55.991300 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991309 | orchestrator | 2026-04-24 05:22:55.991319 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:22:55.991330 | orchestrator | Friday 24 April 2026 05:22:45 +0000 (0:00:00.809) 0:20:27.123 ********** 2026-04-24 05:22:55.991342 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991359 | orchestrator | 2026-04-24 05:22:55.991375 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:22:55.991391 | orchestrator | Friday 24 April 2026 05:22:46 +0000 (0:00:00.784) 0:20:27.907 ********** 2026-04-24 05:22:55.991409 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991433 | orchestrator | 2026-04-24 05:22:55.991449 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:22:55.991464 | orchestrator | Friday 24 April 2026 05:22:46 +0000 (0:00:00.780) 0:20:28.688 ********** 2026-04-24 05:22:55.991479 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991494 | orchestrator | 2026-04-24 05:22:55.991509 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:22:55.991579 | orchestrator | Friday 24 April 2026 05:22:47 +0000 (0:00:00.882) 0:20:29.570 ********** 2026-04-24 05:22:55.991597 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991612 | orchestrator | 2026-04-24 05:22:55.991629 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:22:55.991643 | orchestrator | Friday 24 April 2026 05:22:48 +0000 (0:00:00.781) 0:20:30.352 ********** 2026-04-24 05:22:55.991658 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.991674 | orchestrator | 2026-04-24 05:22:55.991691 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:22:55.991707 | orchestrator | Friday 24 April 2026 05:22:49 +0000 (0:00:00.869) 0:20:31.222 ********** 2026-04-24 05:22:55.991994 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992022 | orchestrator | 2026-04-24 05:22:55.992038 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:22:55.992053 | orchestrator | Friday 24 April 2026 05:22:50 +0000 (0:00:00.791) 0:20:32.013 ********** 2026-04-24 05:22:55.992069 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992085 | orchestrator | 2026-04-24 05:22:55.992102 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:22:55.992119 | orchestrator | Friday 24 April 2026 05:22:51 +0000 (0:00:00.786) 0:20:32.800 ********** 2026-04-24 05:22:55.992135 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992150 | orchestrator | 2026-04-24 05:22:55.992167 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:22:55.992183 | orchestrator | Friday 24 April 2026 05:22:51 +0000 (0:00:00.789) 0:20:33.590 ********** 2026-04-24 05:22:55.992199 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992215 | orchestrator | 2026-04-24 05:22:55.992231 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:22:55.992247 | orchestrator | Friday 24 April 2026 05:22:52 +0000 (0:00:00.793) 0:20:34.383 ********** 2026-04-24 05:22:55.992263 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992278 | orchestrator | 2026-04-24 05:22:55.992293 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:22:55.992307 | orchestrator | Friday 24 April 2026 05:22:53 +0000 (0:00:00.758) 0:20:35.142 ********** 2026-04-24 05:22:55.992322 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992338 | orchestrator | 2026-04-24 05:22:55.992353 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:22:55.992388 | orchestrator | Friday 24 April 2026 05:22:54 +0000 (0:00:00.817) 0:20:35.960 ********** 2026-04-24 05:22:55.992404 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992420 | orchestrator | 2026-04-24 05:22:55.992435 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:22:55.992450 | orchestrator | Friday 24 April 2026 05:22:55 +0000 (0:00:00.785) 0:20:36.745 ********** 2026-04-24 05:22:55.992465 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992480 | orchestrator | 2026-04-24 05:22:55.992495 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:22:55.992512 | orchestrator | Friday 24 April 2026 05:22:55 +0000 (0:00:00.800) 0:20:37.546 ********** 2026-04-24 05:22:55.992638 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:22:55.992658 | orchestrator | 2026-04-24 05:22:55.992695 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:23:26.376368 | orchestrator | Friday 24 April 2026 05:22:56 +0000 (0:00:00.768) 0:20:38.314 ********** 2026-04-24 05:23:26.376549 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376569 | orchestrator | 2026-04-24 05:23:26.376582 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:23:26.376594 | orchestrator | Friday 24 April 2026 05:22:57 +0000 (0:00:00.759) 0:20:39.074 ********** 2026-04-24 05:23:26.376605 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376616 | orchestrator | 2026-04-24 05:23:26.376628 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:23:26.376638 | orchestrator | Friday 24 April 2026 05:22:58 +0000 (0:00:00.771) 0:20:39.845 ********** 2026-04-24 05:23:26.376649 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376660 | orchestrator | 2026-04-24 05:23:26.376671 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:23:26.376698 | orchestrator | Friday 24 April 2026 05:22:58 +0000 (0:00:00.802) 0:20:40.647 ********** 2026-04-24 05:23:26.376709 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376720 | orchestrator | 2026-04-24 05:23:26.376732 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:23:26.376743 | orchestrator | Friday 24 April 2026 05:22:59 +0000 (0:00:00.751) 0:20:41.399 ********** 2026-04-24 05:23:26.376753 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376764 | orchestrator | 2026-04-24 05:23:26.376775 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:23:26.376786 | orchestrator | Friday 24 April 2026 05:23:00 +0000 (0:00:00.765) 0:20:42.164 ********** 2026-04-24 05:23:26.376797 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376808 | orchestrator | 2026-04-24 05:23:26.376818 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:23:26.376830 | orchestrator | Friday 24 April 2026 05:23:01 +0000 (0:00:00.778) 0:20:42.942 ********** 2026-04-24 05:23:26.376841 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376852 | orchestrator | 2026-04-24 05:23:26.376862 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:23:26.376873 | orchestrator | Friday 24 April 2026 05:23:02 +0000 (0:00:00.797) 0:20:43.740 ********** 2026-04-24 05:23:26.376884 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376895 | orchestrator | 2026-04-24 05:23:26.376907 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:23:26.376920 | orchestrator | Friday 24 April 2026 05:23:02 +0000 (0:00:00.836) 0:20:44.577 ********** 2026-04-24 05:23:26.376932 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.376944 | orchestrator | 2026-04-24 05:23:26.376957 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:23:26.376969 | orchestrator | Friday 24 April 2026 05:23:03 +0000 (0:00:00.768) 0:20:45.345 ********** 2026-04-24 05:23:26.376981 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377017 | orchestrator | 2026-04-24 05:23:26.377030 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:23:26.377042 | orchestrator | Friday 24 April 2026 05:23:04 +0000 (0:00:00.783) 0:20:46.129 ********** 2026-04-24 05:23:26.377054 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377066 | orchestrator | 2026-04-24 05:23:26.377079 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:23:26.377091 | orchestrator | Friday 24 April 2026 05:23:05 +0000 (0:00:00.762) 0:20:46.891 ********** 2026-04-24 05:23:26.377104 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377116 | orchestrator | 2026-04-24 05:23:26.377129 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:23:26.377141 | orchestrator | Friday 24 April 2026 05:23:05 +0000 (0:00:00.773) 0:20:47.665 ********** 2026-04-24 05:23:26.377153 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377166 | orchestrator | 2026-04-24 05:23:26.377177 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:23:26.377187 | orchestrator | Friday 24 April 2026 05:23:06 +0000 (0:00:00.885) 0:20:48.551 ********** 2026-04-24 05:23:26.377198 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377208 | orchestrator | 2026-04-24 05:23:26.377219 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:23:26.377230 | orchestrator | Friday 24 April 2026 05:23:07 +0000 (0:00:00.837) 0:20:49.389 ********** 2026-04-24 05:23:26.377240 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377251 | orchestrator | 2026-04-24 05:23:26.377262 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:23:26.377272 | orchestrator | Friday 24 April 2026 05:23:08 +0000 (0:00:00.855) 0:20:50.245 ********** 2026-04-24 05:23:26.377283 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377294 | orchestrator | 2026-04-24 05:23:26.377304 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:23:26.377315 | orchestrator | Friday 24 April 2026 05:23:09 +0000 (0:00:00.800) 0:20:51.045 ********** 2026-04-24 05:23:26.377326 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377336 | orchestrator | 2026-04-24 05:23:26.377347 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:23:26.377360 | orchestrator | Friday 24 April 2026 05:23:10 +0000 (0:00:00.798) 0:20:51.844 ********** 2026-04-24 05:23:26.377370 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377381 | orchestrator | 2026-04-24 05:23:26.377392 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:23:26.377402 | orchestrator | Friday 24 April 2026 05:23:10 +0000 (0:00:00.781) 0:20:52.625 ********** 2026-04-24 05:23:26.377413 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377424 | orchestrator | 2026-04-24 05:23:26.377434 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:23:26.377466 | orchestrator | Friday 24 April 2026 05:23:11 +0000 (0:00:00.824) 0:20:53.450 ********** 2026-04-24 05:23:26.377477 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377488 | orchestrator | 2026-04-24 05:23:26.377516 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:23:26.377527 | orchestrator | Friday 24 April 2026 05:23:12 +0000 (0:00:00.787) 0:20:54.238 ********** 2026-04-24 05:23:26.377538 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377549 | orchestrator | 2026-04-24 05:23:26.377559 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:23:26.377570 | orchestrator | Friday 24 April 2026 05:23:13 +0000 (0:00:00.811) 0:20:55.050 ********** 2026-04-24 05:23:26.377580 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:23:26.377591 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:23:26.377602 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:23:26.377621 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377632 | orchestrator | 2026-04-24 05:23:26.377648 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:23:26.377659 | orchestrator | Friday 24 April 2026 05:23:14 +0000 (0:00:01.071) 0:20:56.122 ********** 2026-04-24 05:23:26.377670 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:23:26.377680 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:23:26.377691 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:23:26.377701 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377712 | orchestrator | 2026-04-24 05:23:26.377748 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:23:26.377775 | orchestrator | Friday 24 April 2026 05:23:15 +0000 (0:00:01.093) 0:20:57.215 ********** 2026-04-24 05:23:26.377798 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:23:26.377808 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:23:26.377819 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:23:26.377829 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377840 | orchestrator | 2026-04-24 05:23:26.377851 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:23:26.377861 | orchestrator | Friday 24 April 2026 05:23:16 +0000 (0:00:01.033) 0:20:58.249 ********** 2026-04-24 05:23:26.377872 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377882 | orchestrator | 2026-04-24 05:23:26.377893 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:23:26.377903 | orchestrator | Friday 24 April 2026 05:23:17 +0000 (0:00:00.848) 0:20:59.098 ********** 2026-04-24 05:23:26.377915 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-24 05:23:26.377925 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377936 | orchestrator | 2026-04-24 05:23:26.377946 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:23:26.377957 | orchestrator | Friday 24 April 2026 05:23:18 +0000 (0:00:00.890) 0:20:59.988 ********** 2026-04-24 05:23:26.377967 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.377978 | orchestrator | 2026-04-24 05:23:26.377988 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:23:26.377999 | orchestrator | Friday 24 April 2026 05:23:19 +0000 (0:00:00.814) 0:21:00.803 ********** 2026-04-24 05:23:26.378010 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 05:23:26.378075 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 05:23:26.378087 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 05:23:26.378098 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.378109 | orchestrator | 2026-04-24 05:23:26.378119 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-24 05:23:26.378130 | orchestrator | Friday 24 April 2026 05:23:20 +0000 (0:00:01.424) 0:21:02.227 ********** 2026-04-24 05:23:26.378141 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.378151 | orchestrator | 2026-04-24 05:23:26.378162 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-24 05:23:26.378172 | orchestrator | Friday 24 April 2026 05:23:21 +0000 (0:00:00.799) 0:21:03.027 ********** 2026-04-24 05:23:26.378183 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.378193 | orchestrator | 2026-04-24 05:23:26.378204 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-24 05:23:26.378215 | orchestrator | Friday 24 April 2026 05:23:22 +0000 (0:00:00.766) 0:21:03.793 ********** 2026-04-24 05:23:26.378225 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.378236 | orchestrator | 2026-04-24 05:23:26.378247 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-24 05:23:26.378257 | orchestrator | Friday 24 April 2026 05:23:22 +0000 (0:00:00.830) 0:21:04.624 ********** 2026-04-24 05:23:26.378276 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:23:26.378287 | orchestrator | 2026-04-24 05:23:26.378297 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-24 05:23:26.378308 | orchestrator | 2026-04-24 05:23:26.378319 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-24 05:23:26.378329 | orchestrator | Friday 24 April 2026 05:23:23 +0000 (0:00:00.975) 0:21:05.600 ********** 2026-04-24 05:23:26.378340 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:26.378351 | orchestrator | 2026-04-24 05:23:26.378361 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:23:26.378372 | orchestrator | Friday 24 April 2026 05:23:24 +0000 (0:00:00.867) 0:21:06.467 ********** 2026-04-24 05:23:26.378382 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:26.378393 | orchestrator | 2026-04-24 05:23:26.378404 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:23:26.378414 | orchestrator | Friday 24 April 2026 05:23:25 +0000 (0:00:00.780) 0:21:07.248 ********** 2026-04-24 05:23:26.378425 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:26.378436 | orchestrator | 2026-04-24 05:23:26.378491 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:23:26.378503 | orchestrator | Friday 24 April 2026 05:23:26 +0000 (0:00:00.771) 0:21:08.019 ********** 2026-04-24 05:23:26.378522 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.344887 | orchestrator | 2026-04-24 05:23:58.345040 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:23:58.345069 | orchestrator | Friday 24 April 2026 05:23:27 +0000 (0:00:00.807) 0:21:08.827 ********** 2026-04-24 05:23:58.345129 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345151 | orchestrator | 2026-04-24 05:23:58.345169 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:23:58.345187 | orchestrator | Friday 24 April 2026 05:23:27 +0000 (0:00:00.794) 0:21:09.622 ********** 2026-04-24 05:23:58.345207 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345226 | orchestrator | 2026-04-24 05:23:58.345246 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:23:58.345266 | orchestrator | Friday 24 April 2026 05:23:28 +0000 (0:00:00.785) 0:21:10.408 ********** 2026-04-24 05:23:58.345307 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345328 | orchestrator | 2026-04-24 05:23:58.345348 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:23:58.345397 | orchestrator | Friday 24 April 2026 05:23:29 +0000 (0:00:00.767) 0:21:11.175 ********** 2026-04-24 05:23:58.345419 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345440 | orchestrator | 2026-04-24 05:23:58.345462 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:23:58.345483 | orchestrator | Friday 24 April 2026 05:23:30 +0000 (0:00:00.759) 0:21:11.936 ********** 2026-04-24 05:23:58.345503 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345525 | orchestrator | 2026-04-24 05:23:58.345548 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:23:58.345571 | orchestrator | Friday 24 April 2026 05:23:30 +0000 (0:00:00.769) 0:21:12.706 ********** 2026-04-24 05:23:58.345594 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345617 | orchestrator | 2026-04-24 05:23:58.345639 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:23:58.345663 | orchestrator | Friday 24 April 2026 05:23:31 +0000 (0:00:00.777) 0:21:13.484 ********** 2026-04-24 05:23:58.345686 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345708 | orchestrator | 2026-04-24 05:23:58.345730 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:23:58.345752 | orchestrator | Friday 24 April 2026 05:23:32 +0000 (0:00:00.801) 0:21:14.285 ********** 2026-04-24 05:23:58.345771 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345792 | orchestrator | 2026-04-24 05:23:58.345813 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:23:58.345865 | orchestrator | Friday 24 April 2026 05:23:33 +0000 (0:00:00.792) 0:21:15.078 ********** 2026-04-24 05:23:58.345885 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345905 | orchestrator | 2026-04-24 05:23:58.345925 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:23:58.345946 | orchestrator | Friday 24 April 2026 05:23:34 +0000 (0:00:00.780) 0:21:15.859 ********** 2026-04-24 05:23:58.345964 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.345984 | orchestrator | 2026-04-24 05:23:58.346002 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:23:58.346100 | orchestrator | Friday 24 April 2026 05:23:34 +0000 (0:00:00.799) 0:21:16.658 ********** 2026-04-24 05:23:58.346120 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346138 | orchestrator | 2026-04-24 05:23:58.346156 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:23:58.346175 | orchestrator | Friday 24 April 2026 05:23:35 +0000 (0:00:00.827) 0:21:17.486 ********** 2026-04-24 05:23:58.346192 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346209 | orchestrator | 2026-04-24 05:23:58.346227 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:23:58.346244 | orchestrator | Friday 24 April 2026 05:23:36 +0000 (0:00:00.783) 0:21:18.269 ********** 2026-04-24 05:23:58.346263 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346282 | orchestrator | 2026-04-24 05:23:58.346301 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:23:58.346321 | orchestrator | Friday 24 April 2026 05:23:37 +0000 (0:00:00.800) 0:21:19.070 ********** 2026-04-24 05:23:58.346340 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346360 | orchestrator | 2026-04-24 05:23:58.346408 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:23:58.346426 | orchestrator | Friday 24 April 2026 05:23:38 +0000 (0:00:00.799) 0:21:19.870 ********** 2026-04-24 05:23:58.346445 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346463 | orchestrator | 2026-04-24 05:23:58.346481 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:23:58.346501 | orchestrator | Friday 24 April 2026 05:23:38 +0000 (0:00:00.809) 0:21:20.679 ********** 2026-04-24 05:23:58.346515 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346526 | orchestrator | 2026-04-24 05:23:58.346536 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:23:58.346547 | orchestrator | Friday 24 April 2026 05:23:39 +0000 (0:00:00.783) 0:21:21.462 ********** 2026-04-24 05:23:58.346558 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346568 | orchestrator | 2026-04-24 05:23:58.346579 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:23:58.346589 | orchestrator | Friday 24 April 2026 05:23:40 +0000 (0:00:00.781) 0:21:22.244 ********** 2026-04-24 05:23:58.346600 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346611 | orchestrator | 2026-04-24 05:23:58.346621 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:23:58.346632 | orchestrator | Friday 24 April 2026 05:23:41 +0000 (0:00:00.794) 0:21:23.039 ********** 2026-04-24 05:23:58.346642 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346653 | orchestrator | 2026-04-24 05:23:58.346664 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:23:58.346674 | orchestrator | Friday 24 April 2026 05:23:42 +0000 (0:00:00.764) 0:21:23.803 ********** 2026-04-24 05:23:58.346685 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346696 | orchestrator | 2026-04-24 05:23:58.346732 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:23:58.346744 | orchestrator | Friday 24 April 2026 05:23:42 +0000 (0:00:00.766) 0:21:24.570 ********** 2026-04-24 05:23:58.346754 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346765 | orchestrator | 2026-04-24 05:23:58.346792 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:23:58.346803 | orchestrator | Friday 24 April 2026 05:23:43 +0000 (0:00:00.792) 0:21:25.363 ********** 2026-04-24 05:23:58.346814 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346824 | orchestrator | 2026-04-24 05:23:58.346835 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:23:58.346846 | orchestrator | Friday 24 April 2026 05:23:44 +0000 (0:00:00.790) 0:21:26.153 ********** 2026-04-24 05:23:58.346856 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346867 | orchestrator | 2026-04-24 05:23:58.346888 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:23:58.346898 | orchestrator | Friday 24 April 2026 05:23:45 +0000 (0:00:00.803) 0:21:26.956 ********** 2026-04-24 05:23:58.346909 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346920 | orchestrator | 2026-04-24 05:23:58.346931 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:23:58.346941 | orchestrator | Friday 24 April 2026 05:23:46 +0000 (0:00:00.815) 0:21:27.772 ********** 2026-04-24 05:23:58.346952 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.346962 | orchestrator | 2026-04-24 05:23:58.346973 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:23:58.346984 | orchestrator | Friday 24 April 2026 05:23:46 +0000 (0:00:00.817) 0:21:28.589 ********** 2026-04-24 05:23:58.346994 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347005 | orchestrator | 2026-04-24 05:23:58.347016 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:23:58.347026 | orchestrator | Friday 24 April 2026 05:23:47 +0000 (0:00:00.856) 0:21:29.446 ********** 2026-04-24 05:23:58.347037 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347048 | orchestrator | 2026-04-24 05:23:58.347058 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:23:58.347069 | orchestrator | Friday 24 April 2026 05:23:48 +0000 (0:00:00.784) 0:21:30.231 ********** 2026-04-24 05:23:58.347080 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347090 | orchestrator | 2026-04-24 05:23:58.347101 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:23:58.347112 | orchestrator | Friday 24 April 2026 05:23:49 +0000 (0:00:00.761) 0:21:30.992 ********** 2026-04-24 05:23:58.347122 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347133 | orchestrator | 2026-04-24 05:23:58.347144 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:23:58.347154 | orchestrator | Friday 24 April 2026 05:23:50 +0000 (0:00:00.784) 0:21:31.776 ********** 2026-04-24 05:23:58.347165 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347175 | orchestrator | 2026-04-24 05:23:58.347186 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:23:58.347196 | orchestrator | Friday 24 April 2026 05:23:50 +0000 (0:00:00.800) 0:21:32.577 ********** 2026-04-24 05:23:58.347207 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347218 | orchestrator | 2026-04-24 05:23:58.347228 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:23:58.347238 | orchestrator | Friday 24 April 2026 05:23:51 +0000 (0:00:00.804) 0:21:33.381 ********** 2026-04-24 05:23:58.347249 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347259 | orchestrator | 2026-04-24 05:23:58.347270 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:23:58.347281 | orchestrator | Friday 24 April 2026 05:23:52 +0000 (0:00:00.865) 0:21:34.247 ********** 2026-04-24 05:23:58.347291 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347302 | orchestrator | 2026-04-24 05:23:58.347313 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:23:58.347323 | orchestrator | Friday 24 April 2026 05:23:53 +0000 (0:00:00.808) 0:21:35.055 ********** 2026-04-24 05:23:58.347334 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347351 | orchestrator | 2026-04-24 05:23:58.347422 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:23:58.347445 | orchestrator | Friday 24 April 2026 05:23:54 +0000 (0:00:00.800) 0:21:35.856 ********** 2026-04-24 05:23:58.347458 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347469 | orchestrator | 2026-04-24 05:23:58.347480 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:23:58.347492 | orchestrator | Friday 24 April 2026 05:23:54 +0000 (0:00:00.787) 0:21:36.644 ********** 2026-04-24 05:23:58.347503 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347514 | orchestrator | 2026-04-24 05:23:58.347524 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:23:58.347535 | orchestrator | Friday 24 April 2026 05:23:55 +0000 (0:00:00.823) 0:21:37.467 ********** 2026-04-24 05:23:58.347546 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347556 | orchestrator | 2026-04-24 05:23:58.347567 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:23:58.347577 | orchestrator | Friday 24 April 2026 05:23:56 +0000 (0:00:00.799) 0:21:38.266 ********** 2026-04-24 05:23:58.347588 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347598 | orchestrator | 2026-04-24 05:23:58.347609 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:23:58.347619 | orchestrator | Friday 24 April 2026 05:23:57 +0000 (0:00:00.811) 0:21:39.078 ********** 2026-04-24 05:23:58.347630 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347640 | orchestrator | 2026-04-24 05:23:58.347651 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:23:58.347661 | orchestrator | Friday 24 April 2026 05:23:58 +0000 (0:00:00.805) 0:21:39.884 ********** 2026-04-24 05:23:58.347672 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:23:58.347683 | orchestrator | 2026-04-24 05:23:58.347701 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:24:50.136302 | orchestrator | Friday 24 April 2026 05:23:58 +0000 (0:00:00.784) 0:21:40.668 ********** 2026-04-24 05:24:50.136450 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136477 | orchestrator | 2026-04-24 05:24:50.136498 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:24:50.136516 | orchestrator | Friday 24 April 2026 05:23:59 +0000 (0:00:00.765) 0:21:41.434 ********** 2026-04-24 05:24:50.136533 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136550 | orchestrator | 2026-04-24 05:24:50.136588 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:24:50.136608 | orchestrator | Friday 24 April 2026 05:24:00 +0000 (0:00:00.909) 0:21:42.344 ********** 2026-04-24 05:24:50.136626 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136642 | orchestrator | 2026-04-24 05:24:50.136669 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:24:50.136681 | orchestrator | Friday 24 April 2026 05:24:01 +0000 (0:00:00.761) 0:21:43.105 ********** 2026-04-24 05:24:50.136692 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136703 | orchestrator | 2026-04-24 05:24:50.136714 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:24:50.136725 | orchestrator | Friday 24 April 2026 05:24:02 +0000 (0:00:00.853) 0:21:43.958 ********** 2026-04-24 05:24:50.136736 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136749 | orchestrator | 2026-04-24 05:24:50.136762 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:24:50.136775 | orchestrator | Friday 24 April 2026 05:24:03 +0000 (0:00:00.764) 0:21:44.723 ********** 2026-04-24 05:24:50.136787 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136800 | orchestrator | 2026-04-24 05:24:50.136813 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:24:50.136852 | orchestrator | Friday 24 April 2026 05:24:03 +0000 (0:00:00.782) 0:21:45.506 ********** 2026-04-24 05:24:50.136865 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136877 | orchestrator | 2026-04-24 05:24:50.136890 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:24:50.136902 | orchestrator | Friday 24 April 2026 05:24:04 +0000 (0:00:00.820) 0:21:46.326 ********** 2026-04-24 05:24:50.136914 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136927 | orchestrator | 2026-04-24 05:24:50.136939 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:24:50.136951 | orchestrator | Friday 24 April 2026 05:24:05 +0000 (0:00:00.828) 0:21:47.155 ********** 2026-04-24 05:24:50.136964 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.136976 | orchestrator | 2026-04-24 05:24:50.136988 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:24:50.137000 | orchestrator | Friday 24 April 2026 05:24:06 +0000 (0:00:00.813) 0:21:47.968 ********** 2026-04-24 05:24:50.137012 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137025 | orchestrator | 2026-04-24 05:24:50.137037 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:24:50.137047 | orchestrator | Friday 24 April 2026 05:24:07 +0000 (0:00:00.800) 0:21:48.769 ********** 2026-04-24 05:24:50.137058 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:24:50.137069 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:24:50.137079 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:24:50.137090 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137101 | orchestrator | 2026-04-24 05:24:50.137111 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:24:50.137122 | orchestrator | Friday 24 April 2026 05:24:08 +0000 (0:00:01.367) 0:21:50.136 ********** 2026-04-24 05:24:50.137133 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:24:50.137144 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:24:50.137154 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:24:50.137165 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137175 | orchestrator | 2026-04-24 05:24:50.137186 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:24:50.137196 | orchestrator | Friday 24 April 2026 05:24:09 +0000 (0:00:01.452) 0:21:51.588 ********** 2026-04-24 05:24:50.137207 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:24:50.137218 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:24:50.137228 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:24:50.137266 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137279 | orchestrator | 2026-04-24 05:24:50.137290 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:24:50.137300 | orchestrator | Friday 24 April 2026 05:24:10 +0000 (0:00:01.087) 0:21:52.675 ********** 2026-04-24 05:24:50.137311 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137322 | orchestrator | 2026-04-24 05:24:50.137333 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:24:50.137343 | orchestrator | Friday 24 April 2026 05:24:11 +0000 (0:00:00.795) 0:21:53.471 ********** 2026-04-24 05:24:50.137355 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-24 05:24:50.137365 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137376 | orchestrator | 2026-04-24 05:24:50.137386 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:24:50.137397 | orchestrator | Friday 24 April 2026 05:24:12 +0000 (0:00:00.913) 0:21:54.385 ********** 2026-04-24 05:24:50.137408 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137418 | orchestrator | 2026-04-24 05:24:50.137429 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:24:50.137439 | orchestrator | Friday 24 April 2026 05:24:13 +0000 (0:00:00.754) 0:21:55.140 ********** 2026-04-24 05:24:50.137459 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 05:24:50.137490 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 05:24:50.137501 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 05:24:50.137512 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137523 | orchestrator | 2026-04-24 05:24:50.137533 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-24 05:24:50.137544 | orchestrator | Friday 24 April 2026 05:24:14 +0000 (0:00:01.065) 0:21:56.205 ********** 2026-04-24 05:24:50.137555 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137565 | orchestrator | 2026-04-24 05:24:50.137576 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-24 05:24:50.137587 | orchestrator | Friday 24 April 2026 05:24:15 +0000 (0:00:00.806) 0:21:57.012 ********** 2026-04-24 05:24:50.137597 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137608 | orchestrator | 2026-04-24 05:24:50.137625 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-24 05:24:50.137636 | orchestrator | Friday 24 April 2026 05:24:16 +0000 (0:00:00.776) 0:21:57.789 ********** 2026-04-24 05:24:50.137647 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137657 | orchestrator | 2026-04-24 05:24:50.137668 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-24 05:24:50.137679 | orchestrator | Friday 24 April 2026 05:24:16 +0000 (0:00:00.813) 0:21:58.602 ********** 2026-04-24 05:24:50.137689 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:24:50.137700 | orchestrator | 2026-04-24 05:24:50.137711 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-24 05:24:50.137721 | orchestrator | 2026-04-24 05:24:50.137732 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-24 05:24:50.137743 | orchestrator | Friday 24 April 2026 05:24:18 +0000 (0:00:01.404) 0:22:00.007 ********** 2026-04-24 05:24:50.137753 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:24:50.137764 | orchestrator | 2026-04-24 05:24:50.137775 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-24 05:24:50.137785 | orchestrator | Friday 24 April 2026 05:24:31 +0000 (0:00:13.063) 0:22:13.071 ********** 2026-04-24 05:24:50.137796 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:24:50.137807 | orchestrator | 2026-04-24 05:24:50.137817 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:24:50.137828 | orchestrator | Friday 24 April 2026 05:24:34 +0000 (0:00:02.859) 0:22:15.930 ********** 2026-04-24 05:24:50.137838 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-24 05:24:50.137849 | orchestrator | 2026-04-24 05:24:50.137859 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:24:50.137870 | orchestrator | Friday 24 April 2026 05:24:35 +0000 (0:00:01.136) 0:22:17.067 ********** 2026-04-24 05:24:50.137881 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:24:50.137891 | orchestrator | 2026-04-24 05:24:50.137902 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:24:50.137913 | orchestrator | Friday 24 April 2026 05:24:36 +0000 (0:00:01.466) 0:22:18.533 ********** 2026-04-24 05:24:50.137924 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:24:50.137934 | orchestrator | 2026-04-24 05:24:50.137945 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:24:50.137956 | orchestrator | Friday 24 April 2026 05:24:37 +0000 (0:00:01.115) 0:22:19.649 ********** 2026-04-24 05:24:50.137967 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:24:50.137977 | orchestrator | 2026-04-24 05:24:50.137988 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:24:50.137998 | orchestrator | Friday 24 April 2026 05:24:39 +0000 (0:00:01.520) 0:22:21.170 ********** 2026-04-24 05:24:50.138009 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:24:50.138076 | orchestrator | 2026-04-24 05:24:50.138094 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:24:50.138104 | orchestrator | Friday 24 April 2026 05:24:40 +0000 (0:00:01.168) 0:22:22.338 ********** 2026-04-24 05:24:50.138115 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:24:50.138126 | orchestrator | 2026-04-24 05:24:50.138137 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:24:50.138147 | orchestrator | Friday 24 April 2026 05:24:41 +0000 (0:00:01.175) 0:22:23.514 ********** 2026-04-24 05:24:50.138158 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:24:50.138179 | orchestrator | 2026-04-24 05:24:50.138190 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:24:50.138202 | orchestrator | Friday 24 April 2026 05:24:42 +0000 (0:00:01.139) 0:22:24.653 ********** 2026-04-24 05:24:50.138213 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:24:50.138223 | orchestrator | 2026-04-24 05:24:50.138234 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:24:50.138268 | orchestrator | Friday 24 April 2026 05:24:44 +0000 (0:00:01.142) 0:22:25.796 ********** 2026-04-24 05:24:50.138278 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:24:50.138289 | orchestrator | 2026-04-24 05:24:50.138300 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:24:50.138310 | orchestrator | Friday 24 April 2026 05:24:45 +0000 (0:00:01.156) 0:22:26.952 ********** 2026-04-24 05:24:50.138321 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:24:50.138332 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:24:50.138343 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:24:50.138354 | orchestrator | 2026-04-24 05:24:50.138365 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:24:50.138375 | orchestrator | Friday 24 April 2026 05:24:47 +0000 (0:00:02.035) 0:22:28.987 ********** 2026-04-24 05:24:50.138386 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:24:50.138397 | orchestrator | 2026-04-24 05:24:50.138408 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:24:50.138418 | orchestrator | Friday 24 April 2026 05:24:48 +0000 (0:00:01.673) 0:22:30.660 ********** 2026-04-24 05:24:50.138429 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:24:50.138448 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:25:13.312905 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:25:13.313020 | orchestrator | 2026-04-24 05:25:13.313036 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:25:13.313049 | orchestrator | Friday 24 April 2026 05:24:51 +0000 (0:00:02.837) 0:22:33.498 ********** 2026-04-24 05:25:13.313061 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:25:13.313072 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:25:13.313083 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:25:13.313094 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313106 | orchestrator | 2026-04-24 05:25:13.313117 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:25:13.313128 | orchestrator | Friday 24 April 2026 05:24:53 +0000 (0:00:01.427) 0:22:34.926 ********** 2026-04-24 05:25:13.313141 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:25:13.313155 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:25:13.313222 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:25:13.313235 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313246 | orchestrator | 2026-04-24 05:25:13.313257 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:25:13.313268 | orchestrator | Friday 24 April 2026 05:24:54 +0000 (0:00:01.636) 0:22:36.563 ********** 2026-04-24 05:25:13.313281 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:13.313342 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:13.313356 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:13.313367 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313377 | orchestrator | 2026-04-24 05:25:13.313388 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:25:13.313399 | orchestrator | Friday 24 April 2026 05:24:56 +0000 (0:00:01.227) 0:22:37.790 ********** 2026-04-24 05:25:13.313412 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:24:49.465039', 'end': '2026-04-24 05:24:49.522059', 'delta': '0:00:00.057020', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:25:13.313446 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:24:50.048668', 'end': '2026-04-24 05:24:50.083038', 'delta': '0:00:00.034370', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:25:13.313465 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:24:50.603102', 'end': '2026-04-24 05:24:50.643926', 'delta': '0:00:00.040824', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:25:13.313488 | orchestrator | 2026-04-24 05:25:13.313501 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:25:13.313513 | orchestrator | Friday 24 April 2026 05:24:57 +0000 (0:00:01.210) 0:22:39.001 ********** 2026-04-24 05:25:13.313526 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:25:13.313538 | orchestrator | 2026-04-24 05:25:13.313551 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:25:13.313563 | orchestrator | Friday 24 April 2026 05:24:58 +0000 (0:00:01.263) 0:22:40.265 ********** 2026-04-24 05:25:13.313575 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313588 | orchestrator | 2026-04-24 05:25:13.313600 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:25:13.313612 | orchestrator | Friday 24 April 2026 05:24:59 +0000 (0:00:01.229) 0:22:41.494 ********** 2026-04-24 05:25:13.313624 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:25:13.313636 | orchestrator | 2026-04-24 05:25:13.313649 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:25:13.313661 | orchestrator | Friday 24 April 2026 05:25:00 +0000 (0:00:01.146) 0:22:42.641 ********** 2026-04-24 05:25:13.313673 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:25:13.313685 | orchestrator | 2026-04-24 05:25:13.313698 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:25:13.313710 | orchestrator | Friday 24 April 2026 05:25:02 +0000 (0:00:02.043) 0:22:44.685 ********** 2026-04-24 05:25:13.313723 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:25:13.313735 | orchestrator | 2026-04-24 05:25:13.313747 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:25:13.313760 | orchestrator | Friday 24 April 2026 05:25:04 +0000 (0:00:01.150) 0:22:45.836 ********** 2026-04-24 05:25:13.313772 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313785 | orchestrator | 2026-04-24 05:25:13.313798 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:25:13.313811 | orchestrator | Friday 24 April 2026 05:25:05 +0000 (0:00:01.106) 0:22:46.943 ********** 2026-04-24 05:25:13.313823 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313834 | orchestrator | 2026-04-24 05:25:13.313844 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:25:13.313855 | orchestrator | Friday 24 April 2026 05:25:06 +0000 (0:00:01.247) 0:22:48.191 ********** 2026-04-24 05:25:13.313866 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313876 | orchestrator | 2026-04-24 05:25:13.313887 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:25:13.313898 | orchestrator | Friday 24 April 2026 05:25:07 +0000 (0:00:01.099) 0:22:49.290 ********** 2026-04-24 05:25:13.313908 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313919 | orchestrator | 2026-04-24 05:25:13.313929 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:25:13.313940 | orchestrator | Friday 24 April 2026 05:25:08 +0000 (0:00:01.081) 0:22:50.371 ********** 2026-04-24 05:25:13.313951 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.313968 | orchestrator | 2026-04-24 05:25:13.314001 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:25:13.314106 | orchestrator | Friday 24 April 2026 05:25:09 +0000 (0:00:01.103) 0:22:51.475 ********** 2026-04-24 05:25:13.314121 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.314132 | orchestrator | 2026-04-24 05:25:13.314143 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:25:13.314162 | orchestrator | Friday 24 April 2026 05:25:10 +0000 (0:00:01.124) 0:22:52.599 ********** 2026-04-24 05:25:13.314173 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.314208 | orchestrator | 2026-04-24 05:25:13.314221 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:25:13.314232 | orchestrator | Friday 24 April 2026 05:25:12 +0000 (0:00:01.135) 0:22:53.735 ********** 2026-04-24 05:25:13.314242 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.314253 | orchestrator | 2026-04-24 05:25:13.314264 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:25:13.314275 | orchestrator | Friday 24 April 2026 05:25:13 +0000 (0:00:01.124) 0:22:54.859 ********** 2026-04-24 05:25:13.314286 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:13.314297 | orchestrator | 2026-04-24 05:25:13.314317 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:25:15.639613 | orchestrator | Friday 24 April 2026 05:25:14 +0000 (0:00:01.131) 0:22:55.991 ********** 2026-04-24 05:25:15.639715 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:25:15.639749 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:25:15.639763 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:25:15.639776 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-10-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:25:15.639790 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:25:15.639802 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:25:15.639813 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:25:15.639880 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '890efc9d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:25:15.639896 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:25:15.639908 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:25:15.639919 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:15.639932 | orchestrator | 2026-04-24 05:25:15.639944 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:25:15.639956 | orchestrator | Friday 24 April 2026 05:25:15 +0000 (0:00:01.278) 0:22:57.270 ********** 2026-04-24 05:25:15.639967 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:15.639987 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:15.640005 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:26.744690 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-10-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:26.744835 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:26.744849 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:26.744860 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:26.744928 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '890efc9d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:26.744943 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:26.744954 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:25:26.744965 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:26.744977 | orchestrator | 2026-04-24 05:25:26.744988 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:25:26.745000 | orchestrator | Friday 24 April 2026 05:25:16 +0000 (0:00:01.216) 0:22:58.486 ********** 2026-04-24 05:25:26.745017 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:25:26.745028 | orchestrator | 2026-04-24 05:25:26.745038 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:25:26.745047 | orchestrator | Friday 24 April 2026 05:25:18 +0000 (0:00:01.548) 0:23:00.034 ********** 2026-04-24 05:25:26.745057 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:25:26.745066 | orchestrator | 2026-04-24 05:25:26.745076 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:25:26.745085 | orchestrator | Friday 24 April 2026 05:25:19 +0000 (0:00:01.126) 0:23:01.161 ********** 2026-04-24 05:25:26.745095 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:25:26.745104 | orchestrator | 2026-04-24 05:25:26.745114 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:25:26.745123 | orchestrator | Friday 24 April 2026 05:25:20 +0000 (0:00:01.472) 0:23:02.634 ********** 2026-04-24 05:25:26.745133 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:26.745143 | orchestrator | 2026-04-24 05:25:26.745152 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:25:26.745194 | orchestrator | Friday 24 April 2026 05:25:22 +0000 (0:00:01.103) 0:23:03.737 ********** 2026-04-24 05:25:26.745205 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:26.745216 | orchestrator | 2026-04-24 05:25:26.745227 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:25:26.745238 | orchestrator | Friday 24 April 2026 05:25:23 +0000 (0:00:01.608) 0:23:05.346 ********** 2026-04-24 05:25:26.745249 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:26.745259 | orchestrator | 2026-04-24 05:25:26.745271 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:25:26.745282 | orchestrator | Friday 24 April 2026 05:25:24 +0000 (0:00:01.210) 0:23:06.557 ********** 2026-04-24 05:25:26.745293 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:25:26.745304 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 05:25:26.745315 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 05:25:26.745326 | orchestrator | 2026-04-24 05:25:26.745336 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:25:26.745347 | orchestrator | Friday 24 April 2026 05:25:26 +0000 (0:00:01.704) 0:23:08.261 ********** 2026-04-24 05:25:26.745358 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:25:26.745369 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:25:26.745380 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:25:26.745391 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:25:26.745401 | orchestrator | 2026-04-24 05:25:26.745419 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:26:10.603870 | orchestrator | Friday 24 April 2026 05:25:27 +0000 (0:00:01.167) 0:23:09.428 ********** 2026-04-24 05:26:10.603968 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.603980 | orchestrator | 2026-04-24 05:26:10.603989 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:26:10.603997 | orchestrator | Friday 24 April 2026 05:25:28 +0000 (0:00:01.104) 0:23:10.533 ********** 2026-04-24 05:26:10.604005 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:26:10.604026 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:26:10.604035 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:26:10.604042 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:26:10.604050 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:26:10.604058 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:26:10.604065 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:26:10.604127 | orchestrator | 2026-04-24 05:26:10.604137 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:26:10.604144 | orchestrator | Friday 24 April 2026 05:25:30 +0000 (0:00:01.882) 0:23:12.415 ********** 2026-04-24 05:26:10.604151 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:26:10.604158 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:26:10.604165 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:26:10.604172 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:26:10.604179 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:26:10.604186 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:26:10.604194 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:26:10.604201 | orchestrator | 2026-04-24 05:26:10.604208 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:26:10.604215 | orchestrator | Friday 24 April 2026 05:25:33 +0000 (0:00:02.569) 0:23:14.984 ********** 2026-04-24 05:26:10.604222 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0 2026-04-24 05:26:10.604230 | orchestrator | 2026-04-24 05:26:10.604238 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:26:10.604251 | orchestrator | Friday 24 April 2026 05:25:34 +0000 (0:00:01.141) 0:23:16.126 ********** 2026-04-24 05:26:10.604263 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0 2026-04-24 05:26:10.604274 | orchestrator | 2026-04-24 05:26:10.604286 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:26:10.604298 | orchestrator | Friday 24 April 2026 05:25:35 +0000 (0:00:01.155) 0:23:17.281 ********** 2026-04-24 05:26:10.604310 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:10.604323 | orchestrator | 2026-04-24 05:26:10.604335 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:26:10.604350 | orchestrator | Friday 24 April 2026 05:25:37 +0000 (0:00:01.527) 0:23:18.809 ********** 2026-04-24 05:26:10.604364 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604379 | orchestrator | 2026-04-24 05:26:10.604394 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:26:10.604409 | orchestrator | Friday 24 April 2026 05:25:38 +0000 (0:00:01.202) 0:23:20.012 ********** 2026-04-24 05:26:10.604425 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604440 | orchestrator | 2026-04-24 05:26:10.604455 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:26:10.604470 | orchestrator | Friday 24 April 2026 05:25:39 +0000 (0:00:01.126) 0:23:21.138 ********** 2026-04-24 05:26:10.604484 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604499 | orchestrator | 2026-04-24 05:26:10.604515 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:26:10.604529 | orchestrator | Friday 24 April 2026 05:25:40 +0000 (0:00:01.139) 0:23:22.278 ********** 2026-04-24 05:26:10.604545 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:10.604559 | orchestrator | 2026-04-24 05:26:10.604575 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:26:10.604591 | orchestrator | Friday 24 April 2026 05:25:42 +0000 (0:00:01.614) 0:23:23.892 ********** 2026-04-24 05:26:10.604606 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604622 | orchestrator | 2026-04-24 05:26:10.604638 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:26:10.604653 | orchestrator | Friday 24 April 2026 05:25:43 +0000 (0:00:01.121) 0:23:25.014 ********** 2026-04-24 05:26:10.604666 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604687 | orchestrator | 2026-04-24 05:26:10.604695 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:26:10.604704 | orchestrator | Friday 24 April 2026 05:25:44 +0000 (0:00:01.129) 0:23:26.144 ********** 2026-04-24 05:26:10.604712 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:10.604721 | orchestrator | 2026-04-24 05:26:10.604730 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:26:10.604739 | orchestrator | Friday 24 April 2026 05:25:46 +0000 (0:00:01.595) 0:23:27.740 ********** 2026-04-24 05:26:10.604747 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:10.604756 | orchestrator | 2026-04-24 05:26:10.604765 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:26:10.604792 | orchestrator | Friday 24 April 2026 05:25:47 +0000 (0:00:01.555) 0:23:29.295 ********** 2026-04-24 05:26:10.604802 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604810 | orchestrator | 2026-04-24 05:26:10.604819 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:26:10.604828 | orchestrator | Friday 24 April 2026 05:25:48 +0000 (0:00:01.108) 0:23:30.404 ********** 2026-04-24 05:26:10.604836 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:10.604845 | orchestrator | 2026-04-24 05:26:10.604854 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:26:10.604862 | orchestrator | Friday 24 April 2026 05:25:49 +0000 (0:00:01.164) 0:23:31.569 ********** 2026-04-24 05:26:10.604878 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604887 | orchestrator | 2026-04-24 05:26:10.604896 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:26:10.604904 | orchestrator | Friday 24 April 2026 05:25:50 +0000 (0:00:01.133) 0:23:32.703 ********** 2026-04-24 05:26:10.604913 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604921 | orchestrator | 2026-04-24 05:26:10.604930 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:26:10.604939 | orchestrator | Friday 24 April 2026 05:25:52 +0000 (0:00:01.122) 0:23:33.825 ********** 2026-04-24 05:26:10.604947 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604956 | orchestrator | 2026-04-24 05:26:10.604964 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:26:10.604973 | orchestrator | Friday 24 April 2026 05:25:53 +0000 (0:00:01.117) 0:23:34.942 ********** 2026-04-24 05:26:10.604981 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.604990 | orchestrator | 2026-04-24 05:26:10.604999 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:26:10.605007 | orchestrator | Friday 24 April 2026 05:25:54 +0000 (0:00:01.186) 0:23:36.129 ********** 2026-04-24 05:26:10.605016 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605025 | orchestrator | 2026-04-24 05:26:10.605033 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:26:10.605042 | orchestrator | Friday 24 April 2026 05:25:55 +0000 (0:00:01.156) 0:23:37.285 ********** 2026-04-24 05:26:10.605050 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:10.605059 | orchestrator | 2026-04-24 05:26:10.605068 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:26:10.605114 | orchestrator | Friday 24 April 2026 05:25:56 +0000 (0:00:01.154) 0:23:38.440 ********** 2026-04-24 05:26:10.605129 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:10.605145 | orchestrator | 2026-04-24 05:26:10.605161 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:26:10.605170 | orchestrator | Friday 24 April 2026 05:25:57 +0000 (0:00:01.202) 0:23:39.642 ********** 2026-04-24 05:26:10.605179 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:10.605187 | orchestrator | 2026-04-24 05:26:10.605196 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:26:10.605205 | orchestrator | Friday 24 April 2026 05:25:59 +0000 (0:00:01.152) 0:23:40.795 ********** 2026-04-24 05:26:10.605213 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605229 | orchestrator | 2026-04-24 05:26:10.605238 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:26:10.605247 | orchestrator | Friday 24 April 2026 05:26:00 +0000 (0:00:01.190) 0:23:41.985 ********** 2026-04-24 05:26:10.605255 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605264 | orchestrator | 2026-04-24 05:26:10.605272 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:26:10.605281 | orchestrator | Friday 24 April 2026 05:26:01 +0000 (0:00:01.114) 0:23:43.100 ********** 2026-04-24 05:26:10.605290 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605298 | orchestrator | 2026-04-24 05:26:10.605307 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:26:10.605315 | orchestrator | Friday 24 April 2026 05:26:02 +0000 (0:00:01.111) 0:23:44.212 ********** 2026-04-24 05:26:10.605324 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605332 | orchestrator | 2026-04-24 05:26:10.605341 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:26:10.605350 | orchestrator | Friday 24 April 2026 05:26:03 +0000 (0:00:01.115) 0:23:45.327 ********** 2026-04-24 05:26:10.605358 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605367 | orchestrator | 2026-04-24 05:26:10.605375 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:26:10.605384 | orchestrator | Friday 24 April 2026 05:26:04 +0000 (0:00:01.141) 0:23:46.469 ********** 2026-04-24 05:26:10.605393 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605401 | orchestrator | 2026-04-24 05:26:10.605410 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:26:10.605418 | orchestrator | Friday 24 April 2026 05:26:05 +0000 (0:00:01.132) 0:23:47.601 ********** 2026-04-24 05:26:10.605427 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605436 | orchestrator | 2026-04-24 05:26:10.605444 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:26:10.605453 | orchestrator | Friday 24 April 2026 05:26:07 +0000 (0:00:01.111) 0:23:48.712 ********** 2026-04-24 05:26:10.605462 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605470 | orchestrator | 2026-04-24 05:26:10.605479 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:26:10.605488 | orchestrator | Friday 24 April 2026 05:26:08 +0000 (0:00:01.146) 0:23:49.859 ********** 2026-04-24 05:26:10.605496 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605505 | orchestrator | 2026-04-24 05:26:10.605513 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:26:10.605522 | orchestrator | Friday 24 April 2026 05:26:09 +0000 (0:00:01.165) 0:23:51.024 ********** 2026-04-24 05:26:10.605531 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605539 | orchestrator | 2026-04-24 05:26:10.605548 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:26:10.605557 | orchestrator | Friday 24 April 2026 05:26:10 +0000 (0:00:01.130) 0:23:52.154 ********** 2026-04-24 05:26:10.605565 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:10.605574 | orchestrator | 2026-04-24 05:26:10.605589 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:26:59.659730 | orchestrator | Friday 24 April 2026 05:26:11 +0000 (0:00:01.092) 0:23:53.247 ********** 2026-04-24 05:26:59.659858 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.659876 | orchestrator | 2026-04-24 05:26:59.659889 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:26:59.659900 | orchestrator | Friday 24 April 2026 05:26:12 +0000 (0:00:01.119) 0:23:54.366 ********** 2026-04-24 05:26:59.659912 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:59.659924 | orchestrator | 2026-04-24 05:26:59.659950 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:26:59.659962 | orchestrator | Friday 24 April 2026 05:26:14 +0000 (0:00:02.083) 0:23:56.450 ********** 2026-04-24 05:26:59.659973 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:59.660035 | orchestrator | 2026-04-24 05:26:59.660048 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:26:59.660059 | orchestrator | Friday 24 April 2026 05:26:17 +0000 (0:00:02.435) 0:23:58.885 ********** 2026-04-24 05:26:59.660069 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-0 2026-04-24 05:26:59.660082 | orchestrator | 2026-04-24 05:26:59.660093 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:26:59.660104 | orchestrator | Friday 24 April 2026 05:26:18 +0000 (0:00:01.135) 0:24:00.021 ********** 2026-04-24 05:26:59.660114 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660125 | orchestrator | 2026-04-24 05:26:59.660136 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:26:59.660147 | orchestrator | Friday 24 April 2026 05:26:19 +0000 (0:00:01.152) 0:24:01.173 ********** 2026-04-24 05:26:59.660158 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660169 | orchestrator | 2026-04-24 05:26:59.660179 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:26:59.660190 | orchestrator | Friday 24 April 2026 05:26:20 +0000 (0:00:01.153) 0:24:02.327 ********** 2026-04-24 05:26:59.660202 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:26:59.660213 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:26:59.660225 | orchestrator | 2026-04-24 05:26:59.660235 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:26:59.660246 | orchestrator | Friday 24 April 2026 05:26:22 +0000 (0:00:01.805) 0:24:04.133 ********** 2026-04-24 05:26:59.660257 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:59.660270 | orchestrator | 2026-04-24 05:26:59.660282 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:26:59.660295 | orchestrator | Friday 24 April 2026 05:26:23 +0000 (0:00:01.451) 0:24:05.584 ********** 2026-04-24 05:26:59.660307 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660320 | orchestrator | 2026-04-24 05:26:59.660333 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:26:59.660346 | orchestrator | Friday 24 April 2026 05:26:25 +0000 (0:00:01.165) 0:24:06.750 ********** 2026-04-24 05:26:59.660359 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660371 | orchestrator | 2026-04-24 05:26:59.660384 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:26:59.660396 | orchestrator | Friday 24 April 2026 05:26:26 +0000 (0:00:01.109) 0:24:07.859 ********** 2026-04-24 05:26:59.660409 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660421 | orchestrator | 2026-04-24 05:26:59.660433 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:26:59.660446 | orchestrator | Friday 24 April 2026 05:26:27 +0000 (0:00:01.154) 0:24:09.013 ********** 2026-04-24 05:26:59.660459 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-0 2026-04-24 05:26:59.660471 | orchestrator | 2026-04-24 05:26:59.660484 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:26:59.660496 | orchestrator | Friday 24 April 2026 05:26:28 +0000 (0:00:01.204) 0:24:10.217 ********** 2026-04-24 05:26:59.660509 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:59.660521 | orchestrator | 2026-04-24 05:26:59.660534 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:26:59.660547 | orchestrator | Friday 24 April 2026 05:26:30 +0000 (0:00:01.714) 0:24:11.932 ********** 2026-04-24 05:26:59.660560 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:26:59.660572 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:26:59.660584 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:26:59.660606 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660619 | orchestrator | 2026-04-24 05:26:59.660630 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:26:59.660641 | orchestrator | Friday 24 April 2026 05:26:31 +0000 (0:00:01.131) 0:24:13.063 ********** 2026-04-24 05:26:59.660652 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660662 | orchestrator | 2026-04-24 05:26:59.660673 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:26:59.660684 | orchestrator | Friday 24 April 2026 05:26:32 +0000 (0:00:01.131) 0:24:14.195 ********** 2026-04-24 05:26:59.660694 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660705 | orchestrator | 2026-04-24 05:26:59.660716 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:26:59.660726 | orchestrator | Friday 24 April 2026 05:26:33 +0000 (0:00:01.171) 0:24:15.367 ********** 2026-04-24 05:26:59.660737 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660748 | orchestrator | 2026-04-24 05:26:59.660759 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:26:59.660769 | orchestrator | Friday 24 April 2026 05:26:34 +0000 (0:00:01.148) 0:24:16.515 ********** 2026-04-24 05:26:59.660780 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660791 | orchestrator | 2026-04-24 05:26:59.660820 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:26:59.660832 | orchestrator | Friday 24 April 2026 05:26:35 +0000 (0:00:01.157) 0:24:17.673 ********** 2026-04-24 05:26:59.660843 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.660854 | orchestrator | 2026-04-24 05:26:59.660865 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:26:59.660876 | orchestrator | Friday 24 April 2026 05:26:37 +0000 (0:00:01.157) 0:24:18.830 ********** 2026-04-24 05:26:59.660886 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:59.660897 | orchestrator | 2026-04-24 05:26:59.660914 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:26:59.660925 | orchestrator | Friday 24 April 2026 05:26:39 +0000 (0:00:02.625) 0:24:21.456 ********** 2026-04-24 05:26:59.660936 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:59.660947 | orchestrator | 2026-04-24 05:26:59.660964 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:26:59.660984 | orchestrator | Friday 24 April 2026 05:26:40 +0000 (0:00:01.177) 0:24:22.634 ********** 2026-04-24 05:26:59.661023 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-0 2026-04-24 05:26:59.661040 | orchestrator | 2026-04-24 05:26:59.661055 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:26:59.661066 | orchestrator | Friday 24 April 2026 05:26:42 +0000 (0:00:01.131) 0:24:23.766 ********** 2026-04-24 05:26:59.661077 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.661087 | orchestrator | 2026-04-24 05:26:59.661098 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:26:59.661109 | orchestrator | Friday 24 April 2026 05:26:43 +0000 (0:00:01.171) 0:24:24.937 ********** 2026-04-24 05:26:59.661120 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.661131 | orchestrator | 2026-04-24 05:26:59.661142 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:26:59.661153 | orchestrator | Friday 24 April 2026 05:26:44 +0000 (0:00:01.160) 0:24:26.097 ********** 2026-04-24 05:26:59.661163 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.661174 | orchestrator | 2026-04-24 05:26:59.661185 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:26:59.661196 | orchestrator | Friday 24 April 2026 05:26:45 +0000 (0:00:01.236) 0:24:27.334 ********** 2026-04-24 05:26:59.661207 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.661218 | orchestrator | 2026-04-24 05:26:59.661229 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:26:59.661240 | orchestrator | Friday 24 April 2026 05:26:46 +0000 (0:00:01.153) 0:24:28.488 ********** 2026-04-24 05:26:59.661258 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.661270 | orchestrator | 2026-04-24 05:26:59.661281 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:26:59.661292 | orchestrator | Friday 24 April 2026 05:26:48 +0000 (0:00:01.229) 0:24:29.718 ********** 2026-04-24 05:26:59.661303 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.661314 | orchestrator | 2026-04-24 05:26:59.661324 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:26:59.661335 | orchestrator | Friday 24 April 2026 05:26:49 +0000 (0:00:01.242) 0:24:30.961 ********** 2026-04-24 05:26:59.661346 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.661357 | orchestrator | 2026-04-24 05:26:59.661368 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:26:59.661379 | orchestrator | Friday 24 April 2026 05:26:50 +0000 (0:00:01.144) 0:24:32.105 ********** 2026-04-24 05:26:59.661390 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:26:59.661400 | orchestrator | 2026-04-24 05:26:59.661412 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:26:59.661422 | orchestrator | Friday 24 April 2026 05:26:51 +0000 (0:00:01.166) 0:24:33.272 ********** 2026-04-24 05:26:59.661433 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:26:59.661444 | orchestrator | 2026-04-24 05:26:59.661455 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:26:59.661466 | orchestrator | Friday 24 April 2026 05:26:52 +0000 (0:00:01.162) 0:24:34.434 ********** 2026-04-24 05:26:59.661477 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-0 2026-04-24 05:26:59.661488 | orchestrator | 2026-04-24 05:26:59.661499 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:26:59.661510 | orchestrator | Friday 24 April 2026 05:26:53 +0000 (0:00:01.220) 0:24:35.655 ********** 2026-04-24 05:26:59.661521 | orchestrator | ok: [testbed-node-0] => (item=/etc/ceph) 2026-04-24 05:26:59.661532 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-24 05:26:59.661543 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-24 05:26:59.661554 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-24 05:26:59.661564 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-24 05:26:59.661575 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-24 05:26:59.661586 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-24 05:26:59.661596 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:26:59.661607 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:26:59.661618 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:26:59.661629 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:26:59.661640 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:26:59.661651 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:26:59.661661 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:26:59.661672 | orchestrator | ok: [testbed-node-0] => (item=/var/run/ceph) 2026-04-24 05:26:59.661683 | orchestrator | ok: [testbed-node-0] => (item=/var/log/ceph) 2026-04-24 05:26:59.661694 | orchestrator | 2026-04-24 05:26:59.661711 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:27:52.673460 | orchestrator | Friday 24 April 2026 05:27:00 +0000 (0:00:06.815) 0:24:42.470 ********** 2026-04-24 05:27:52.673579 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.673598 | orchestrator | 2026-04-24 05:27:52.673611 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:27:52.673624 | orchestrator | Friday 24 April 2026 05:27:01 +0000 (0:00:01.121) 0:24:43.592 ********** 2026-04-24 05:27:52.673635 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.673672 | orchestrator | 2026-04-24 05:27:52.673698 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:27:52.673710 | orchestrator | Friday 24 April 2026 05:27:03 +0000 (0:00:01.134) 0:24:44.726 ********** 2026-04-24 05:27:52.673721 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.673733 | orchestrator | 2026-04-24 05:27:52.673744 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:27:52.673756 | orchestrator | Friday 24 April 2026 05:27:04 +0000 (0:00:01.115) 0:24:45.842 ********** 2026-04-24 05:27:52.673766 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.673778 | orchestrator | 2026-04-24 05:27:52.673789 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:27:52.673800 | orchestrator | Friday 24 April 2026 05:27:05 +0000 (0:00:01.166) 0:24:47.009 ********** 2026-04-24 05:27:52.673811 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.673823 | orchestrator | 2026-04-24 05:27:52.673833 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:27:52.673845 | orchestrator | Friday 24 April 2026 05:27:06 +0000 (0:00:01.117) 0:24:48.127 ********** 2026-04-24 05:27:52.673855 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.673867 | orchestrator | 2026-04-24 05:27:52.673878 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:27:52.673890 | orchestrator | Friday 24 April 2026 05:27:07 +0000 (0:00:01.177) 0:24:49.305 ********** 2026-04-24 05:27:52.673901 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.673912 | orchestrator | 2026-04-24 05:27:52.673923 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:27:52.673965 | orchestrator | Friday 24 April 2026 05:27:08 +0000 (0:00:01.178) 0:24:50.483 ********** 2026-04-24 05:27:52.673976 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.673987 | orchestrator | 2026-04-24 05:27:52.673998 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:27:52.674009 | orchestrator | Friday 24 April 2026 05:27:09 +0000 (0:00:01.110) 0:24:51.593 ********** 2026-04-24 05:27:52.674070 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674082 | orchestrator | 2026-04-24 05:27:52.674093 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:27:52.674103 | orchestrator | Friday 24 April 2026 05:27:11 +0000 (0:00:01.131) 0:24:52.725 ********** 2026-04-24 05:27:52.674114 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674125 | orchestrator | 2026-04-24 05:27:52.674136 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:27:52.674147 | orchestrator | Friday 24 April 2026 05:27:12 +0000 (0:00:01.149) 0:24:53.875 ********** 2026-04-24 05:27:52.674158 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674169 | orchestrator | 2026-04-24 05:27:52.674180 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:27:52.674225 | orchestrator | Friday 24 April 2026 05:27:13 +0000 (0:00:01.147) 0:24:55.022 ********** 2026-04-24 05:27:52.674237 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674248 | orchestrator | 2026-04-24 05:27:52.674259 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:27:52.674270 | orchestrator | Friday 24 April 2026 05:27:14 +0000 (0:00:01.161) 0:24:56.184 ********** 2026-04-24 05:27:52.674280 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674291 | orchestrator | 2026-04-24 05:27:52.674302 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:27:52.674313 | orchestrator | Friday 24 April 2026 05:27:15 +0000 (0:00:01.277) 0:24:57.462 ********** 2026-04-24 05:27:52.674323 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674334 | orchestrator | 2026-04-24 05:27:52.674345 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:27:52.674356 | orchestrator | Friday 24 April 2026 05:27:16 +0000 (0:00:01.173) 0:24:58.635 ********** 2026-04-24 05:27:52.674377 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674388 | orchestrator | 2026-04-24 05:27:52.674398 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:27:52.674409 | orchestrator | Friday 24 April 2026 05:27:18 +0000 (0:00:01.372) 0:25:00.008 ********** 2026-04-24 05:27:52.674422 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674439 | orchestrator | 2026-04-24 05:27:52.674458 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:27:52.674477 | orchestrator | Friday 24 April 2026 05:27:19 +0000 (0:00:01.140) 0:25:01.149 ********** 2026-04-24 05:27:52.674489 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674499 | orchestrator | 2026-04-24 05:27:52.674511 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:27:52.674523 | orchestrator | Friday 24 April 2026 05:27:20 +0000 (0:00:01.179) 0:25:02.329 ********** 2026-04-24 05:27:52.674534 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674544 | orchestrator | 2026-04-24 05:27:52.674555 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:27:52.674566 | orchestrator | Friday 24 April 2026 05:27:21 +0000 (0:00:01.148) 0:25:03.477 ********** 2026-04-24 05:27:52.674577 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674587 | orchestrator | 2026-04-24 05:27:52.674598 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:27:52.674609 | orchestrator | Friday 24 April 2026 05:27:22 +0000 (0:00:01.125) 0:25:04.603 ********** 2026-04-24 05:27:52.674620 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674631 | orchestrator | 2026-04-24 05:27:52.674661 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:27:52.674672 | orchestrator | Friday 24 April 2026 05:27:24 +0000 (0:00:01.148) 0:25:05.751 ********** 2026-04-24 05:27:52.674683 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674694 | orchestrator | 2026-04-24 05:27:52.674704 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:27:52.674722 | orchestrator | Friday 24 April 2026 05:27:25 +0000 (0:00:01.159) 0:25:06.911 ********** 2026-04-24 05:27:52.674734 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:27:52.674744 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:27:52.674755 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:27:52.674766 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674777 | orchestrator | 2026-04-24 05:27:52.674788 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:27:52.674798 | orchestrator | Friday 24 April 2026 05:27:26 +0000 (0:00:01.402) 0:25:08.314 ********** 2026-04-24 05:27:52.674809 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:27:52.674820 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:27:52.674831 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:27:52.674841 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674852 | orchestrator | 2026-04-24 05:27:52.674863 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:27:52.674874 | orchestrator | Friday 24 April 2026 05:27:28 +0000 (0:00:01.743) 0:25:10.057 ********** 2026-04-24 05:27:52.674884 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-24 05:27:52.674895 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:27:52.674905 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:27:52.674916 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.674949 | orchestrator | 2026-04-24 05:27:52.674960 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:27:52.674971 | orchestrator | Friday 24 April 2026 05:27:30 +0000 (0:00:01.774) 0:25:11.832 ********** 2026-04-24 05:27:52.674989 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.675000 | orchestrator | 2026-04-24 05:27:52.675011 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:27:52.675022 | orchestrator | Friday 24 April 2026 05:27:31 +0000 (0:00:01.154) 0:25:12.987 ********** 2026-04-24 05:27:52.675033 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-24 05:27:52.675044 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.675054 | orchestrator | 2026-04-24 05:27:52.675065 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:27:52.675076 | orchestrator | Friday 24 April 2026 05:27:32 +0000 (0:00:01.235) 0:25:14.223 ********** 2026-04-24 05:27:52.675086 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:27:52.675097 | orchestrator | 2026-04-24 05:27:52.675108 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:27:52.675119 | orchestrator | Friday 24 April 2026 05:27:34 +0000 (0:00:01.798) 0:25:16.022 ********** 2026-04-24 05:27:52.675129 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:27:52.675140 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:27:52.675152 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:27:52.675162 | orchestrator | 2026-04-24 05:27:52.675173 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-24 05:27:52.675184 | orchestrator | Friday 24 April 2026 05:27:36 +0000 (0:00:01.743) 0:25:17.765 ********** 2026-04-24 05:27:52.675195 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-0 2026-04-24 05:27:52.675205 | orchestrator | 2026-04-24 05:27:52.675216 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-24 05:27:52.675227 | orchestrator | Friday 24 April 2026 05:27:37 +0000 (0:00:01.479) 0:25:19.245 ********** 2026-04-24 05:27:52.675238 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:27:52.675249 | orchestrator | 2026-04-24 05:27:52.675259 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-24 05:27:52.675270 | orchestrator | Friday 24 April 2026 05:27:39 +0000 (0:00:01.509) 0:25:20.755 ********** 2026-04-24 05:27:52.675281 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:27:52.675291 | orchestrator | 2026-04-24 05:27:52.675307 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-24 05:27:52.675318 | orchestrator | Friday 24 April 2026 05:27:40 +0000 (0:00:01.176) 0:25:21.931 ********** 2026-04-24 05:27:52.675329 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 05:27:52.675340 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 05:27:52.675351 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 05:27:52.675361 | orchestrator | ok: [testbed-node-0 -> {{ groups[mon_group_name][0] }}] 2026-04-24 05:27:52.675372 | orchestrator | 2026-04-24 05:27:52.675383 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-24 05:27:52.675394 | orchestrator | Friday 24 April 2026 05:27:47 +0000 (0:00:07.680) 0:25:29.612 ********** 2026-04-24 05:27:52.675405 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:27:52.675415 | orchestrator | 2026-04-24 05:27:52.675426 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-24 05:27:52.675437 | orchestrator | Friday 24 April 2026 05:27:49 +0000 (0:00:01.164) 0:25:30.776 ********** 2026-04-24 05:27:52.675448 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-24 05:27:52.675458 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 05:27:52.675469 | orchestrator | 2026-04-24 05:27:52.675480 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-24 05:27:52.675491 | orchestrator | Friday 24 April 2026 05:27:52 +0000 (0:00:03.518) 0:25:34.295 ********** 2026-04-24 05:27:52.675509 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-24 05:28:39.348196 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 05:28:39.348331 | orchestrator | 2026-04-24 05:28:39.348346 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-24 05:28:39.348358 | orchestrator | Friday 24 April 2026 05:27:54 +0000 (0:00:02.066) 0:25:36.362 ********** 2026-04-24 05:28:39.348368 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:28:39.348378 | orchestrator | 2026-04-24 05:28:39.348401 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-24 05:28:39.348410 | orchestrator | Friday 24 April 2026 05:27:56 +0000 (0:00:01.526) 0:25:37.888 ********** 2026-04-24 05:28:39.348419 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:28:39.348428 | orchestrator | 2026-04-24 05:28:39.348437 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-24 05:28:39.348447 | orchestrator | Friday 24 April 2026 05:27:57 +0000 (0:00:01.108) 0:25:38.997 ********** 2026-04-24 05:28:39.348456 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:28:39.348465 | orchestrator | 2026-04-24 05:28:39.348475 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-24 05:28:39.348484 | orchestrator | Friday 24 April 2026 05:27:58 +0000 (0:00:01.116) 0:25:40.113 ********** 2026-04-24 05:28:39.348492 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-0 2026-04-24 05:28:39.348502 | orchestrator | 2026-04-24 05:28:39.348511 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-24 05:28:39.348520 | orchestrator | Friday 24 April 2026 05:27:59 +0000 (0:00:01.449) 0:25:41.563 ********** 2026-04-24 05:28:39.348529 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:28:39.348538 | orchestrator | 2026-04-24 05:28:39.348549 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-24 05:28:39.348559 | orchestrator | Friday 24 April 2026 05:28:01 +0000 (0:00:01.226) 0:25:42.789 ********** 2026-04-24 05:28:39.348569 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:28:39.348580 | orchestrator | 2026-04-24 05:28:39.348590 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-24 05:28:39.348601 | orchestrator | Friday 24 April 2026 05:28:02 +0000 (0:00:01.164) 0:25:43.954 ********** 2026-04-24 05:28:39.348611 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-0 2026-04-24 05:28:39.348621 | orchestrator | 2026-04-24 05:28:39.348632 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-24 05:28:39.348642 | orchestrator | Friday 24 April 2026 05:28:03 +0000 (0:00:01.482) 0:25:45.437 ********** 2026-04-24 05:28:39.348653 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:28:39.348663 | orchestrator | 2026-04-24 05:28:39.348672 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-24 05:28:39.348683 | orchestrator | Friday 24 April 2026 05:28:05 +0000 (0:00:02.015) 0:25:47.453 ********** 2026-04-24 05:28:39.348694 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:28:39.348704 | orchestrator | 2026-04-24 05:28:39.348715 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-24 05:28:39.348725 | orchestrator | Friday 24 April 2026 05:28:07 +0000 (0:00:01.956) 0:25:49.409 ********** 2026-04-24 05:28:39.348736 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:28:39.348748 | orchestrator | 2026-04-24 05:28:39.348760 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-24 05:28:39.348772 | orchestrator | Friday 24 April 2026 05:28:10 +0000 (0:00:02.384) 0:25:51.794 ********** 2026-04-24 05:28:39.348785 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:28:39.348795 | orchestrator | 2026-04-24 05:28:39.348804 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-24 05:28:39.348815 | orchestrator | Friday 24 April 2026 05:28:13 +0000 (0:00:03.763) 0:25:55.557 ********** 2026-04-24 05:28:39.348825 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:28:39.348834 | orchestrator | 2026-04-24 05:28:39.348843 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-24 05:28:39.348853 | orchestrator | 2026-04-24 05:28:39.348863 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-24 05:28:39.348911 | orchestrator | Friday 24 April 2026 05:28:14 +0000 (0:00:01.024) 0:25:56.582 ********** 2026-04-24 05:28:39.348922 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:28:39.348933 | orchestrator | 2026-04-24 05:28:39.348944 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-24 05:28:39.348954 | orchestrator | Friday 24 April 2026 05:28:17 +0000 (0:00:02.517) 0:25:59.099 ********** 2026-04-24 05:28:39.348965 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:28:39.348974 | orchestrator | 2026-04-24 05:28:39.348983 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:28:39.348993 | orchestrator | Friday 24 April 2026 05:28:19 +0000 (0:00:02.113) 0:26:01.212 ********** 2026-04-24 05:28:39.349001 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-1 2026-04-24 05:28:39.349010 | orchestrator | 2026-04-24 05:28:39.349020 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:28:39.349030 | orchestrator | Friday 24 April 2026 05:28:20 +0000 (0:00:01.103) 0:26:02.316 ********** 2026-04-24 05:28:39.349039 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:39.349048 | orchestrator | 2026-04-24 05:28:39.349058 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:28:39.349067 | orchestrator | Friday 24 April 2026 05:28:22 +0000 (0:00:01.440) 0:26:03.756 ********** 2026-04-24 05:28:39.349078 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:39.349088 | orchestrator | 2026-04-24 05:28:39.349098 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:28:39.349107 | orchestrator | Friday 24 April 2026 05:28:23 +0000 (0:00:01.148) 0:26:04.905 ********** 2026-04-24 05:28:39.349116 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:39.349124 | orchestrator | 2026-04-24 05:28:39.349133 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:28:39.349141 | orchestrator | Friday 24 April 2026 05:28:24 +0000 (0:00:01.447) 0:26:06.353 ********** 2026-04-24 05:28:39.349149 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:39.349159 | orchestrator | 2026-04-24 05:28:39.349189 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:28:39.349198 | orchestrator | Friday 24 April 2026 05:28:25 +0000 (0:00:01.160) 0:26:07.514 ********** 2026-04-24 05:28:39.349208 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:39.349217 | orchestrator | 2026-04-24 05:28:39.349227 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:28:39.349234 | orchestrator | Friday 24 April 2026 05:28:26 +0000 (0:00:01.162) 0:26:08.676 ********** 2026-04-24 05:28:39.349247 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:39.349253 | orchestrator | 2026-04-24 05:28:39.349258 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:28:39.349265 | orchestrator | Friday 24 April 2026 05:28:28 +0000 (0:00:01.192) 0:26:09.868 ********** 2026-04-24 05:28:39.349270 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:39.349276 | orchestrator | 2026-04-24 05:28:39.349282 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:28:39.349288 | orchestrator | Friday 24 April 2026 05:28:29 +0000 (0:00:01.152) 0:26:11.021 ********** 2026-04-24 05:28:39.349293 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:39.349299 | orchestrator | 2026-04-24 05:28:39.349305 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:28:39.349311 | orchestrator | Friday 24 April 2026 05:28:30 +0000 (0:00:01.197) 0:26:12.219 ********** 2026-04-24 05:28:39.349316 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:28:39.349322 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:28:39.349328 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:28:39.349334 | orchestrator | 2026-04-24 05:28:39.349340 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:28:39.349353 | orchestrator | Friday 24 April 2026 05:28:32 +0000 (0:00:01.650) 0:26:13.869 ********** 2026-04-24 05:28:39.349358 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:39.349364 | orchestrator | 2026-04-24 05:28:39.349370 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:28:39.349376 | orchestrator | Friday 24 April 2026 05:28:33 +0000 (0:00:01.218) 0:26:15.088 ********** 2026-04-24 05:28:39.349382 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:28:39.349388 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:28:39.349394 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:28:39.349400 | orchestrator | 2026-04-24 05:28:39.349405 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:28:39.349411 | orchestrator | Friday 24 April 2026 05:28:36 +0000 (0:00:02.726) 0:26:17.814 ********** 2026-04-24 05:28:39.349417 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 05:28:39.349423 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 05:28:39.349428 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 05:28:39.349434 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:39.349440 | orchestrator | 2026-04-24 05:28:39.349446 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:28:39.349451 | orchestrator | Friday 24 April 2026 05:28:37 +0000 (0:00:01.476) 0:26:19.291 ********** 2026-04-24 05:28:39.349459 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:28:39.349468 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:28:39.349474 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:28:39.349480 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:39.349486 | orchestrator | 2026-04-24 05:28:39.349491 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:28:39.349497 | orchestrator | Friday 24 April 2026 05:28:39 +0000 (0:00:01.660) 0:26:20.951 ********** 2026-04-24 05:28:39.349505 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:28:39.349514 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:28:39.349528 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:28:59.433801 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.433993 | orchestrator | 2026-04-24 05:28:59.434013 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:28:59.434090 | orchestrator | Friday 24 April 2026 05:28:40 +0000 (0:00:01.177) 0:26:22.129 ********** 2026-04-24 05:28:59.434107 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:28:33.879421', 'end': '2026-04-24 05:28:33.925117', 'delta': '0:00:00.045696', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:28:59.434124 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:28:34.409625', 'end': '2026-04-24 05:28:34.453183', 'delta': '0:00:00.043558', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:28:59.434136 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:28:34.912880', 'end': '2026-04-24 05:28:34.948150', 'delta': '0:00:00.035270', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:28:59.434148 | orchestrator | 2026-04-24 05:28:59.434160 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:28:59.434172 | orchestrator | Friday 24 April 2026 05:28:41 +0000 (0:00:01.238) 0:26:23.367 ********** 2026-04-24 05:28:59.434183 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:59.434195 | orchestrator | 2026-04-24 05:28:59.434207 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:28:59.434218 | orchestrator | Friday 24 April 2026 05:28:42 +0000 (0:00:01.289) 0:26:24.656 ********** 2026-04-24 05:28:59.434229 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434240 | orchestrator | 2026-04-24 05:28:59.434252 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:28:59.434263 | orchestrator | Friday 24 April 2026 05:28:44 +0000 (0:00:01.274) 0:26:25.931 ********** 2026-04-24 05:28:59.434274 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:59.434285 | orchestrator | 2026-04-24 05:28:59.434296 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:28:59.434307 | orchestrator | Friday 24 April 2026 05:28:45 +0000 (0:00:01.138) 0:26:27.070 ********** 2026-04-24 05:28:59.434318 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:28:59.434329 | orchestrator | 2026-04-24 05:28:59.434343 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:28:59.434383 | orchestrator | Friday 24 April 2026 05:28:47 +0000 (0:00:02.408) 0:26:29.479 ********** 2026-04-24 05:28:59.434396 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:28:59.434409 | orchestrator | 2026-04-24 05:28:59.434422 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:28:59.434435 | orchestrator | Friday 24 April 2026 05:28:48 +0000 (0:00:01.164) 0:26:30.643 ********** 2026-04-24 05:28:59.434446 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434457 | orchestrator | 2026-04-24 05:28:59.434468 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:28:59.434479 | orchestrator | Friday 24 April 2026 05:28:50 +0000 (0:00:01.099) 0:26:31.743 ********** 2026-04-24 05:28:59.434490 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434501 | orchestrator | 2026-04-24 05:28:59.434512 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:28:59.434538 | orchestrator | Friday 24 April 2026 05:28:51 +0000 (0:00:01.221) 0:26:32.965 ********** 2026-04-24 05:28:59.434550 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434561 | orchestrator | 2026-04-24 05:28:59.434591 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:28:59.434603 | orchestrator | Friday 24 April 2026 05:28:52 +0000 (0:00:01.150) 0:26:34.115 ********** 2026-04-24 05:28:59.434614 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434625 | orchestrator | 2026-04-24 05:28:59.434636 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:28:59.434647 | orchestrator | Friday 24 April 2026 05:28:53 +0000 (0:00:01.216) 0:26:35.332 ********** 2026-04-24 05:28:59.434658 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434669 | orchestrator | 2026-04-24 05:28:59.434680 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:28:59.434691 | orchestrator | Friday 24 April 2026 05:28:54 +0000 (0:00:01.169) 0:26:36.501 ********** 2026-04-24 05:28:59.434702 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434713 | orchestrator | 2026-04-24 05:28:59.434724 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:28:59.434735 | orchestrator | Friday 24 April 2026 05:28:55 +0000 (0:00:01.168) 0:26:37.670 ********** 2026-04-24 05:28:59.434746 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434757 | orchestrator | 2026-04-24 05:28:59.434768 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:28:59.434779 | orchestrator | Friday 24 April 2026 05:28:57 +0000 (0:00:01.136) 0:26:38.807 ********** 2026-04-24 05:28:59.434790 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434801 | orchestrator | 2026-04-24 05:28:59.434812 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:28:59.434824 | orchestrator | Friday 24 April 2026 05:28:58 +0000 (0:00:01.101) 0:26:39.909 ********** 2026-04-24 05:28:59.434835 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:28:59.434871 | orchestrator | 2026-04-24 05:28:59.434882 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:28:59.434893 | orchestrator | Friday 24 April 2026 05:28:59 +0000 (0:00:01.111) 0:26:41.021 ********** 2026-04-24 05:28:59.434906 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:28:59.434920 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:28:59.434941 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:28:59.434953 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-08-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:28:59.434965 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:28:59.434982 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:28:59.435001 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:29:00.700180 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '922a5bfc', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:29:00.700301 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:29:00.700319 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:29:00.700331 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:00.700343 | orchestrator | 2026-04-24 05:29:00.700354 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:29:00.700365 | orchestrator | Friday 24 April 2026 05:29:00 +0000 (0:00:01.262) 0:26:42.283 ********** 2026-04-24 05:29:00.700393 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:00.700423 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:00.700435 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:00.700447 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-08-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:00.700465 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:00.700476 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:00.700514 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:00.700542 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '922a5bfc', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1', 'scsi-SQEMU_QEMU_HARDDISK_922a5bfc-9600-4150-ae8a-25af0bf28f1a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:35.434573 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:35.434696 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:29:35.434713 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.434726 | orchestrator | 2026-04-24 05:29:35.434738 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:29:35.434752 | orchestrator | Friday 24 April 2026 05:29:01 +0000 (0:00:01.248) 0:26:43.532 ********** 2026-04-24 05:29:35.434763 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:29:35.434775 | orchestrator | 2026-04-24 05:29:35.434786 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:29:35.434796 | orchestrator | Friday 24 April 2026 05:29:03 +0000 (0:00:01.556) 0:26:45.089 ********** 2026-04-24 05:29:35.434833 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:29:35.434844 | orchestrator | 2026-04-24 05:29:35.434855 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:29:35.434883 | orchestrator | Friday 24 April 2026 05:29:04 +0000 (0:00:01.136) 0:26:46.225 ********** 2026-04-24 05:29:35.434894 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:29:35.434905 | orchestrator | 2026-04-24 05:29:35.434916 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:29:35.434927 | orchestrator | Friday 24 April 2026 05:29:06 +0000 (0:00:01.513) 0:26:47.739 ********** 2026-04-24 05:29:35.434938 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.434949 | orchestrator | 2026-04-24 05:29:35.434960 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:29:35.434970 | orchestrator | Friday 24 April 2026 05:29:07 +0000 (0:00:01.153) 0:26:48.893 ********** 2026-04-24 05:29:35.434981 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.434992 | orchestrator | 2026-04-24 05:29:35.435003 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:29:35.435013 | orchestrator | Friday 24 April 2026 05:29:08 +0000 (0:00:01.246) 0:26:50.140 ********** 2026-04-24 05:29:35.435024 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.435035 | orchestrator | 2026-04-24 05:29:35.435046 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:29:35.435078 | orchestrator | Friday 24 April 2026 05:29:09 +0000 (0:00:01.129) 0:26:51.269 ********** 2026-04-24 05:29:35.435093 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-24 05:29:35.435106 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:29:35.435118 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-24 05:29:35.435130 | orchestrator | 2026-04-24 05:29:35.435143 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:29:35.435155 | orchestrator | Friday 24 April 2026 05:29:11 +0000 (0:00:01.739) 0:26:53.009 ********** 2026-04-24 05:29:35.435167 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-24 05:29:35.435180 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-24 05:29:35.435192 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-24 05:29:35.435204 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.435216 | orchestrator | 2026-04-24 05:29:35.435229 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:29:35.435241 | orchestrator | Friday 24 April 2026 05:29:12 +0000 (0:00:01.186) 0:26:54.195 ********** 2026-04-24 05:29:35.435254 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.435266 | orchestrator | 2026-04-24 05:29:35.435279 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:29:35.435292 | orchestrator | Friday 24 April 2026 05:29:13 +0000 (0:00:01.157) 0:26:55.353 ********** 2026-04-24 05:29:35.435305 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:29:35.435318 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:29:35.435330 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:29:35.435342 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:29:35.435353 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:29:35.435365 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:29:35.435397 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:29:35.435409 | orchestrator | 2026-04-24 05:29:35.435422 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:29:35.435434 | orchestrator | Friday 24 April 2026 05:29:15 +0000 (0:00:02.179) 0:26:57.533 ********** 2026-04-24 05:29:35.435445 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:29:35.435456 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:29:35.435467 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:29:35.435477 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:29:35.435488 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:29:35.435498 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:29:35.435509 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:29:35.435519 | orchestrator | 2026-04-24 05:29:35.435530 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:29:35.435541 | orchestrator | Friday 24 April 2026 05:29:18 +0000 (0:00:02.273) 0:26:59.806 ********** 2026-04-24 05:29:35.435551 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-1 2026-04-24 05:29:35.435562 | orchestrator | 2026-04-24 05:29:35.435573 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:29:35.435584 | orchestrator | Friday 24 April 2026 05:29:19 +0000 (0:00:01.133) 0:27:00.940 ********** 2026-04-24 05:29:35.435594 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-1 2026-04-24 05:29:35.435617 | orchestrator | 2026-04-24 05:29:35.435628 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:29:35.435638 | orchestrator | Friday 24 April 2026 05:29:20 +0000 (0:00:01.233) 0:27:02.174 ********** 2026-04-24 05:29:35.435649 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:29:35.435660 | orchestrator | 2026-04-24 05:29:35.435670 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:29:35.435681 | orchestrator | Friday 24 April 2026 05:29:22 +0000 (0:00:01.544) 0:27:03.718 ********** 2026-04-24 05:29:35.435691 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.435702 | orchestrator | 2026-04-24 05:29:35.435718 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:29:35.435729 | orchestrator | Friday 24 April 2026 05:29:23 +0000 (0:00:01.141) 0:27:04.860 ********** 2026-04-24 05:29:35.435740 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.435751 | orchestrator | 2026-04-24 05:29:35.435761 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:29:35.435772 | orchestrator | Friday 24 April 2026 05:29:24 +0000 (0:00:01.105) 0:27:05.965 ********** 2026-04-24 05:29:35.435782 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.435793 | orchestrator | 2026-04-24 05:29:35.435819 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:29:35.435831 | orchestrator | Friday 24 April 2026 05:29:25 +0000 (0:00:01.142) 0:27:07.107 ********** 2026-04-24 05:29:35.435842 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:29:35.435853 | orchestrator | 2026-04-24 05:29:35.435863 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:29:35.435874 | orchestrator | Friday 24 April 2026 05:29:26 +0000 (0:00:01.500) 0:27:08.608 ********** 2026-04-24 05:29:35.435884 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.435895 | orchestrator | 2026-04-24 05:29:35.435906 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:29:35.435916 | orchestrator | Friday 24 April 2026 05:29:28 +0000 (0:00:01.108) 0:27:09.716 ********** 2026-04-24 05:29:35.435927 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.435938 | orchestrator | 2026-04-24 05:29:35.435948 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:29:35.435959 | orchestrator | Friday 24 April 2026 05:29:29 +0000 (0:00:01.123) 0:27:10.839 ********** 2026-04-24 05:29:35.435969 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:29:35.435980 | orchestrator | 2026-04-24 05:29:35.435990 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:29:35.436001 | orchestrator | Friday 24 April 2026 05:29:30 +0000 (0:00:01.562) 0:27:12.402 ********** 2026-04-24 05:29:35.436012 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:29:35.436022 | orchestrator | 2026-04-24 05:29:35.436033 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:29:35.436043 | orchestrator | Friday 24 April 2026 05:29:32 +0000 (0:00:01.573) 0:27:13.975 ********** 2026-04-24 05:29:35.436054 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.436065 | orchestrator | 2026-04-24 05:29:35.436075 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:29:35.436184 | orchestrator | Friday 24 April 2026 05:29:33 +0000 (0:00:00.762) 0:27:14.738 ********** 2026-04-24 05:29:35.436198 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:29:35.436209 | orchestrator | 2026-04-24 05:29:35.436220 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:29:35.436230 | orchestrator | Friday 24 April 2026 05:29:33 +0000 (0:00:00.799) 0:27:15.537 ********** 2026-04-24 05:29:35.436241 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.436252 | orchestrator | 2026-04-24 05:29:35.436262 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:29:35.436273 | orchestrator | Friday 24 April 2026 05:29:34 +0000 (0:00:00.772) 0:27:16.309 ********** 2026-04-24 05:29:35.436284 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:29:35.436303 | orchestrator | 2026-04-24 05:29:35.436314 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:29:35.436324 | orchestrator | Friday 24 April 2026 05:29:35 +0000 (0:00:00.775) 0:27:17.085 ********** 2026-04-24 05:29:35.436343 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825018 | orchestrator | 2026-04-24 05:30:14.825142 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:30:14.825166 | orchestrator | Friday 24 April 2026 05:29:36 +0000 (0:00:00.772) 0:27:17.857 ********** 2026-04-24 05:30:14.825202 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825223 | orchestrator | 2026-04-24 05:30:14.825243 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:30:14.825262 | orchestrator | Friday 24 April 2026 05:29:36 +0000 (0:00:00.760) 0:27:18.617 ********** 2026-04-24 05:30:14.825280 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825295 | orchestrator | 2026-04-24 05:30:14.825306 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:30:14.825317 | orchestrator | Friday 24 April 2026 05:29:37 +0000 (0:00:00.769) 0:27:19.387 ********** 2026-04-24 05:30:14.825328 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.825339 | orchestrator | 2026-04-24 05:30:14.825351 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:30:14.825362 | orchestrator | Friday 24 April 2026 05:29:38 +0000 (0:00:00.813) 0:27:20.200 ********** 2026-04-24 05:30:14.825373 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.825383 | orchestrator | 2026-04-24 05:30:14.825394 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:30:14.825405 | orchestrator | Friday 24 April 2026 05:29:39 +0000 (0:00:00.811) 0:27:21.012 ********** 2026-04-24 05:30:14.825415 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.825426 | orchestrator | 2026-04-24 05:30:14.825437 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:30:14.825447 | orchestrator | Friday 24 April 2026 05:29:40 +0000 (0:00:00.813) 0:27:21.826 ********** 2026-04-24 05:30:14.825470 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825482 | orchestrator | 2026-04-24 05:30:14.825504 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:30:14.825515 | orchestrator | Friday 24 April 2026 05:29:40 +0000 (0:00:00.790) 0:27:22.616 ********** 2026-04-24 05:30:14.825526 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825536 | orchestrator | 2026-04-24 05:30:14.825549 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:30:14.825561 | orchestrator | Friday 24 April 2026 05:29:41 +0000 (0:00:00.756) 0:27:23.373 ********** 2026-04-24 05:30:14.825574 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825586 | orchestrator | 2026-04-24 05:30:14.825599 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:30:14.825611 | orchestrator | Friday 24 April 2026 05:29:42 +0000 (0:00:00.760) 0:27:24.133 ********** 2026-04-24 05:30:14.825641 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825654 | orchestrator | 2026-04-24 05:30:14.825666 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:30:14.825678 | orchestrator | Friday 24 April 2026 05:29:43 +0000 (0:00:00.781) 0:27:24.915 ********** 2026-04-24 05:30:14.825691 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825703 | orchestrator | 2026-04-24 05:30:14.825716 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:30:14.825728 | orchestrator | Friday 24 April 2026 05:29:44 +0000 (0:00:00.829) 0:27:25.744 ********** 2026-04-24 05:30:14.825741 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825753 | orchestrator | 2026-04-24 05:30:14.825830 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:30:14.825845 | orchestrator | Friday 24 April 2026 05:29:44 +0000 (0:00:00.782) 0:27:26.527 ********** 2026-04-24 05:30:14.825858 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825894 | orchestrator | 2026-04-24 05:30:14.825906 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:30:14.825917 | orchestrator | Friday 24 April 2026 05:29:45 +0000 (0:00:00.793) 0:27:27.320 ********** 2026-04-24 05:30:14.825928 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825939 | orchestrator | 2026-04-24 05:30:14.825949 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:30:14.825960 | orchestrator | Friday 24 April 2026 05:29:46 +0000 (0:00:00.777) 0:27:28.097 ********** 2026-04-24 05:30:14.825971 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.825981 | orchestrator | 2026-04-24 05:30:14.825993 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:30:14.826012 | orchestrator | Friday 24 April 2026 05:29:47 +0000 (0:00:00.777) 0:27:28.875 ********** 2026-04-24 05:30:14.826109 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826127 | orchestrator | 2026-04-24 05:30:14.826147 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:30:14.826165 | orchestrator | Friday 24 April 2026 05:29:47 +0000 (0:00:00.754) 0:27:29.630 ********** 2026-04-24 05:30:14.826184 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826204 | orchestrator | 2026-04-24 05:30:14.826223 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:30:14.826240 | orchestrator | Friday 24 April 2026 05:29:48 +0000 (0:00:00.793) 0:27:30.424 ********** 2026-04-24 05:30:14.826251 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826261 | orchestrator | 2026-04-24 05:30:14.826272 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:30:14.826282 | orchestrator | Friday 24 April 2026 05:29:49 +0000 (0:00:00.798) 0:27:31.222 ********** 2026-04-24 05:30:14.826293 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.826303 | orchestrator | 2026-04-24 05:30:14.826314 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:30:14.826325 | orchestrator | Friday 24 April 2026 05:29:51 +0000 (0:00:01.595) 0:27:32.818 ********** 2026-04-24 05:30:14.826335 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.826346 | orchestrator | 2026-04-24 05:30:14.826356 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:30:14.826367 | orchestrator | Friday 24 April 2026 05:29:53 +0000 (0:00:02.150) 0:27:34.969 ********** 2026-04-24 05:30:14.826377 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-1 2026-04-24 05:30:14.826389 | orchestrator | 2026-04-24 05:30:14.826421 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:30:14.826432 | orchestrator | Friday 24 April 2026 05:29:54 +0000 (0:00:01.160) 0:27:36.130 ********** 2026-04-24 05:30:14.826443 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826454 | orchestrator | 2026-04-24 05:30:14.826465 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:30:14.826475 | orchestrator | Friday 24 April 2026 05:29:55 +0000 (0:00:01.184) 0:27:37.315 ********** 2026-04-24 05:30:14.826486 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826496 | orchestrator | 2026-04-24 05:30:14.826507 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:30:14.826517 | orchestrator | Friday 24 April 2026 05:29:56 +0000 (0:00:01.099) 0:27:38.415 ********** 2026-04-24 05:30:14.826528 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:30:14.826539 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:30:14.826549 | orchestrator | 2026-04-24 05:30:14.826560 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:30:14.826571 | orchestrator | Friday 24 April 2026 05:29:58 +0000 (0:00:01.823) 0:27:40.238 ********** 2026-04-24 05:30:14.826581 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.826592 | orchestrator | 2026-04-24 05:30:14.826614 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:30:14.826625 | orchestrator | Friday 24 April 2026 05:30:00 +0000 (0:00:01.483) 0:27:41.722 ********** 2026-04-24 05:30:14.826636 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826646 | orchestrator | 2026-04-24 05:30:14.826657 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:30:14.826667 | orchestrator | Friday 24 April 2026 05:30:01 +0000 (0:00:01.143) 0:27:42.866 ********** 2026-04-24 05:30:14.826678 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826689 | orchestrator | 2026-04-24 05:30:14.826699 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:30:14.826710 | orchestrator | Friday 24 April 2026 05:30:01 +0000 (0:00:00.765) 0:27:43.631 ********** 2026-04-24 05:30:14.826721 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826731 | orchestrator | 2026-04-24 05:30:14.826742 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:30:14.826752 | orchestrator | Friday 24 April 2026 05:30:02 +0000 (0:00:00.629) 0:27:44.261 ********** 2026-04-24 05:30:14.826796 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-1 2026-04-24 05:30:14.826809 | orchestrator | 2026-04-24 05:30:14.826820 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:30:14.826830 | orchestrator | Friday 24 April 2026 05:30:03 +0000 (0:00:00.927) 0:27:45.188 ********** 2026-04-24 05:30:14.826841 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.826852 | orchestrator | 2026-04-24 05:30:14.826863 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:30:14.826873 | orchestrator | Friday 24 April 2026 05:30:05 +0000 (0:00:01.873) 0:27:47.062 ********** 2026-04-24 05:30:14.826884 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:30:14.826894 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:30:14.826905 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:30:14.826915 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826926 | orchestrator | 2026-04-24 05:30:14.826937 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:30:14.826947 | orchestrator | Friday 24 April 2026 05:30:06 +0000 (0:00:01.086) 0:27:48.149 ********** 2026-04-24 05:30:14.826958 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.826968 | orchestrator | 2026-04-24 05:30:14.826979 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:30:14.826990 | orchestrator | Friday 24 April 2026 05:30:07 +0000 (0:00:01.099) 0:27:49.248 ********** 2026-04-24 05:30:14.827000 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.827011 | orchestrator | 2026-04-24 05:30:14.827022 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:30:14.827033 | orchestrator | Friday 24 April 2026 05:30:08 +0000 (0:00:01.111) 0:27:50.360 ********** 2026-04-24 05:30:14.827044 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.827054 | orchestrator | 2026-04-24 05:30:14.827065 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:30:14.827076 | orchestrator | Friday 24 April 2026 05:30:09 +0000 (0:00:01.117) 0:27:51.478 ********** 2026-04-24 05:30:14.827086 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.827097 | orchestrator | 2026-04-24 05:30:14.827107 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:30:14.827118 | orchestrator | Friday 24 April 2026 05:30:10 +0000 (0:00:01.153) 0:27:52.632 ********** 2026-04-24 05:30:14.827134 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:14.827152 | orchestrator | 2026-04-24 05:30:14.827169 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:30:14.827188 | orchestrator | Friday 24 April 2026 05:30:11 +0000 (0:00:00.786) 0:27:53.418 ********** 2026-04-24 05:30:14.827216 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.827232 | orchestrator | 2026-04-24 05:30:14.827249 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:30:14.827266 | orchestrator | Friday 24 April 2026 05:30:13 +0000 (0:00:02.121) 0:27:55.540 ********** 2026-04-24 05:30:14.827283 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:14.827299 | orchestrator | 2026-04-24 05:30:14.827314 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:30:14.827332 | orchestrator | Friday 24 April 2026 05:30:14 +0000 (0:00:00.784) 0:27:56.325 ********** 2026-04-24 05:30:14.827349 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-1 2026-04-24 05:30:14.827366 | orchestrator | 2026-04-24 05:30:14.827398 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:30:51.330011 | orchestrator | Friday 24 April 2026 05:30:15 +0000 (0:00:01.115) 0:27:57.440 ********** 2026-04-24 05:30:51.330180 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.330197 | orchestrator | 2026-04-24 05:30:51.330210 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:30:51.330222 | orchestrator | Friday 24 April 2026 05:30:16 +0000 (0:00:01.121) 0:27:58.561 ********** 2026-04-24 05:30:51.330233 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.330244 | orchestrator | 2026-04-24 05:30:51.330255 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:30:51.330271 | orchestrator | Friday 24 April 2026 05:30:17 +0000 (0:00:01.140) 0:27:59.702 ********** 2026-04-24 05:30:51.330294 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.330342 | orchestrator | 2026-04-24 05:30:51.330361 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:30:51.330394 | orchestrator | Friday 24 April 2026 05:30:19 +0000 (0:00:01.203) 0:28:00.906 ********** 2026-04-24 05:30:51.330413 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.330430 | orchestrator | 2026-04-24 05:30:51.330450 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:30:51.330469 | orchestrator | Friday 24 April 2026 05:30:20 +0000 (0:00:01.163) 0:28:02.069 ********** 2026-04-24 05:30:51.330488 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.330504 | orchestrator | 2026-04-24 05:30:51.330515 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:30:51.330529 | orchestrator | Friday 24 April 2026 05:30:21 +0000 (0:00:01.120) 0:28:03.190 ********** 2026-04-24 05:30:51.330542 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.330555 | orchestrator | 2026-04-24 05:30:51.330569 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:30:51.330581 | orchestrator | Friday 24 April 2026 05:30:22 +0000 (0:00:01.164) 0:28:04.354 ********** 2026-04-24 05:30:51.330594 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.330607 | orchestrator | 2026-04-24 05:30:51.330621 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:30:51.330633 | orchestrator | Friday 24 April 2026 05:30:23 +0000 (0:00:01.182) 0:28:05.536 ********** 2026-04-24 05:30:51.330646 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.330658 | orchestrator | 2026-04-24 05:30:51.330671 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:30:51.330685 | orchestrator | Friday 24 April 2026 05:30:25 +0000 (0:00:01.216) 0:28:06.753 ********** 2026-04-24 05:30:51.330713 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:30:51.330749 | orchestrator | 2026-04-24 05:30:51.330762 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:30:51.330776 | orchestrator | Friday 24 April 2026 05:30:25 +0000 (0:00:00.824) 0:28:07.577 ********** 2026-04-24 05:30:51.330788 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-1 2026-04-24 05:30:51.330803 | orchestrator | 2026-04-24 05:30:51.330816 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:30:51.330852 | orchestrator | Friday 24 April 2026 05:30:27 +0000 (0:00:01.154) 0:28:08.732 ********** 2026-04-24 05:30:51.330866 | orchestrator | ok: [testbed-node-1] => (item=/etc/ceph) 2026-04-24 05:30:51.330879 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-24 05:30:51.330891 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-24 05:30:51.330902 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-24 05:30:51.330913 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-24 05:30:51.330923 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-24 05:30:51.330934 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-24 05:30:51.330944 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:30:51.330955 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:30:51.330966 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:30:51.330977 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:30:51.330987 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:30:51.330998 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:30:51.331009 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:30:51.331020 | orchestrator | ok: [testbed-node-1] => (item=/var/run/ceph) 2026-04-24 05:30:51.331031 | orchestrator | ok: [testbed-node-1] => (item=/var/log/ceph) 2026-04-24 05:30:51.331042 | orchestrator | 2026-04-24 05:30:51.331053 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:30:51.331064 | orchestrator | Friday 24 April 2026 05:30:33 +0000 (0:00:06.391) 0:28:15.124 ********** 2026-04-24 05:30:51.331075 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331086 | orchestrator | 2026-04-24 05:30:51.331096 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:30:51.331107 | orchestrator | Friday 24 April 2026 05:30:34 +0000 (0:00:00.816) 0:28:15.940 ********** 2026-04-24 05:30:51.331118 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331129 | orchestrator | 2026-04-24 05:30:51.331140 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:30:51.331152 | orchestrator | Friday 24 April 2026 05:30:35 +0000 (0:00:00.787) 0:28:16.728 ********** 2026-04-24 05:30:51.331172 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331201 | orchestrator | 2026-04-24 05:30:51.331221 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:30:51.331239 | orchestrator | Friday 24 April 2026 05:30:35 +0000 (0:00:00.789) 0:28:17.518 ********** 2026-04-24 05:30:51.331255 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331274 | orchestrator | 2026-04-24 05:30:51.331293 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:30:51.331338 | orchestrator | Friday 24 April 2026 05:30:36 +0000 (0:00:00.764) 0:28:18.283 ********** 2026-04-24 05:30:51.331358 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331375 | orchestrator | 2026-04-24 05:30:51.331391 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:30:51.331410 | orchestrator | Friday 24 April 2026 05:30:37 +0000 (0:00:00.781) 0:28:19.065 ********** 2026-04-24 05:30:51.331430 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331449 | orchestrator | 2026-04-24 05:30:51.331467 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:30:51.331486 | orchestrator | Friday 24 April 2026 05:30:38 +0000 (0:00:00.755) 0:28:19.820 ********** 2026-04-24 05:30:51.331504 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331522 | orchestrator | 2026-04-24 05:30:51.331542 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:30:51.331561 | orchestrator | Friday 24 April 2026 05:30:38 +0000 (0:00:00.770) 0:28:20.590 ********** 2026-04-24 05:30:51.331594 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331606 | orchestrator | 2026-04-24 05:30:51.331617 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:30:51.331628 | orchestrator | Friday 24 April 2026 05:30:39 +0000 (0:00:00.781) 0:28:21.372 ********** 2026-04-24 05:30:51.331638 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331649 | orchestrator | 2026-04-24 05:30:51.331660 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:30:51.331670 | orchestrator | Friday 24 April 2026 05:30:40 +0000 (0:00:00.765) 0:28:22.138 ********** 2026-04-24 05:30:51.331681 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331692 | orchestrator | 2026-04-24 05:30:51.331703 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:30:51.331714 | orchestrator | Friday 24 April 2026 05:30:41 +0000 (0:00:00.772) 0:28:22.911 ********** 2026-04-24 05:30:51.331724 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331764 | orchestrator | 2026-04-24 05:30:51.331775 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:30:51.331786 | orchestrator | Friday 24 April 2026 05:30:41 +0000 (0:00:00.790) 0:28:23.701 ********** 2026-04-24 05:30:51.331797 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331808 | orchestrator | 2026-04-24 05:30:51.331818 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:30:51.331838 | orchestrator | Friday 24 April 2026 05:30:42 +0000 (0:00:00.769) 0:28:24.470 ********** 2026-04-24 05:30:51.331854 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331871 | orchestrator | 2026-04-24 05:30:51.331895 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:30:51.331920 | orchestrator | Friday 24 April 2026 05:30:43 +0000 (0:00:00.860) 0:28:25.331 ********** 2026-04-24 05:30:51.331937 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.331955 | orchestrator | 2026-04-24 05:30:51.331972 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:30:51.331991 | orchestrator | Friday 24 April 2026 05:30:44 +0000 (0:00:00.791) 0:28:26.122 ********** 2026-04-24 05:30:51.332009 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.332027 | orchestrator | 2026-04-24 05:30:51.332047 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:30:51.332071 | orchestrator | Friday 24 April 2026 05:30:45 +0000 (0:00:00.877) 0:28:27.000 ********** 2026-04-24 05:30:51.332095 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.332112 | orchestrator | 2026-04-24 05:30:51.332130 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:30:51.332145 | orchestrator | Friday 24 April 2026 05:30:46 +0000 (0:00:00.798) 0:28:27.799 ********** 2026-04-24 05:30:51.332161 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.332179 | orchestrator | 2026-04-24 05:30:51.332197 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:30:51.332217 | orchestrator | Friday 24 April 2026 05:30:46 +0000 (0:00:00.739) 0:28:28.539 ********** 2026-04-24 05:30:51.332235 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.332254 | orchestrator | 2026-04-24 05:30:51.332267 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:30:51.332278 | orchestrator | Friday 24 April 2026 05:30:47 +0000 (0:00:00.777) 0:28:29.316 ********** 2026-04-24 05:30:51.332289 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.332300 | orchestrator | 2026-04-24 05:30:51.332310 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:30:51.332321 | orchestrator | Friday 24 April 2026 05:30:48 +0000 (0:00:00.813) 0:28:30.130 ********** 2026-04-24 05:30:51.332332 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.332342 | orchestrator | 2026-04-24 05:30:51.332353 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:30:51.332375 | orchestrator | Friday 24 April 2026 05:30:49 +0000 (0:00:00.783) 0:28:30.913 ********** 2026-04-24 05:30:51.332386 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.332397 | orchestrator | 2026-04-24 05:30:51.332408 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:30:51.332418 | orchestrator | Friday 24 April 2026 05:30:49 +0000 (0:00:00.796) 0:28:31.710 ********** 2026-04-24 05:30:51.332429 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:30:51.332440 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:30:51.332451 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:30:51.332461 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:30:51.332472 | orchestrator | 2026-04-24 05:30:51.332483 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:30:51.332494 | orchestrator | Friday 24 April 2026 05:30:51 +0000 (0:00:01.067) 0:28:32.777 ********** 2026-04-24 05:30:51.332505 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:30:51.332527 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:31:50.102183 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:31:50.102304 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.102320 | orchestrator | 2026-04-24 05:31:50.102333 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:31:50.102345 | orchestrator | Friday 24 April 2026 05:30:52 +0000 (0:00:01.063) 0:28:33.841 ********** 2026-04-24 05:31:50.102357 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-24 05:31:50.102368 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-24 05:31:50.102379 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-24 05:31:50.102390 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.102400 | orchestrator | 2026-04-24 05:31:50.102412 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:31:50.102423 | orchestrator | Friday 24 April 2026 05:30:53 +0000 (0:00:01.105) 0:28:34.947 ********** 2026-04-24 05:31:50.102433 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.102444 | orchestrator | 2026-04-24 05:31:50.102455 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:31:50.102466 | orchestrator | Friday 24 April 2026 05:30:54 +0000 (0:00:00.782) 0:28:35.729 ********** 2026-04-24 05:31:50.102477 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-24 05:31:50.102488 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.102499 | orchestrator | 2026-04-24 05:31:50.102510 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:31:50.102521 | orchestrator | Friday 24 April 2026 05:30:54 +0000 (0:00:00.902) 0:28:36.632 ********** 2026-04-24 05:31:50.102532 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:31:50.102543 | orchestrator | 2026-04-24 05:31:50.102554 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:31:50.102565 | orchestrator | Friday 24 April 2026 05:30:56 +0000 (0:00:01.482) 0:28:38.115 ********** 2026-04-24 05:31:50.102575 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:31:50.102587 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-24 05:31:50.102599 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:31:50.102610 | orchestrator | 2026-04-24 05:31:50.102621 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-24 05:31:50.102648 | orchestrator | Friday 24 April 2026 05:30:58 +0000 (0:00:01.599) 0:28:39.715 ********** 2026-04-24 05:31:50.102659 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-1 2026-04-24 05:31:50.102673 | orchestrator | 2026-04-24 05:31:50.102710 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-24 05:31:50.102747 | orchestrator | Friday 24 April 2026 05:30:59 +0000 (0:00:01.117) 0:28:40.832 ********** 2026-04-24 05:31:50.102760 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:31:50.102773 | orchestrator | 2026-04-24 05:31:50.102785 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-24 05:31:50.102798 | orchestrator | Friday 24 April 2026 05:31:00 +0000 (0:00:01.591) 0:28:42.424 ********** 2026-04-24 05:31:50.102810 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.102823 | orchestrator | 2026-04-24 05:31:50.102836 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-24 05:31:50.102849 | orchestrator | Friday 24 April 2026 05:31:01 +0000 (0:00:01.148) 0:28:43.573 ********** 2026-04-24 05:31:50.102861 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:31:50.102873 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:31:50.102885 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:31:50.102897 | orchestrator | ok: [testbed-node-1 -> {{ groups[mon_group_name][0] }}] 2026-04-24 05:31:50.102910 | orchestrator | 2026-04-24 05:31:50.102922 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-24 05:31:50.102934 | orchestrator | Friday 24 April 2026 05:31:09 +0000 (0:00:07.366) 0:28:50.939 ********** 2026-04-24 05:31:50.102947 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:31:50.102959 | orchestrator | 2026-04-24 05:31:50.102972 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-24 05:31:50.102984 | orchestrator | Friday 24 April 2026 05:31:10 +0000 (0:00:01.182) 0:28:52.122 ********** 2026-04-24 05:31:50.102996 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-24 05:31:50.103008 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-24 05:31:50.103021 | orchestrator | 2026-04-24 05:31:50.103033 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-24 05:31:50.103045 | orchestrator | Friday 24 April 2026 05:31:13 +0000 (0:00:03.220) 0:28:55.343 ********** 2026-04-24 05:31:50.103058 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-24 05:31:50.103068 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-24 05:31:50.103079 | orchestrator | 2026-04-24 05:31:50.103090 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-24 05:31:50.103101 | orchestrator | Friday 24 April 2026 05:31:15 +0000 (0:00:02.063) 0:28:57.407 ********** 2026-04-24 05:31:50.103111 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:31:50.103122 | orchestrator | 2026-04-24 05:31:50.103133 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-24 05:31:50.103143 | orchestrator | Friday 24 April 2026 05:31:17 +0000 (0:00:01.477) 0:28:58.885 ********** 2026-04-24 05:31:50.103154 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.103165 | orchestrator | 2026-04-24 05:31:50.103176 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-24 05:31:50.103187 | orchestrator | Friday 24 April 2026 05:31:17 +0000 (0:00:00.784) 0:28:59.669 ********** 2026-04-24 05:31:50.103198 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.103209 | orchestrator | 2026-04-24 05:31:50.103220 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-24 05:31:50.103248 | orchestrator | Friday 24 April 2026 05:31:18 +0000 (0:00:00.801) 0:29:00.471 ********** 2026-04-24 05:31:50.103260 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-1 2026-04-24 05:31:50.103270 | orchestrator | 2026-04-24 05:31:50.103281 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-24 05:31:50.103292 | orchestrator | Friday 24 April 2026 05:31:19 +0000 (0:00:01.167) 0:29:01.639 ********** 2026-04-24 05:31:50.103302 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.103313 | orchestrator | 2026-04-24 05:31:50.103324 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-24 05:31:50.103344 | orchestrator | Friday 24 April 2026 05:31:21 +0000 (0:00:01.151) 0:29:02.790 ********** 2026-04-24 05:31:50.103355 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.103365 | orchestrator | 2026-04-24 05:31:50.103376 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-24 05:31:50.103387 | orchestrator | Friday 24 April 2026 05:31:22 +0000 (0:00:01.152) 0:29:03.942 ********** 2026-04-24 05:31:50.103397 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-1 2026-04-24 05:31:50.103408 | orchestrator | 2026-04-24 05:31:50.103419 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-24 05:31:50.103429 | orchestrator | Friday 24 April 2026 05:31:23 +0000 (0:00:01.144) 0:29:05.087 ********** 2026-04-24 05:31:50.103440 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:31:50.103451 | orchestrator | 2026-04-24 05:31:50.103461 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-24 05:31:50.103472 | orchestrator | Friday 24 April 2026 05:31:25 +0000 (0:00:02.374) 0:29:07.461 ********** 2026-04-24 05:31:50.103482 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:31:50.103493 | orchestrator | 2026-04-24 05:31:50.103504 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-24 05:31:50.103514 | orchestrator | Friday 24 April 2026 05:31:27 +0000 (0:00:01.962) 0:29:09.424 ********** 2026-04-24 05:31:50.103525 | orchestrator | ok: [testbed-node-1] 2026-04-24 05:31:50.103535 | orchestrator | 2026-04-24 05:31:50.103546 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-24 05:31:50.103557 | orchestrator | Friday 24 April 2026 05:31:30 +0000 (0:00:02.505) 0:29:11.930 ********** 2026-04-24 05:31:50.103567 | orchestrator | changed: [testbed-node-1] 2026-04-24 05:31:50.103578 | orchestrator | 2026-04-24 05:31:50.103589 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-24 05:31:50.103605 | orchestrator | Friday 24 April 2026 05:31:34 +0000 (0:00:04.249) 0:29:16.179 ********** 2026-04-24 05:31:50.103616 | orchestrator | skipping: [testbed-node-1] 2026-04-24 05:31:50.103627 | orchestrator | 2026-04-24 05:31:50.103637 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-24 05:31:50.103648 | orchestrator | 2026-04-24 05:31:50.103659 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-24 05:31:50.103669 | orchestrator | Friday 24 April 2026 05:31:35 +0000 (0:00:00.988) 0:29:17.167 ********** 2026-04-24 05:31:50.103695 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:31:50.103707 | orchestrator | 2026-04-24 05:31:50.103718 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-24 05:31:50.103728 | orchestrator | Friday 24 April 2026 05:31:38 +0000 (0:00:02.567) 0:29:19.735 ********** 2026-04-24 05:31:50.103739 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:31:50.103750 | orchestrator | 2026-04-24 05:31:50.103760 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:31:50.103771 | orchestrator | Friday 24 April 2026 05:31:40 +0000 (0:00:02.131) 0:29:21.867 ********** 2026-04-24 05:31:50.103782 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-2 2026-04-24 05:31:50.103792 | orchestrator | 2026-04-24 05:31:50.103803 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:31:50.103814 | orchestrator | Friday 24 April 2026 05:31:41 +0000 (0:00:01.139) 0:29:23.007 ********** 2026-04-24 05:31:50.103824 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:31:50.103835 | orchestrator | 2026-04-24 05:31:50.103846 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:31:50.103857 | orchestrator | Friday 24 April 2026 05:31:42 +0000 (0:00:01.447) 0:29:24.455 ********** 2026-04-24 05:31:50.103867 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:31:50.103878 | orchestrator | 2026-04-24 05:31:50.103889 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:31:50.103900 | orchestrator | Friday 24 April 2026 05:31:43 +0000 (0:00:01.104) 0:29:25.560 ********** 2026-04-24 05:31:50.103918 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:31:50.103928 | orchestrator | 2026-04-24 05:31:50.103939 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:31:50.103950 | orchestrator | Friday 24 April 2026 05:31:45 +0000 (0:00:01.497) 0:29:27.057 ********** 2026-04-24 05:31:50.103960 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:31:50.103971 | orchestrator | 2026-04-24 05:31:50.103982 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:31:50.103992 | orchestrator | Friday 24 April 2026 05:31:46 +0000 (0:00:01.170) 0:29:28.228 ********** 2026-04-24 05:31:50.104003 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:31:50.104014 | orchestrator | 2026-04-24 05:31:50.104024 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:31:50.104035 | orchestrator | Friday 24 April 2026 05:31:47 +0000 (0:00:01.142) 0:29:29.370 ********** 2026-04-24 05:31:50.104046 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:31:50.104056 | orchestrator | 2026-04-24 05:31:50.104067 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:31:50.104078 | orchestrator | Friday 24 April 2026 05:31:48 +0000 (0:00:01.152) 0:29:30.522 ********** 2026-04-24 05:31:50.104088 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:31:50.104099 | orchestrator | 2026-04-24 05:31:50.104110 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:31:50.104121 | orchestrator | Friday 24 April 2026 05:31:49 +0000 (0:00:01.115) 0:29:31.638 ********** 2026-04-24 05:31:50.104131 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:31:50.104142 | orchestrator | 2026-04-24 05:31:50.104159 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:32:15.114800 | orchestrator | Friday 24 April 2026 05:31:51 +0000 (0:00:01.200) 0:29:32.839 ********** 2026-04-24 05:32:15.114929 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:32:15.114947 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:32:15.114960 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:32:15.114971 | orchestrator | 2026-04-24 05:32:15.114983 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:32:15.114994 | orchestrator | Friday 24 April 2026 05:31:52 +0000 (0:00:01.624) 0:29:34.464 ********** 2026-04-24 05:32:15.115004 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:32:15.115015 | orchestrator | 2026-04-24 05:32:15.115027 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:32:15.115038 | orchestrator | Friday 24 April 2026 05:31:54 +0000 (0:00:01.326) 0:29:35.790 ********** 2026-04-24 05:32:15.115049 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:32:15.115059 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:32:15.115070 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:32:15.115081 | orchestrator | 2026-04-24 05:32:15.115091 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:32:15.115102 | orchestrator | Friday 24 April 2026 05:31:57 +0000 (0:00:03.163) 0:29:38.953 ********** 2026-04-24 05:32:15.115113 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 05:32:15.115124 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 05:32:15.115135 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 05:32:15.115146 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115157 | orchestrator | 2026-04-24 05:32:15.115168 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:32:15.115178 | orchestrator | Friday 24 April 2026 05:31:58 +0000 (0:00:01.442) 0:29:40.396 ********** 2026-04-24 05:32:15.115207 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:32:15.115245 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:32:15.115257 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:32:15.115268 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115279 | orchestrator | 2026-04-24 05:32:15.115290 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:32:15.115303 | orchestrator | Friday 24 April 2026 05:32:00 +0000 (0:00:01.963) 0:29:42.359 ********** 2026-04-24 05:32:15.115317 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:15.115333 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:15.115346 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:15.115359 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115371 | orchestrator | 2026-04-24 05:32:15.115384 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:32:15.115397 | orchestrator | Friday 24 April 2026 05:32:01 +0000 (0:00:01.178) 0:29:43.537 ********** 2026-04-24 05:32:15.115429 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:31:54.631700', 'end': '2026-04-24 05:31:54.680791', 'delta': '0:00:00.049091', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:32:15.115446 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:31:55.182080', 'end': '2026-04-24 05:31:55.233163', 'delta': '0:00:00.051083', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:32:15.115474 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:31:56.051952', 'end': '2026-04-24 05:31:56.091707', 'delta': '0:00:00.039755', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:32:15.115488 | orchestrator | 2026-04-24 05:32:15.115500 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:32:15.115513 | orchestrator | Friday 24 April 2026 05:32:03 +0000 (0:00:01.195) 0:29:44.733 ********** 2026-04-24 05:32:15.115525 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:32:15.115537 | orchestrator | 2026-04-24 05:32:15.115549 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:32:15.115561 | orchestrator | Friday 24 April 2026 05:32:04 +0000 (0:00:01.683) 0:29:46.416 ********** 2026-04-24 05:32:15.115573 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115586 | orchestrator | 2026-04-24 05:32:15.115598 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:32:15.115611 | orchestrator | Friday 24 April 2026 05:32:05 +0000 (0:00:01.256) 0:29:47.673 ********** 2026-04-24 05:32:15.115623 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:32:15.115635 | orchestrator | 2026-04-24 05:32:15.115648 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:32:15.115690 | orchestrator | Friday 24 April 2026 05:32:07 +0000 (0:00:01.151) 0:29:48.824 ********** 2026-04-24 05:32:15.115702 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:32:15.115712 | orchestrator | 2026-04-24 05:32:15.115723 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:32:15.115733 | orchestrator | Friday 24 April 2026 05:32:09 +0000 (0:00:01.937) 0:29:50.762 ********** 2026-04-24 05:32:15.115744 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:32:15.115755 | orchestrator | 2026-04-24 05:32:15.115765 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:32:15.115776 | orchestrator | Friday 24 April 2026 05:32:10 +0000 (0:00:01.125) 0:29:51.888 ********** 2026-04-24 05:32:15.115786 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115797 | orchestrator | 2026-04-24 05:32:15.115807 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:32:15.115818 | orchestrator | Friday 24 April 2026 05:32:11 +0000 (0:00:01.158) 0:29:53.046 ********** 2026-04-24 05:32:15.115828 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115839 | orchestrator | 2026-04-24 05:32:15.115849 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:32:15.115860 | orchestrator | Friday 24 April 2026 05:32:12 +0000 (0:00:01.297) 0:29:54.344 ********** 2026-04-24 05:32:15.115870 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115881 | orchestrator | 2026-04-24 05:32:15.115892 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:32:15.115902 | orchestrator | Friday 24 April 2026 05:32:13 +0000 (0:00:01.109) 0:29:55.453 ********** 2026-04-24 05:32:15.115913 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115923 | orchestrator | 2026-04-24 05:32:15.115934 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:32:15.115944 | orchestrator | Friday 24 April 2026 05:32:14 +0000 (0:00:01.220) 0:29:56.674 ********** 2026-04-24 05:32:15.115955 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:15.115974 | orchestrator | 2026-04-24 05:32:15.115993 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:32:21.989065 | orchestrator | Friday 24 April 2026 05:32:16 +0000 (0:00:01.141) 0:29:57.815 ********** 2026-04-24 05:32:21.989177 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:21.989194 | orchestrator | 2026-04-24 05:32:21.989207 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:32:21.989219 | orchestrator | Friday 24 April 2026 05:32:17 +0000 (0:00:01.109) 0:29:58.925 ********** 2026-04-24 05:32:21.989230 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:21.989241 | orchestrator | 2026-04-24 05:32:21.989252 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:32:21.989263 | orchestrator | Friday 24 April 2026 05:32:18 +0000 (0:00:01.111) 0:30:00.036 ********** 2026-04-24 05:32:21.989274 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:21.989284 | orchestrator | 2026-04-24 05:32:21.989295 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:32:21.989307 | orchestrator | Friday 24 April 2026 05:32:19 +0000 (0:00:01.130) 0:30:01.167 ********** 2026-04-24 05:32:21.989317 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:21.989328 | orchestrator | 2026-04-24 05:32:21.989339 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:32:21.989349 | orchestrator | Friday 24 April 2026 05:32:20 +0000 (0:00:01.167) 0:30:02.335 ********** 2026-04-24 05:32:21.989363 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:32:21.989392 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:32:21.989405 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:32:21.989419 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-07-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:32:21.989433 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:32:21.989445 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:32:21.989478 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:32:21.989522 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f837a177', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:32:21.989539 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:32:21.989551 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:32:21.989563 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:21.989574 | orchestrator | 2026-04-24 05:32:21.989585 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:32:21.989599 | orchestrator | Friday 24 April 2026 05:32:21 +0000 (0:00:01.278) 0:30:03.613 ********** 2026-04-24 05:32:21.989620 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:21.989645 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.802791 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.802917 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-07-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.802935 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.802948 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.802982 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.803027 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f837a177', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1', 'scsi-SQEMU_QEMU_HARDDISK_f837a177-fc6d-44f1-95c8-fd24e6372293-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.803043 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.803054 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:32:30.803076 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:30.803089 | orchestrator | 2026-04-24 05:32:30.803101 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:32:30.803113 | orchestrator | Friday 24 April 2026 05:32:23 +0000 (0:00:01.241) 0:30:04.855 ********** 2026-04-24 05:32:30.803124 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:32:30.803135 | orchestrator | 2026-04-24 05:32:30.803146 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:32:30.803157 | orchestrator | Friday 24 April 2026 05:32:24 +0000 (0:00:01.548) 0:30:06.403 ********** 2026-04-24 05:32:30.803168 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:32:30.803179 | orchestrator | 2026-04-24 05:32:30.803190 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:32:30.803200 | orchestrator | Friday 24 April 2026 05:32:25 +0000 (0:00:01.128) 0:30:07.532 ********** 2026-04-24 05:32:30.803211 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:32:30.803221 | orchestrator | 2026-04-24 05:32:30.803232 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:32:30.803242 | orchestrator | Friday 24 April 2026 05:32:27 +0000 (0:00:01.453) 0:30:08.985 ********** 2026-04-24 05:32:30.803253 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:30.803264 | orchestrator | 2026-04-24 05:32:30.803275 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:32:30.803285 | orchestrator | Friday 24 April 2026 05:32:28 +0000 (0:00:01.166) 0:30:10.152 ********** 2026-04-24 05:32:30.803296 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:30.803307 | orchestrator | 2026-04-24 05:32:30.803317 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:32:30.803328 | orchestrator | Friday 24 April 2026 05:32:29 +0000 (0:00:01.245) 0:30:11.398 ********** 2026-04-24 05:32:30.803338 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:32:30.803349 | orchestrator | 2026-04-24 05:32:30.803360 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:32:30.803377 | orchestrator | Friday 24 April 2026 05:32:30 +0000 (0:00:01.109) 0:30:12.507 ********** 2026-04-24 05:33:07.444239 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-24 05:33:07.444355 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-24 05:33:07.444371 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:33:07.444383 | orchestrator | 2026-04-24 05:33:07.444395 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:33:07.444407 | orchestrator | Friday 24 April 2026 05:32:32 +0000 (0:00:01.986) 0:30:14.494 ********** 2026-04-24 05:33:07.444419 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-24 05:33:07.444430 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-24 05:33:07.444440 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-24 05:33:07.444450 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.444460 | orchestrator | 2026-04-24 05:33:07.444471 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:33:07.444483 | orchestrator | Friday 24 April 2026 05:32:34 +0000 (0:00:01.238) 0:30:15.733 ********** 2026-04-24 05:33:07.444494 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.444505 | orchestrator | 2026-04-24 05:33:07.444515 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:33:07.444525 | orchestrator | Friday 24 April 2026 05:32:35 +0000 (0:00:01.112) 0:30:16.846 ********** 2026-04-24 05:33:07.444535 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:33:07.444547 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:33:07.444582 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:33:07.444592 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:33:07.444700 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:33:07.444717 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:33:07.444728 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:33:07.444739 | orchestrator | 2026-04-24 05:33:07.444750 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:33:07.444760 | orchestrator | Friday 24 April 2026 05:32:37 +0000 (0:00:02.250) 0:30:19.096 ********** 2026-04-24 05:33:07.444770 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:33:07.444782 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:33:07.444793 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:33:07.444805 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:33:07.444816 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:33:07.444828 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:33:07.444840 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:33:07.444851 | orchestrator | 2026-04-24 05:33:07.444862 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:33:07.444873 | orchestrator | Friday 24 April 2026 05:32:39 +0000 (0:00:02.598) 0:30:21.695 ********** 2026-04-24 05:33:07.444885 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-2 2026-04-24 05:33:07.444897 | orchestrator | 2026-04-24 05:33:07.444908 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:33:07.444920 | orchestrator | Friday 24 April 2026 05:32:41 +0000 (0:00:01.096) 0:30:22.791 ********** 2026-04-24 05:33:07.444931 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-2 2026-04-24 05:33:07.444942 | orchestrator | 2026-04-24 05:33:07.444953 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:33:07.444964 | orchestrator | Friday 24 April 2026 05:32:42 +0000 (0:00:01.102) 0:30:23.894 ********** 2026-04-24 05:33:07.444976 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:07.444987 | orchestrator | 2026-04-24 05:33:07.444999 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:33:07.445010 | orchestrator | Friday 24 April 2026 05:32:43 +0000 (0:00:01.548) 0:30:25.442 ********** 2026-04-24 05:33:07.445022 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445033 | orchestrator | 2026-04-24 05:33:07.445044 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:33:07.445056 | orchestrator | Friday 24 April 2026 05:32:44 +0000 (0:00:01.121) 0:30:26.563 ********** 2026-04-24 05:33:07.445067 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445078 | orchestrator | 2026-04-24 05:33:07.445090 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:33:07.445101 | orchestrator | Friday 24 April 2026 05:32:45 +0000 (0:00:01.118) 0:30:27.682 ********** 2026-04-24 05:33:07.445113 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445124 | orchestrator | 2026-04-24 05:33:07.445135 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:33:07.445146 | orchestrator | Friday 24 April 2026 05:32:47 +0000 (0:00:01.157) 0:30:28.840 ********** 2026-04-24 05:33:07.445157 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:07.445167 | orchestrator | 2026-04-24 05:33:07.445178 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:33:07.445198 | orchestrator | Friday 24 April 2026 05:32:48 +0000 (0:00:01.531) 0:30:30.371 ********** 2026-04-24 05:33:07.445207 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445216 | orchestrator | 2026-04-24 05:33:07.445225 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:33:07.445255 | orchestrator | Friday 24 April 2026 05:32:49 +0000 (0:00:01.100) 0:30:31.472 ********** 2026-04-24 05:33:07.445264 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445273 | orchestrator | 2026-04-24 05:33:07.445283 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:33:07.445292 | orchestrator | Friday 24 April 2026 05:32:50 +0000 (0:00:01.141) 0:30:32.614 ********** 2026-04-24 05:33:07.445301 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:07.445311 | orchestrator | 2026-04-24 05:33:07.445320 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:33:07.445330 | orchestrator | Friday 24 April 2026 05:32:52 +0000 (0:00:01.552) 0:30:34.166 ********** 2026-04-24 05:33:07.445339 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:07.445348 | orchestrator | 2026-04-24 05:33:07.445358 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:33:07.445366 | orchestrator | Friday 24 April 2026 05:32:53 +0000 (0:00:01.533) 0:30:35.700 ********** 2026-04-24 05:33:07.445375 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445384 | orchestrator | 2026-04-24 05:33:07.445393 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:33:07.445403 | orchestrator | Friday 24 April 2026 05:32:54 +0000 (0:00:00.755) 0:30:36.455 ********** 2026-04-24 05:33:07.445412 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:07.445421 | orchestrator | 2026-04-24 05:33:07.445431 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:33:07.445440 | orchestrator | Friday 24 April 2026 05:32:55 +0000 (0:00:00.833) 0:30:37.288 ********** 2026-04-24 05:33:07.445449 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445459 | orchestrator | 2026-04-24 05:33:07.445468 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:33:07.445478 | orchestrator | Friday 24 April 2026 05:32:56 +0000 (0:00:00.756) 0:30:38.045 ********** 2026-04-24 05:33:07.445493 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445503 | orchestrator | 2026-04-24 05:33:07.445512 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:33:07.445522 | orchestrator | Friday 24 April 2026 05:32:57 +0000 (0:00:00.776) 0:30:38.822 ********** 2026-04-24 05:33:07.445531 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445540 | orchestrator | 2026-04-24 05:33:07.445549 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:33:07.445558 | orchestrator | Friday 24 April 2026 05:32:57 +0000 (0:00:00.762) 0:30:39.584 ********** 2026-04-24 05:33:07.445568 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445578 | orchestrator | 2026-04-24 05:33:07.445587 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:33:07.445595 | orchestrator | Friday 24 April 2026 05:32:58 +0000 (0:00:00.792) 0:30:40.376 ********** 2026-04-24 05:33:07.445604 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445630 | orchestrator | 2026-04-24 05:33:07.445639 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:33:07.445648 | orchestrator | Friday 24 April 2026 05:32:59 +0000 (0:00:00.798) 0:30:41.175 ********** 2026-04-24 05:33:07.445657 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:07.445666 | orchestrator | 2026-04-24 05:33:07.445675 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:33:07.445683 | orchestrator | Friday 24 April 2026 05:33:00 +0000 (0:00:00.775) 0:30:41.951 ********** 2026-04-24 05:33:07.445692 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:07.445701 | orchestrator | 2026-04-24 05:33:07.445709 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:33:07.445718 | orchestrator | Friday 24 April 2026 05:33:01 +0000 (0:00:00.782) 0:30:42.733 ********** 2026-04-24 05:33:07.445734 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:07.445743 | orchestrator | 2026-04-24 05:33:07.445752 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:33:07.445762 | orchestrator | Friday 24 April 2026 05:33:01 +0000 (0:00:00.855) 0:30:43.589 ********** 2026-04-24 05:33:07.445771 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445780 | orchestrator | 2026-04-24 05:33:07.445789 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:33:07.445798 | orchestrator | Friday 24 April 2026 05:33:02 +0000 (0:00:00.851) 0:30:44.440 ********** 2026-04-24 05:33:07.445806 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445815 | orchestrator | 2026-04-24 05:33:07.445824 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:33:07.445833 | orchestrator | Friday 24 April 2026 05:33:03 +0000 (0:00:00.782) 0:30:45.223 ********** 2026-04-24 05:33:07.445842 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445851 | orchestrator | 2026-04-24 05:33:07.445860 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:33:07.445869 | orchestrator | Friday 24 April 2026 05:33:04 +0000 (0:00:00.779) 0:30:46.002 ********** 2026-04-24 05:33:07.445879 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445887 | orchestrator | 2026-04-24 05:33:07.445896 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:33:07.445905 | orchestrator | Friday 24 April 2026 05:33:05 +0000 (0:00:00.760) 0:30:46.763 ********** 2026-04-24 05:33:07.445914 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445923 | orchestrator | 2026-04-24 05:33:07.445932 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:33:07.445940 | orchestrator | Friday 24 April 2026 05:33:05 +0000 (0:00:00.785) 0:30:47.549 ********** 2026-04-24 05:33:07.445950 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445958 | orchestrator | 2026-04-24 05:33:07.445967 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:33:07.445976 | orchestrator | Friday 24 April 2026 05:33:06 +0000 (0:00:00.766) 0:30:48.316 ********** 2026-04-24 05:33:07.445984 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:07.445993 | orchestrator | 2026-04-24 05:33:07.446001 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:33:07.446010 | orchestrator | Friday 24 April 2026 05:33:07 +0000 (0:00:00.784) 0:30:49.100 ********** 2026-04-24 05:33:07.446073 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498207 | orchestrator | 2026-04-24 05:33:52.498324 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:33:52.498343 | orchestrator | Friday 24 April 2026 05:33:08 +0000 (0:00:00.768) 0:30:49.869 ********** 2026-04-24 05:33:52.498355 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498368 | orchestrator | 2026-04-24 05:33:52.498379 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:33:52.498391 | orchestrator | Friday 24 April 2026 05:33:08 +0000 (0:00:00.816) 0:30:50.686 ********** 2026-04-24 05:33:52.498401 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498412 | orchestrator | 2026-04-24 05:33:52.498423 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:33:52.498434 | orchestrator | Friday 24 April 2026 05:33:09 +0000 (0:00:00.788) 0:30:51.475 ********** 2026-04-24 05:33:52.498445 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498456 | orchestrator | 2026-04-24 05:33:52.498467 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:33:52.498478 | orchestrator | Friday 24 April 2026 05:33:10 +0000 (0:00:00.770) 0:30:52.246 ********** 2026-04-24 05:33:52.498489 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498499 | orchestrator | 2026-04-24 05:33:52.498510 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:33:52.498546 | orchestrator | Friday 24 April 2026 05:33:11 +0000 (0:00:00.779) 0:30:53.025 ********** 2026-04-24 05:33:52.498558 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:52.498569 | orchestrator | 2026-04-24 05:33:52.498610 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:33:52.498627 | orchestrator | Friday 24 April 2026 05:33:12 +0000 (0:00:01.609) 0:30:54.634 ********** 2026-04-24 05:33:52.498638 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:52.498648 | orchestrator | 2026-04-24 05:33:52.498673 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:33:52.498685 | orchestrator | Friday 24 April 2026 05:33:15 +0000 (0:00:02.101) 0:30:56.736 ********** 2026-04-24 05:33:52.498695 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-2 2026-04-24 05:33:52.498707 | orchestrator | 2026-04-24 05:33:52.498717 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:33:52.498728 | orchestrator | Friday 24 April 2026 05:33:16 +0000 (0:00:01.123) 0:30:57.859 ********** 2026-04-24 05:33:52.498739 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498751 | orchestrator | 2026-04-24 05:33:52.498762 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:33:52.498772 | orchestrator | Friday 24 April 2026 05:33:17 +0000 (0:00:01.175) 0:30:59.035 ********** 2026-04-24 05:33:52.498783 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498794 | orchestrator | 2026-04-24 05:33:52.498805 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:33:52.498815 | orchestrator | Friday 24 April 2026 05:33:18 +0000 (0:00:01.108) 0:31:00.143 ********** 2026-04-24 05:33:52.498826 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:33:52.498837 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:33:52.498848 | orchestrator | 2026-04-24 05:33:52.498859 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:33:52.498869 | orchestrator | Friday 24 April 2026 05:33:20 +0000 (0:00:01.792) 0:31:01.936 ********** 2026-04-24 05:33:52.498880 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:52.498891 | orchestrator | 2026-04-24 05:33:52.498901 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:33:52.498912 | orchestrator | Friday 24 April 2026 05:33:21 +0000 (0:00:01.457) 0:31:03.393 ********** 2026-04-24 05:33:52.498923 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498933 | orchestrator | 2026-04-24 05:33:52.498944 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:33:52.498955 | orchestrator | Friday 24 April 2026 05:33:22 +0000 (0:00:01.132) 0:31:04.526 ********** 2026-04-24 05:33:52.498966 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.498976 | orchestrator | 2026-04-24 05:33:52.499000 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:33:52.499012 | orchestrator | Friday 24 April 2026 05:33:23 +0000 (0:00:00.765) 0:31:05.292 ********** 2026-04-24 05:33:52.499034 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499045 | orchestrator | 2026-04-24 05:33:52.499056 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:33:52.499067 | orchestrator | Friday 24 April 2026 05:33:24 +0000 (0:00:00.818) 0:31:06.110 ********** 2026-04-24 05:33:52.499077 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-2 2026-04-24 05:33:52.499088 | orchestrator | 2026-04-24 05:33:52.499098 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:33:52.499109 | orchestrator | Friday 24 April 2026 05:33:25 +0000 (0:00:01.120) 0:31:07.230 ********** 2026-04-24 05:33:52.499119 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:52.499130 | orchestrator | 2026-04-24 05:33:52.499140 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:33:52.499160 | orchestrator | Friday 24 April 2026 05:33:28 +0000 (0:00:02.612) 0:31:09.843 ********** 2026-04-24 05:33:52.499171 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:33:52.499182 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:33:52.499192 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:33:52.499202 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499213 | orchestrator | 2026-04-24 05:33:52.499224 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:33:52.499234 | orchestrator | Friday 24 April 2026 05:33:29 +0000 (0:00:01.156) 0:31:10.999 ********** 2026-04-24 05:33:52.499262 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499273 | orchestrator | 2026-04-24 05:33:52.499284 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:33:52.499294 | orchestrator | Friday 24 April 2026 05:33:30 +0000 (0:00:01.177) 0:31:12.177 ********** 2026-04-24 05:33:52.499305 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499316 | orchestrator | 2026-04-24 05:33:52.499326 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:33:52.499337 | orchestrator | Friday 24 April 2026 05:33:31 +0000 (0:00:01.184) 0:31:13.361 ********** 2026-04-24 05:33:52.499348 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499358 | orchestrator | 2026-04-24 05:33:52.499369 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:33:52.499380 | orchestrator | Friday 24 April 2026 05:33:32 +0000 (0:00:01.149) 0:31:14.511 ********** 2026-04-24 05:33:52.499391 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499401 | orchestrator | 2026-04-24 05:33:52.499412 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:33:52.499422 | orchestrator | Friday 24 April 2026 05:33:33 +0000 (0:00:01.160) 0:31:15.671 ********** 2026-04-24 05:33:52.499433 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499443 | orchestrator | 2026-04-24 05:33:52.499454 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:33:52.499465 | orchestrator | Friday 24 April 2026 05:33:34 +0000 (0:00:00.792) 0:31:16.464 ********** 2026-04-24 05:33:52.499475 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:52.499486 | orchestrator | 2026-04-24 05:33:52.499496 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:33:52.499507 | orchestrator | Friday 24 April 2026 05:33:36 +0000 (0:00:02.177) 0:31:18.641 ********** 2026-04-24 05:33:52.499517 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:52.499528 | orchestrator | 2026-04-24 05:33:52.499544 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:33:52.499555 | orchestrator | Friday 24 April 2026 05:33:37 +0000 (0:00:00.802) 0:31:19.444 ********** 2026-04-24 05:33:52.499566 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-2 2026-04-24 05:33:52.499608 | orchestrator | 2026-04-24 05:33:52.499620 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:33:52.499644 | orchestrator | Friday 24 April 2026 05:33:38 +0000 (0:00:01.114) 0:31:20.558 ********** 2026-04-24 05:33:52.499655 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499666 | orchestrator | 2026-04-24 05:33:52.499676 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:33:52.499687 | orchestrator | Friday 24 April 2026 05:33:39 +0000 (0:00:01.127) 0:31:21.686 ********** 2026-04-24 05:33:52.499698 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499708 | orchestrator | 2026-04-24 05:33:52.499719 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:33:52.499730 | orchestrator | Friday 24 April 2026 05:33:41 +0000 (0:00:01.149) 0:31:22.835 ********** 2026-04-24 05:33:52.499741 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499751 | orchestrator | 2026-04-24 05:33:52.499762 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:33:52.499780 | orchestrator | Friday 24 April 2026 05:33:42 +0000 (0:00:01.153) 0:31:23.988 ********** 2026-04-24 05:33:52.499791 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499801 | orchestrator | 2026-04-24 05:33:52.499812 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:33:52.499823 | orchestrator | Friday 24 April 2026 05:33:43 +0000 (0:00:01.140) 0:31:25.128 ********** 2026-04-24 05:33:52.499833 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499844 | orchestrator | 2026-04-24 05:33:52.499855 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:33:52.499866 | orchestrator | Friday 24 April 2026 05:33:44 +0000 (0:00:01.139) 0:31:26.268 ********** 2026-04-24 05:33:52.499876 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499887 | orchestrator | 2026-04-24 05:33:52.499898 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:33:52.499909 | orchestrator | Friday 24 April 2026 05:33:45 +0000 (0:00:01.147) 0:31:27.416 ********** 2026-04-24 05:33:52.499919 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499930 | orchestrator | 2026-04-24 05:33:52.499941 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:33:52.499951 | orchestrator | Friday 24 April 2026 05:33:46 +0000 (0:00:01.166) 0:31:28.583 ********** 2026-04-24 05:33:52.499962 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:33:52.499973 | orchestrator | 2026-04-24 05:33:52.499984 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:33:52.499994 | orchestrator | Friday 24 April 2026 05:33:48 +0000 (0:00:01.167) 0:31:29.751 ********** 2026-04-24 05:33:52.500005 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:33:52.500016 | orchestrator | 2026-04-24 05:33:52.500027 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:33:52.500037 | orchestrator | Friday 24 April 2026 05:33:48 +0000 (0:00:00.794) 0:31:30.546 ********** 2026-04-24 05:33:52.500048 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-2 2026-04-24 05:33:52.500059 | orchestrator | 2026-04-24 05:33:52.500070 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:33:52.500080 | orchestrator | Friday 24 April 2026 05:33:49 +0000 (0:00:01.116) 0:31:31.662 ********** 2026-04-24 05:33:52.500091 | orchestrator | ok: [testbed-node-2] => (item=/etc/ceph) 2026-04-24 05:33:52.500102 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-24 05:33:52.500113 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-24 05:33:52.500124 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-24 05:33:52.500134 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-24 05:33:52.500145 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-24 05:33:52.500163 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-24 05:34:30.796206 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:34:30.796307 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:34:30.796320 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:34:30.796330 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:34:30.796339 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:34:30.796348 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:34:30.796357 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:34:30.796366 | orchestrator | ok: [testbed-node-2] => (item=/var/run/ceph) 2026-04-24 05:34:30.796375 | orchestrator | ok: [testbed-node-2] => (item=/var/log/ceph) 2026-04-24 05:34:30.796385 | orchestrator | 2026-04-24 05:34:30.796395 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:34:30.796425 | orchestrator | Friday 24 April 2026 05:33:56 +0000 (0:00:06.377) 0:31:38.040 ********** 2026-04-24 05:34:30.796435 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796445 | orchestrator | 2026-04-24 05:34:30.796454 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:34:30.796463 | orchestrator | Friday 24 April 2026 05:33:57 +0000 (0:00:00.761) 0:31:38.801 ********** 2026-04-24 05:34:30.796472 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796481 | orchestrator | 2026-04-24 05:34:30.796489 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:34:30.796498 | orchestrator | Friday 24 April 2026 05:33:57 +0000 (0:00:00.761) 0:31:39.563 ********** 2026-04-24 05:34:30.796507 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796515 | orchestrator | 2026-04-24 05:34:30.796537 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:34:30.796546 | orchestrator | Friday 24 April 2026 05:33:58 +0000 (0:00:00.782) 0:31:40.346 ********** 2026-04-24 05:34:30.796596 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796605 | orchestrator | 2026-04-24 05:34:30.796614 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:34:30.796623 | orchestrator | Friday 24 April 2026 05:33:59 +0000 (0:00:00.820) 0:31:41.167 ********** 2026-04-24 05:34:30.796632 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796641 | orchestrator | 2026-04-24 05:34:30.796649 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:34:30.796658 | orchestrator | Friday 24 April 2026 05:34:00 +0000 (0:00:00.759) 0:31:41.927 ********** 2026-04-24 05:34:30.796667 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796676 | orchestrator | 2026-04-24 05:34:30.796685 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:34:30.796695 | orchestrator | Friday 24 April 2026 05:34:01 +0000 (0:00:00.811) 0:31:42.738 ********** 2026-04-24 05:34:30.796704 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796713 | orchestrator | 2026-04-24 05:34:30.796722 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:34:30.796730 | orchestrator | Friday 24 April 2026 05:34:01 +0000 (0:00:00.803) 0:31:43.541 ********** 2026-04-24 05:34:30.796739 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796748 | orchestrator | 2026-04-24 05:34:30.796759 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:34:30.796768 | orchestrator | Friday 24 April 2026 05:34:02 +0000 (0:00:00.774) 0:31:44.316 ********** 2026-04-24 05:34:30.796779 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796789 | orchestrator | 2026-04-24 05:34:30.796799 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:34:30.796810 | orchestrator | Friday 24 April 2026 05:34:03 +0000 (0:00:00.822) 0:31:45.138 ********** 2026-04-24 05:34:30.796820 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796830 | orchestrator | 2026-04-24 05:34:30.796840 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:34:30.796850 | orchestrator | Friday 24 April 2026 05:34:04 +0000 (0:00:00.778) 0:31:45.917 ********** 2026-04-24 05:34:30.796861 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796871 | orchestrator | 2026-04-24 05:34:30.796881 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:34:30.796891 | orchestrator | Friday 24 April 2026 05:34:04 +0000 (0:00:00.769) 0:31:46.686 ********** 2026-04-24 05:34:30.796901 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796911 | orchestrator | 2026-04-24 05:34:30.796921 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:34:30.796931 | orchestrator | Friday 24 April 2026 05:34:05 +0000 (0:00:00.767) 0:31:47.454 ********** 2026-04-24 05:34:30.796941 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796951 | orchestrator | 2026-04-24 05:34:30.796968 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:34:30.796978 | orchestrator | Friday 24 April 2026 05:34:06 +0000 (0:00:00.901) 0:31:48.356 ********** 2026-04-24 05:34:30.796989 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.796999 | orchestrator | 2026-04-24 05:34:30.797009 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:34:30.797019 | orchestrator | Friday 24 April 2026 05:34:07 +0000 (0:00:00.781) 0:31:49.137 ********** 2026-04-24 05:34:30.797029 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797039 | orchestrator | 2026-04-24 05:34:30.797049 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:34:30.797060 | orchestrator | Friday 24 April 2026 05:34:08 +0000 (0:00:00.867) 0:31:50.005 ********** 2026-04-24 05:34:30.797070 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797080 | orchestrator | 2026-04-24 05:34:30.797090 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:34:30.797100 | orchestrator | Friday 24 April 2026 05:34:09 +0000 (0:00:00.761) 0:31:50.767 ********** 2026-04-24 05:34:30.797125 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797134 | orchestrator | 2026-04-24 05:34:30.797143 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:34:30.797153 | orchestrator | Friday 24 April 2026 05:34:09 +0000 (0:00:00.779) 0:31:51.546 ********** 2026-04-24 05:34:30.797163 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797171 | orchestrator | 2026-04-24 05:34:30.797180 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:34:30.797189 | orchestrator | Friday 24 April 2026 05:34:10 +0000 (0:00:00.834) 0:31:52.381 ********** 2026-04-24 05:34:30.797198 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797207 | orchestrator | 2026-04-24 05:34:30.797215 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:34:30.797224 | orchestrator | Friday 24 April 2026 05:34:11 +0000 (0:00:00.779) 0:31:53.160 ********** 2026-04-24 05:34:30.797233 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797242 | orchestrator | 2026-04-24 05:34:30.797251 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:34:30.797260 | orchestrator | Friday 24 April 2026 05:34:12 +0000 (0:00:00.769) 0:31:53.929 ********** 2026-04-24 05:34:30.797268 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797277 | orchestrator | 2026-04-24 05:34:30.797286 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:34:30.797295 | orchestrator | Friday 24 April 2026 05:34:13 +0000 (0:00:00.819) 0:31:54.749 ********** 2026-04-24 05:34:30.797304 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:34:30.797313 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:34:30.797321 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:34:30.797335 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797344 | orchestrator | 2026-04-24 05:34:30.797353 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:34:30.797362 | orchestrator | Friday 24 April 2026 05:34:14 +0000 (0:00:01.066) 0:31:55.815 ********** 2026-04-24 05:34:30.797371 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:34:30.797379 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:34:30.797388 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:34:30.797397 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797406 | orchestrator | 2026-04-24 05:34:30.797414 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:34:30.797423 | orchestrator | Friday 24 April 2026 05:34:15 +0000 (0:00:01.039) 0:31:56.854 ********** 2026-04-24 05:34:30.797432 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-24 05:34:30.797447 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-24 05:34:30.797456 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-24 05:34:30.797465 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797474 | orchestrator | 2026-04-24 05:34:30.797483 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:34:30.797491 | orchestrator | Friday 24 April 2026 05:34:16 +0000 (0:00:01.086) 0:31:57.941 ********** 2026-04-24 05:34:30.797500 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797509 | orchestrator | 2026-04-24 05:34:30.797518 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:34:30.797526 | orchestrator | Friday 24 April 2026 05:34:16 +0000 (0:00:00.767) 0:31:58.708 ********** 2026-04-24 05:34:30.797535 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-24 05:34:30.797544 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797568 | orchestrator | 2026-04-24 05:34:30.797577 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:34:30.797586 | orchestrator | Friday 24 April 2026 05:34:17 +0000 (0:00:00.966) 0:31:59.675 ********** 2026-04-24 05:34:30.797595 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:34:30.797604 | orchestrator | 2026-04-24 05:34:30.797613 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:34:30.797622 | orchestrator | Friday 24 April 2026 05:34:19 +0000 (0:00:01.379) 0:32:01.054 ********** 2026-04-24 05:34:30.797630 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:34:30.797640 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:34:30.797649 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-24 05:34:30.797658 | orchestrator | 2026-04-24 05:34:30.797667 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-24 05:34:30.797676 | orchestrator | Friday 24 April 2026 05:34:20 +0000 (0:00:01.634) 0:32:02.688 ********** 2026-04-24 05:34:30.797684 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-2 2026-04-24 05:34:30.797693 | orchestrator | 2026-04-24 05:34:30.797702 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-24 05:34:30.797711 | orchestrator | Friday 24 April 2026 05:34:22 +0000 (0:00:01.244) 0:32:03.933 ********** 2026-04-24 05:34:30.797720 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:34:30.797728 | orchestrator | 2026-04-24 05:34:30.797737 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-24 05:34:30.797746 | orchestrator | Friday 24 April 2026 05:34:23 +0000 (0:00:01.455) 0:32:05.389 ********** 2026-04-24 05:34:30.797755 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:34:30.797764 | orchestrator | 2026-04-24 05:34:30.797772 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-24 05:34:30.797781 | orchestrator | Friday 24 April 2026 05:34:24 +0000 (0:00:01.138) 0:32:06.527 ********** 2026-04-24 05:34:30.797790 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:34:30.797799 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:34:30.797812 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:35:17.111268 | orchestrator | ok: [testbed-node-2 -> {{ groups[mon_group_name][0] }}] 2026-04-24 05:35:17.111386 | orchestrator | 2026-04-24 05:35:17.111402 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-24 05:35:17.111415 | orchestrator | Friday 24 April 2026 05:34:31 +0000 (0:00:07.065) 0:32:13.592 ********** 2026-04-24 05:35:17.111426 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:35:17.111439 | orchestrator | 2026-04-24 05:35:17.111450 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-24 05:35:17.111461 | orchestrator | Friday 24 April 2026 05:34:33 +0000 (0:00:01.151) 0:32:14.744 ********** 2026-04-24 05:35:17.111496 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-24 05:35:17.111508 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-24 05:35:17.111519 | orchestrator | 2026-04-24 05:35:17.111590 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-24 05:35:17.111601 | orchestrator | Friday 24 April 2026 05:34:36 +0000 (0:00:03.167) 0:32:17.911 ********** 2026-04-24 05:35:17.111612 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-24 05:35:17.111623 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-24 05:35:17.111634 | orchestrator | 2026-04-24 05:35:17.111645 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-24 05:35:17.111656 | orchestrator | Friday 24 April 2026 05:34:38 +0000 (0:00:01.969) 0:32:19.881 ********** 2026-04-24 05:35:17.111666 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:35:17.111677 | orchestrator | 2026-04-24 05:35:17.111688 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-24 05:35:17.111699 | orchestrator | Friday 24 April 2026 05:34:39 +0000 (0:00:01.473) 0:32:21.355 ********** 2026-04-24 05:35:17.111709 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:35:17.111721 | orchestrator | 2026-04-24 05:35:17.111747 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-24 05:35:17.111758 | orchestrator | Friday 24 April 2026 05:34:40 +0000 (0:00:00.756) 0:32:22.111 ********** 2026-04-24 05:35:17.111768 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:35:17.111779 | orchestrator | 2026-04-24 05:35:17.111790 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-24 05:35:17.111801 | orchestrator | Friday 24 April 2026 05:34:41 +0000 (0:00:00.750) 0:32:22.862 ********** 2026-04-24 05:35:17.111813 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-2 2026-04-24 05:35:17.111827 | orchestrator | 2026-04-24 05:35:17.111840 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-24 05:35:17.111852 | orchestrator | Friday 24 April 2026 05:34:42 +0000 (0:00:01.127) 0:32:23.990 ********** 2026-04-24 05:35:17.111864 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:35:17.111878 | orchestrator | 2026-04-24 05:35:17.111890 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-24 05:35:17.111902 | orchestrator | Friday 24 April 2026 05:34:43 +0000 (0:00:01.162) 0:32:25.152 ********** 2026-04-24 05:35:17.111914 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:35:17.111927 | orchestrator | 2026-04-24 05:35:17.111939 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-24 05:35:17.111952 | orchestrator | Friday 24 April 2026 05:34:44 +0000 (0:00:01.192) 0:32:26.345 ********** 2026-04-24 05:35:17.111964 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-2 2026-04-24 05:35:17.111977 | orchestrator | 2026-04-24 05:35:17.111989 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-24 05:35:17.112002 | orchestrator | Friday 24 April 2026 05:34:45 +0000 (0:00:01.140) 0:32:27.485 ********** 2026-04-24 05:35:17.112014 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:35:17.112027 | orchestrator | 2026-04-24 05:35:17.112039 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-24 05:35:17.112052 | orchestrator | Friday 24 April 2026 05:34:47 +0000 (0:00:02.054) 0:32:29.540 ********** 2026-04-24 05:35:17.112064 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:35:17.112076 | orchestrator | 2026-04-24 05:35:17.112089 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-24 05:35:17.112101 | orchestrator | Friday 24 April 2026 05:34:49 +0000 (0:00:02.034) 0:32:31.575 ********** 2026-04-24 05:35:17.112113 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:35:17.112125 | orchestrator | 2026-04-24 05:35:17.112138 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-24 05:35:17.112150 | orchestrator | Friday 24 April 2026 05:34:52 +0000 (0:00:02.505) 0:32:34.080 ********** 2026-04-24 05:35:17.112162 | orchestrator | changed: [testbed-node-2] 2026-04-24 05:35:17.112182 | orchestrator | 2026-04-24 05:35:17.112193 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-24 05:35:17.112203 | orchestrator | Friday 24 April 2026 05:34:55 +0000 (0:00:03.600) 0:32:37.681 ********** 2026-04-24 05:35:17.112215 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/mgr_modules.yml for testbed-node-2 2026-04-24 05:35:17.112226 | orchestrator | 2026-04-24 05:35:17.112236 | orchestrator | TASK [ceph-mgr : Wait for all mgr to be up] ************************************ 2026-04-24 05:35:17.112247 | orchestrator | Friday 24 April 2026 05:34:57 +0000 (0:00:01.498) 0:32:39.180 ********** 2026-04-24 05:35:17.112258 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:35:17.112269 | orchestrator | 2026-04-24 05:35:17.112279 | orchestrator | TASK [ceph-mgr : Get enabled modules from ceph-mgr] **************************** 2026-04-24 05:35:17.112290 | orchestrator | Friday 24 April 2026 05:34:59 +0000 (0:00:02.389) 0:32:41.569 ********** 2026-04-24 05:35:17.112301 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:35:17.112311 | orchestrator | 2026-04-24 05:35:17.112322 | orchestrator | TASK [ceph-mgr : Set _ceph_mgr_modules fact (convert _ceph_mgr_modules.stdout to a dict)] *** 2026-04-24 05:35:17.112333 | orchestrator | Friday 24 April 2026 05:35:02 +0000 (0:00:02.288) 0:32:43.858 ********** 2026-04-24 05:35:17.112343 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:35:17.112354 | orchestrator | 2026-04-24 05:35:17.112365 | orchestrator | TASK [ceph-mgr : Set _disabled_ceph_mgr_modules fact] ************************** 2026-04-24 05:35:17.112392 | orchestrator | Friday 24 April 2026 05:35:03 +0000 (0:00:01.372) 0:32:45.230 ********** 2026-04-24 05:35:17.112403 | orchestrator | ok: [testbed-node-2] 2026-04-24 05:35:17.112414 | orchestrator | 2026-04-24 05:35:17.112425 | orchestrator | TASK [ceph-mgr : Disable ceph mgr enabled modules] ***************************** 2026-04-24 05:35:17.112435 | orchestrator | Friday 24 April 2026 05:35:04 +0000 (0:00:01.155) 0:32:46.386 ********** 2026-04-24 05:35:17.112446 | orchestrator | skipping: [testbed-node-2] => (item=dashboard)  2026-04-24 05:35:17.112457 | orchestrator | skipping: [testbed-node-2] => (item=prometheus)  2026-04-24 05:35:17.112468 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:35:17.112479 | orchestrator | 2026-04-24 05:35:17.112489 | orchestrator | TASK [ceph-mgr : Add modules to ceph-mgr] ************************************** 2026-04-24 05:35:17.112500 | orchestrator | Friday 24 April 2026 05:35:06 +0000 (0:00:01.342) 0:32:47.728 ********** 2026-04-24 05:35:17.112511 | orchestrator | skipping: [testbed-node-2] => (item=balancer)  2026-04-24 05:35:17.112522 | orchestrator | skipping: [testbed-node-2] => (item=dashboard)  2026-04-24 05:35:17.112550 | orchestrator | skipping: [testbed-node-2] => (item=prometheus)  2026-04-24 05:35:17.112561 | orchestrator | skipping: [testbed-node-2] => (item=status)  2026-04-24 05:35:17.112572 | orchestrator | skipping: [testbed-node-2] 2026-04-24 05:35:17.112583 | orchestrator | 2026-04-24 05:35:17.112593 | orchestrator | PLAY [Set osd flags] *********************************************************** 2026-04-24 05:35:17.112604 | orchestrator | 2026-04-24 05:35:17.112615 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:35:17.112626 | orchestrator | Friday 24 April 2026 05:35:07 +0000 (0:00:01.757) 0:32:49.486 ********** 2026-04-24 05:35:17.112636 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:35:17.112647 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:35:17.112658 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:35:17.112669 | orchestrator | 2026-04-24 05:35:17.112684 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:35:17.112696 | orchestrator | Friday 24 April 2026 05:35:09 +0000 (0:00:01.651) 0:32:51.138 ********** 2026-04-24 05:35:17.112706 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:35:17.112717 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:35:17.112728 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:35:17.112738 | orchestrator | 2026-04-24 05:35:17.112749 | orchestrator | TASK [Get pool list] *********************************************************** 2026-04-24 05:35:17.112760 | orchestrator | Friday 24 April 2026 05:35:10 +0000 (0:00:01.393) 0:32:52.531 ********** 2026-04-24 05:35:17.112777 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:35:17.112788 | orchestrator | 2026-04-24 05:35:17.112799 | orchestrator | TASK [Get balancer module status] ********************************************** 2026-04-24 05:35:17.112809 | orchestrator | Friday 24 April 2026 05:35:13 +0000 (0:00:02.969) 0:32:55.500 ********** 2026-04-24 05:35:17.112820 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:35:17.112831 | orchestrator | 2026-04-24 05:35:17.112842 | orchestrator | TASK [Set_fact pools_pgautoscaler_mode] **************************************** 2026-04-24 05:35:17.112853 | orchestrator | Friday 24 April 2026 05:35:16 +0000 (0:00:02.993) 0:32:58.494 ********** 2026-04-24 05:35:17.112870 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 1, 'pool_name': '.mgr', 'create_time': '2026-04-24T03:02:58.324019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:17.112903 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 2, 'pool_name': 'cephfs_data', 'create_time': '2026-04-24T03:04:08.252885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '31', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:17.533812 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2026-04-24T03:04:11.878890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '31', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:17.533968 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 4, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2026-04-24T03:05:10.457377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '69', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:17.534088 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 5, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2026-04-24T03:05:15.884226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '69', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:17.534117 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 6, 'pool_name': 'default.rgw.control', 'create_time': '2026-04-24T03:05:22.043969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '71', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 1, 'raw_score_acting': 2.059999942779541, 'raw_score_stable': 2.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:17.534153 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 7, 'pool_name': 'default.rgw.log', 'create_time': '2026-04-24T03:05:28.275606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '170', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '71', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:18.293340 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2026-04-24T03:05:34.640272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '73', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:18.293469 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 9, 'pool_name': '.rgw.root', 'create_time': '2026-04-24T03:05:46.498470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '73', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:18.293515 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 10, 'pool_name': 'backups', 'create_time': '2026-04-24T03:06:33.052075+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 1, 'raw_score_acting': 2.059999942779541, 'raw_score_stable': 2.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:18.293613 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 11, 'pool_name': 'volumes', 'create_time': '2026-04-24T03:06:42.445375+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:35:18.293643 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 12, 'pool_name': 'images', 'create_time': '2026-04-24T03:06:51.739273+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 6, 'snap_epoch': 180, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:36:53.871597 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 13, 'pool_name': 'metrics', 'create_time': '2026-04-24T03:07:00.466120+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 117, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:36:53.871735 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 14, 'pool_name': 'vms', 'create_time': '2026-04-24T03:07:09.319657+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 124, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-24 05:36:53.871770 | orchestrator | 2026-04-24 05:36:53.871802 | orchestrator | TASK [Disable balancer] ******************************************************** 2026-04-24 05:36:53.871814 | orchestrator | Friday 24 April 2026 05:35:19 +0000 (0:00:02.847) 0:33:01.341 ********** 2026-04-24 05:36:53.871823 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:36:53.871832 | orchestrator | 2026-04-24 05:36:53.871842 | orchestrator | TASK [Disable pg autoscale on pools] ******************************************* 2026-04-24 05:36:53.871850 | orchestrator | Friday 24 April 2026 05:35:22 +0000 (0:00:02.732) 0:33:04.074 ********** 2026-04-24 05:36:53.871859 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.mgr', 'mode': 'on'}) 2026-04-24 05:36:53.871869 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_data', 'mode': 'on'}) 2026-04-24 05:36:53.871878 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_metadata', 'mode': 'on'}) 2026-04-24 05:36:53.871887 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.data', 'mode': 'on'}) 2026-04-24 05:36:53.871897 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.index', 'mode': 'on'}) 2026-04-24 05:36:53.871906 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.control', 'mode': 'on'}) 2026-04-24 05:36:53.871914 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.log', 'mode': 'on'}) 2026-04-24 05:36:53.871923 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.meta', 'mode': 'on'}) 2026-04-24 05:36:53.871932 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.rgw.root', 'mode': 'on'}) 2026-04-24 05:36:53.871941 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'backups', 'mode': 'off'})  2026-04-24 05:36:53.871949 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'volumes', 'mode': 'off'})  2026-04-24 05:36:53.871958 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'images', 'mode': 'off'})  2026-04-24 05:36:53.871967 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'metrics', 'mode': 'off'})  2026-04-24 05:36:53.871975 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vms', 'mode': 'off'})  2026-04-24 05:36:53.871984 | orchestrator | 2026-04-24 05:36:53.871992 | orchestrator | TASK [Set osd flags] *********************************************************** 2026-04-24 05:36:53.872001 | orchestrator | Friday 24 April 2026 05:36:37 +0000 (0:01:15.614) 0:34:19.689 ********** 2026-04-24 05:36:53.872010 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=noout) 2026-04-24 05:36:53.872018 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=nodeep-scrub) 2026-04-24 05:36:53.872027 | orchestrator | 2026-04-24 05:36:53.872035 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-24 05:36:53.872050 | orchestrator | 2026-04-24 05:36:53.872059 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:36:53.872068 | orchestrator | Friday 24 April 2026 05:36:43 +0000 (0:00:05.913) 0:34:25.602 ********** 2026-04-24 05:36:53.872076 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3 2026-04-24 05:36:53.872085 | orchestrator | 2026-04-24 05:36:53.872095 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:36:53.872105 | orchestrator | Friday 24 April 2026 05:36:45 +0000 (0:00:01.159) 0:34:26.762 ********** 2026-04-24 05:36:53.872117 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:36:53.872127 | orchestrator | 2026-04-24 05:36:53.872137 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:36:53.872147 | orchestrator | Friday 24 April 2026 05:36:46 +0000 (0:00:01.449) 0:34:28.211 ********** 2026-04-24 05:36:53.872158 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:36:53.872168 | orchestrator | 2026-04-24 05:36:53.872177 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:36:53.872188 | orchestrator | Friday 24 April 2026 05:36:47 +0000 (0:00:01.199) 0:34:29.410 ********** 2026-04-24 05:36:53.872197 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:36:53.872207 | orchestrator | 2026-04-24 05:36:53.872218 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:36:53.872228 | orchestrator | Friday 24 April 2026 05:36:49 +0000 (0:00:01.524) 0:34:30.935 ********** 2026-04-24 05:36:53.872237 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:36:53.872247 | orchestrator | 2026-04-24 05:36:53.872262 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:36:53.872272 | orchestrator | Friday 24 April 2026 05:36:50 +0000 (0:00:01.150) 0:34:32.086 ********** 2026-04-24 05:36:53.872282 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:36:53.872291 | orchestrator | 2026-04-24 05:36:53.872301 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:36:53.872311 | orchestrator | Friday 24 April 2026 05:36:51 +0000 (0:00:01.135) 0:34:33.221 ********** 2026-04-24 05:36:53.872321 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:36:53.872331 | orchestrator | 2026-04-24 05:36:53.872341 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:36:53.872351 | orchestrator | Friday 24 April 2026 05:36:52 +0000 (0:00:01.194) 0:34:34.415 ********** 2026-04-24 05:36:53.872361 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:36:53.872371 | orchestrator | 2026-04-24 05:36:53.872381 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:36:53.872396 | orchestrator | Friday 24 April 2026 05:36:53 +0000 (0:00:01.155) 0:34:35.571 ********** 2026-04-24 05:37:18.142253 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:37:18.142383 | orchestrator | 2026-04-24 05:37:18.142400 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:37:18.142414 | orchestrator | Friday 24 April 2026 05:36:55 +0000 (0:00:01.162) 0:34:36.733 ********** 2026-04-24 05:37:18.142427 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:37:18.142439 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:37:18.142450 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:37:18.142506 | orchestrator | 2026-04-24 05:37:18.142518 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:37:18.142529 | orchestrator | Friday 24 April 2026 05:36:57 +0000 (0:00:02.045) 0:34:38.778 ********** 2026-04-24 05:37:18.142540 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:37:18.142551 | orchestrator | 2026-04-24 05:37:18.142562 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:37:18.142573 | orchestrator | Friday 24 April 2026 05:36:58 +0000 (0:00:01.226) 0:34:40.005 ********** 2026-04-24 05:37:18.142584 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:37:18.142626 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:37:18.142638 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:37:18.142648 | orchestrator | 2026-04-24 05:37:18.142659 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:37:18.142670 | orchestrator | Friday 24 April 2026 05:37:01 +0000 (0:00:03.215) 0:34:43.220 ********** 2026-04-24 05:37:18.142681 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 05:37:18.142692 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 05:37:18.142703 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 05:37:18.142714 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:18.142725 | orchestrator | 2026-04-24 05:37:18.142735 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:37:18.142746 | orchestrator | Friday 24 April 2026 05:37:03 +0000 (0:00:01.741) 0:34:44.962 ********** 2026-04-24 05:37:18.142758 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:37:18.142772 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:37:18.142783 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:37:18.142794 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:18.142805 | orchestrator | 2026-04-24 05:37:18.142816 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:37:18.142826 | orchestrator | Friday 24 April 2026 05:37:05 +0000 (0:00:01.949) 0:34:46.912 ********** 2026-04-24 05:37:18.142839 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:18.142870 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:18.142882 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:18.142893 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:18.142904 | orchestrator | 2026-04-24 05:37:18.142915 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:37:18.142932 | orchestrator | Friday 24 April 2026 05:37:06 +0000 (0:00:01.199) 0:34:48.111 ********** 2026-04-24 05:37:18.142974 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:36:58.830470', 'end': '2026-04-24 05:36:58.880377', 'delta': '0:00:00.049907', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:37:18.142998 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:36:59.745007', 'end': '2026-04-24 05:36:59.790633', 'delta': '0:00:00.045626', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:37:18.143010 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:37:00.277389', 'end': '2026-04-24 05:37:00.318069', 'delta': '0:00:00.040680', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:37:18.143021 | orchestrator | 2026-04-24 05:37:18.143032 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:37:18.143043 | orchestrator | Friday 24 April 2026 05:37:07 +0000 (0:00:01.243) 0:34:49.355 ********** 2026-04-24 05:37:18.143054 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:37:18.143065 | orchestrator | 2026-04-24 05:37:18.143076 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:37:18.143086 | orchestrator | Friday 24 April 2026 05:37:08 +0000 (0:00:01.288) 0:34:50.643 ********** 2026-04-24 05:37:18.143097 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:18.143108 | orchestrator | 2026-04-24 05:37:18.143118 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:37:18.143129 | orchestrator | Friday 24 April 2026 05:37:10 +0000 (0:00:01.264) 0:34:51.907 ********** 2026-04-24 05:37:18.143140 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:37:18.143151 | orchestrator | 2026-04-24 05:37:18.143161 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:37:18.143172 | orchestrator | Friday 24 April 2026 05:37:11 +0000 (0:00:01.146) 0:34:53.054 ********** 2026-04-24 05:37:18.143183 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:37:18.143194 | orchestrator | 2026-04-24 05:37:18.143204 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:37:18.143215 | orchestrator | Friday 24 April 2026 05:37:13 +0000 (0:00:01.985) 0:34:55.039 ********** 2026-04-24 05:37:18.143226 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:37:18.143236 | orchestrator | 2026-04-24 05:37:18.143247 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:37:18.143258 | orchestrator | Friday 24 April 2026 05:37:14 +0000 (0:00:01.176) 0:34:56.216 ********** 2026-04-24 05:37:18.143269 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:18.143286 | orchestrator | 2026-04-24 05:37:18.143297 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:37:18.143308 | orchestrator | Friday 24 April 2026 05:37:15 +0000 (0:00:01.128) 0:34:57.345 ********** 2026-04-24 05:37:18.143318 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:18.143329 | orchestrator | 2026-04-24 05:37:18.143339 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:37:18.143350 | orchestrator | Friday 24 April 2026 05:37:16 +0000 (0:00:01.259) 0:34:58.605 ********** 2026-04-24 05:37:18.143361 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:18.143371 | orchestrator | 2026-04-24 05:37:18.143382 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:37:18.143393 | orchestrator | Friday 24 April 2026 05:37:18 +0000 (0:00:01.118) 0:34:59.723 ********** 2026-04-24 05:37:18.143404 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:18.143414 | orchestrator | 2026-04-24 05:37:18.143433 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:37:25.110994 | orchestrator | Friday 24 April 2026 05:37:19 +0000 (0:00:01.091) 0:35:00.815 ********** 2026-04-24 05:37:25.111096 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:37:25.111114 | orchestrator | 2026-04-24 05:37:25.111127 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:37:25.111139 | orchestrator | Friday 24 April 2026 05:37:20 +0000 (0:00:01.144) 0:35:01.960 ********** 2026-04-24 05:37:25.111151 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:25.111164 | orchestrator | 2026-04-24 05:37:25.111176 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:37:25.111187 | orchestrator | Friday 24 April 2026 05:37:21 +0000 (0:00:01.155) 0:35:03.115 ********** 2026-04-24 05:37:25.111199 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:37:25.111211 | orchestrator | 2026-04-24 05:37:25.111222 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:37:25.111233 | orchestrator | Friday 24 April 2026 05:37:22 +0000 (0:00:01.194) 0:35:04.310 ********** 2026-04-24 05:37:25.111245 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:25.111256 | orchestrator | 2026-04-24 05:37:25.111268 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:37:25.111280 | orchestrator | Friday 24 April 2026 05:37:23 +0000 (0:00:01.132) 0:35:05.443 ********** 2026-04-24 05:37:25.111292 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:37:25.111303 | orchestrator | 2026-04-24 05:37:25.111314 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:37:25.111326 | orchestrator | Friday 24 April 2026 05:37:24 +0000 (0:00:01.169) 0:35:06.613 ********** 2026-04-24 05:37:25.111340 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:37:25.111355 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'uuids': ['6d15df4f-c4ce-4002-ae8a-c5ea103b6315'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R']}})  2026-04-24 05:37:25.111370 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '92dd2642', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:37:25.111539 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3']}})  2026-04-24 05:37:25.111571 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:37:25.111605 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:37:25.111621 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-05-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:37:25.111634 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:37:25.111647 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx', 'dm-uuid-CRYPT-LUKS2-7bd2335635b44d1cb53d2df716853f40-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:37:25.111660 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:37:25.111685 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'uuids': ['7bd23356-35b4-4d1c-b53d-2df716853f40'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx']}})  2026-04-24 05:37:25.111705 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f']}})  2026-04-24 05:37:25.111726 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:37:26.408300 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3ccf7d33', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:37:26.408430 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:37:26.408448 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:37:26.408543 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R', 'dm-uuid-CRYPT-LUKS2-6d15df4fc4ce4002ae8ac5ea103b6315-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:37:26.408559 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:37:26.408572 | orchestrator | 2026-04-24 05:37:26.408584 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:37:26.408596 | orchestrator | Friday 24 April 2026 05:37:26 +0000 (0:00:01.339) 0:35:07.953 ********** 2026-04-24 05:37:26.408628 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.408642 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'uuids': ['6d15df4f-c4ce-4002-ae8a-c5ea103b6315'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.408655 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '92dd2642', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.408675 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.408693 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.408712 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527166 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-05-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527264 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527303 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx', 'dm-uuid-CRYPT-LUKS2-7bd2335635b44d1cb53d2df716853f40-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527316 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527343 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'uuids': ['7bd23356-35b4-4d1c-b53d-2df716853f40'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527376 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527392 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527419 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3ccf7d33', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527433 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:37:26.527452 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:38:05.045117 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R', 'dm-uuid-CRYPT-LUKS2-6d15df4fc4ce4002ae8ac5ea103b6315-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:38:05.045258 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.045275 | orchestrator | 2026-04-24 05:38:05.045286 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:38:05.045298 | orchestrator | Friday 24 April 2026 05:37:27 +0000 (0:00:01.404) 0:35:09.358 ********** 2026-04-24 05:38:05.045310 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:05.045321 | orchestrator | 2026-04-24 05:38:05.045332 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:38:05.045343 | orchestrator | Friday 24 April 2026 05:37:29 +0000 (0:00:01.455) 0:35:10.814 ********** 2026-04-24 05:38:05.045353 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:05.045363 | orchestrator | 2026-04-24 05:38:05.045374 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:38:05.045384 | orchestrator | Friday 24 April 2026 05:37:30 +0000 (0:00:01.102) 0:35:11.917 ********** 2026-04-24 05:38:05.045395 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:05.045405 | orchestrator | 2026-04-24 05:38:05.045414 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:38:05.045425 | orchestrator | Friday 24 April 2026 05:37:31 +0000 (0:00:01.449) 0:35:13.367 ********** 2026-04-24 05:38:05.045435 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.045503 | orchestrator | 2026-04-24 05:38:05.045515 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:38:05.045526 | orchestrator | Friday 24 April 2026 05:37:32 +0000 (0:00:01.138) 0:35:14.505 ********** 2026-04-24 05:38:05.045535 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.045545 | orchestrator | 2026-04-24 05:38:05.045555 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:38:05.045565 | orchestrator | Friday 24 April 2026 05:37:34 +0000 (0:00:01.251) 0:35:15.757 ********** 2026-04-24 05:38:05.045575 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.045585 | orchestrator | 2026-04-24 05:38:05.045596 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:38:05.045605 | orchestrator | Friday 24 April 2026 05:37:35 +0000 (0:00:01.160) 0:35:16.917 ********** 2026-04-24 05:38:05.045615 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-24 05:38:05.045626 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-24 05:38:05.045636 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-24 05:38:05.045647 | orchestrator | 2026-04-24 05:38:05.045674 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:38:05.045686 | orchestrator | Friday 24 April 2026 05:37:37 +0000 (0:00:02.025) 0:35:18.943 ********** 2026-04-24 05:38:05.045697 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 05:38:05.045708 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 05:38:05.045718 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 05:38:05.045728 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.045739 | orchestrator | 2026-04-24 05:38:05.045750 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:38:05.045761 | orchestrator | Friday 24 April 2026 05:37:38 +0000 (0:00:01.149) 0:35:20.092 ********** 2026-04-24 05:38:05.045772 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3 2026-04-24 05:38:05.045784 | orchestrator | 2026-04-24 05:38:05.045796 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:38:05.045816 | orchestrator | Friday 24 April 2026 05:37:39 +0000 (0:00:01.347) 0:35:21.440 ********** 2026-04-24 05:38:05.045827 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.045838 | orchestrator | 2026-04-24 05:38:05.045848 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:38:05.045859 | orchestrator | Friday 24 April 2026 05:37:40 +0000 (0:00:01.198) 0:35:22.639 ********** 2026-04-24 05:38:05.045869 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.045880 | orchestrator | 2026-04-24 05:38:05.045890 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:38:05.045901 | orchestrator | Friday 24 April 2026 05:37:42 +0000 (0:00:01.130) 0:35:23.769 ********** 2026-04-24 05:38:05.045912 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.045922 | orchestrator | 2026-04-24 05:38:05.045932 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:38:05.045944 | orchestrator | Friday 24 April 2026 05:37:43 +0000 (0:00:01.136) 0:35:24.905 ********** 2026-04-24 05:38:05.045954 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:05.045965 | orchestrator | 2026-04-24 05:38:05.045976 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:38:05.045986 | orchestrator | Friday 24 April 2026 05:37:44 +0000 (0:00:01.256) 0:35:26.162 ********** 2026-04-24 05:38:05.045998 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:38:05.046086 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:38:05.046098 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:38:05.046107 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.046117 | orchestrator | 2026-04-24 05:38:05.046127 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:38:05.046137 | orchestrator | Friday 24 April 2026 05:37:45 +0000 (0:00:01.421) 0:35:27.583 ********** 2026-04-24 05:38:05.046146 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:38:05.046156 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:38:05.046166 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:38:05.046175 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.046185 | orchestrator | 2026-04-24 05:38:05.046195 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:38:05.046205 | orchestrator | Friday 24 April 2026 05:37:47 +0000 (0:00:01.402) 0:35:28.986 ********** 2026-04-24 05:38:05.046215 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:38:05.046226 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:38:05.046236 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:38:05.046247 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:05.046258 | orchestrator | 2026-04-24 05:38:05.046268 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:38:05.046279 | orchestrator | Friday 24 April 2026 05:37:48 +0000 (0:00:01.466) 0:35:30.452 ********** 2026-04-24 05:38:05.046290 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:05.046300 | orchestrator | 2026-04-24 05:38:05.046311 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:38:05.046322 | orchestrator | Friday 24 April 2026 05:37:49 +0000 (0:00:01.156) 0:35:31.609 ********** 2026-04-24 05:38:05.046353 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 05:38:05.046373 | orchestrator | 2026-04-24 05:38:05.046384 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:38:05.046395 | orchestrator | Friday 24 April 2026 05:37:51 +0000 (0:00:01.336) 0:35:32.945 ********** 2026-04-24 05:38:05.046407 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:38:05.046418 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:38:05.046430 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:38:05.046521 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 05:38:05.046534 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:38:05.046545 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:38:05.046557 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:38:05.046568 | orchestrator | 2026-04-24 05:38:05.046580 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:38:05.046591 | orchestrator | Friday 24 April 2026 05:37:53 +0000 (0:00:02.102) 0:35:35.048 ********** 2026-04-24 05:38:05.046603 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:38:05.046623 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:38:05.046636 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:38:05.046647 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 05:38:05.046659 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:38:05.046670 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:38:05.046681 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:38:05.046692 | orchestrator | 2026-04-24 05:38:05.046704 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-24 05:38:05.046716 | orchestrator | Friday 24 April 2026 05:37:55 +0000 (0:00:02.576) 0:35:37.624 ********** 2026-04-24 05:38:05.046727 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:05.046738 | orchestrator | 2026-04-24 05:38:05.046748 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-24 05:38:05.046760 | orchestrator | Friday 24 April 2026 05:37:57 +0000 (0:00:01.518) 0:35:39.143 ********** 2026-04-24 05:38:05.046771 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:05.046781 | orchestrator | 2026-04-24 05:38:05.046791 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-24 05:38:05.046802 | orchestrator | Friday 24 April 2026 05:37:58 +0000 (0:00:01.117) 0:35:40.260 ********** 2026-04-24 05:38:05.046813 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:05.046823 | orchestrator | 2026-04-24 05:38:05.046833 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-24 05:38:05.046844 | orchestrator | Friday 24 April 2026 05:37:59 +0000 (0:00:01.204) 0:35:41.464 ********** 2026-04-24 05:38:05.046854 | orchestrator | changed: [testbed-node-3] => (item=0) 2026-04-24 05:38:05.046865 | orchestrator | changed: [testbed-node-3] => (item=4) 2026-04-24 05:38:05.046875 | orchestrator | 2026-04-24 05:38:05.046886 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:38:05.046896 | orchestrator | Friday 24 April 2026 05:38:03 +0000 (0:00:04.121) 0:35:45.586 ********** 2026-04-24 05:38:05.046906 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3 2026-04-24 05:38:05.046918 | orchestrator | 2026-04-24 05:38:05.046929 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:38:05.046949 | orchestrator | Friday 24 April 2026 05:38:05 +0000 (0:00:01.157) 0:35:46.744 ********** 2026-04-24 05:38:55.748723 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3 2026-04-24 05:38:55.748842 | orchestrator | 2026-04-24 05:38:55.748859 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:38:55.748872 | orchestrator | Friday 24 April 2026 05:38:06 +0000 (0:00:01.122) 0:35:47.866 ********** 2026-04-24 05:38:55.748883 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.748904 | orchestrator | 2026-04-24 05:38:55.748924 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:38:55.748971 | orchestrator | Friday 24 April 2026 05:38:07 +0000 (0:00:01.135) 0:35:49.002 ********** 2026-04-24 05:38:55.748991 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749010 | orchestrator | 2026-04-24 05:38:55.749028 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:38:55.749046 | orchestrator | Friday 24 April 2026 05:38:08 +0000 (0:00:01.523) 0:35:50.526 ********** 2026-04-24 05:38:55.749066 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749085 | orchestrator | 2026-04-24 05:38:55.749104 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:38:55.749122 | orchestrator | Friday 24 April 2026 05:38:10 +0000 (0:00:01.505) 0:35:52.031 ********** 2026-04-24 05:38:55.749133 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749143 | orchestrator | 2026-04-24 05:38:55.749154 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:38:55.749169 | orchestrator | Friday 24 April 2026 05:38:11 +0000 (0:00:01.513) 0:35:53.544 ********** 2026-04-24 05:38:55.749187 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749205 | orchestrator | 2026-04-24 05:38:55.749223 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:38:55.749241 | orchestrator | Friday 24 April 2026 05:38:12 +0000 (0:00:01.115) 0:35:54.660 ********** 2026-04-24 05:38:55.749260 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749280 | orchestrator | 2026-04-24 05:38:55.749299 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:38:55.749319 | orchestrator | Friday 24 April 2026 05:38:14 +0000 (0:00:01.185) 0:35:55.846 ********** 2026-04-24 05:38:55.749340 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749355 | orchestrator | 2026-04-24 05:38:55.749368 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:38:55.749380 | orchestrator | Friday 24 April 2026 05:38:15 +0000 (0:00:01.220) 0:35:57.067 ********** 2026-04-24 05:38:55.749393 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749405 | orchestrator | 2026-04-24 05:38:55.749441 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:38:55.749454 | orchestrator | Friday 24 April 2026 05:38:16 +0000 (0:00:01.496) 0:35:58.564 ********** 2026-04-24 05:38:55.749465 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749477 | orchestrator | 2026-04-24 05:38:55.749490 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:38:55.749502 | orchestrator | Friday 24 April 2026 05:38:18 +0000 (0:00:01.527) 0:36:00.091 ********** 2026-04-24 05:38:55.749514 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749526 | orchestrator | 2026-04-24 05:38:55.749538 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:38:55.749550 | orchestrator | Friday 24 April 2026 05:38:19 +0000 (0:00:01.117) 0:36:01.208 ********** 2026-04-24 05:38:55.749563 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749575 | orchestrator | 2026-04-24 05:38:55.749587 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:38:55.749615 | orchestrator | Friday 24 April 2026 05:38:20 +0000 (0:00:01.219) 0:36:02.428 ********** 2026-04-24 05:38:55.749626 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749636 | orchestrator | 2026-04-24 05:38:55.749647 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:38:55.749658 | orchestrator | Friday 24 April 2026 05:38:21 +0000 (0:00:01.124) 0:36:03.553 ********** 2026-04-24 05:38:55.749668 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749679 | orchestrator | 2026-04-24 05:38:55.749689 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:38:55.749700 | orchestrator | Friday 24 April 2026 05:38:23 +0000 (0:00:01.166) 0:36:04.719 ********** 2026-04-24 05:38:55.749710 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749721 | orchestrator | 2026-04-24 05:38:55.749731 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:38:55.749742 | orchestrator | Friday 24 April 2026 05:38:24 +0000 (0:00:01.152) 0:36:05.872 ********** 2026-04-24 05:38:55.749763 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749774 | orchestrator | 2026-04-24 05:38:55.749785 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:38:55.749795 | orchestrator | Friday 24 April 2026 05:38:25 +0000 (0:00:01.124) 0:36:06.997 ********** 2026-04-24 05:38:55.749806 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749816 | orchestrator | 2026-04-24 05:38:55.749827 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:38:55.749838 | orchestrator | Friday 24 April 2026 05:38:26 +0000 (0:00:01.111) 0:36:08.109 ********** 2026-04-24 05:38:55.749848 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749859 | orchestrator | 2026-04-24 05:38:55.749870 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:38:55.749880 | orchestrator | Friday 24 April 2026 05:38:27 +0000 (0:00:01.119) 0:36:09.228 ********** 2026-04-24 05:38:55.749891 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749901 | orchestrator | 2026-04-24 05:38:55.749911 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:38:55.749922 | orchestrator | Friday 24 April 2026 05:38:28 +0000 (0:00:01.133) 0:36:10.362 ********** 2026-04-24 05:38:55.749932 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.749943 | orchestrator | 2026-04-24 05:38:55.749954 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:38:55.749964 | orchestrator | Friday 24 April 2026 05:38:29 +0000 (0:00:01.287) 0:36:11.650 ********** 2026-04-24 05:38:55.749975 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.749985 | orchestrator | 2026-04-24 05:38:55.750072 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:38:55.750088 | orchestrator | Friday 24 April 2026 05:38:31 +0000 (0:00:01.165) 0:36:12.816 ********** 2026-04-24 05:38:55.750099 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750109 | orchestrator | 2026-04-24 05:38:55.750120 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:38:55.750141 | orchestrator | Friday 24 April 2026 05:38:32 +0000 (0:00:01.159) 0:36:13.975 ********** 2026-04-24 05:38:55.750152 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750162 | orchestrator | 2026-04-24 05:38:55.750173 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:38:55.750184 | orchestrator | Friday 24 April 2026 05:38:33 +0000 (0:00:01.107) 0:36:15.082 ********** 2026-04-24 05:38:55.750194 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750205 | orchestrator | 2026-04-24 05:38:55.750215 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:38:55.750226 | orchestrator | Friday 24 April 2026 05:38:34 +0000 (0:00:01.157) 0:36:16.240 ********** 2026-04-24 05:38:55.750237 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750247 | orchestrator | 2026-04-24 05:38:55.750258 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:38:55.750269 | orchestrator | Friday 24 April 2026 05:38:35 +0000 (0:00:01.125) 0:36:17.366 ********** 2026-04-24 05:38:55.750279 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750290 | orchestrator | 2026-04-24 05:38:55.750301 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:38:55.750311 | orchestrator | Friday 24 April 2026 05:38:36 +0000 (0:00:01.105) 0:36:18.472 ********** 2026-04-24 05:38:55.750322 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750332 | orchestrator | 2026-04-24 05:38:55.750344 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:38:55.750356 | orchestrator | Friday 24 April 2026 05:38:37 +0000 (0:00:01.123) 0:36:19.596 ********** 2026-04-24 05:38:55.750366 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750377 | orchestrator | 2026-04-24 05:38:55.750388 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:38:55.750406 | orchestrator | Friday 24 April 2026 05:38:39 +0000 (0:00:01.119) 0:36:20.715 ********** 2026-04-24 05:38:55.750445 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750457 | orchestrator | 2026-04-24 05:38:55.750468 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:38:55.750479 | orchestrator | Friday 24 April 2026 05:38:40 +0000 (0:00:01.120) 0:36:21.836 ********** 2026-04-24 05:38:55.750489 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750500 | orchestrator | 2026-04-24 05:38:55.750510 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:38:55.750521 | orchestrator | Friday 24 April 2026 05:38:41 +0000 (0:00:01.129) 0:36:22.965 ********** 2026-04-24 05:38:55.750531 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750542 | orchestrator | 2026-04-24 05:38:55.750553 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:38:55.750563 | orchestrator | Friday 24 April 2026 05:38:42 +0000 (0:00:01.125) 0:36:24.090 ********** 2026-04-24 05:38:55.750574 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750584 | orchestrator | 2026-04-24 05:38:55.750595 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:38:55.750605 | orchestrator | Friday 24 April 2026 05:38:43 +0000 (0:00:01.308) 0:36:25.398 ********** 2026-04-24 05:38:55.750622 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.750633 | orchestrator | 2026-04-24 05:38:55.750644 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:38:55.750655 | orchestrator | Friday 24 April 2026 05:38:45 +0000 (0:00:01.967) 0:36:27.366 ********** 2026-04-24 05:38:55.750665 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.750676 | orchestrator | 2026-04-24 05:38:55.750686 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:38:55.750697 | orchestrator | Friday 24 April 2026 05:38:47 +0000 (0:00:02.224) 0:36:29.591 ********** 2026-04-24 05:38:55.750707 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3 2026-04-24 05:38:55.750718 | orchestrator | 2026-04-24 05:38:55.750729 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:38:55.750740 | orchestrator | Friday 24 April 2026 05:38:49 +0000 (0:00:01.146) 0:36:30.737 ********** 2026-04-24 05:38:55.750750 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750761 | orchestrator | 2026-04-24 05:38:55.750772 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:38:55.750782 | orchestrator | Friday 24 April 2026 05:38:50 +0000 (0:00:01.148) 0:36:31.885 ********** 2026-04-24 05:38:55.750793 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.750803 | orchestrator | 2026-04-24 05:38:55.750814 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:38:55.750825 | orchestrator | Friday 24 April 2026 05:38:51 +0000 (0:00:01.142) 0:36:33.028 ********** 2026-04-24 05:38:55.750835 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:38:55.750846 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:38:55.750979 | orchestrator | 2026-04-24 05:38:55.750994 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:38:55.751005 | orchestrator | Friday 24 April 2026 05:38:53 +0000 (0:00:01.810) 0:36:34.839 ********** 2026-04-24 05:38:55.751016 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:38:55.751027 | orchestrator | 2026-04-24 05:38:55.751038 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:38:55.751049 | orchestrator | Friday 24 April 2026 05:38:54 +0000 (0:00:01.448) 0:36:36.287 ********** 2026-04-24 05:38:55.751059 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:38:55.751070 | orchestrator | 2026-04-24 05:38:55.751081 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:38:55.751103 | orchestrator | Friday 24 April 2026 05:38:55 +0000 (0:00:01.161) 0:36:37.449 ********** 2026-04-24 05:39:41.956059 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956159 | orchestrator | 2026-04-24 05:39:41.956173 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:39:41.956184 | orchestrator | Friday 24 April 2026 05:38:56 +0000 (0:00:01.158) 0:36:38.607 ********** 2026-04-24 05:39:41.956192 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956200 | orchestrator | 2026-04-24 05:39:41.956209 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:39:41.956217 | orchestrator | Friday 24 April 2026 05:38:58 +0000 (0:00:01.162) 0:36:39.770 ********** 2026-04-24 05:39:41.956225 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3 2026-04-24 05:39:41.956234 | orchestrator | 2026-04-24 05:39:41.956242 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:39:41.956250 | orchestrator | Friday 24 April 2026 05:38:59 +0000 (0:00:01.259) 0:36:41.029 ********** 2026-04-24 05:39:41.956257 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:39:41.956266 | orchestrator | 2026-04-24 05:39:41.956274 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:39:41.956283 | orchestrator | Friday 24 April 2026 05:39:01 +0000 (0:00:01.730) 0:36:42.759 ********** 2026-04-24 05:39:41.956291 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:39:41.956298 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:39:41.956306 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:39:41.956314 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956322 | orchestrator | 2026-04-24 05:39:41.956330 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:39:41.956338 | orchestrator | Friday 24 April 2026 05:39:02 +0000 (0:00:01.136) 0:36:43.895 ********** 2026-04-24 05:39:41.956346 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956354 | orchestrator | 2026-04-24 05:39:41.956362 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:39:41.956369 | orchestrator | Friday 24 April 2026 05:39:03 +0000 (0:00:01.127) 0:36:45.023 ********** 2026-04-24 05:39:41.956408 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956417 | orchestrator | 2026-04-24 05:39:41.956425 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:39:41.956433 | orchestrator | Friday 24 April 2026 05:39:04 +0000 (0:00:01.205) 0:36:46.229 ********** 2026-04-24 05:39:41.956441 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956448 | orchestrator | 2026-04-24 05:39:41.956456 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:39:41.956464 | orchestrator | Friday 24 April 2026 05:39:05 +0000 (0:00:01.157) 0:36:47.387 ********** 2026-04-24 05:39:41.956472 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956480 | orchestrator | 2026-04-24 05:39:41.956488 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:39:41.956496 | orchestrator | Friday 24 April 2026 05:39:06 +0000 (0:00:01.138) 0:36:48.525 ********** 2026-04-24 05:39:41.956503 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956511 | orchestrator | 2026-04-24 05:39:41.956519 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:39:41.956527 | orchestrator | Friday 24 April 2026 05:39:07 +0000 (0:00:01.159) 0:36:49.685 ********** 2026-04-24 05:39:41.956548 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:39:41.956556 | orchestrator | 2026-04-24 05:39:41.956564 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:39:41.956572 | orchestrator | Friday 24 April 2026 05:39:10 +0000 (0:00:02.484) 0:36:52.169 ********** 2026-04-24 05:39:41.956580 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:39:41.956588 | orchestrator | 2026-04-24 05:39:41.956595 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:39:41.956621 | orchestrator | Friday 24 April 2026 05:39:11 +0000 (0:00:01.115) 0:36:53.284 ********** 2026-04-24 05:39:41.956631 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3 2026-04-24 05:39:41.956640 | orchestrator | 2026-04-24 05:39:41.956648 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:39:41.956657 | orchestrator | Friday 24 April 2026 05:39:12 +0000 (0:00:01.110) 0:36:54.395 ********** 2026-04-24 05:39:41.956666 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956675 | orchestrator | 2026-04-24 05:39:41.956684 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:39:41.956693 | orchestrator | Friday 24 April 2026 05:39:13 +0000 (0:00:01.110) 0:36:55.505 ********** 2026-04-24 05:39:41.956702 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956711 | orchestrator | 2026-04-24 05:39:41.956720 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:39:41.956728 | orchestrator | Friday 24 April 2026 05:39:15 +0000 (0:00:01.222) 0:36:56.728 ********** 2026-04-24 05:39:41.956737 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956746 | orchestrator | 2026-04-24 05:39:41.956755 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:39:41.956764 | orchestrator | Friday 24 April 2026 05:39:16 +0000 (0:00:01.151) 0:36:57.880 ********** 2026-04-24 05:39:41.956773 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956782 | orchestrator | 2026-04-24 05:39:41.956791 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:39:41.956800 | orchestrator | Friday 24 April 2026 05:39:17 +0000 (0:00:01.230) 0:36:59.111 ********** 2026-04-24 05:39:41.956809 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956818 | orchestrator | 2026-04-24 05:39:41.956827 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:39:41.956836 | orchestrator | Friday 24 April 2026 05:39:18 +0000 (0:00:01.229) 0:37:00.341 ********** 2026-04-24 05:39:41.956845 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956854 | orchestrator | 2026-04-24 05:39:41.956877 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:39:41.956887 | orchestrator | Friday 24 April 2026 05:39:19 +0000 (0:00:01.144) 0:37:01.485 ********** 2026-04-24 05:39:41.956896 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956905 | orchestrator | 2026-04-24 05:39:41.956914 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:39:41.956923 | orchestrator | Friday 24 April 2026 05:39:20 +0000 (0:00:01.167) 0:37:02.653 ********** 2026-04-24 05:39:41.956931 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.956940 | orchestrator | 2026-04-24 05:39:41.956949 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:39:41.956958 | orchestrator | Friday 24 April 2026 05:39:22 +0000 (0:00:01.133) 0:37:03.787 ********** 2026-04-24 05:39:41.956966 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:39:41.956975 | orchestrator | 2026-04-24 05:39:41.956985 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:39:41.956992 | orchestrator | Friday 24 April 2026 05:39:23 +0000 (0:00:01.160) 0:37:04.947 ********** 2026-04-24 05:39:41.957000 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3 2026-04-24 05:39:41.957008 | orchestrator | 2026-04-24 05:39:41.957016 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:39:41.957024 | orchestrator | Friday 24 April 2026 05:39:24 +0000 (0:00:01.187) 0:37:06.134 ********** 2026-04-24 05:39:41.957032 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-24 05:39:41.957040 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-24 05:39:41.957048 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-24 05:39:41.957056 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-24 05:39:41.957063 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-24 05:39:41.957077 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-24 05:39:41.957085 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-24 05:39:41.957093 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:39:41.957100 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:39:41.957108 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:39:41.957116 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:39:41.957123 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:39:41.957131 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:39:41.957139 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:39:41.957147 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-24 05:39:41.957155 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-24 05:39:41.957163 | orchestrator | 2026-04-24 05:39:41.957170 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:39:41.957178 | orchestrator | Friday 24 April 2026 05:39:31 +0000 (0:00:06.608) 0:37:12.743 ********** 2026-04-24 05:39:41.957186 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3 2026-04-24 05:39:41.957194 | orchestrator | 2026-04-24 05:39:41.957202 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 05:39:41.957214 | orchestrator | Friday 24 April 2026 05:39:32 +0000 (0:00:01.533) 0:37:14.277 ********** 2026-04-24 05:39:41.957222 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 05:39:41.957231 | orchestrator | 2026-04-24 05:39:41.957238 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 05:39:41.957246 | orchestrator | Friday 24 April 2026 05:39:34 +0000 (0:00:01.534) 0:37:15.812 ********** 2026-04-24 05:39:41.957254 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 05:39:41.957262 | orchestrator | 2026-04-24 05:39:41.957269 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:39:41.957277 | orchestrator | Friday 24 April 2026 05:39:36 +0000 (0:00:01.969) 0:37:17.782 ********** 2026-04-24 05:39:41.957285 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.957293 | orchestrator | 2026-04-24 05:39:41.957301 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:39:41.957308 | orchestrator | Friday 24 April 2026 05:39:37 +0000 (0:00:01.178) 0:37:18.960 ********** 2026-04-24 05:39:41.957316 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.957324 | orchestrator | 2026-04-24 05:39:41.957331 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:39:41.957339 | orchestrator | Friday 24 April 2026 05:39:38 +0000 (0:00:01.164) 0:37:20.125 ********** 2026-04-24 05:39:41.957347 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.957355 | orchestrator | 2026-04-24 05:39:41.957362 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:39:41.957370 | orchestrator | Friday 24 April 2026 05:39:39 +0000 (0:00:01.118) 0:37:21.243 ********** 2026-04-24 05:39:41.957425 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.957433 | orchestrator | 2026-04-24 05:39:41.957441 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:39:41.957449 | orchestrator | Friday 24 April 2026 05:39:40 +0000 (0:00:01.151) 0:37:22.395 ********** 2026-04-24 05:39:41.957457 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.957464 | orchestrator | 2026-04-24 05:39:41.957472 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:39:41.957480 | orchestrator | Friday 24 April 2026 05:39:41 +0000 (0:00:01.113) 0:37:23.509 ********** 2026-04-24 05:39:41.957494 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:39:41.957501 | orchestrator | 2026-04-24 05:39:41.957515 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:40:32.165742 | orchestrator | Friday 24 April 2026 05:39:42 +0000 (0:00:01.121) 0:37:24.630 ********** 2026-04-24 05:40:32.165860 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.165878 | orchestrator | 2026-04-24 05:40:32.165891 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:40:32.165903 | orchestrator | Friday 24 April 2026 05:39:44 +0000 (0:00:01.259) 0:37:25.890 ********** 2026-04-24 05:40:32.165915 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.165926 | orchestrator | 2026-04-24 05:40:32.165937 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:40:32.165948 | orchestrator | Friday 24 April 2026 05:39:45 +0000 (0:00:01.231) 0:37:27.121 ********** 2026-04-24 05:40:32.165959 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.165970 | orchestrator | 2026-04-24 05:40:32.165981 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:40:32.165992 | orchestrator | Friday 24 April 2026 05:39:46 +0000 (0:00:01.093) 0:37:28.215 ********** 2026-04-24 05:40:32.166003 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166014 | orchestrator | 2026-04-24 05:40:32.166086 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:40:32.166098 | orchestrator | Friday 24 April 2026 05:39:47 +0000 (0:00:01.167) 0:37:29.382 ********** 2026-04-24 05:40:32.166109 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:40:32.166121 | orchestrator | 2026-04-24 05:40:32.166132 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:40:32.166143 | orchestrator | Friday 24 April 2026 05:39:48 +0000 (0:00:01.321) 0:37:30.704 ********** 2026-04-24 05:40:32.166154 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:40:32.166165 | orchestrator | 2026-04-24 05:40:32.166176 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:40:32.166187 | orchestrator | Friday 24 April 2026 05:39:53 +0000 (0:00:04.388) 0:37:35.092 ********** 2026-04-24 05:40:32.166198 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 05:40:32.166210 | orchestrator | 2026-04-24 05:40:32.166221 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:40:32.166232 | orchestrator | Friday 24 April 2026 05:39:54 +0000 (0:00:01.215) 0:37:36.308 ********** 2026-04-24 05:40:32.166245 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-24 05:40:32.166276 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-24 05:40:32.166291 | orchestrator | 2026-04-24 05:40:32.166304 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:40:32.166343 | orchestrator | Friday 24 April 2026 05:40:02 +0000 (0:00:07.613) 0:37:43.922 ********** 2026-04-24 05:40:32.166356 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166368 | orchestrator | 2026-04-24 05:40:32.166380 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:40:32.166393 | orchestrator | Friday 24 April 2026 05:40:03 +0000 (0:00:01.143) 0:37:45.066 ********** 2026-04-24 05:40:32.166429 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166442 | orchestrator | 2026-04-24 05:40:32.166454 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:40:32.166468 | orchestrator | Friday 24 April 2026 05:40:04 +0000 (0:00:01.151) 0:37:46.217 ********** 2026-04-24 05:40:32.166480 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166492 | orchestrator | 2026-04-24 05:40:32.166505 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:40:32.166518 | orchestrator | Friday 24 April 2026 05:40:05 +0000 (0:00:01.151) 0:37:47.369 ********** 2026-04-24 05:40:32.166528 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166539 | orchestrator | 2026-04-24 05:40:32.166550 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:40:32.166560 | orchestrator | Friday 24 April 2026 05:40:06 +0000 (0:00:01.125) 0:37:48.494 ********** 2026-04-24 05:40:32.166571 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166582 | orchestrator | 2026-04-24 05:40:32.166592 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:40:32.166603 | orchestrator | Friday 24 April 2026 05:40:07 +0000 (0:00:01.132) 0:37:49.627 ********** 2026-04-24 05:40:32.166613 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:40:32.166624 | orchestrator | 2026-04-24 05:40:32.166634 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:40:32.166645 | orchestrator | Friday 24 April 2026 05:40:09 +0000 (0:00:01.182) 0:37:50.809 ********** 2026-04-24 05:40:32.166656 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:40:32.166666 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:40:32.166677 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:40:32.166688 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166698 | orchestrator | 2026-04-24 05:40:32.166709 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:40:32.166738 | orchestrator | Friday 24 April 2026 05:40:10 +0000 (0:00:01.387) 0:37:52.197 ********** 2026-04-24 05:40:32.166749 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:40:32.166760 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:40:32.166771 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:40:32.166781 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166792 | orchestrator | 2026-04-24 05:40:32.166803 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:40:32.166814 | orchestrator | Friday 24 April 2026 05:40:12 +0000 (0:00:01.612) 0:37:53.809 ********** 2026-04-24 05:40:32.166825 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:40:32.166835 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:40:32.166846 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:40:32.166856 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.166867 | orchestrator | 2026-04-24 05:40:32.166877 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:40:32.166888 | orchestrator | Friday 24 April 2026 05:40:13 +0000 (0:00:01.737) 0:37:55.547 ********** 2026-04-24 05:40:32.166899 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:40:32.166909 | orchestrator | 2026-04-24 05:40:32.166920 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:40:32.166930 | orchestrator | Friday 24 April 2026 05:40:15 +0000 (0:00:01.322) 0:37:56.869 ********** 2026-04-24 05:40:32.166941 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 05:40:32.166952 | orchestrator | 2026-04-24 05:40:32.166962 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:40:32.166973 | orchestrator | Friday 24 April 2026 05:40:16 +0000 (0:00:01.337) 0:37:58.207 ********** 2026-04-24 05:40:32.166992 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:40:32.167003 | orchestrator | 2026-04-24 05:40:32.167013 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-24 05:40:32.167024 | orchestrator | Friday 24 April 2026 05:40:18 +0000 (0:00:01.743) 0:37:59.950 ********** 2026-04-24 05:40:32.167035 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:40:32.167045 | orchestrator | 2026-04-24 05:40:32.167056 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:40:32.167067 | orchestrator | Friday 24 April 2026 05:40:19 +0000 (0:00:01.096) 0:38:01.046 ********** 2026-04-24 05:40:32.167077 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:40:32.167089 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:40:32.167100 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:40:32.167110 | orchestrator | 2026-04-24 05:40:32.167121 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-24 05:40:32.167131 | orchestrator | Friday 24 April 2026 05:40:20 +0000 (0:00:01.596) 0:38:02.643 ********** 2026-04-24 05:40:32.167142 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-3 2026-04-24 05:40:32.167153 | orchestrator | 2026-04-24 05:40:32.167163 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-24 05:40:32.167180 | orchestrator | Friday 24 April 2026 05:40:22 +0000 (0:00:01.453) 0:38:04.097 ********** 2026-04-24 05:40:32.167191 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.167201 | orchestrator | 2026-04-24 05:40:32.167212 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-24 05:40:32.167223 | orchestrator | Friday 24 April 2026 05:40:23 +0000 (0:00:01.143) 0:38:05.241 ********** 2026-04-24 05:40:32.167233 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.167244 | orchestrator | 2026-04-24 05:40:32.167254 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-24 05:40:32.167265 | orchestrator | Friday 24 April 2026 05:40:24 +0000 (0:00:01.161) 0:38:06.403 ********** 2026-04-24 05:40:32.167276 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:40:32.167286 | orchestrator | 2026-04-24 05:40:32.167297 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-24 05:40:32.167308 | orchestrator | Friday 24 April 2026 05:40:26 +0000 (0:00:01.430) 0:38:07.834 ********** 2026-04-24 05:40:32.167338 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:40:32.167349 | orchestrator | 2026-04-24 05:40:32.167360 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-24 05:40:32.167371 | orchestrator | Friday 24 April 2026 05:40:27 +0000 (0:00:01.213) 0:38:09.048 ********** 2026-04-24 05:40:32.167381 | orchestrator | ok: [testbed-node-3] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-24 05:40:32.167392 | orchestrator | ok: [testbed-node-3] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-24 05:40:32.167403 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-24 05:40:32.167414 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-24 05:40:32.167425 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-24 05:40:32.167435 | orchestrator | 2026-04-24 05:40:32.167446 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-24 05:40:32.167457 | orchestrator | Friday 24 April 2026 05:40:30 +0000 (0:00:03.459) 0:38:12.507 ********** 2026-04-24 05:40:32.167467 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:40:32.167478 | orchestrator | 2026-04-24 05:40:32.167489 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-24 05:40:32.167499 | orchestrator | Friday 24 April 2026 05:40:31 +0000 (0:00:01.117) 0:38:13.625 ********** 2026-04-24 05:40:32.167510 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-3 2026-04-24 05:40:32.167527 | orchestrator | 2026-04-24 05:40:32.167538 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-24 05:41:39.971538 | orchestrator | Friday 24 April 2026 05:40:33 +0000 (0:00:01.464) 0:38:15.090 ********** 2026-04-24 05:41:39.971699 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-24 05:41:39.971724 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd/) 2026-04-24 05:41:39.971740 | orchestrator | 2026-04-24 05:41:39.971756 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-24 05:41:39.971765 | orchestrator | Friday 24 April 2026 05:40:35 +0000 (0:00:01.846) 0:38:16.937 ********** 2026-04-24 05:41:39.971774 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:41:39.971784 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 05:41:39.971793 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 05:41:39.971801 | orchestrator | 2026-04-24 05:41:39.971810 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-24 05:41:39.971819 | orchestrator | Friday 24 April 2026 05:40:38 +0000 (0:00:03.287) 0:38:20.224 ********** 2026-04-24 05:41:39.971828 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-24 05:41:39.971837 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 05:41:39.971846 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:41:39.971855 | orchestrator | 2026-04-24 05:41:39.971864 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-24 05:41:39.971872 | orchestrator | Friday 24 April 2026 05:40:40 +0000 (0:00:01.979) 0:38:22.204 ********** 2026-04-24 05:41:39.971881 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.971890 | orchestrator | 2026-04-24 05:41:39.971899 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-24 05:41:39.971907 | orchestrator | Friday 24 April 2026 05:40:41 +0000 (0:00:01.210) 0:38:23.415 ********** 2026-04-24 05:41:39.971916 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.971925 | orchestrator | 2026-04-24 05:41:39.971933 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-24 05:41:39.971942 | orchestrator | Friday 24 April 2026 05:40:42 +0000 (0:00:01.127) 0:38:24.542 ********** 2026-04-24 05:41:39.971950 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.971959 | orchestrator | 2026-04-24 05:41:39.971967 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-24 05:41:39.971976 | orchestrator | Friday 24 April 2026 05:40:43 +0000 (0:00:01.146) 0:38:25.689 ********** 2026-04-24 05:41:39.971985 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-3 2026-04-24 05:41:39.971995 | orchestrator | 2026-04-24 05:41:39.972003 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-24 05:41:39.972011 | orchestrator | Friday 24 April 2026 05:40:45 +0000 (0:00:01.529) 0:38:27.219 ********** 2026-04-24 05:41:39.972020 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:41:39.972030 | orchestrator | 2026-04-24 05:41:39.972040 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-24 05:41:39.972050 | orchestrator | Friday 24 April 2026 05:40:46 +0000 (0:00:01.442) 0:38:28.662 ********** 2026-04-24 05:41:39.972060 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:41:39.972070 | orchestrator | 2026-04-24 05:41:39.972080 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-24 05:41:39.972110 | orchestrator | Friday 24 April 2026 05:40:50 +0000 (0:00:03.581) 0:38:32.243 ********** 2026-04-24 05:41:39.972120 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-3 2026-04-24 05:41:39.972131 | orchestrator | 2026-04-24 05:41:39.972141 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-24 05:41:39.972150 | orchestrator | Friday 24 April 2026 05:40:51 +0000 (0:00:01.467) 0:38:33.710 ********** 2026-04-24 05:41:39.972161 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:41:39.972232 | orchestrator | 2026-04-24 05:41:39.972246 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-24 05:41:39.972256 | orchestrator | Friday 24 April 2026 05:40:53 +0000 (0:00:01.925) 0:38:35.636 ********** 2026-04-24 05:41:39.972266 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:41:39.972276 | orchestrator | 2026-04-24 05:41:39.972286 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-24 05:41:39.972296 | orchestrator | Friday 24 April 2026 05:40:55 +0000 (0:00:01.987) 0:38:37.623 ********** 2026-04-24 05:41:39.972306 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:41:39.972316 | orchestrator | 2026-04-24 05:41:39.972324 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-24 05:41:39.972333 | orchestrator | Friday 24 April 2026 05:40:58 +0000 (0:00:02.183) 0:38:39.807 ********** 2026-04-24 05:41:39.972341 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.972350 | orchestrator | 2026-04-24 05:41:39.972359 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-24 05:41:39.972367 | orchestrator | Friday 24 April 2026 05:40:59 +0000 (0:00:01.136) 0:38:40.944 ********** 2026-04-24 05:41:39.972376 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.972384 | orchestrator | 2026-04-24 05:41:39.972393 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-24 05:41:39.972401 | orchestrator | Friday 24 April 2026 05:41:00 +0000 (0:00:01.125) 0:38:42.070 ********** 2026-04-24 05:41:39.972410 | orchestrator | ok: [testbed-node-3] => (item=4) 2026-04-24 05:41:39.972418 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 05:41:39.972427 | orchestrator | 2026-04-24 05:41:39.972436 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-24 05:41:39.972444 | orchestrator | Friday 24 April 2026 05:41:02 +0000 (0:00:01.834) 0:38:43.905 ********** 2026-04-24 05:41:39.972452 | orchestrator | ok: [testbed-node-3] => (item=4) 2026-04-24 05:41:39.972461 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 05:41:39.972471 | orchestrator | 2026-04-24 05:41:39.972479 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-24 05:41:39.972488 | orchestrator | Friday 24 April 2026 05:41:05 +0000 (0:00:02.940) 0:38:46.846 ********** 2026-04-24 05:41:39.972497 | orchestrator | changed: [testbed-node-3] => (item=4) 2026-04-24 05:41:39.972524 | orchestrator | changed: [testbed-node-3] => (item=0) 2026-04-24 05:41:39.972534 | orchestrator | 2026-04-24 05:41:39.972542 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-24 05:41:39.972551 | orchestrator | Friday 24 April 2026 05:41:09 +0000 (0:00:04.558) 0:38:51.405 ********** 2026-04-24 05:41:39.972559 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.972568 | orchestrator | 2026-04-24 05:41:39.972576 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-24 05:41:39.972585 | orchestrator | Friday 24 April 2026 05:41:10 +0000 (0:00:01.229) 0:38:52.635 ********** 2026-04-24 05:41:39.972593 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.972602 | orchestrator | 2026-04-24 05:41:39.972611 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-24 05:41:39.972619 | orchestrator | Friday 24 April 2026 05:41:12 +0000 (0:00:01.287) 0:38:53.922 ********** 2026-04-24 05:41:39.972628 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.972636 | orchestrator | 2026-04-24 05:41:39.972645 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-24 05:41:39.972654 | orchestrator | Friday 24 April 2026 05:41:13 +0000 (0:00:01.728) 0:38:55.651 ********** 2026-04-24 05:41:39.972662 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.972671 | orchestrator | 2026-04-24 05:41:39.972679 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-24 05:41:39.972688 | orchestrator | Friday 24 April 2026 05:41:15 +0000 (0:00:01.134) 0:38:56.786 ********** 2026-04-24 05:41:39.972697 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:41:39.972705 | orchestrator | 2026-04-24 05:41:39.972714 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-24 05:41:39.972730 | orchestrator | Friday 24 April 2026 05:41:16 +0000 (0:00:01.164) 0:38:57.950 ********** 2026-04-24 05:41:39.972739 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (600 retries left). 2026-04-24 05:41:39.972749 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (599 retries left). 2026-04-24 05:41:39.972758 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (598 retries left). 2026-04-24 05:41:39.972766 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:41:39.972775 | orchestrator | 2026-04-24 05:41:39.972783 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-24 05:41:39.972792 | orchestrator | 2026-04-24 05:41:39.972801 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:41:39.972809 | orchestrator | Friday 24 April 2026 05:41:27 +0000 (0:00:10.928) 0:39:08.878 ********** 2026-04-24 05:41:39.972818 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4 2026-04-24 05:41:39.972827 | orchestrator | 2026-04-24 05:41:39.972835 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:41:39.972844 | orchestrator | Friday 24 April 2026 05:41:28 +0000 (0:00:01.160) 0:39:10.039 ********** 2026-04-24 05:41:39.972852 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:41:39.972861 | orchestrator | 2026-04-24 05:41:39.972870 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:41:39.972884 | orchestrator | Friday 24 April 2026 05:41:29 +0000 (0:00:01.458) 0:39:11.498 ********** 2026-04-24 05:41:39.972893 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:41:39.972901 | orchestrator | 2026-04-24 05:41:39.972910 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:41:39.972918 | orchestrator | Friday 24 April 2026 05:41:30 +0000 (0:00:01.153) 0:39:12.652 ********** 2026-04-24 05:41:39.972927 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:41:39.972936 | orchestrator | 2026-04-24 05:41:39.972944 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:41:39.972953 | orchestrator | Friday 24 April 2026 05:41:32 +0000 (0:00:01.425) 0:39:14.078 ********** 2026-04-24 05:41:39.972961 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:41:39.972970 | orchestrator | 2026-04-24 05:41:39.972979 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:41:39.972987 | orchestrator | Friday 24 April 2026 05:41:33 +0000 (0:00:01.155) 0:39:15.234 ********** 2026-04-24 05:41:39.972996 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:41:39.973004 | orchestrator | 2026-04-24 05:41:39.973013 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:41:39.973022 | orchestrator | Friday 24 April 2026 05:41:34 +0000 (0:00:01.140) 0:39:16.374 ********** 2026-04-24 05:41:39.973030 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:41:39.973039 | orchestrator | 2026-04-24 05:41:39.973047 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:41:39.973056 | orchestrator | Friday 24 April 2026 05:41:35 +0000 (0:00:01.168) 0:39:17.542 ********** 2026-04-24 05:41:39.973064 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:41:39.973073 | orchestrator | 2026-04-24 05:41:39.973081 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:41:39.973090 | orchestrator | Friday 24 April 2026 05:41:36 +0000 (0:00:01.138) 0:39:18.681 ********** 2026-04-24 05:41:39.973098 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:41:39.973107 | orchestrator | 2026-04-24 05:41:39.973115 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:41:39.973124 | orchestrator | Friday 24 April 2026 05:41:38 +0000 (0:00:01.155) 0:39:19.836 ********** 2026-04-24 05:41:39.973132 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:41:39.973147 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:41:39.973156 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:41:39.973165 | orchestrator | 2026-04-24 05:41:39.973173 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:41:39.973182 | orchestrator | Friday 24 April 2026 05:41:39 +0000 (0:00:01.668) 0:39:21.504 ********** 2026-04-24 05:41:39.973216 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:04.906359 | orchestrator | 2026-04-24 05:42:04.906451 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:42:04.906463 | orchestrator | Friday 24 April 2026 05:41:41 +0000 (0:00:01.237) 0:39:22.742 ********** 2026-04-24 05:42:04.906470 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:42:04.906478 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:42:04.906484 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:42:04.906490 | orchestrator | 2026-04-24 05:42:04.906497 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:42:04.906503 | orchestrator | Friday 24 April 2026 05:41:43 +0000 (0:00:02.829) 0:39:25.572 ********** 2026-04-24 05:42:04.906509 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 05:42:04.906516 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 05:42:04.906522 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 05:42:04.906528 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906534 | orchestrator | 2026-04-24 05:42:04.906540 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:42:04.906545 | orchestrator | Friday 24 April 2026 05:41:45 +0000 (0:00:01.451) 0:39:27.024 ********** 2026-04-24 05:42:04.906553 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:42:04.906562 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:42:04.906568 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:42:04.906574 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906580 | orchestrator | 2026-04-24 05:42:04.906586 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:42:04.906592 | orchestrator | Friday 24 April 2026 05:41:46 +0000 (0:00:01.658) 0:39:28.682 ********** 2026-04-24 05:42:04.906613 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:04.906622 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:04.906628 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:04.906651 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906657 | orchestrator | 2026-04-24 05:42:04.906663 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:42:04.906669 | orchestrator | Friday 24 April 2026 05:41:48 +0000 (0:00:01.295) 0:39:29.977 ********** 2026-04-24 05:42:04.906688 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:41:41.554274', 'end': '2026-04-24 05:41:41.617059', 'delta': '0:00:00.062785', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:42:04.906696 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:41:42.111964', 'end': '2026-04-24 05:41:42.168319', 'delta': '0:00:00.056355', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:42:04.906703 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:41:42.667070', 'end': '2026-04-24 05:41:42.712567', 'delta': '0:00:00.045497', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:42:04.906709 | orchestrator | 2026-04-24 05:42:04.906715 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:42:04.906721 | orchestrator | Friday 24 April 2026 05:41:49 +0000 (0:00:01.194) 0:39:31.172 ********** 2026-04-24 05:42:04.906727 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:04.906733 | orchestrator | 2026-04-24 05:42:04.906738 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:42:04.906744 | orchestrator | Friday 24 April 2026 05:41:50 +0000 (0:00:01.329) 0:39:32.502 ********** 2026-04-24 05:42:04.906750 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906756 | orchestrator | 2026-04-24 05:42:04.906761 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:42:04.906767 | orchestrator | Friday 24 April 2026 05:41:52 +0000 (0:00:01.277) 0:39:33.779 ********** 2026-04-24 05:42:04.906773 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:04.906778 | orchestrator | 2026-04-24 05:42:04.906784 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:42:04.906801 | orchestrator | Friday 24 April 2026 05:41:53 +0000 (0:00:01.151) 0:39:34.931 ********** 2026-04-24 05:42:04.906807 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:42:04.906813 | orchestrator | 2026-04-24 05:42:04.906819 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:42:04.906824 | orchestrator | Friday 24 April 2026 05:41:55 +0000 (0:00:02.410) 0:39:37.341 ********** 2026-04-24 05:42:04.906830 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:04.906836 | orchestrator | 2026-04-24 05:42:04.906842 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:42:04.906848 | orchestrator | Friday 24 April 2026 05:41:56 +0000 (0:00:01.203) 0:39:38.545 ********** 2026-04-24 05:42:04.906853 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906859 | orchestrator | 2026-04-24 05:42:04.906865 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:42:04.906871 | orchestrator | Friday 24 April 2026 05:41:57 +0000 (0:00:01.116) 0:39:39.662 ********** 2026-04-24 05:42:04.906877 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906882 | orchestrator | 2026-04-24 05:42:04.906888 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:42:04.906894 | orchestrator | Friday 24 April 2026 05:41:59 +0000 (0:00:01.238) 0:39:40.900 ********** 2026-04-24 05:42:04.906901 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906908 | orchestrator | 2026-04-24 05:42:04.906914 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:42:04.906921 | orchestrator | Friday 24 April 2026 05:42:00 +0000 (0:00:01.120) 0:39:42.020 ********** 2026-04-24 05:42:04.906927 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906934 | orchestrator | 2026-04-24 05:42:04.906941 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:42:04.906948 | orchestrator | Friday 24 April 2026 05:42:01 +0000 (0:00:01.119) 0:39:43.140 ********** 2026-04-24 05:42:04.906955 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:04.906961 | orchestrator | 2026-04-24 05:42:04.906968 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:42:04.906974 | orchestrator | Friday 24 April 2026 05:42:02 +0000 (0:00:01.163) 0:39:44.304 ********** 2026-04-24 05:42:04.906981 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:04.906988 | orchestrator | 2026-04-24 05:42:04.906995 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:42:04.907002 | orchestrator | Friday 24 April 2026 05:42:03 +0000 (0:00:01.118) 0:39:45.423 ********** 2026-04-24 05:42:04.907008 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:04.907015 | orchestrator | 2026-04-24 05:42:04.907022 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:42:04.907033 | orchestrator | Friday 24 April 2026 05:42:04 +0000 (0:00:01.182) 0:39:46.605 ********** 2026-04-24 05:42:07.544096 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:07.544226 | orchestrator | 2026-04-24 05:42:07.544241 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:42:07.544252 | orchestrator | Friday 24 April 2026 05:42:06 +0000 (0:00:01.141) 0:39:47.747 ********** 2026-04-24 05:42:07.544264 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:07.544273 | orchestrator | 2026-04-24 05:42:07.544282 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:42:07.544292 | orchestrator | Friday 24 April 2026 05:42:07 +0000 (0:00:01.256) 0:39:49.004 ********** 2026-04-24 05:42:07.544303 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:42:07.544340 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'uuids': ['69ee4aae-da3e-49ce-8e1d-04f23a1ac1f1'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13']}})  2026-04-24 05:42:07.544353 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '36b4f46e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:42:07.544379 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1']}})  2026-04-24 05:42:07.544389 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:42:07.544398 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:42:07.544424 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:42:07.544435 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:42:07.544451 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF', 'dm-uuid-CRYPT-LUKS2-57e78844afcf406497404f4a368c2f85-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:42:07.544460 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:42:07.544474 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'uuids': ['57e78844-afcf-4064-9740-4f4a368c2f85'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF']}})  2026-04-24 05:42:07.544483 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3']}})  2026-04-24 05:42:07.544493 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:42:07.544515 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8aa3c015', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:42:08.873969 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:42:08.874143 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:42:08.874218 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13', 'dm-uuid-CRYPT-LUKS2-69ee4aaeda3e49ce8e1d04f23a1ac1f1-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:42:08.874235 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:08.874249 | orchestrator | 2026-04-24 05:42:08.874261 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:42:08.874274 | orchestrator | Friday 24 April 2026 05:42:08 +0000 (0:00:01.377) 0:39:50.381 ********** 2026-04-24 05:42:08.874287 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:08.874300 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'uuids': ['69ee4aae-da3e-49ce-8e1d-04f23a1ac1f1'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:08.874336 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '36b4f46e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:08.874373 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:08.874389 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:08.874401 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:08.874413 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:08.874432 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:08.874449 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF', 'dm-uuid-CRYPT-LUKS2-57e78844afcf406497404f4a368c2f85-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244361 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244476 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'uuids': ['57e78844-afcf-4064-9740-4f4a368c2f85'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244496 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244536 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244578 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8aa3c015', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244594 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244606 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244625 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13', 'dm-uuid-CRYPT-LUKS2-69ee4aaeda3e49ce8e1d04f23a1ac1f1-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:42:14.244638 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:14.244651 | orchestrator | 2026-04-24 05:42:14.244663 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:42:14.244675 | orchestrator | Friday 24 April 2026 05:42:10 +0000 (0:00:01.388) 0:39:51.770 ********** 2026-04-24 05:42:14.244686 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:14.244698 | orchestrator | 2026-04-24 05:42:14.244708 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:42:14.244719 | orchestrator | Friday 24 April 2026 05:42:11 +0000 (0:00:01.519) 0:39:53.290 ********** 2026-04-24 05:42:14.244730 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:14.244741 | orchestrator | 2026-04-24 05:42:14.244752 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:42:14.244763 | orchestrator | Friday 24 April 2026 05:42:12 +0000 (0:00:01.164) 0:39:54.455 ********** 2026-04-24 05:42:14.244774 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:14.244785 | orchestrator | 2026-04-24 05:42:14.244795 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:42:14.244813 | orchestrator | Friday 24 April 2026 05:42:14 +0000 (0:00:01.492) 0:39:55.948 ********** 2026-04-24 05:42:54.677979 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678223 | orchestrator | 2026-04-24 05:42:54.678246 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:42:54.678260 | orchestrator | Friday 24 April 2026 05:42:15 +0000 (0:00:01.105) 0:39:57.054 ********** 2026-04-24 05:42:54.678271 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678282 | orchestrator | 2026-04-24 05:42:54.678294 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:42:54.678320 | orchestrator | Friday 24 April 2026 05:42:16 +0000 (0:00:01.242) 0:39:58.296 ********** 2026-04-24 05:42:54.678331 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678342 | orchestrator | 2026-04-24 05:42:54.678353 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:42:54.678364 | orchestrator | Friday 24 April 2026 05:42:17 +0000 (0:00:01.123) 0:39:59.419 ********** 2026-04-24 05:42:54.678376 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-24 05:42:54.678387 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-24 05:42:54.678398 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-24 05:42:54.678409 | orchestrator | 2026-04-24 05:42:54.678419 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:42:54.678430 | orchestrator | Friday 24 April 2026 05:42:19 +0000 (0:00:01.679) 0:40:01.098 ********** 2026-04-24 05:42:54.678441 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 05:42:54.678475 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 05:42:54.678486 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 05:42:54.678497 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678508 | orchestrator | 2026-04-24 05:42:54.678521 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:42:54.678534 | orchestrator | Friday 24 April 2026 05:42:20 +0000 (0:00:01.211) 0:40:02.310 ********** 2026-04-24 05:42:54.678545 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4 2026-04-24 05:42:54.678560 | orchestrator | 2026-04-24 05:42:54.678573 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:42:54.678587 | orchestrator | Friday 24 April 2026 05:42:21 +0000 (0:00:01.101) 0:40:03.412 ********** 2026-04-24 05:42:54.678600 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678612 | orchestrator | 2026-04-24 05:42:54.678624 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:42:54.678636 | orchestrator | Friday 24 April 2026 05:42:22 +0000 (0:00:01.144) 0:40:04.556 ********** 2026-04-24 05:42:54.678649 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678661 | orchestrator | 2026-04-24 05:42:54.678673 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:42:54.678685 | orchestrator | Friday 24 April 2026 05:42:23 +0000 (0:00:01.130) 0:40:05.687 ********** 2026-04-24 05:42:54.678697 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678710 | orchestrator | 2026-04-24 05:42:54.678723 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:42:54.678735 | orchestrator | Friday 24 April 2026 05:42:25 +0000 (0:00:01.145) 0:40:06.833 ********** 2026-04-24 05:42:54.678749 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:54.678761 | orchestrator | 2026-04-24 05:42:54.678773 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:42:54.678785 | orchestrator | Friday 24 April 2026 05:42:26 +0000 (0:00:01.238) 0:40:08.072 ********** 2026-04-24 05:42:54.678798 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:42:54.678810 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:42:54.678822 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:42:54.678834 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678847 | orchestrator | 2026-04-24 05:42:54.678860 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:42:54.678872 | orchestrator | Friday 24 April 2026 05:42:28 +0000 (0:00:01.784) 0:40:09.856 ********** 2026-04-24 05:42:54.678883 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:42:54.678894 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:42:54.678904 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:42:54.678915 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.678925 | orchestrator | 2026-04-24 05:42:54.678936 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:42:54.678947 | orchestrator | Friday 24 April 2026 05:42:29 +0000 (0:00:01.395) 0:40:11.252 ********** 2026-04-24 05:42:54.678958 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:42:54.678969 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:42:54.678979 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:42:54.678990 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.679000 | orchestrator | 2026-04-24 05:42:54.679011 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:42:54.679022 | orchestrator | Friday 24 April 2026 05:42:30 +0000 (0:00:01.424) 0:40:12.676 ********** 2026-04-24 05:42:54.679032 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:54.679043 | orchestrator | 2026-04-24 05:42:54.679062 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:42:54.679073 | orchestrator | Friday 24 April 2026 05:42:32 +0000 (0:00:01.153) 0:40:13.830 ********** 2026-04-24 05:42:54.679083 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 05:42:54.679094 | orchestrator | 2026-04-24 05:42:54.679104 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:42:54.679115 | orchestrator | Friday 24 April 2026 05:42:33 +0000 (0:00:01.313) 0:40:15.143 ********** 2026-04-24 05:42:54.679181 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:42:54.679201 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:42:54.679219 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:42:54.679230 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:42:54.679248 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-24 05:42:54.679259 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:42:54.679270 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:42:54.679281 | orchestrator | 2026-04-24 05:42:54.679291 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:42:54.679302 | orchestrator | Friday 24 April 2026 05:42:35 +0000 (0:00:01.821) 0:40:16.965 ********** 2026-04-24 05:42:54.679313 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:42:54.679323 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:42:54.679334 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:42:54.679345 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:42:54.679356 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-24 05:42:54.679366 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:42:54.679377 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:42:54.679388 | orchestrator | 2026-04-24 05:42:54.679398 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-24 05:42:54.679409 | orchestrator | Friday 24 April 2026 05:42:37 +0000 (0:00:02.265) 0:40:19.231 ********** 2026-04-24 05:42:54.679420 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:54.679431 | orchestrator | 2026-04-24 05:42:54.679441 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-24 05:42:54.679452 | orchestrator | Friday 24 April 2026 05:42:38 +0000 (0:00:01.092) 0:40:20.324 ********** 2026-04-24 05:42:54.679462 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:54.679473 | orchestrator | 2026-04-24 05:42:54.679484 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-24 05:42:54.679495 | orchestrator | Friday 24 April 2026 05:42:39 +0000 (0:00:00.771) 0:40:21.095 ********** 2026-04-24 05:42:54.679505 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:54.679516 | orchestrator | 2026-04-24 05:42:54.679527 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-24 05:42:54.679537 | orchestrator | Friday 24 April 2026 05:42:40 +0000 (0:00:00.917) 0:40:22.012 ********** 2026-04-24 05:42:54.679548 | orchestrator | changed: [testbed-node-4] => (item=2) 2026-04-24 05:42:54.679559 | orchestrator | changed: [testbed-node-4] => (item=3) 2026-04-24 05:42:54.679570 | orchestrator | 2026-04-24 05:42:54.679580 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:42:54.679591 | orchestrator | Friday 24 April 2026 05:42:44 +0000 (0:00:03.739) 0:40:25.752 ********** 2026-04-24 05:42:54.679602 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4 2026-04-24 05:42:54.679622 | orchestrator | 2026-04-24 05:42:54.679633 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:42:54.679644 | orchestrator | Friday 24 April 2026 05:42:45 +0000 (0:00:01.323) 0:40:27.076 ********** 2026-04-24 05:42:54.679655 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4 2026-04-24 05:42:54.679666 | orchestrator | 2026-04-24 05:42:54.679676 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:42:54.679687 | orchestrator | Friday 24 April 2026 05:42:46 +0000 (0:00:01.137) 0:40:28.214 ********** 2026-04-24 05:42:54.679697 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.679708 | orchestrator | 2026-04-24 05:42:54.679719 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:42:54.679729 | orchestrator | Friday 24 April 2026 05:42:47 +0000 (0:00:01.182) 0:40:29.397 ********** 2026-04-24 05:42:54.679740 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:54.679751 | orchestrator | 2026-04-24 05:42:54.679761 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:42:54.679772 | orchestrator | Friday 24 April 2026 05:42:49 +0000 (0:00:01.489) 0:40:30.886 ********** 2026-04-24 05:42:54.679783 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:54.679793 | orchestrator | 2026-04-24 05:42:54.679804 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:42:54.679815 | orchestrator | Friday 24 April 2026 05:42:50 +0000 (0:00:01.542) 0:40:32.429 ********** 2026-04-24 05:42:54.679825 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:42:54.679836 | orchestrator | 2026-04-24 05:42:54.679847 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:42:54.679857 | orchestrator | Friday 24 April 2026 05:42:52 +0000 (0:00:01.537) 0:40:33.967 ********** 2026-04-24 05:42:54.679868 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.679878 | orchestrator | 2026-04-24 05:42:54.679889 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:42:54.679900 | orchestrator | Friday 24 April 2026 05:42:53 +0000 (0:00:01.109) 0:40:35.077 ********** 2026-04-24 05:42:54.679910 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.679921 | orchestrator | 2026-04-24 05:42:54.679932 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:42:54.679942 | orchestrator | Friday 24 April 2026 05:42:54 +0000 (0:00:01.141) 0:40:36.218 ********** 2026-04-24 05:42:54.679953 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:42:54.679963 | orchestrator | 2026-04-24 05:42:54.679981 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:43:34.157307 | orchestrator | Friday 24 April 2026 05:42:55 +0000 (0:00:01.181) 0:40:37.400 ********** 2026-04-24 05:43:34.157428 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.157448 | orchestrator | 2026-04-24 05:43:34.157462 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:43:34.157475 | orchestrator | Friday 24 April 2026 05:42:57 +0000 (0:00:01.529) 0:40:38.929 ********** 2026-04-24 05:43:34.157507 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.157521 | orchestrator | 2026-04-24 05:43:34.157533 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:43:34.157546 | orchestrator | Friday 24 April 2026 05:42:58 +0000 (0:00:01.505) 0:40:40.435 ********** 2026-04-24 05:43:34.157559 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.157573 | orchestrator | 2026-04-24 05:43:34.157587 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:43:34.157600 | orchestrator | Friday 24 April 2026 05:42:59 +0000 (0:00:00.759) 0:40:41.195 ********** 2026-04-24 05:43:34.157615 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.157628 | orchestrator | 2026-04-24 05:43:34.157641 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:43:34.157655 | orchestrator | Friday 24 April 2026 05:43:00 +0000 (0:00:00.814) 0:40:42.009 ********** 2026-04-24 05:43:34.157696 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.157712 | orchestrator | 2026-04-24 05:43:34.157725 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:43:34.157737 | orchestrator | Friday 24 April 2026 05:43:01 +0000 (0:00:00.777) 0:40:42.787 ********** 2026-04-24 05:43:34.157749 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.157761 | orchestrator | 2026-04-24 05:43:34.157775 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:43:34.157788 | orchestrator | Friday 24 April 2026 05:43:01 +0000 (0:00:00.775) 0:40:43.563 ********** 2026-04-24 05:43:34.157800 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.157813 | orchestrator | 2026-04-24 05:43:34.157826 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:43:34.157839 | orchestrator | Friday 24 April 2026 05:43:02 +0000 (0:00:00.794) 0:40:44.357 ********** 2026-04-24 05:43:34.157853 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.157867 | orchestrator | 2026-04-24 05:43:34.157880 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:43:34.157895 | orchestrator | Friday 24 April 2026 05:43:03 +0000 (0:00:00.804) 0:40:45.162 ********** 2026-04-24 05:43:34.157908 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.157921 | orchestrator | 2026-04-24 05:43:34.157935 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:43:34.157948 | orchestrator | Friday 24 April 2026 05:43:04 +0000 (0:00:00.780) 0:40:45.943 ********** 2026-04-24 05:43:34.157960 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.157973 | orchestrator | 2026-04-24 05:43:34.157987 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:43:34.158000 | orchestrator | Friday 24 April 2026 05:43:04 +0000 (0:00:00.765) 0:40:46.708 ********** 2026-04-24 05:43:34.158014 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.158092 | orchestrator | 2026-04-24 05:43:34.158126 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:43:34.158140 | orchestrator | Friday 24 April 2026 05:43:05 +0000 (0:00:00.786) 0:40:47.494 ********** 2026-04-24 05:43:34.158153 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.158166 | orchestrator | 2026-04-24 05:43:34.158179 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:43:34.158193 | orchestrator | Friday 24 April 2026 05:43:06 +0000 (0:00:00.777) 0:40:48.272 ********** 2026-04-24 05:43:34.158206 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158219 | orchestrator | 2026-04-24 05:43:34.158232 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:43:34.158245 | orchestrator | Friday 24 April 2026 05:43:07 +0000 (0:00:00.778) 0:40:49.050 ********** 2026-04-24 05:43:34.158258 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158271 | orchestrator | 2026-04-24 05:43:34.158283 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:43:34.158297 | orchestrator | Friday 24 April 2026 05:43:08 +0000 (0:00:00.767) 0:40:49.818 ********** 2026-04-24 05:43:34.158310 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158323 | orchestrator | 2026-04-24 05:43:34.158336 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:43:34.158349 | orchestrator | Friday 24 April 2026 05:43:08 +0000 (0:00:00.767) 0:40:50.585 ********** 2026-04-24 05:43:34.158361 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158375 | orchestrator | 2026-04-24 05:43:34.158388 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:43:34.158401 | orchestrator | Friday 24 April 2026 05:43:09 +0000 (0:00:00.792) 0:40:51.377 ********** 2026-04-24 05:43:34.158414 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158427 | orchestrator | 2026-04-24 05:43:34.158439 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:43:34.158452 | orchestrator | Friday 24 April 2026 05:43:10 +0000 (0:00:00.848) 0:40:52.226 ********** 2026-04-24 05:43:34.158476 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158490 | orchestrator | 2026-04-24 05:43:34.158503 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:43:34.158516 | orchestrator | Friday 24 April 2026 05:43:11 +0000 (0:00:00.803) 0:40:53.029 ********** 2026-04-24 05:43:34.158529 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158541 | orchestrator | 2026-04-24 05:43:34.158555 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:43:34.158569 | orchestrator | Friday 24 April 2026 05:43:12 +0000 (0:00:00.801) 0:40:53.831 ********** 2026-04-24 05:43:34.158583 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158596 | orchestrator | 2026-04-24 05:43:34.158609 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:43:34.158622 | orchestrator | Friday 24 April 2026 05:43:12 +0000 (0:00:00.766) 0:40:54.598 ********** 2026-04-24 05:43:34.158656 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158669 | orchestrator | 2026-04-24 05:43:34.158682 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:43:34.158694 | orchestrator | Friday 24 April 2026 05:43:13 +0000 (0:00:00.764) 0:40:55.362 ********** 2026-04-24 05:43:34.158704 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158715 | orchestrator | 2026-04-24 05:43:34.158727 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:43:34.158747 | orchestrator | Friday 24 April 2026 05:43:14 +0000 (0:00:00.774) 0:40:56.137 ********** 2026-04-24 05:43:34.158760 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158771 | orchestrator | 2026-04-24 05:43:34.158782 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:43:34.158794 | orchestrator | Friday 24 April 2026 05:43:15 +0000 (0:00:00.762) 0:40:56.899 ********** 2026-04-24 05:43:34.158806 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.158818 | orchestrator | 2026-04-24 05:43:34.158830 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:43:34.158843 | orchestrator | Friday 24 April 2026 05:43:15 +0000 (0:00:00.767) 0:40:57.667 ********** 2026-04-24 05:43:34.158855 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.158869 | orchestrator | 2026-04-24 05:43:34.158879 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:43:34.158890 | orchestrator | Friday 24 April 2026 05:43:17 +0000 (0:00:01.552) 0:40:59.219 ********** 2026-04-24 05:43:34.158903 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.158915 | orchestrator | 2026-04-24 05:43:34.158928 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:43:34.158941 | orchestrator | Friday 24 April 2026 05:43:19 +0000 (0:00:01.949) 0:41:01.169 ********** 2026-04-24 05:43:34.158953 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4 2026-04-24 05:43:34.159216 | orchestrator | 2026-04-24 05:43:34.159247 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:43:34.159260 | orchestrator | Friday 24 April 2026 05:43:20 +0000 (0:00:01.135) 0:41:02.305 ********** 2026-04-24 05:43:34.159274 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.159288 | orchestrator | 2026-04-24 05:43:34.159301 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:43:34.159315 | orchestrator | Friday 24 April 2026 05:43:21 +0000 (0:00:01.182) 0:41:03.487 ********** 2026-04-24 05:43:34.159328 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.159341 | orchestrator | 2026-04-24 05:43:34.159354 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:43:34.159367 | orchestrator | Friday 24 April 2026 05:43:22 +0000 (0:00:01.152) 0:41:04.640 ********** 2026-04-24 05:43:34.159380 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:43:34.159392 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:43:34.159422 | orchestrator | 2026-04-24 05:43:34.159437 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:43:34.159451 | orchestrator | Friday 24 April 2026 05:43:24 +0000 (0:00:01.811) 0:41:06.452 ********** 2026-04-24 05:43:34.159465 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.159477 | orchestrator | 2026-04-24 05:43:34.159491 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:43:34.159504 | orchestrator | Friday 24 April 2026 05:43:26 +0000 (0:00:01.482) 0:41:07.935 ********** 2026-04-24 05:43:34.159518 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.159531 | orchestrator | 2026-04-24 05:43:34.159545 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:43:34.159558 | orchestrator | Friday 24 April 2026 05:43:27 +0000 (0:00:01.150) 0:41:09.085 ********** 2026-04-24 05:43:34.159572 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.159586 | orchestrator | 2026-04-24 05:43:34.159600 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:43:34.159614 | orchestrator | Friday 24 April 2026 05:43:28 +0000 (0:00:00.816) 0:41:09.902 ********** 2026-04-24 05:43:34.159627 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.159641 | orchestrator | 2026-04-24 05:43:34.159655 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:43:34.159668 | orchestrator | Friday 24 April 2026 05:43:28 +0000 (0:00:00.785) 0:41:10.687 ********** 2026-04-24 05:43:34.159680 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4 2026-04-24 05:43:34.159694 | orchestrator | 2026-04-24 05:43:34.159706 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:43:34.159719 | orchestrator | Friday 24 April 2026 05:43:30 +0000 (0:00:01.101) 0:41:11.789 ********** 2026-04-24 05:43:34.159733 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:43:34.159746 | orchestrator | 2026-04-24 05:43:34.159760 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:43:34.159774 | orchestrator | Friday 24 April 2026 05:43:31 +0000 (0:00:01.726) 0:41:13.515 ********** 2026-04-24 05:43:34.159786 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:43:34.159800 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:43:34.159814 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:43:34.159828 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.159842 | orchestrator | 2026-04-24 05:43:34.159855 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:43:34.159869 | orchestrator | Friday 24 April 2026 05:43:32 +0000 (0:00:01.137) 0:41:14.652 ********** 2026-04-24 05:43:34.159882 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:43:34.159895 | orchestrator | 2026-04-24 05:43:34.159910 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:43:34.159922 | orchestrator | Friday 24 April 2026 05:43:34 +0000 (0:00:01.118) 0:41:15.771 ********** 2026-04-24 05:43:34.159952 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773073 | orchestrator | 2026-04-24 05:44:16.773225 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:44:16.773241 | orchestrator | Friday 24 April 2026 05:43:35 +0000 (0:00:01.169) 0:41:16.940 ********** 2026-04-24 05:44:16.773250 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773259 | orchestrator | 2026-04-24 05:44:16.773279 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:44:16.773287 | orchestrator | Friday 24 April 2026 05:43:36 +0000 (0:00:01.175) 0:41:18.116 ********** 2026-04-24 05:44:16.773295 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773302 | orchestrator | 2026-04-24 05:44:16.773309 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:44:16.773317 | orchestrator | Friday 24 April 2026 05:43:37 +0000 (0:00:01.156) 0:41:19.273 ********** 2026-04-24 05:44:16.773342 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773350 | orchestrator | 2026-04-24 05:44:16.773357 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:44:16.773364 | orchestrator | Friday 24 April 2026 05:43:38 +0000 (0:00:00.831) 0:41:20.104 ********** 2026-04-24 05:44:16.773371 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:16.773380 | orchestrator | 2026-04-24 05:44:16.773387 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:44:16.773395 | orchestrator | Friday 24 April 2026 05:43:40 +0000 (0:00:02.148) 0:41:22.253 ********** 2026-04-24 05:44:16.773402 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:16.773409 | orchestrator | 2026-04-24 05:44:16.773416 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:44:16.773423 | orchestrator | Friday 24 April 2026 05:43:41 +0000 (0:00:00.790) 0:41:23.043 ********** 2026-04-24 05:44:16.773430 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4 2026-04-24 05:44:16.773437 | orchestrator | 2026-04-24 05:44:16.773444 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:44:16.773452 | orchestrator | Friday 24 April 2026 05:43:42 +0000 (0:00:01.125) 0:41:24.168 ********** 2026-04-24 05:44:16.773459 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773466 | orchestrator | 2026-04-24 05:44:16.773473 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:44:16.773480 | orchestrator | Friday 24 April 2026 05:43:43 +0000 (0:00:01.126) 0:41:25.295 ********** 2026-04-24 05:44:16.773487 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773494 | orchestrator | 2026-04-24 05:44:16.773502 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:44:16.773509 | orchestrator | Friday 24 April 2026 05:43:44 +0000 (0:00:01.212) 0:41:26.508 ********** 2026-04-24 05:44:16.773516 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773523 | orchestrator | 2026-04-24 05:44:16.773530 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:44:16.773537 | orchestrator | Friday 24 April 2026 05:43:45 +0000 (0:00:01.139) 0:41:27.647 ********** 2026-04-24 05:44:16.773544 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773551 | orchestrator | 2026-04-24 05:44:16.773558 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:44:16.773565 | orchestrator | Friday 24 April 2026 05:43:47 +0000 (0:00:01.194) 0:41:28.842 ********** 2026-04-24 05:44:16.773572 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773579 | orchestrator | 2026-04-24 05:44:16.773586 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:44:16.773593 | orchestrator | Friday 24 April 2026 05:43:48 +0000 (0:00:01.152) 0:41:29.994 ********** 2026-04-24 05:44:16.773601 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773608 | orchestrator | 2026-04-24 05:44:16.773615 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:44:16.773622 | orchestrator | Friday 24 April 2026 05:43:49 +0000 (0:00:01.135) 0:41:31.130 ********** 2026-04-24 05:44:16.773629 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773636 | orchestrator | 2026-04-24 05:44:16.773643 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:44:16.773650 | orchestrator | Friday 24 April 2026 05:43:50 +0000 (0:00:01.163) 0:41:32.294 ********** 2026-04-24 05:44:16.773658 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.773670 | orchestrator | 2026-04-24 05:44:16.773682 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:44:16.773694 | orchestrator | Friday 24 April 2026 05:43:51 +0000 (0:00:01.140) 0:41:33.434 ********** 2026-04-24 05:44:16.773707 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:16.773718 | orchestrator | 2026-04-24 05:44:16.773730 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:44:16.773752 | orchestrator | Friday 24 April 2026 05:43:52 +0000 (0:00:00.807) 0:41:34.242 ********** 2026-04-24 05:44:16.773766 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4 2026-04-24 05:44:16.773774 | orchestrator | 2026-04-24 05:44:16.773781 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:44:16.773789 | orchestrator | Friday 24 April 2026 05:43:53 +0000 (0:00:01.136) 0:41:35.378 ********** 2026-04-24 05:44:16.773796 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-24 05:44:16.773804 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-24 05:44:16.773811 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-24 05:44:16.773818 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-24 05:44:16.773825 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-24 05:44:16.773832 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-24 05:44:16.773839 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-24 05:44:16.773847 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:44:16.773854 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:44:16.773877 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:44:16.773885 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:44:16.773892 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:44:16.773900 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:44:16.773912 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:44:16.773919 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-24 05:44:16.773926 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-24 05:44:16.773934 | orchestrator | 2026-04-24 05:44:16.773941 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:44:16.773948 | orchestrator | Friday 24 April 2026 05:43:59 +0000 (0:00:06.062) 0:41:41.440 ********** 2026-04-24 05:44:16.773955 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4 2026-04-24 05:44:16.773962 | orchestrator | 2026-04-24 05:44:16.773970 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 05:44:16.773977 | orchestrator | Friday 24 April 2026 05:44:00 +0000 (0:00:01.192) 0:41:42.633 ********** 2026-04-24 05:44:16.773984 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 05:44:16.773992 | orchestrator | 2026-04-24 05:44:16.774000 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 05:44:16.774007 | orchestrator | Friday 24 April 2026 05:44:02 +0000 (0:00:01.478) 0:41:44.111 ********** 2026-04-24 05:44:16.774053 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 05:44:16.774061 | orchestrator | 2026-04-24 05:44:16.774069 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:44:16.774076 | orchestrator | Friday 24 April 2026 05:44:03 +0000 (0:00:01.589) 0:41:45.701 ********** 2026-04-24 05:44:16.774083 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774090 | orchestrator | 2026-04-24 05:44:16.774116 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:44:16.774124 | orchestrator | Friday 24 April 2026 05:44:04 +0000 (0:00:00.783) 0:41:46.485 ********** 2026-04-24 05:44:16.774131 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774138 | orchestrator | 2026-04-24 05:44:16.774145 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:44:16.774152 | orchestrator | Friday 24 April 2026 05:44:05 +0000 (0:00:00.802) 0:41:47.287 ********** 2026-04-24 05:44:16.774160 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774173 | orchestrator | 2026-04-24 05:44:16.774188 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:44:16.774196 | orchestrator | Friday 24 April 2026 05:44:06 +0000 (0:00:00.804) 0:41:48.091 ********** 2026-04-24 05:44:16.774203 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774210 | orchestrator | 2026-04-24 05:44:16.774217 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:44:16.774224 | orchestrator | Friday 24 April 2026 05:44:07 +0000 (0:00:00.766) 0:41:48.857 ********** 2026-04-24 05:44:16.774231 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774238 | orchestrator | 2026-04-24 05:44:16.774245 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:44:16.774253 | orchestrator | Friday 24 April 2026 05:44:07 +0000 (0:00:00.762) 0:41:49.621 ********** 2026-04-24 05:44:16.774260 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774267 | orchestrator | 2026-04-24 05:44:16.774274 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:44:16.774281 | orchestrator | Friday 24 April 2026 05:44:08 +0000 (0:00:00.830) 0:41:50.451 ********** 2026-04-24 05:44:16.774288 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774295 | orchestrator | 2026-04-24 05:44:16.774302 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:44:16.774309 | orchestrator | Friday 24 April 2026 05:44:09 +0000 (0:00:00.763) 0:41:51.215 ********** 2026-04-24 05:44:16.774316 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774323 | orchestrator | 2026-04-24 05:44:16.774331 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:44:16.774338 | orchestrator | Friday 24 April 2026 05:44:10 +0000 (0:00:00.765) 0:41:51.981 ********** 2026-04-24 05:44:16.774345 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774352 | orchestrator | 2026-04-24 05:44:16.774359 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:44:16.774366 | orchestrator | Friday 24 April 2026 05:44:11 +0000 (0:00:00.767) 0:41:52.748 ********** 2026-04-24 05:44:16.774373 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:16.774380 | orchestrator | 2026-04-24 05:44:16.774387 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:44:16.774394 | orchestrator | Friday 24 April 2026 05:44:11 +0000 (0:00:00.748) 0:41:53.496 ********** 2026-04-24 05:44:16.774401 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:16.774408 | orchestrator | 2026-04-24 05:44:16.774415 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:44:16.774423 | orchestrator | Friday 24 April 2026 05:44:12 +0000 (0:00:00.853) 0:41:54.350 ********** 2026-04-24 05:44:16.774430 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:44:16.774437 | orchestrator | 2026-04-24 05:44:16.774444 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:44:16.774452 | orchestrator | Friday 24 April 2026 05:44:16 +0000 (0:00:04.027) 0:41:58.378 ********** 2026-04-24 05:44:16.774464 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 05:44:58.277170 | orchestrator | 2026-04-24 05:44:58.277278 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:44:58.277295 | orchestrator | Friday 24 April 2026 05:44:17 +0000 (0:00:00.862) 0:41:59.241 ********** 2026-04-24 05:44:58.277326 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-24 05:44:58.277340 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-24 05:44:58.277373 | orchestrator | 2026-04-24 05:44:58.277385 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:44:58.277397 | orchestrator | Friday 24 April 2026 05:44:24 +0000 (0:00:07.109) 0:42:06.350 ********** 2026-04-24 05:44:58.277407 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.277419 | orchestrator | 2026-04-24 05:44:58.277430 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:44:58.277440 | orchestrator | Friday 24 April 2026 05:44:25 +0000 (0:00:00.773) 0:42:07.123 ********** 2026-04-24 05:44:58.277451 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.277462 | orchestrator | 2026-04-24 05:44:58.277474 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:44:58.277488 | orchestrator | Friday 24 April 2026 05:44:26 +0000 (0:00:00.765) 0:42:07.889 ********** 2026-04-24 05:44:58.277499 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.277511 | orchestrator | 2026-04-24 05:44:58.277522 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:44:58.277534 | orchestrator | Friday 24 April 2026 05:44:27 +0000 (0:00:00.893) 0:42:08.783 ********** 2026-04-24 05:44:58.277545 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.277556 | orchestrator | 2026-04-24 05:44:58.277568 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:44:58.277579 | orchestrator | Friday 24 April 2026 05:44:27 +0000 (0:00:00.806) 0:42:09.590 ********** 2026-04-24 05:44:58.277590 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.277602 | orchestrator | 2026-04-24 05:44:58.277613 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:44:58.277625 | orchestrator | Friday 24 April 2026 05:44:28 +0000 (0:00:00.788) 0:42:10.378 ********** 2026-04-24 05:44:58.277636 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:58.277649 | orchestrator | 2026-04-24 05:44:58.277659 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:44:58.277670 | orchestrator | Friday 24 April 2026 05:44:29 +0000 (0:00:00.899) 0:42:11.278 ********** 2026-04-24 05:44:58.277681 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:44:58.277693 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:44:58.277704 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:44:58.277716 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.277727 | orchestrator | 2026-04-24 05:44:58.277739 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:44:58.277750 | orchestrator | Friday 24 April 2026 05:44:30 +0000 (0:00:01.081) 0:42:12.359 ********** 2026-04-24 05:44:58.277761 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:44:58.277773 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:44:58.277784 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:44:58.277796 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.277807 | orchestrator | 2026-04-24 05:44:58.277818 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:44:58.277830 | orchestrator | Friday 24 April 2026 05:44:31 +0000 (0:00:01.125) 0:42:13.485 ********** 2026-04-24 05:44:58.277841 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:44:58.277853 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:44:58.277864 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:44:58.277876 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.277896 | orchestrator | 2026-04-24 05:44:58.277907 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:44:58.277919 | orchestrator | Friday 24 April 2026 05:44:32 +0000 (0:00:01.094) 0:42:14.579 ********** 2026-04-24 05:44:58.277930 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:58.277942 | orchestrator | 2026-04-24 05:44:58.277953 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:44:58.277965 | orchestrator | Friday 24 April 2026 05:44:33 +0000 (0:00:00.809) 0:42:15.389 ********** 2026-04-24 05:44:58.277977 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 05:44:58.277988 | orchestrator | 2026-04-24 05:44:58.277999 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:44:58.278011 | orchestrator | Friday 24 April 2026 05:44:34 +0000 (0:00:01.022) 0:42:16.411 ********** 2026-04-24 05:44:58.278075 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:58.278122 | orchestrator | 2026-04-24 05:44:58.278135 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-24 05:44:58.278147 | orchestrator | Friday 24 April 2026 05:44:36 +0000 (0:00:01.361) 0:42:17.773 ********** 2026-04-24 05:44:58.278158 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:58.278170 | orchestrator | 2026-04-24 05:44:58.278198 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:44:58.278210 | orchestrator | Friday 24 April 2026 05:44:36 +0000 (0:00:00.810) 0:42:18.584 ********** 2026-04-24 05:44:58.278221 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:44:58.278240 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:44:58.278252 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:44:58.278263 | orchestrator | 2026-04-24 05:44:58.278274 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-24 05:44:58.278286 | orchestrator | Friday 24 April 2026 05:44:38 +0000 (0:00:01.771) 0:42:20.356 ********** 2026-04-24 05:44:58.278298 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-4 2026-04-24 05:44:58.278309 | orchestrator | 2026-04-24 05:44:58.278320 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-24 05:44:58.278332 | orchestrator | Friday 24 April 2026 05:44:39 +0000 (0:00:01.120) 0:42:21.477 ********** 2026-04-24 05:44:58.278344 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.278355 | orchestrator | 2026-04-24 05:44:58.278367 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-24 05:44:58.278379 | orchestrator | Friday 24 April 2026 05:44:40 +0000 (0:00:01.101) 0:42:22.579 ********** 2026-04-24 05:44:58.278390 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.278402 | orchestrator | 2026-04-24 05:44:58.278413 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-24 05:44:58.278424 | orchestrator | Friday 24 April 2026 05:44:41 +0000 (0:00:01.130) 0:42:23.710 ********** 2026-04-24 05:44:58.278435 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:58.278445 | orchestrator | 2026-04-24 05:44:58.278456 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-24 05:44:58.278467 | orchestrator | Friday 24 April 2026 05:44:43 +0000 (0:00:01.414) 0:42:25.124 ********** 2026-04-24 05:44:58.278479 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:58.278491 | orchestrator | 2026-04-24 05:44:58.278502 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-24 05:44:58.278513 | orchestrator | Friday 24 April 2026 05:44:44 +0000 (0:00:01.160) 0:42:26.284 ********** 2026-04-24 05:44:58.278524 | orchestrator | ok: [testbed-node-4] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-24 05:44:58.278535 | orchestrator | ok: [testbed-node-4] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-24 05:44:58.278546 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-24 05:44:58.278565 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-24 05:44:58.278576 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-24 05:44:58.278587 | orchestrator | 2026-04-24 05:44:58.278598 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-24 05:44:58.278609 | orchestrator | Friday 24 April 2026 05:44:47 +0000 (0:00:02.468) 0:42:28.753 ********** 2026-04-24 05:44:58.278621 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.278631 | orchestrator | 2026-04-24 05:44:58.278642 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-24 05:44:58.278652 | orchestrator | Friday 24 April 2026 05:44:47 +0000 (0:00:00.785) 0:42:29.538 ********** 2026-04-24 05:44:58.278663 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-4 2026-04-24 05:44:58.278674 | orchestrator | 2026-04-24 05:44:58.278685 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-24 05:44:58.278696 | orchestrator | Friday 24 April 2026 05:44:48 +0000 (0:00:01.142) 0:42:30.681 ********** 2026-04-24 05:44:58.278707 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-24 05:44:58.278718 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd/) 2026-04-24 05:44:58.278728 | orchestrator | 2026-04-24 05:44:58.278739 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-24 05:44:58.278750 | orchestrator | Friday 24 April 2026 05:44:50 +0000 (0:00:01.794) 0:42:32.475 ********** 2026-04-24 05:44:58.278761 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:44:58.278772 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 05:44:58.278783 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 05:44:58.278794 | orchestrator | 2026-04-24 05:44:58.278806 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-24 05:44:58.278816 | orchestrator | Friday 24 April 2026 05:44:54 +0000 (0:00:04.051) 0:42:36.527 ********** 2026-04-24 05:44:58.278827 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-24 05:44:58.278838 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 05:44:58.278849 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:44:58.278861 | orchestrator | 2026-04-24 05:44:58.278873 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-24 05:44:58.278884 | orchestrator | Friday 24 April 2026 05:44:56 +0000 (0:00:01.612) 0:42:38.139 ********** 2026-04-24 05:44:58.278895 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.278906 | orchestrator | 2026-04-24 05:44:58.278917 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-24 05:44:58.278928 | orchestrator | Friday 24 April 2026 05:44:57 +0000 (0:00:00.916) 0:42:39.056 ********** 2026-04-24 05:44:58.278939 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.278950 | orchestrator | 2026-04-24 05:44:58.278962 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-24 05:44:58.278973 | orchestrator | Friday 24 April 2026 05:44:58 +0000 (0:00:00.786) 0:42:39.842 ********** 2026-04-24 05:44:58.278984 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:44:58.278995 | orchestrator | 2026-04-24 05:44:58.279012 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-24 05:46:04.972690 | orchestrator | Friday 24 April 2026 05:44:58 +0000 (0:00:00.774) 0:42:40.617 ********** 2026-04-24 05:46:04.972801 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-4 2026-04-24 05:46:04.972823 | orchestrator | 2026-04-24 05:46:04.972870 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-24 05:46:04.972888 | orchestrator | Friday 24 April 2026 05:44:59 +0000 (0:00:01.085) 0:42:41.702 ********** 2026-04-24 05:46:04.972903 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:46:04.972920 | orchestrator | 2026-04-24 05:46:04.972936 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-24 05:46:04.972980 | orchestrator | Friday 24 April 2026 05:45:01 +0000 (0:00:01.485) 0:42:43.188 ********** 2026-04-24 05:46:04.972998 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:46:04.973014 | orchestrator | 2026-04-24 05:46:04.973031 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-24 05:46:04.973041 | orchestrator | Friday 24 April 2026 05:45:04 +0000 (0:00:03.347) 0:42:46.536 ********** 2026-04-24 05:46:04.973050 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-4 2026-04-24 05:46:04.973059 | orchestrator | 2026-04-24 05:46:04.973069 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-24 05:46:04.973135 | orchestrator | Friday 24 April 2026 05:45:05 +0000 (0:00:01.132) 0:42:47.669 ********** 2026-04-24 05:46:04.973145 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:46:04.973155 | orchestrator | 2026-04-24 05:46:04.973165 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-24 05:46:04.973174 | orchestrator | Friday 24 April 2026 05:45:07 +0000 (0:00:01.916) 0:42:49.586 ********** 2026-04-24 05:46:04.973183 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:46:04.973193 | orchestrator | 2026-04-24 05:46:04.973203 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-24 05:46:04.973213 | orchestrator | Friday 24 April 2026 05:45:09 +0000 (0:00:01.917) 0:42:51.504 ********** 2026-04-24 05:46:04.973223 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:46:04.973232 | orchestrator | 2026-04-24 05:46:04.973242 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-24 05:46:04.973251 | orchestrator | Friday 24 April 2026 05:45:12 +0000 (0:00:02.224) 0:42:53.729 ********** 2026-04-24 05:46:04.973261 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:46:04.973279 | orchestrator | 2026-04-24 05:46:04.973295 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-24 05:46:04.973312 | orchestrator | Friday 24 April 2026 05:45:13 +0000 (0:00:01.106) 0:42:54.835 ********** 2026-04-24 05:46:04.973328 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:46:04.973342 | orchestrator | 2026-04-24 05:46:04.973356 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-24 05:46:04.973371 | orchestrator | Friday 24 April 2026 05:45:14 +0000 (0:00:01.142) 0:42:55.977 ********** 2026-04-24 05:46:04.973386 | orchestrator | ok: [testbed-node-4] => (item=3) 2026-04-24 05:46:04.973402 | orchestrator | ok: [testbed-node-4] => (item=2) 2026-04-24 05:46:04.973419 | orchestrator | 2026-04-24 05:46:04.973432 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-24 05:46:04.973446 | orchestrator | Friday 24 April 2026 05:45:16 +0000 (0:00:01.887) 0:42:57.865 ********** 2026-04-24 05:46:04.973460 | orchestrator | ok: [testbed-node-4] => (item=3) 2026-04-24 05:46:04.973474 | orchestrator | ok: [testbed-node-4] => (item=2) 2026-04-24 05:46:04.973489 | orchestrator | 2026-04-24 05:46:04.973506 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-24 05:46:04.973521 | orchestrator | Friday 24 April 2026 05:45:19 +0000 (0:00:02.933) 0:43:00.798 ********** 2026-04-24 05:46:04.973536 | orchestrator | changed: [testbed-node-4] => (item=3) 2026-04-24 05:46:04.973552 | orchestrator | changed: [testbed-node-4] => (item=2) 2026-04-24 05:46:04.973569 | orchestrator | 2026-04-24 05:46:04.973585 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-24 05:46:04.973601 | orchestrator | Friday 24 April 2026 05:45:23 +0000 (0:00:04.362) 0:43:05.161 ********** 2026-04-24 05:46:04.973616 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:46:04.973633 | orchestrator | 2026-04-24 05:46:04.973648 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-24 05:46:04.973665 | orchestrator | Friday 24 April 2026 05:45:24 +0000 (0:00:00.913) 0:43:06.075 ********** 2026-04-24 05:46:04.973681 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:46:04.973696 | orchestrator | 2026-04-24 05:46:04.973712 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-24 05:46:04.973743 | orchestrator | Friday 24 April 2026 05:45:25 +0000 (0:00:00.886) 0:43:06.961 ********** 2026-04-24 05:46:04.973759 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:46:04.973776 | orchestrator | 2026-04-24 05:46:04.973792 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-24 05:46:04.973809 | orchestrator | Friday 24 April 2026 05:45:26 +0000 (0:00:00.867) 0:43:07.829 ********** 2026-04-24 05:46:04.973826 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:46:04.973843 | orchestrator | 2026-04-24 05:46:04.973859 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-24 05:46:04.973876 | orchestrator | Friday 24 April 2026 05:45:26 +0000 (0:00:00.786) 0:43:08.615 ********** 2026-04-24 05:46:04.973893 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:46:04.973910 | orchestrator | 2026-04-24 05:46:04.973926 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-24 05:46:04.973944 | orchestrator | Friday 24 April 2026 05:45:27 +0000 (0:00:00.819) 0:43:09.435 ********** 2026-04-24 05:46:04.973961 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (600 retries left). 2026-04-24 05:46:04.973979 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (599 retries left). 2026-04-24 05:46:04.973995 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (598 retries left). 2026-04-24 05:46:04.974130 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (597 retries left). 2026-04-24 05:46:04.974156 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (596 retries left). 2026-04-24 05:46:04.974184 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:46:04.974201 | orchestrator | 2026-04-24 05:46:04.974218 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-24 05:46:04.974234 | orchestrator | 2026-04-24 05:46:04.974251 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:46:04.974267 | orchestrator | Friday 24 April 2026 05:45:44 +0000 (0:00:16.740) 0:43:26.175 ********** 2026-04-24 05:46:04.974283 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-5 2026-04-24 05:46:04.974297 | orchestrator | 2026-04-24 05:46:04.974312 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:46:04.974328 | orchestrator | Friday 24 April 2026 05:45:45 +0000 (0:00:01.330) 0:43:27.506 ********** 2026-04-24 05:46:04.974343 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:04.974359 | orchestrator | 2026-04-24 05:46:04.974374 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:46:04.974389 | orchestrator | Friday 24 April 2026 05:45:47 +0000 (0:00:01.470) 0:43:28.976 ********** 2026-04-24 05:46:04.974405 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:04.974422 | orchestrator | 2026-04-24 05:46:04.974439 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:46:04.974454 | orchestrator | Friday 24 April 2026 05:45:48 +0000 (0:00:01.127) 0:43:30.104 ********** 2026-04-24 05:46:04.974472 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:04.974487 | orchestrator | 2026-04-24 05:46:04.974497 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:46:04.974506 | orchestrator | Friday 24 April 2026 05:45:49 +0000 (0:00:01.451) 0:43:31.555 ********** 2026-04-24 05:46:04.974516 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:04.974526 | orchestrator | 2026-04-24 05:46:04.974535 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:46:04.974544 | orchestrator | Friday 24 April 2026 05:45:50 +0000 (0:00:01.125) 0:43:32.681 ********** 2026-04-24 05:46:04.974554 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:04.974563 | orchestrator | 2026-04-24 05:46:04.974573 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:46:04.974582 | orchestrator | Friday 24 April 2026 05:45:52 +0000 (0:00:01.199) 0:43:33.881 ********** 2026-04-24 05:46:04.974603 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:04.974613 | orchestrator | 2026-04-24 05:46:04.974623 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:46:04.974633 | orchestrator | Friday 24 April 2026 05:45:53 +0000 (0:00:01.171) 0:43:35.052 ********** 2026-04-24 05:46:04.974642 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:04.974652 | orchestrator | 2026-04-24 05:46:04.974662 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:46:04.974671 | orchestrator | Friday 24 April 2026 05:45:54 +0000 (0:00:01.144) 0:43:36.197 ********** 2026-04-24 05:46:04.974681 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:04.974690 | orchestrator | 2026-04-24 05:46:04.974700 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:46:04.974709 | orchestrator | Friday 24 April 2026 05:45:55 +0000 (0:00:01.133) 0:43:37.330 ********** 2026-04-24 05:46:04.974719 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:46:04.974728 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:46:04.974737 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:46:04.974747 | orchestrator | 2026-04-24 05:46:04.974756 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:46:04.974766 | orchestrator | Friday 24 April 2026 05:45:57 +0000 (0:00:02.168) 0:43:39.498 ********** 2026-04-24 05:46:04.974775 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:04.974785 | orchestrator | 2026-04-24 05:46:04.974794 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:46:04.974803 | orchestrator | Friday 24 April 2026 05:45:59 +0000 (0:00:01.314) 0:43:40.813 ********** 2026-04-24 05:46:04.974813 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:46:04.974822 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:46:04.974832 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:46:04.974841 | orchestrator | 2026-04-24 05:46:04.974850 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:46:04.974860 | orchestrator | Friday 24 April 2026 05:46:02 +0000 (0:00:03.315) 0:43:44.129 ********** 2026-04-24 05:46:04.974869 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 05:46:04.974879 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 05:46:04.974888 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 05:46:04.974898 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:04.974907 | orchestrator | 2026-04-24 05:46:04.974917 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:46:04.974926 | orchestrator | Friday 24 April 2026 05:46:04 +0000 (0:00:01.796) 0:43:45.925 ********** 2026-04-24 05:46:04.974942 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:46:04.974975 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:46:25.789565 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:46:25.789682 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.789699 | orchestrator | 2026-04-24 05:46:25.789712 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:46:25.789747 | orchestrator | Friday 24 April 2026 05:46:06 +0000 (0:00:01.992) 0:43:47.918 ********** 2026-04-24 05:46:25.789761 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:25.789774 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:25.789786 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:25.789796 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.789807 | orchestrator | 2026-04-24 05:46:25.789818 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:46:25.789829 | orchestrator | Friday 24 April 2026 05:46:07 +0000 (0:00:01.174) 0:43:49.093 ********** 2026-04-24 05:46:25.789842 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:46:00.063493', 'end': '2026-04-24 05:46:00.122473', 'delta': '0:00:00.058980', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:46:25.789856 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:46:00.618562', 'end': '2026-04-24 05:46:00.676827', 'delta': '0:00:00.058265', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:46:25.789891 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:46:01.177559', 'end': '2026-04-24 05:46:01.220260', 'delta': '0:00:00.042701', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:46:25.789912 | orchestrator | 2026-04-24 05:46:25.789923 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:46:25.789934 | orchestrator | Friday 24 April 2026 05:46:08 +0000 (0:00:01.186) 0:43:50.280 ********** 2026-04-24 05:46:25.789945 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:25.789957 | orchestrator | 2026-04-24 05:46:25.789968 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:46:25.789978 | orchestrator | Friday 24 April 2026 05:46:09 +0000 (0:00:01.254) 0:43:51.534 ********** 2026-04-24 05:46:25.789989 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.790000 | orchestrator | 2026-04-24 05:46:25.790010 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:46:25.790134 | orchestrator | Friday 24 April 2026 05:46:11 +0000 (0:00:01.241) 0:43:52.776 ********** 2026-04-24 05:46:25.790148 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:25.790161 | orchestrator | 2026-04-24 05:46:25.790173 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:46:25.790185 | orchestrator | Friday 24 April 2026 05:46:12 +0000 (0:00:01.130) 0:43:53.906 ********** 2026-04-24 05:46:25.790197 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:46:25.790210 | orchestrator | 2026-04-24 05:46:25.790222 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:46:25.790235 | orchestrator | Friday 24 April 2026 05:46:14 +0000 (0:00:01.945) 0:43:55.852 ********** 2026-04-24 05:46:25.790247 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:25.790259 | orchestrator | 2026-04-24 05:46:25.790272 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:46:25.790285 | orchestrator | Friday 24 April 2026 05:46:15 +0000 (0:00:01.129) 0:43:56.982 ********** 2026-04-24 05:46:25.790296 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.790307 | orchestrator | 2026-04-24 05:46:25.790317 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:46:25.790328 | orchestrator | Friday 24 April 2026 05:46:16 +0000 (0:00:01.098) 0:43:58.080 ********** 2026-04-24 05:46:25.790338 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.790349 | orchestrator | 2026-04-24 05:46:25.790360 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:46:25.790370 | orchestrator | Friday 24 April 2026 05:46:17 +0000 (0:00:01.246) 0:43:59.326 ********** 2026-04-24 05:46:25.790381 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.790392 | orchestrator | 2026-04-24 05:46:25.790403 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:46:25.790413 | orchestrator | Friday 24 April 2026 05:46:18 +0000 (0:00:01.126) 0:44:00.453 ********** 2026-04-24 05:46:25.790424 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.790435 | orchestrator | 2026-04-24 05:46:25.790445 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:46:25.790456 | orchestrator | Friday 24 April 2026 05:46:19 +0000 (0:00:01.109) 0:44:01.562 ********** 2026-04-24 05:46:25.790466 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:25.790477 | orchestrator | 2026-04-24 05:46:25.790488 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:46:25.790498 | orchestrator | Friday 24 April 2026 05:46:21 +0000 (0:00:01.213) 0:44:02.776 ********** 2026-04-24 05:46:25.790509 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.790519 | orchestrator | 2026-04-24 05:46:25.790530 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:46:25.790541 | orchestrator | Friday 24 April 2026 05:46:22 +0000 (0:00:01.171) 0:44:03.947 ********** 2026-04-24 05:46:25.790551 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:25.790562 | orchestrator | 2026-04-24 05:46:25.790573 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:46:25.790583 | orchestrator | Friday 24 April 2026 05:46:23 +0000 (0:00:01.164) 0:44:05.112 ********** 2026-04-24 05:46:25.790603 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:25.790614 | orchestrator | 2026-04-24 05:46:25.790625 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:46:25.790637 | orchestrator | Friday 24 April 2026 05:46:24 +0000 (0:00:01.106) 0:44:06.219 ********** 2026-04-24 05:46:25.790647 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:25.790658 | orchestrator | 2026-04-24 05:46:25.790669 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:46:25.790679 | orchestrator | Friday 24 April 2026 05:46:25 +0000 (0:00:01.164) 0:44:07.384 ********** 2026-04-24 05:46:25.790691 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:46:25.790717 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'uuids': ['6d348d92-84de-4a0c-bfda-a8ce4c95c396'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve']}})  2026-04-24 05:46:25.901477 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '076ca587', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:46:25.901572 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71']}})  2026-04-24 05:46:25.901588 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:46:25.901603 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:46:25.901638 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-04-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:46:25.901651 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:46:25.901663 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7', 'dm-uuid-CRYPT-LUKS2-99c37d5f37cf4f86bc5baee17726ca8d-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:46:25.901705 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:46:25.901719 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'uuids': ['99c37d5f-37cf-4f86-bc5b-aee17726ca8d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7']}})  2026-04-24 05:46:25.901731 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f']}})  2026-04-24 05:46:25.901743 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:46:25.901781 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '457a59b4', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:46:27.228180 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:46:27.228277 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:46:27.228292 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve', 'dm-uuid-CRYPT-LUKS2-6d348d9284de4a0cbfdaa8ce4c95c396-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:46:27.228305 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:27.228317 | orchestrator | 2026-04-24 05:46:27.228327 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:46:27.228361 | orchestrator | Friday 24 April 2026 05:46:27 +0000 (0:00:01.347) 0:44:08.731 ********** 2026-04-24 05:46:27.228374 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:27.228387 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'uuids': ['6d348d92-84de-4a0c-bfda-a8ce4c95c396'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:27.228413 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '076ca587', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:27.228444 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:27.228458 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:27.228480 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:27.228492 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-04-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:27.228502 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:27.228524 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7', 'dm-uuid-CRYPT-LUKS2-99c37d5f37cf4f86bc5baee17726ca8d-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549763 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549834 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'uuids': ['99c37d5f-37cf-4f86-bc5b-aee17726ca8d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549858 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549864 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549890 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '457a59b4', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549900 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549905 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549909 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve', 'dm-uuid-CRYPT-LUKS2-6d348d9284de4a0cbfdaa8ce4c95c396-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:46:32.549914 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:46:32.549919 | orchestrator | 2026-04-24 05:46:32.549924 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:46:32.549929 | orchestrator | Friday 24 April 2026 05:46:28 +0000 (0:00:01.403) 0:44:10.135 ********** 2026-04-24 05:46:32.549933 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:32.549938 | orchestrator | 2026-04-24 05:46:32.549942 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:46:32.549946 | orchestrator | Friday 24 April 2026 05:46:29 +0000 (0:00:01.508) 0:44:11.643 ********** 2026-04-24 05:46:32.549952 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:32.549956 | orchestrator | 2026-04-24 05:46:32.549959 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:46:32.549963 | orchestrator | Friday 24 April 2026 05:46:31 +0000 (0:00:01.091) 0:44:12.735 ********** 2026-04-24 05:46:32.549967 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:46:32.549971 | orchestrator | 2026-04-24 05:46:32.549974 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:46:32.549981 | orchestrator | Friday 24 April 2026 05:46:32 +0000 (0:00:01.520) 0:44:14.255 ********** 2026-04-24 05:47:13.518858 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519012 | orchestrator | 2026-04-24 05:47:13.519031 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:47:13.519044 | orchestrator | Friday 24 April 2026 05:46:33 +0000 (0:00:01.169) 0:44:15.425 ********** 2026-04-24 05:47:13.519057 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519158 | orchestrator | 2026-04-24 05:47:13.519171 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:47:13.519182 | orchestrator | Friday 24 April 2026 05:46:34 +0000 (0:00:01.255) 0:44:16.680 ********** 2026-04-24 05:47:13.519193 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519204 | orchestrator | 2026-04-24 05:47:13.519215 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:47:13.519226 | orchestrator | Friday 24 April 2026 05:46:36 +0000 (0:00:01.147) 0:44:17.827 ********** 2026-04-24 05:47:13.519238 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-24 05:47:13.519249 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-24 05:47:13.519260 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-24 05:47:13.519271 | orchestrator | 2026-04-24 05:47:13.519281 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:47:13.519292 | orchestrator | Friday 24 April 2026 05:46:38 +0000 (0:00:02.062) 0:44:19.890 ********** 2026-04-24 05:47:13.519304 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 05:47:13.519315 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 05:47:13.519326 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 05:47:13.519337 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519347 | orchestrator | 2026-04-24 05:47:13.519358 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:47:13.519369 | orchestrator | Friday 24 April 2026 05:46:39 +0000 (0:00:01.232) 0:44:21.123 ********** 2026-04-24 05:47:13.519379 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-5 2026-04-24 05:47:13.519391 | orchestrator | 2026-04-24 05:47:13.519403 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:47:13.519416 | orchestrator | Friday 24 April 2026 05:46:40 +0000 (0:00:01.135) 0:44:22.259 ********** 2026-04-24 05:47:13.519426 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519437 | orchestrator | 2026-04-24 05:47:13.519448 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:47:13.519458 | orchestrator | Friday 24 April 2026 05:46:41 +0000 (0:00:01.155) 0:44:23.414 ********** 2026-04-24 05:47:13.519469 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519480 | orchestrator | 2026-04-24 05:47:13.519490 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:47:13.519501 | orchestrator | Friday 24 April 2026 05:46:42 +0000 (0:00:01.159) 0:44:24.574 ********** 2026-04-24 05:47:13.519512 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519523 | orchestrator | 2026-04-24 05:47:13.519533 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:47:13.519544 | orchestrator | Friday 24 April 2026 05:46:44 +0000 (0:00:01.200) 0:44:25.774 ********** 2026-04-24 05:47:13.519555 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:13.519566 | orchestrator | 2026-04-24 05:47:13.519577 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:47:13.519588 | orchestrator | Friday 24 April 2026 05:46:45 +0000 (0:00:01.256) 0:44:27.030 ********** 2026-04-24 05:47:13.519599 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 05:47:13.519609 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 05:47:13.519620 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 05:47:13.519631 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519642 | orchestrator | 2026-04-24 05:47:13.519652 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:47:13.519663 | orchestrator | Friday 24 April 2026 05:46:46 +0000 (0:00:01.406) 0:44:28.437 ********** 2026-04-24 05:47:13.519674 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 05:47:13.519685 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 05:47:13.519704 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 05:47:13.519714 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519725 | orchestrator | 2026-04-24 05:47:13.519736 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:47:13.519747 | orchestrator | Friday 24 April 2026 05:46:48 +0000 (0:00:01.392) 0:44:29.829 ********** 2026-04-24 05:47:13.519758 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 05:47:13.519768 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 05:47:13.519779 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 05:47:13.519790 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.519800 | orchestrator | 2026-04-24 05:47:13.519811 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:47:13.519822 | orchestrator | Friday 24 April 2026 05:46:49 +0000 (0:00:01.420) 0:44:31.250 ********** 2026-04-24 05:47:13.519833 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:13.519843 | orchestrator | 2026-04-24 05:47:13.519872 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:47:13.519883 | orchestrator | Friday 24 April 2026 05:46:50 +0000 (0:00:01.153) 0:44:32.404 ********** 2026-04-24 05:47:13.519894 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 05:47:13.519904 | orchestrator | 2026-04-24 05:47:13.519915 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:47:13.519926 | orchestrator | Friday 24 April 2026 05:46:52 +0000 (0:00:01.359) 0:44:33.764 ********** 2026-04-24 05:47:13.519957 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:47:13.519968 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:47:13.519979 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:47:13.519990 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:47:13.520000 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:47:13.520011 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-24 05:47:13.520021 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:47:13.520032 | orchestrator | 2026-04-24 05:47:13.520042 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:47:13.520053 | orchestrator | Friday 24 April 2026 05:46:54 +0000 (0:00:02.082) 0:44:35.846 ********** 2026-04-24 05:47:13.520083 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:47:13.520094 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:47:13.520104 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:47:13.520115 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:47:13.520126 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:47:13.520136 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-24 05:47:13.520147 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:47:13.520158 | orchestrator | 2026-04-24 05:47:13.520168 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-24 05:47:13.520179 | orchestrator | Friday 24 April 2026 05:46:56 +0000 (0:00:02.553) 0:44:38.399 ********** 2026-04-24 05:47:13.520189 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:13.520200 | orchestrator | 2026-04-24 05:47:13.520210 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-24 05:47:13.520221 | orchestrator | Friday 24 April 2026 05:46:57 +0000 (0:00:01.093) 0:44:39.493 ********** 2026-04-24 05:47:13.520240 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:13.520250 | orchestrator | 2026-04-24 05:47:13.520261 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-24 05:47:13.520272 | orchestrator | Friday 24 April 2026 05:46:58 +0000 (0:00:00.763) 0:44:40.257 ********** 2026-04-24 05:47:13.520282 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:13.520293 | orchestrator | 2026-04-24 05:47:13.520303 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-24 05:47:13.520314 | orchestrator | Friday 24 April 2026 05:46:59 +0000 (0:00:00.976) 0:44:41.233 ********** 2026-04-24 05:47:13.520325 | orchestrator | changed: [testbed-node-5] => (item=1) 2026-04-24 05:47:13.520336 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-24 05:47:13.520347 | orchestrator | 2026-04-24 05:47:13.520357 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:47:13.520368 | orchestrator | Friday 24 April 2026 05:47:03 +0000 (0:00:03.731) 0:44:44.965 ********** 2026-04-24 05:47:13.520379 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-5 2026-04-24 05:47:13.520389 | orchestrator | 2026-04-24 05:47:13.520400 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:47:13.520411 | orchestrator | Friday 24 April 2026 05:47:04 +0000 (0:00:01.123) 0:44:46.089 ********** 2026-04-24 05:47:13.520421 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-5 2026-04-24 05:47:13.520432 | orchestrator | 2026-04-24 05:47:13.520443 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:47:13.520453 | orchestrator | Friday 24 April 2026 05:47:05 +0000 (0:00:01.111) 0:44:47.200 ********** 2026-04-24 05:47:13.520464 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.520475 | orchestrator | 2026-04-24 05:47:13.520485 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:47:13.520496 | orchestrator | Friday 24 April 2026 05:47:06 +0000 (0:00:01.107) 0:44:48.308 ********** 2026-04-24 05:47:13.520506 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:13.520517 | orchestrator | 2026-04-24 05:47:13.520528 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:47:13.520538 | orchestrator | Friday 24 April 2026 05:47:08 +0000 (0:00:01.488) 0:44:49.796 ********** 2026-04-24 05:47:13.520549 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:13.520559 | orchestrator | 2026-04-24 05:47:13.520570 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:47:13.520581 | orchestrator | Friday 24 April 2026 05:47:09 +0000 (0:00:01.521) 0:44:51.317 ********** 2026-04-24 05:47:13.520591 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:13.520602 | orchestrator | 2026-04-24 05:47:13.520613 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:47:13.520623 | orchestrator | Friday 24 April 2026 05:47:11 +0000 (0:00:01.501) 0:44:52.819 ********** 2026-04-24 05:47:13.520634 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.520644 | orchestrator | 2026-04-24 05:47:13.520661 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:47:13.520672 | orchestrator | Friday 24 April 2026 05:47:12 +0000 (0:00:01.124) 0:44:53.943 ********** 2026-04-24 05:47:13.520682 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.520693 | orchestrator | 2026-04-24 05:47:13.520704 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:47:13.520715 | orchestrator | Friday 24 April 2026 05:47:13 +0000 (0:00:01.134) 0:44:55.078 ********** 2026-04-24 05:47:13.520725 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:13.520736 | orchestrator | 2026-04-24 05:47:13.520754 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:47:53.446714 | orchestrator | Friday 24 April 2026 05:47:14 +0000 (0:00:01.110) 0:44:56.188 ********** 2026-04-24 05:47:53.446818 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.446829 | orchestrator | 2026-04-24 05:47:53.446857 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:47:53.446865 | orchestrator | Friday 24 April 2026 05:47:15 +0000 (0:00:01.517) 0:44:57.706 ********** 2026-04-24 05:47:53.446872 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.446878 | orchestrator | 2026-04-24 05:47:53.446885 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:47:53.446891 | orchestrator | Friday 24 April 2026 05:47:17 +0000 (0:00:01.598) 0:44:59.305 ********** 2026-04-24 05:47:53.446897 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.446905 | orchestrator | 2026-04-24 05:47:53.446912 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:47:53.446918 | orchestrator | Friday 24 April 2026 05:47:18 +0000 (0:00:00.755) 0:45:00.061 ********** 2026-04-24 05:47:53.446924 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.446930 | orchestrator | 2026-04-24 05:47:53.446936 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:47:53.446942 | orchestrator | Friday 24 April 2026 05:47:19 +0000 (0:00:00.800) 0:45:00.861 ********** 2026-04-24 05:47:53.446949 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.446973 | orchestrator | 2026-04-24 05:47:53.446979 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:47:53.446986 | orchestrator | Friday 24 April 2026 05:47:19 +0000 (0:00:00.774) 0:45:01.635 ********** 2026-04-24 05:47:53.446992 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.446998 | orchestrator | 2026-04-24 05:47:53.447004 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:47:53.447011 | orchestrator | Friday 24 April 2026 05:47:20 +0000 (0:00:00.786) 0:45:02.422 ********** 2026-04-24 05:47:53.447017 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.447024 | orchestrator | 2026-04-24 05:47:53.447030 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:47:53.447036 | orchestrator | Friday 24 April 2026 05:47:21 +0000 (0:00:00.815) 0:45:03.238 ********** 2026-04-24 05:47:53.447042 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447090 | orchestrator | 2026-04-24 05:47:53.447097 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:47:53.447104 | orchestrator | Friday 24 April 2026 05:47:22 +0000 (0:00:00.867) 0:45:04.106 ********** 2026-04-24 05:47:53.447110 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447116 | orchestrator | 2026-04-24 05:47:53.447123 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:47:53.447129 | orchestrator | Friday 24 April 2026 05:47:23 +0000 (0:00:00.855) 0:45:04.961 ********** 2026-04-24 05:47:53.447135 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447141 | orchestrator | 2026-04-24 05:47:53.447148 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:47:53.447154 | orchestrator | Friday 24 April 2026 05:47:24 +0000 (0:00:00.835) 0:45:05.796 ********** 2026-04-24 05:47:53.447160 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.447167 | orchestrator | 2026-04-24 05:47:53.447173 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:47:53.447180 | orchestrator | Friday 24 April 2026 05:47:24 +0000 (0:00:00.807) 0:45:06.604 ********** 2026-04-24 05:47:53.447186 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.447193 | orchestrator | 2026-04-24 05:47:53.447199 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:47:53.447206 | orchestrator | Friday 24 April 2026 05:47:25 +0000 (0:00:00.813) 0:45:07.418 ********** 2026-04-24 05:47:53.447212 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447218 | orchestrator | 2026-04-24 05:47:53.447225 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:47:53.447232 | orchestrator | Friday 24 April 2026 05:47:26 +0000 (0:00:00.791) 0:45:08.210 ********** 2026-04-24 05:47:53.447238 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447244 | orchestrator | 2026-04-24 05:47:53.447257 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:47:53.447265 | orchestrator | Friday 24 April 2026 05:47:27 +0000 (0:00:00.782) 0:45:08.992 ********** 2026-04-24 05:47:53.447272 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447279 | orchestrator | 2026-04-24 05:47:53.447286 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:47:53.447292 | orchestrator | Friday 24 April 2026 05:47:28 +0000 (0:00:00.794) 0:45:09.786 ********** 2026-04-24 05:47:53.447299 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447307 | orchestrator | 2026-04-24 05:47:53.447314 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:47:53.447321 | orchestrator | Friday 24 April 2026 05:47:28 +0000 (0:00:00.773) 0:45:10.560 ********** 2026-04-24 05:47:53.447328 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447335 | orchestrator | 2026-04-24 05:47:53.447342 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:47:53.447350 | orchestrator | Friday 24 April 2026 05:47:29 +0000 (0:00:00.782) 0:45:11.342 ********** 2026-04-24 05:47:53.447357 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447365 | orchestrator | 2026-04-24 05:47:53.447372 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:47:53.447378 | orchestrator | Friday 24 April 2026 05:47:30 +0000 (0:00:00.747) 0:45:12.090 ********** 2026-04-24 05:47:53.447397 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447405 | orchestrator | 2026-04-24 05:47:53.447412 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:47:53.447421 | orchestrator | Friday 24 April 2026 05:47:31 +0000 (0:00:00.744) 0:45:12.834 ********** 2026-04-24 05:47:53.447428 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447435 | orchestrator | 2026-04-24 05:47:53.447442 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:47:53.447449 | orchestrator | Friday 24 April 2026 05:47:31 +0000 (0:00:00.789) 0:45:13.624 ********** 2026-04-24 05:47:53.447471 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447479 | orchestrator | 2026-04-24 05:47:53.447486 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:47:53.447493 | orchestrator | Friday 24 April 2026 05:47:32 +0000 (0:00:00.777) 0:45:14.401 ********** 2026-04-24 05:47:53.447499 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447506 | orchestrator | 2026-04-24 05:47:53.447512 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:47:53.447519 | orchestrator | Friday 24 April 2026 05:47:33 +0000 (0:00:00.783) 0:45:15.185 ********** 2026-04-24 05:47:53.447525 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447532 | orchestrator | 2026-04-24 05:47:53.447539 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:47:53.447546 | orchestrator | Friday 24 April 2026 05:47:34 +0000 (0:00:00.834) 0:45:16.019 ********** 2026-04-24 05:47:53.447553 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447560 | orchestrator | 2026-04-24 05:47:53.447567 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:47:53.447574 | orchestrator | Friday 24 April 2026 05:47:35 +0000 (0:00:00.769) 0:45:16.789 ********** 2026-04-24 05:47:53.447581 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.447587 | orchestrator | 2026-04-24 05:47:53.447594 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:47:53.447601 | orchestrator | Friday 24 April 2026 05:47:36 +0000 (0:00:01.676) 0:45:18.465 ********** 2026-04-24 05:47:53.447607 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.447614 | orchestrator | 2026-04-24 05:47:53.447622 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:47:53.447629 | orchestrator | Friday 24 April 2026 05:47:38 +0000 (0:00:01.826) 0:45:20.291 ********** 2026-04-24 05:47:53.447635 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-5 2026-04-24 05:47:53.447649 | orchestrator | 2026-04-24 05:47:53.447655 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:47:53.447662 | orchestrator | Friday 24 April 2026 05:47:39 +0000 (0:00:01.170) 0:45:21.461 ********** 2026-04-24 05:47:53.447668 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447674 | orchestrator | 2026-04-24 05:47:53.447681 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:47:53.447688 | orchestrator | Friday 24 April 2026 05:47:40 +0000 (0:00:01.180) 0:45:22.642 ********** 2026-04-24 05:47:53.447694 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447701 | orchestrator | 2026-04-24 05:47:53.447707 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:47:53.447713 | orchestrator | Friday 24 April 2026 05:47:42 +0000 (0:00:01.159) 0:45:23.801 ********** 2026-04-24 05:47:53.447720 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:47:53.447726 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:47:53.447733 | orchestrator | 2026-04-24 05:47:53.447739 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:47:53.447746 | orchestrator | Friday 24 April 2026 05:47:43 +0000 (0:00:01.821) 0:45:25.623 ********** 2026-04-24 05:47:53.447752 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.447759 | orchestrator | 2026-04-24 05:47:53.447765 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:47:53.447772 | orchestrator | Friday 24 April 2026 05:47:45 +0000 (0:00:01.491) 0:45:27.114 ********** 2026-04-24 05:47:53.447778 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447785 | orchestrator | 2026-04-24 05:47:53.447791 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:47:53.447798 | orchestrator | Friday 24 April 2026 05:47:46 +0000 (0:00:01.116) 0:45:28.230 ********** 2026-04-24 05:47:53.447805 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447811 | orchestrator | 2026-04-24 05:47:53.447817 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:47:53.447823 | orchestrator | Friday 24 April 2026 05:47:47 +0000 (0:00:00.812) 0:45:29.043 ********** 2026-04-24 05:47:53.447829 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447835 | orchestrator | 2026-04-24 05:47:53.447840 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:47:53.447846 | orchestrator | Friday 24 April 2026 05:47:48 +0000 (0:00:00.837) 0:45:29.881 ********** 2026-04-24 05:47:53.447852 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-5 2026-04-24 05:47:53.447859 | orchestrator | 2026-04-24 05:47:53.447865 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:47:53.447872 | orchestrator | Friday 24 April 2026 05:47:49 +0000 (0:00:01.202) 0:45:31.084 ********** 2026-04-24 05:47:53.447878 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:47:53.447885 | orchestrator | 2026-04-24 05:47:53.447891 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:47:53.447898 | orchestrator | Friday 24 April 2026 05:47:51 +0000 (0:00:01.714) 0:45:32.798 ********** 2026-04-24 05:47:53.447904 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:47:53.447911 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:47:53.447921 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:47:53.447928 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447934 | orchestrator | 2026-04-24 05:47:53.447941 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:47:53.447947 | orchestrator | Friday 24 April 2026 05:47:52 +0000 (0:00:01.144) 0:45:33.943 ********** 2026-04-24 05:47:53.447954 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:47:53.447964 | orchestrator | 2026-04-24 05:47:53.447971 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:47:53.447978 | orchestrator | Friday 24 April 2026 05:47:53 +0000 (0:00:01.114) 0:45:35.058 ********** 2026-04-24 05:47:53.447989 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802235 | orchestrator | 2026-04-24 05:48:36.802353 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:48:36.802369 | orchestrator | Friday 24 April 2026 05:47:54 +0000 (0:00:01.177) 0:45:36.236 ********** 2026-04-24 05:48:36.802381 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802393 | orchestrator | 2026-04-24 05:48:36.802405 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:48:36.802416 | orchestrator | Friday 24 April 2026 05:47:55 +0000 (0:00:01.176) 0:45:37.412 ********** 2026-04-24 05:48:36.802427 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802438 | orchestrator | 2026-04-24 05:48:36.802449 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:48:36.802460 | orchestrator | Friday 24 April 2026 05:47:56 +0000 (0:00:01.185) 0:45:38.598 ********** 2026-04-24 05:48:36.802471 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802482 | orchestrator | 2026-04-24 05:48:36.802493 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:48:36.802504 | orchestrator | Friday 24 April 2026 05:47:57 +0000 (0:00:00.845) 0:45:39.443 ********** 2026-04-24 05:48:36.802515 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:48:36.802527 | orchestrator | 2026-04-24 05:48:36.802538 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:48:36.802550 | orchestrator | Friday 24 April 2026 05:47:59 +0000 (0:00:02.196) 0:45:41.640 ********** 2026-04-24 05:48:36.802561 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:48:36.802572 | orchestrator | 2026-04-24 05:48:36.802583 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:48:36.802594 | orchestrator | Friday 24 April 2026 05:48:00 +0000 (0:00:00.810) 0:45:42.450 ********** 2026-04-24 05:48:36.802604 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-5 2026-04-24 05:48:36.802615 | orchestrator | 2026-04-24 05:48:36.802626 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:48:36.802637 | orchestrator | Friday 24 April 2026 05:48:02 +0000 (0:00:01.288) 0:45:43.739 ********** 2026-04-24 05:48:36.802649 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802662 | orchestrator | 2026-04-24 05:48:36.802674 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:48:36.802687 | orchestrator | Friday 24 April 2026 05:48:03 +0000 (0:00:01.130) 0:45:44.869 ********** 2026-04-24 05:48:36.802699 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802712 | orchestrator | 2026-04-24 05:48:36.802724 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:48:36.802736 | orchestrator | Friday 24 April 2026 05:48:04 +0000 (0:00:01.261) 0:45:46.131 ********** 2026-04-24 05:48:36.802750 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802764 | orchestrator | 2026-04-24 05:48:36.802776 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:48:36.802788 | orchestrator | Friday 24 April 2026 05:48:05 +0000 (0:00:01.121) 0:45:47.252 ********** 2026-04-24 05:48:36.802801 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802814 | orchestrator | 2026-04-24 05:48:36.802826 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:48:36.802840 | orchestrator | Friday 24 April 2026 05:48:06 +0000 (0:00:01.135) 0:45:48.388 ********** 2026-04-24 05:48:36.802853 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802865 | orchestrator | 2026-04-24 05:48:36.802877 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:48:36.802890 | orchestrator | Friday 24 April 2026 05:48:07 +0000 (0:00:01.159) 0:45:49.547 ********** 2026-04-24 05:48:36.802929 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802942 | orchestrator | 2026-04-24 05:48:36.802955 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:48:36.802967 | orchestrator | Friday 24 April 2026 05:48:08 +0000 (0:00:01.146) 0:45:50.694 ********** 2026-04-24 05:48:36.802980 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.802993 | orchestrator | 2026-04-24 05:48:36.803005 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:48:36.803016 | orchestrator | Friday 24 April 2026 05:48:10 +0000 (0:00:01.139) 0:45:51.833 ********** 2026-04-24 05:48:36.803027 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803060 | orchestrator | 2026-04-24 05:48:36.803072 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:48:36.803083 | orchestrator | Friday 24 April 2026 05:48:11 +0000 (0:00:01.138) 0:45:52.972 ********** 2026-04-24 05:48:36.803093 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:48:36.803104 | orchestrator | 2026-04-24 05:48:36.803115 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:48:36.803126 | orchestrator | Friday 24 April 2026 05:48:12 +0000 (0:00:00.810) 0:45:53.782 ********** 2026-04-24 05:48:36.803137 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-5 2026-04-24 05:48:36.803148 | orchestrator | 2026-04-24 05:48:36.803159 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:48:36.803170 | orchestrator | Friday 24 April 2026 05:48:13 +0000 (0:00:01.133) 0:45:54.916 ********** 2026-04-24 05:48:36.803180 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-24 05:48:36.803192 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-24 05:48:36.803218 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-24 05:48:36.803229 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-24 05:48:36.803239 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-24 05:48:36.803250 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-24 05:48:36.803261 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-24 05:48:36.803271 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:48:36.803282 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:48:36.803311 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:48:36.803323 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:48:36.803334 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:48:36.803344 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:48:36.803355 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:48:36.803366 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-24 05:48:36.803376 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-24 05:48:36.803387 | orchestrator | 2026-04-24 05:48:36.803398 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:48:36.803409 | orchestrator | Friday 24 April 2026 05:48:19 +0000 (0:00:06.299) 0:46:01.215 ********** 2026-04-24 05:48:36.803419 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-5 2026-04-24 05:48:36.803430 | orchestrator | 2026-04-24 05:48:36.803441 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 05:48:36.803452 | orchestrator | Friday 24 April 2026 05:48:20 +0000 (0:00:01.157) 0:46:02.373 ********** 2026-04-24 05:48:36.803463 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 05:48:36.803475 | orchestrator | 2026-04-24 05:48:36.803486 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 05:48:36.803497 | orchestrator | Friday 24 April 2026 05:48:22 +0000 (0:00:01.490) 0:46:03.863 ********** 2026-04-24 05:48:36.803517 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 05:48:36.803528 | orchestrator | 2026-04-24 05:48:36.803539 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:48:36.803549 | orchestrator | Friday 24 April 2026 05:48:23 +0000 (0:00:01.615) 0:46:05.479 ********** 2026-04-24 05:48:36.803560 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803571 | orchestrator | 2026-04-24 05:48:36.803582 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:48:36.803592 | orchestrator | Friday 24 April 2026 05:48:24 +0000 (0:00:00.830) 0:46:06.310 ********** 2026-04-24 05:48:36.803603 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803614 | orchestrator | 2026-04-24 05:48:36.803625 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:48:36.803635 | orchestrator | Friday 24 April 2026 05:48:25 +0000 (0:00:00.815) 0:46:07.125 ********** 2026-04-24 05:48:36.803646 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803657 | orchestrator | 2026-04-24 05:48:36.803667 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:48:36.803678 | orchestrator | Friday 24 April 2026 05:48:26 +0000 (0:00:00.800) 0:46:07.925 ********** 2026-04-24 05:48:36.803689 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803699 | orchestrator | 2026-04-24 05:48:36.803710 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:48:36.803721 | orchestrator | Friday 24 April 2026 05:48:26 +0000 (0:00:00.768) 0:46:08.694 ********** 2026-04-24 05:48:36.803731 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803742 | orchestrator | 2026-04-24 05:48:36.803753 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:48:36.803764 | orchestrator | Friday 24 April 2026 05:48:27 +0000 (0:00:00.807) 0:46:09.502 ********** 2026-04-24 05:48:36.803774 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803785 | orchestrator | 2026-04-24 05:48:36.803796 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:48:36.803807 | orchestrator | Friday 24 April 2026 05:48:28 +0000 (0:00:00.788) 0:46:10.291 ********** 2026-04-24 05:48:36.803818 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803829 | orchestrator | 2026-04-24 05:48:36.803839 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:48:36.803850 | orchestrator | Friday 24 April 2026 05:48:29 +0000 (0:00:00.783) 0:46:11.074 ********** 2026-04-24 05:48:36.803861 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803872 | orchestrator | 2026-04-24 05:48:36.803882 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:48:36.803893 | orchestrator | Friday 24 April 2026 05:48:30 +0000 (0:00:00.786) 0:46:11.861 ********** 2026-04-24 05:48:36.803903 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803914 | orchestrator | 2026-04-24 05:48:36.803925 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:48:36.803935 | orchestrator | Friday 24 April 2026 05:48:30 +0000 (0:00:00.782) 0:46:12.644 ********** 2026-04-24 05:48:36.803946 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:48:36.803957 | orchestrator | 2026-04-24 05:48:36.803967 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:48:36.803978 | orchestrator | Friday 24 April 2026 05:48:31 +0000 (0:00:00.784) 0:46:13.428 ********** 2026-04-24 05:48:36.803988 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:48:36.804000 | orchestrator | 2026-04-24 05:48:36.804016 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:48:36.804027 | orchestrator | Friday 24 April 2026 05:48:32 +0000 (0:00:00.862) 0:46:14.290 ********** 2026-04-24 05:48:36.804073 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:48:36.804092 | orchestrator | 2026-04-24 05:48:36.804103 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:48:36.804114 | orchestrator | Friday 24 April 2026 05:48:36 +0000 (0:00:04.102) 0:46:18.393 ********** 2026-04-24 05:48:36.804132 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 05:49:18.417798 | orchestrator | 2026-04-24 05:49:18.417912 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:49:18.417929 | orchestrator | Friday 24 April 2026 05:48:37 +0000 (0:00:00.857) 0:46:19.251 ********** 2026-04-24 05:49:18.417944 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-24 05:49:18.417959 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-24 05:49:18.417972 | orchestrator | 2026-04-24 05:49:18.417984 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:49:18.417995 | orchestrator | Friday 24 April 2026 05:48:44 +0000 (0:00:07.005) 0:46:26.256 ********** 2026-04-24 05:49:18.418006 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.418111 | orchestrator | 2026-04-24 05:49:18.418126 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:49:18.418137 | orchestrator | Friday 24 April 2026 05:48:45 +0000 (0:00:00.759) 0:46:27.016 ********** 2026-04-24 05:49:18.418148 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.418160 | orchestrator | 2026-04-24 05:49:18.418171 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:49:18.418184 | orchestrator | Friday 24 April 2026 05:48:46 +0000 (0:00:00.756) 0:46:27.772 ********** 2026-04-24 05:49:18.418195 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.418206 | orchestrator | 2026-04-24 05:49:18.418217 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:49:18.418228 | orchestrator | Friday 24 April 2026 05:48:46 +0000 (0:00:00.811) 0:46:28.584 ********** 2026-04-24 05:49:18.418239 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.418250 | orchestrator | 2026-04-24 05:49:18.418261 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:49:18.418272 | orchestrator | Friday 24 April 2026 05:48:47 +0000 (0:00:00.834) 0:46:29.418 ********** 2026-04-24 05:49:18.418283 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.418294 | orchestrator | 2026-04-24 05:49:18.418306 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:49:18.418317 | orchestrator | Friday 24 April 2026 05:48:48 +0000 (0:00:00.811) 0:46:30.229 ********** 2026-04-24 05:49:18.418328 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:49:18.418341 | orchestrator | 2026-04-24 05:49:18.418355 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:49:18.418367 | orchestrator | Friday 24 April 2026 05:48:49 +0000 (0:00:00.914) 0:46:31.144 ********** 2026-04-24 05:49:18.418380 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 05:49:18.418393 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 05:49:18.418406 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 05:49:18.418418 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.418431 | orchestrator | 2026-04-24 05:49:18.418443 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:49:18.418482 | orchestrator | Friday 24 April 2026 05:48:50 +0000 (0:00:01.470) 0:46:32.614 ********** 2026-04-24 05:49:18.418495 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 05:49:18.418508 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 05:49:18.418520 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 05:49:18.418532 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.418543 | orchestrator | 2026-04-24 05:49:18.418553 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:49:18.418564 | orchestrator | Friday 24 April 2026 05:48:52 +0000 (0:00:01.534) 0:46:34.148 ********** 2026-04-24 05:49:18.418575 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 05:49:18.418586 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 05:49:18.418597 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 05:49:18.418608 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.418618 | orchestrator | 2026-04-24 05:49:18.418629 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:49:18.418640 | orchestrator | Friday 24 April 2026 05:48:53 +0000 (0:00:01.509) 0:46:35.658 ********** 2026-04-24 05:49:18.418651 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:49:18.418662 | orchestrator | 2026-04-24 05:49:18.418673 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:49:18.418699 | orchestrator | Friday 24 April 2026 05:48:54 +0000 (0:00:00.811) 0:46:36.470 ********** 2026-04-24 05:49:18.418710 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 05:49:18.418722 | orchestrator | 2026-04-24 05:49:18.418732 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:49:18.418743 | orchestrator | Friday 24 April 2026 05:48:55 +0000 (0:00:01.028) 0:46:37.498 ********** 2026-04-24 05:49:18.418755 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:49:18.418766 | orchestrator | 2026-04-24 05:49:18.418776 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-24 05:49:18.418787 | orchestrator | Friday 24 April 2026 05:48:57 +0000 (0:00:01.413) 0:46:38.912 ********** 2026-04-24 05:49:18.418798 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:49:18.418809 | orchestrator | 2026-04-24 05:49:18.418838 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-24 05:49:18.418850 | orchestrator | Friday 24 April 2026 05:48:57 +0000 (0:00:00.781) 0:46:39.693 ********** 2026-04-24 05:49:18.418862 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:49:18.418875 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:49:18.418894 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:49:18.418912 | orchestrator | 2026-04-24 05:49:18.418929 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-24 05:49:18.418948 | orchestrator | Friday 24 April 2026 05:48:59 +0000 (0:00:01.300) 0:46:40.994 ********** 2026-04-24 05:49:18.418965 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-5 2026-04-24 05:49:18.418982 | orchestrator | 2026-04-24 05:49:18.418998 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-24 05:49:18.419016 | orchestrator | Friday 24 April 2026 05:49:00 +0000 (0:00:01.121) 0:46:42.115 ********** 2026-04-24 05:49:18.419071 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.419091 | orchestrator | 2026-04-24 05:49:18.419109 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-24 05:49:18.419127 | orchestrator | Friday 24 April 2026 05:49:01 +0000 (0:00:01.116) 0:46:43.232 ********** 2026-04-24 05:49:18.419145 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.419162 | orchestrator | 2026-04-24 05:49:18.419180 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-24 05:49:18.419214 | orchestrator | Friday 24 April 2026 05:49:02 +0000 (0:00:01.181) 0:46:44.413 ********** 2026-04-24 05:49:18.419234 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:49:18.419252 | orchestrator | 2026-04-24 05:49:18.419270 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-24 05:49:18.419289 | orchestrator | Friday 24 April 2026 05:49:04 +0000 (0:00:01.509) 0:46:45.922 ********** 2026-04-24 05:49:18.419307 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:49:18.419327 | orchestrator | 2026-04-24 05:49:18.419346 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-24 05:49:18.419365 | orchestrator | Friday 24 April 2026 05:49:05 +0000 (0:00:01.235) 0:46:47.157 ********** 2026-04-24 05:49:18.419384 | orchestrator | ok: [testbed-node-5] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-24 05:49:18.419403 | orchestrator | ok: [testbed-node-5] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-24 05:49:18.419422 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-24 05:49:18.419441 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-24 05:49:18.419461 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-24 05:49:18.419480 | orchestrator | 2026-04-24 05:49:18.419500 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-24 05:49:18.419520 | orchestrator | Friday 24 April 2026 05:49:07 +0000 (0:00:02.424) 0:46:49.582 ********** 2026-04-24 05:49:18.419541 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.419560 | orchestrator | 2026-04-24 05:49:18.419578 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-24 05:49:18.419599 | orchestrator | Friday 24 April 2026 05:49:08 +0000 (0:00:00.826) 0:46:50.409 ********** 2026-04-24 05:49:18.419619 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-5 2026-04-24 05:49:18.419640 | orchestrator | 2026-04-24 05:49:18.419660 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-24 05:49:18.419680 | orchestrator | Friday 24 April 2026 05:49:09 +0000 (0:00:01.100) 0:46:51.509 ********** 2026-04-24 05:49:18.419700 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-24 05:49:18.419720 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd/) 2026-04-24 05:49:18.419739 | orchestrator | 2026-04-24 05:49:18.419759 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-24 05:49:18.419779 | orchestrator | Friday 24 April 2026 05:49:11 +0000 (0:00:01.804) 0:46:53.314 ********** 2026-04-24 05:49:18.419799 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:49:18.419819 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-24 05:49:18.419841 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 05:49:18.419861 | orchestrator | 2026-04-24 05:49:18.419881 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-24 05:49:18.419900 | orchestrator | Friday 24 April 2026 05:49:14 +0000 (0:00:03.302) 0:46:56.617 ********** 2026-04-24 05:49:18.419919 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-24 05:49:18.419936 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-24 05:49:18.419954 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:49:18.419973 | orchestrator | 2026-04-24 05:49:18.419992 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-24 05:49:18.420025 | orchestrator | Friday 24 April 2026 05:49:16 +0000 (0:00:01.634) 0:46:58.251 ********** 2026-04-24 05:49:18.420075 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.420102 | orchestrator | 2026-04-24 05:49:18.420123 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-24 05:49:18.420143 | orchestrator | Friday 24 April 2026 05:49:17 +0000 (0:00:00.900) 0:46:59.151 ********** 2026-04-24 05:49:18.420163 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.420199 | orchestrator | 2026-04-24 05:49:18.420220 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-24 05:49:18.420240 | orchestrator | Friday 24 April 2026 05:49:18 +0000 (0:00:00.815) 0:46:59.967 ********** 2026-04-24 05:49:18.420258 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:49:18.420277 | orchestrator | 2026-04-24 05:49:18.420316 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-24 05:51:35.616921 | orchestrator | Friday 24 April 2026 05:49:19 +0000 (0:00:00.815) 0:47:00.783 ********** 2026-04-24 05:51:35.617116 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-5 2026-04-24 05:51:35.617142 | orchestrator | 2026-04-24 05:51:35.617153 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-24 05:51:35.617163 | orchestrator | Friday 24 April 2026 05:49:20 +0000 (0:00:01.130) 0:47:01.913 ********** 2026-04-24 05:51:35.617179 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:51:35.617206 | orchestrator | 2026-04-24 05:51:35.617223 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-24 05:51:35.617239 | orchestrator | Friday 24 April 2026 05:49:21 +0000 (0:00:01.513) 0:47:03.427 ********** 2026-04-24 05:51:35.617255 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:51:35.617270 | orchestrator | 2026-04-24 05:51:35.617287 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-24 05:51:35.617303 | orchestrator | Friday 24 April 2026 05:49:25 +0000 (0:00:03.406) 0:47:06.834 ********** 2026-04-24 05:51:35.617319 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-5 2026-04-24 05:51:35.617336 | orchestrator | 2026-04-24 05:51:35.617353 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-24 05:51:35.617370 | orchestrator | Friday 24 April 2026 05:49:26 +0000 (0:00:01.206) 0:47:08.040 ********** 2026-04-24 05:51:35.617383 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:51:35.617392 | orchestrator | 2026-04-24 05:51:35.617402 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-24 05:51:35.617412 | orchestrator | Friday 24 April 2026 05:49:28 +0000 (0:00:01.967) 0:47:10.008 ********** 2026-04-24 05:51:35.617422 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:51:35.617431 | orchestrator | 2026-04-24 05:51:35.617441 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-24 05:51:35.617451 | orchestrator | Friday 24 April 2026 05:49:30 +0000 (0:00:01.973) 0:47:11.981 ********** 2026-04-24 05:51:35.617460 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:51:35.617472 | orchestrator | 2026-04-24 05:51:35.617483 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-24 05:51:35.617495 | orchestrator | Friday 24 April 2026 05:49:32 +0000 (0:00:02.136) 0:47:14.117 ********** 2026-04-24 05:51:35.617510 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:51:35.617527 | orchestrator | 2026-04-24 05:51:35.617544 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-24 05:51:35.617563 | orchestrator | Friday 24 April 2026 05:49:33 +0000 (0:00:01.158) 0:47:15.276 ********** 2026-04-24 05:51:35.617582 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:51:35.617602 | orchestrator | 2026-04-24 05:51:35.617622 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-24 05:51:35.617641 | orchestrator | Friday 24 April 2026 05:49:34 +0000 (0:00:01.121) 0:47:16.397 ********** 2026-04-24 05:51:35.617659 | orchestrator | ok: [testbed-node-5] => (item=1) 2026-04-24 05:51:35.617678 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-24 05:51:35.617697 | orchestrator | 2026-04-24 05:51:35.617716 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-24 05:51:35.617736 | orchestrator | Friday 24 April 2026 05:49:36 +0000 (0:00:01.843) 0:47:18.241 ********** 2026-04-24 05:51:35.617756 | orchestrator | ok: [testbed-node-5] => (item=1) 2026-04-24 05:51:35.617776 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-24 05:51:35.617795 | orchestrator | 2026-04-24 05:51:35.617846 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-24 05:51:35.617866 | orchestrator | Friday 24 April 2026 05:49:39 +0000 (0:00:02.840) 0:47:21.081 ********** 2026-04-24 05:51:35.617882 | orchestrator | changed: [testbed-node-5] => (item=1) 2026-04-24 05:51:35.617926 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-24 05:51:35.617961 | orchestrator | 2026-04-24 05:51:35.617980 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-24 05:51:35.618096 | orchestrator | Friday 24 April 2026 05:49:43 +0000 (0:00:04.089) 0:47:25.171 ********** 2026-04-24 05:51:35.618123 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:51:35.618143 | orchestrator | 2026-04-24 05:51:35.618163 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-24 05:51:35.618182 | orchestrator | Friday 24 April 2026 05:49:44 +0000 (0:00:00.886) 0:47:26.057 ********** 2026-04-24 05:51:35.618198 | orchestrator | FAILED - RETRYING: [testbed-node-5 -> testbed-node-0]: Wait for all osd to be up (60 retries left). 2026-04-24 05:51:35.618211 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:51:35.618222 | orchestrator | 2026-04-24 05:51:35.618232 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-24 05:51:35.618243 | orchestrator | Friday 24 April 2026 05:49:57 +0000 (0:00:13.379) 0:47:39.437 ********** 2026-04-24 05:51:35.618254 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:51:35.618264 | orchestrator | 2026-04-24 05:51:35.618275 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-24 05:51:35.618286 | orchestrator | Friday 24 April 2026 05:49:58 +0000 (0:00:00.886) 0:47:40.324 ********** 2026-04-24 05:51:35.618297 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:51:35.618307 | orchestrator | 2026-04-24 05:51:35.618334 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-24 05:51:35.618345 | orchestrator | Friday 24 April 2026 05:49:59 +0000 (0:00:00.737) 0:47:41.062 ********** 2026-04-24 05:51:35.618356 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:51:35.618366 | orchestrator | 2026-04-24 05:51:35.618377 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-24 05:51:35.618388 | orchestrator | Friday 24 April 2026 05:50:00 +0000 (0:00:00.752) 0:47:41.814 ********** 2026-04-24 05:51:35.618398 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:51:35.618409 | orchestrator | 2026-04-24 05:51:35.618420 | orchestrator | PLAY [Complete osd upgrade] **************************************************** 2026-04-24 05:51:35.618430 | orchestrator | 2026-04-24 05:51:35.618465 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:51:35.618477 | orchestrator | Friday 24 April 2026 05:50:02 +0000 (0:00:02.481) 0:47:44.296 ********** 2026-04-24 05:51:35.618487 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:51:35.618498 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:51:35.618509 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:51:35.618520 | orchestrator | 2026-04-24 05:51:35.618530 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:51:35.618541 | orchestrator | Friday 24 April 2026 05:50:04 +0000 (0:00:01.700) 0:47:45.997 ********** 2026-04-24 05:51:35.618552 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:51:35.618563 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:51:35.618573 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:51:35.618584 | orchestrator | 2026-04-24 05:51:35.618600 | orchestrator | TASK [Re-enable pg autoscale on pools] ***************************************** 2026-04-24 05:51:35.618619 | orchestrator | Friday 24 April 2026 05:50:05 +0000 (0:00:01.548) 0:47:47.546 ********** 2026-04-24 05:51:35.618637 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.mgr', 'mode': 'on'}) 2026-04-24 05:51:35.618655 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_data', 'mode': 'on'}) 2026-04-24 05:51:35.618672 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_metadata', 'mode': 'on'}) 2026-04-24 05:51:35.618705 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.data', 'mode': 'on'}) 2026-04-24 05:51:35.618726 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.index', 'mode': 'on'}) 2026-04-24 05:51:35.618744 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.control', 'mode': 'on'}) 2026-04-24 05:51:35.618761 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.log', 'mode': 'on'}) 2026-04-24 05:51:35.618779 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.meta', 'mode': 'on'}) 2026-04-24 05:51:35.618821 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.rgw.root', 'mode': 'on'}) 2026-04-24 05:51:35.618839 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'backups', 'mode': 'off'})  2026-04-24 05:51:35.618855 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'volumes', 'mode': 'off'})  2026-04-24 05:51:35.618871 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'images', 'mode': 'off'})  2026-04-24 05:51:35.618886 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'metrics', 'mode': 'off'})  2026-04-24 05:51:35.618903 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vms', 'mode': 'off'})  2026-04-24 05:51:35.618920 | orchestrator | 2026-04-24 05:51:35.618936 | orchestrator | TASK [Unset osd flags] ********************************************************* 2026-04-24 05:51:35.618952 | orchestrator | Friday 24 April 2026 05:51:19 +0000 (0:01:13.495) 0:49:01.042 ********** 2026-04-24 05:51:35.618970 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=noout) 2026-04-24 05:51:35.618988 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=nodeep-scrub) 2026-04-24 05:51:35.619033 | orchestrator | 2026-04-24 05:51:35.619052 | orchestrator | TASK [Re-enable balancer] ****************************************************** 2026-04-24 05:51:35.619069 | orchestrator | Friday 24 April 2026 05:51:24 +0000 (0:00:05.429) 0:49:06.472 ********** 2026-04-24 05:51:35.619088 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:51:35.619106 | orchestrator | 2026-04-24 05:51:35.619124 | orchestrator | PLAY [Upgrade ceph mdss cluster, deactivate all rank > 0] ********************** 2026-04-24 05:51:35.619142 | orchestrator | 2026-04-24 05:51:35.619161 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:51:35.619180 | orchestrator | Friday 24 April 2026 05:51:28 +0000 (0:00:03.249) 0:49:09.722 ********** 2026-04-24 05:51:35.619198 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-24 05:51:35.619217 | orchestrator | 2026-04-24 05:51:35.619236 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:51:35.619254 | orchestrator | Friday 24 April 2026 05:51:29 +0000 (0:00:01.160) 0:49:10.882 ********** 2026-04-24 05:51:35.619271 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:51:35.619283 | orchestrator | 2026-04-24 05:51:35.619294 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:51:35.619304 | orchestrator | Friday 24 April 2026 05:51:30 +0000 (0:00:01.459) 0:49:12.341 ********** 2026-04-24 05:51:35.619315 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:51:35.619326 | orchestrator | 2026-04-24 05:51:35.619336 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:51:35.619347 | orchestrator | Friday 24 April 2026 05:51:31 +0000 (0:00:01.172) 0:49:13.513 ********** 2026-04-24 05:51:35.619368 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:51:35.619379 | orchestrator | 2026-04-24 05:51:35.619390 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:51:35.619400 | orchestrator | Friday 24 April 2026 05:51:33 +0000 (0:00:01.501) 0:49:15.015 ********** 2026-04-24 05:51:35.619411 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:51:35.619434 | orchestrator | 2026-04-24 05:51:35.619445 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:51:35.619456 | orchestrator | Friday 24 April 2026 05:51:34 +0000 (0:00:01.163) 0:49:16.178 ********** 2026-04-24 05:51:35.619467 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:51:35.619478 | orchestrator | 2026-04-24 05:51:35.619488 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:51:35.619515 | orchestrator | Friday 24 April 2026 05:51:35 +0000 (0:00:01.136) 0:49:17.315 ********** 2026-04-24 05:52:01.204202 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:01.204314 | orchestrator | 2026-04-24 05:52:01.204330 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:52:01.204342 | orchestrator | Friday 24 April 2026 05:51:36 +0000 (0:00:01.231) 0:49:18.546 ********** 2026-04-24 05:52:01.204353 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:01.204364 | orchestrator | 2026-04-24 05:52:01.204374 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:52:01.204384 | orchestrator | Friday 24 April 2026 05:51:38 +0000 (0:00:01.190) 0:49:19.736 ********** 2026-04-24 05:52:01.204394 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:01.204404 | orchestrator | 2026-04-24 05:52:01.204413 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:52:01.204423 | orchestrator | Friday 24 April 2026 05:51:39 +0000 (0:00:01.145) 0:49:20.882 ********** 2026-04-24 05:52:01.204433 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:52:01.204443 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:52:01.204453 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:52:01.204462 | orchestrator | 2026-04-24 05:52:01.204472 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:52:01.204481 | orchestrator | Friday 24 April 2026 05:51:40 +0000 (0:00:01.718) 0:49:22.601 ********** 2026-04-24 05:52:01.204491 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:01.204500 | orchestrator | 2026-04-24 05:52:01.204510 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:52:01.204519 | orchestrator | Friday 24 April 2026 05:51:42 +0000 (0:00:01.278) 0:49:23.879 ********** 2026-04-24 05:52:01.204529 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:52:01.204539 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:52:01.204548 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:52:01.204558 | orchestrator | 2026-04-24 05:52:01.204568 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:52:01.204578 | orchestrator | Friday 24 April 2026 05:51:45 +0000 (0:00:03.178) 0:49:27.058 ********** 2026-04-24 05:52:01.204588 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:52:01.204598 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:52:01.204608 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:52:01.204617 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:01.204627 | orchestrator | 2026-04-24 05:52:01.204637 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:52:01.204646 | orchestrator | Friday 24 April 2026 05:51:46 +0000 (0:00:01.447) 0:49:28.506 ********** 2026-04-24 05:52:01.204658 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:52:01.204671 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:52:01.204704 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:52:01.204715 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:01.204724 | orchestrator | 2026-04-24 05:52:01.204734 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:52:01.204746 | orchestrator | Friday 24 April 2026 05:51:48 +0000 (0:00:02.005) 0:49:30.511 ********** 2026-04-24 05:52:01.204760 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:01.204788 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:01.204816 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:01.204828 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:01.204840 | orchestrator | 2026-04-24 05:52:01.204852 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:52:01.204863 | orchestrator | Friday 24 April 2026 05:51:49 +0000 (0:00:01.185) 0:49:31.696 ********** 2026-04-24 05:52:01.204878 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:51:42.706394', 'end': '2026-04-24 05:51:42.749374', 'delta': '0:00:00.042980', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:52:01.204892 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:51:43.282348', 'end': '2026-04-24 05:51:43.320266', 'delta': '0:00:00.037918', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:52:01.204904 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:51:44.153251', 'end': '2026-04-24 05:51:44.198659', 'delta': '0:00:00.045408', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:52:01.204923 | orchestrator | 2026-04-24 05:52:01.204935 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:52:01.204947 | orchestrator | Friday 24 April 2026 05:51:51 +0000 (0:00:01.224) 0:49:32.921 ********** 2026-04-24 05:52:01.204958 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:01.204969 | orchestrator | 2026-04-24 05:52:01.204981 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:52:01.204992 | orchestrator | Friday 24 April 2026 05:51:52 +0000 (0:00:01.657) 0:49:34.579 ********** 2026-04-24 05:52:01.205027 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:01.205039 | orchestrator | 2026-04-24 05:52:01.205049 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:52:01.205061 | orchestrator | Friday 24 April 2026 05:51:54 +0000 (0:00:01.723) 0:49:36.303 ********** 2026-04-24 05:52:01.205073 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:01.205084 | orchestrator | 2026-04-24 05:52:01.205095 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:52:01.205105 | orchestrator | Friday 24 April 2026 05:51:55 +0000 (0:00:01.145) 0:49:37.448 ********** 2026-04-24 05:52:01.205115 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:01.205125 | orchestrator | 2026-04-24 05:52:01.205135 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:52:01.205144 | orchestrator | Friday 24 April 2026 05:51:57 +0000 (0:00:01.972) 0:49:39.421 ********** 2026-04-24 05:52:01.205159 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:01.205169 | orchestrator | 2026-04-24 05:52:01.205179 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:52:01.205188 | orchestrator | Friday 24 April 2026 05:51:58 +0000 (0:00:01.144) 0:49:40.566 ********** 2026-04-24 05:52:01.205198 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:01.205208 | orchestrator | 2026-04-24 05:52:01.205218 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:52:01.205227 | orchestrator | Friday 24 April 2026 05:51:59 +0000 (0:00:01.119) 0:49:41.685 ********** 2026-04-24 05:52:01.205237 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:01.205247 | orchestrator | 2026-04-24 05:52:01.205257 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:52:01.205273 | orchestrator | Friday 24 April 2026 05:52:01 +0000 (0:00:01.216) 0:49:42.902 ********** 2026-04-24 05:52:10.772645 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:10.772732 | orchestrator | 2026-04-24 05:52:10.772744 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:52:10.772754 | orchestrator | Friday 24 April 2026 05:52:02 +0000 (0:00:01.189) 0:49:44.092 ********** 2026-04-24 05:52:10.772761 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:10.772769 | orchestrator | 2026-04-24 05:52:10.772777 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:52:10.772784 | orchestrator | Friday 24 April 2026 05:52:03 +0000 (0:00:01.124) 0:49:45.217 ********** 2026-04-24 05:52:10.772792 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:10.772799 | orchestrator | 2026-04-24 05:52:10.772806 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:52:10.772813 | orchestrator | Friday 24 April 2026 05:52:04 +0000 (0:00:01.117) 0:49:46.334 ********** 2026-04-24 05:52:10.772820 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:10.772828 | orchestrator | 2026-04-24 05:52:10.772835 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:52:10.772862 | orchestrator | Friday 24 April 2026 05:52:05 +0000 (0:00:01.146) 0:49:47.481 ********** 2026-04-24 05:52:10.772869 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:10.772876 | orchestrator | 2026-04-24 05:52:10.772883 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:52:10.772890 | orchestrator | Friday 24 April 2026 05:52:06 +0000 (0:00:01.184) 0:49:48.666 ********** 2026-04-24 05:52:10.772898 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:10.772905 | orchestrator | 2026-04-24 05:52:10.772912 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:52:10.772920 | orchestrator | Friday 24 April 2026 05:52:08 +0000 (0:00:01.158) 0:49:49.824 ********** 2026-04-24 05:52:10.772927 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:10.772951 | orchestrator | 2026-04-24 05:52:10.772959 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:52:10.772966 | orchestrator | Friday 24 April 2026 05:52:09 +0000 (0:00:01.159) 0:49:50.983 ********** 2026-04-24 05:52:10.772976 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:52:10.772985 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:52:10.773044 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:52:10.773057 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-10-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:52:10.773080 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:52:10.773103 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:52:10.773111 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:52:10.773129 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '890efc9d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:52:10.773140 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:52:10.773148 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:52:10.773156 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:10.773163 | orchestrator | 2026-04-24 05:52:10.773172 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:52:10.773185 | orchestrator | Friday 24 April 2026 05:52:10 +0000 (0:00:01.410) 0:49:52.394 ********** 2026-04-24 05:52:10.773205 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238381 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238488 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238507 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-10-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238521 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238581 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238600 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238662 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '890efc9d', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1', 'scsi-SQEMU_QEMU_HARDDISK_890efc9d-fc13-4d63-b232-fe77c11b084a-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238679 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238690 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:52:16.238708 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:52:16.238721 | orchestrator | 2026-04-24 05:52:16.238733 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:52:16.238754 | orchestrator | Friday 24 April 2026 05:52:11 +0000 (0:00:01.306) 0:49:53.701 ********** 2026-04-24 05:52:16.238765 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:16.238776 | orchestrator | 2026-04-24 05:52:16.238787 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:52:16.238798 | orchestrator | Friday 24 April 2026 05:52:13 +0000 (0:00:01.627) 0:49:55.329 ********** 2026-04-24 05:52:16.238809 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:16.238819 | orchestrator | 2026-04-24 05:52:16.238830 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:52:16.238841 | orchestrator | Friday 24 April 2026 05:52:14 +0000 (0:00:01.125) 0:49:56.455 ********** 2026-04-24 05:52:16.238851 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:52:16.238862 | orchestrator | 2026-04-24 05:52:16.238873 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:52:16.238891 | orchestrator | Friday 24 April 2026 05:52:16 +0000 (0:00:01.488) 0:49:57.944 ********** 2026-04-24 05:53:09.343119 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:53:09.343225 | orchestrator | 2026-04-24 05:53:09.343240 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:53:09.343251 | orchestrator | Friday 24 April 2026 05:52:17 +0000 (0:00:01.137) 0:49:59.082 ********** 2026-04-24 05:53:09.343261 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:53:09.343270 | orchestrator | 2026-04-24 05:53:09.343280 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:53:09.343289 | orchestrator | Friday 24 April 2026 05:52:18 +0000 (0:00:01.246) 0:50:00.328 ********** 2026-04-24 05:53:09.343298 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:53:09.343307 | orchestrator | 2026-04-24 05:53:09.343316 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:53:09.343325 | orchestrator | Friday 24 April 2026 05:52:19 +0000 (0:00:01.170) 0:50:01.499 ********** 2026-04-24 05:53:09.343335 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:53:09.343345 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 05:53:09.343354 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 05:53:09.343363 | orchestrator | 2026-04-24 05:53:09.343372 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:53:09.343381 | orchestrator | Friday 24 April 2026 05:52:21 +0000 (0:00:02.028) 0:50:03.527 ********** 2026-04-24 05:53:09.343390 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-24 05:53:09.343399 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-24 05:53:09.343408 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-24 05:53:09.343417 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:53:09.343426 | orchestrator | 2026-04-24 05:53:09.343435 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:53:09.343449 | orchestrator | Friday 24 April 2026 05:52:23 +0000 (0:00:01.216) 0:50:04.744 ********** 2026-04-24 05:53:09.343464 | orchestrator | skipping: [testbed-node-0] 2026-04-24 05:53:09.343479 | orchestrator | 2026-04-24 05:53:09.343493 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:53:09.343507 | orchestrator | Friday 24 April 2026 05:52:24 +0000 (0:00:01.144) 0:50:05.888 ********** 2026-04-24 05:53:09.343520 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:53:09.343534 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:53:09.343550 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:53:09.343565 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:53:09.343580 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:53:09.343594 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:53:09.343630 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:53:09.343641 | orchestrator | 2026-04-24 05:53:09.343651 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:53:09.343661 | orchestrator | Friday 24 April 2026 05:52:26 +0000 (0:00:02.203) 0:50:08.091 ********** 2026-04-24 05:53:09.343672 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 05:53:09.343682 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:53:09.343692 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:53:09.343703 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:53:09.343713 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:53:09.343723 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:53:09.343734 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:53:09.343744 | orchestrator | 2026-04-24 05:53:09.343754 | orchestrator | TASK [Set max_mds 1 on ceph fs] ************************************************ 2026-04-24 05:53:09.343765 | orchestrator | Friday 24 April 2026 05:52:29 +0000 (0:00:02.911) 0:50:11.003 ********** 2026-04-24 05:53:09.343775 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:53:09.343786 | orchestrator | 2026-04-24 05:53:09.343796 | orchestrator | TASK [Wait until only rank 0 is up] ******************************************** 2026-04-24 05:53:09.343805 | orchestrator | Friday 24 April 2026 05:52:32 +0000 (0:00:03.194) 0:50:14.197 ********** 2026-04-24 05:53:09.343815 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:53:09.343825 | orchestrator | 2026-04-24 05:53:09.343848 | orchestrator | TASK [Get name of remaining active mds] **************************************** 2026-04-24 05:53:09.343859 | orchestrator | Friday 24 April 2026 05:52:35 +0000 (0:00:03.009) 0:50:17.207 ********** 2026-04-24 05:53:09.343868 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:53:09.343878 | orchestrator | 2026-04-24 05:53:09.343888 | orchestrator | TASK [Set_fact mds_active_name] ************************************************ 2026-04-24 05:53:09.343898 | orchestrator | Friday 24 April 2026 05:52:37 +0000 (0:00:02.197) 0:50:19.405 ********** 2026-04-24 05:53:09.343929 | orchestrator | ok: [testbed-node-0] => (item={'key': 'gid_4649', 'value': {'gid': 4649, 'name': 'testbed-node-3', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '192.168.16.13:6817/2426224476', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '192.168.16.13:6816', 'nonce': 2426224476}, {'type': 'v1', 'addr': '192.168.16.13:6817', 'nonce': 2426224476}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}) 2026-04-24 05:53:09.343943 | orchestrator | 2026-04-24 05:53:09.343954 | orchestrator | TASK [Set_fact mds_active_host] ************************************************ 2026-04-24 05:53:09.343963 | orchestrator | Friday 24 April 2026 05:52:38 +0000 (0:00:01.207) 0:50:20.612 ********** 2026-04-24 05:53:09.343973 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-3) 2026-04-24 05:53:09.343983 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-24 05:53:09.344056 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-24 05:53:09.344065 | orchestrator | 2026-04-24 05:53:09.344073 | orchestrator | TASK [Create standby_mdss group] *********************************************** 2026-04-24 05:53:09.344082 | orchestrator | Friday 24 April 2026 05:52:40 +0000 (0:00:01.525) 0:50:22.138 ********** 2026-04-24 05:53:09.344090 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-4) 2026-04-24 05:53:09.344107 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-5) 2026-04-24 05:53:09.344115 | orchestrator | 2026-04-24 05:53:09.344124 | orchestrator | TASK [Stop standby ceph mds] *************************************************** 2026-04-24 05:53:09.344132 | orchestrator | Friday 24 April 2026 05:52:41 +0000 (0:00:01.488) 0:50:23.627 ********** 2026-04-24 05:53:09.344141 | orchestrator | changed: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:53:09.344150 | orchestrator | changed: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:53:09.344158 | orchestrator | 2026-04-24 05:53:09.344167 | orchestrator | TASK [Mask systemd units for standby ceph mds] ********************************* 2026-04-24 05:53:09.344175 | orchestrator | Friday 24 April 2026 05:52:51 +0000 (0:00:09.611) 0:50:33.239 ********** 2026-04-24 05:53:09.344184 | orchestrator | changed: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:53:09.344192 | orchestrator | changed: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:53:09.344201 | orchestrator | 2026-04-24 05:53:09.344209 | orchestrator | TASK [Wait until all standbys mds are stopped] ********************************* 2026-04-24 05:53:09.344218 | orchestrator | Friday 24 April 2026 05:52:55 +0000 (0:00:03.717) 0:50:36.957 ********** 2026-04-24 05:53:09.344226 | orchestrator | ok: [testbed-node-0] 2026-04-24 05:53:09.344235 | orchestrator | 2026-04-24 05:53:09.344243 | orchestrator | TASK [Create active_mdss group] ************************************************ 2026-04-24 05:53:09.344252 | orchestrator | Friday 24 April 2026 05:52:57 +0000 (0:00:02.228) 0:50:39.185 ********** 2026-04-24 05:53:09.344260 | orchestrator | changed: [testbed-node-0] 2026-04-24 05:53:09.344269 | orchestrator | 2026-04-24 05:53:09.344277 | orchestrator | PLAY [Upgrade active mds] ****************************************************** 2026-04-24 05:53:09.344286 | orchestrator | 2026-04-24 05:53:09.344294 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:53:09.344303 | orchestrator | Friday 24 April 2026 05:52:59 +0000 (0:00:01.613) 0:50:40.799 ********** 2026-04-24 05:53:09.344311 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3 2026-04-24 05:53:09.344320 | orchestrator | 2026-04-24 05:53:09.344328 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:53:09.344337 | orchestrator | Friday 24 April 2026 05:53:00 +0000 (0:00:01.336) 0:50:42.135 ********** 2026-04-24 05:53:09.344346 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:09.344354 | orchestrator | 2026-04-24 05:53:09.344363 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:53:09.344371 | orchestrator | Friday 24 April 2026 05:53:01 +0000 (0:00:01.471) 0:50:43.606 ********** 2026-04-24 05:53:09.344380 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:09.344388 | orchestrator | 2026-04-24 05:53:09.344397 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:53:09.344405 | orchestrator | Friday 24 April 2026 05:53:03 +0000 (0:00:01.200) 0:50:44.807 ********** 2026-04-24 05:53:09.344413 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:09.344422 | orchestrator | 2026-04-24 05:53:09.344430 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:53:09.344439 | orchestrator | Friday 24 April 2026 05:53:04 +0000 (0:00:01.448) 0:50:46.255 ********** 2026-04-24 05:53:09.344447 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:09.344456 | orchestrator | 2026-04-24 05:53:09.344469 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:53:09.344478 | orchestrator | Friday 24 April 2026 05:53:05 +0000 (0:00:01.200) 0:50:47.456 ********** 2026-04-24 05:53:09.344486 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:09.344495 | orchestrator | 2026-04-24 05:53:09.344503 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:53:09.344512 | orchestrator | Friday 24 April 2026 05:53:06 +0000 (0:00:01.134) 0:50:48.591 ********** 2026-04-24 05:53:09.344526 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:09.344534 | orchestrator | 2026-04-24 05:53:09.344543 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:53:09.344551 | orchestrator | Friday 24 April 2026 05:53:08 +0000 (0:00:01.161) 0:50:49.752 ********** 2026-04-24 05:53:09.344560 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:09.344568 | orchestrator | 2026-04-24 05:53:09.344577 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:53:09.344585 | orchestrator | Friday 24 April 2026 05:53:09 +0000 (0:00:01.132) 0:50:50.885 ********** 2026-04-24 05:53:09.344594 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:09.344603 | orchestrator | 2026-04-24 05:53:09.344618 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:53:34.659041 | orchestrator | Friday 24 April 2026 05:53:10 +0000 (0:00:01.129) 0:50:52.015 ********** 2026-04-24 05:53:34.659121 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:53:34.659127 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:53:34.659132 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:53:34.659137 | orchestrator | 2026-04-24 05:53:34.659142 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:53:34.659146 | orchestrator | Friday 24 April 2026 05:53:12 +0000 (0:00:02.022) 0:50:54.037 ********** 2026-04-24 05:53:34.659150 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:34.659155 | orchestrator | 2026-04-24 05:53:34.659159 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:53:34.659163 | orchestrator | Friday 24 April 2026 05:53:13 +0000 (0:00:01.252) 0:50:55.290 ********** 2026-04-24 05:53:34.659167 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:53:34.659171 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:53:34.659174 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:53:34.659178 | orchestrator | 2026-04-24 05:53:34.659182 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:53:34.659186 | orchestrator | Friday 24 April 2026 05:53:16 +0000 (0:00:03.200) 0:50:58.490 ********** 2026-04-24 05:53:34.659190 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 05:53:34.659195 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 05:53:34.659198 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 05:53:34.659203 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:34.659207 | orchestrator | 2026-04-24 05:53:34.659210 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:53:34.659214 | orchestrator | Friday 24 April 2026 05:53:18 +0000 (0:00:01.791) 0:51:00.282 ********** 2026-04-24 05:53:34.659220 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:53:34.659226 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:53:34.659230 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:53:34.659234 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:34.659237 | orchestrator | 2026-04-24 05:53:34.659241 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:53:34.659260 | orchestrator | Friday 24 April 2026 05:53:20 +0000 (0:00:02.083) 0:51:02.365 ********** 2026-04-24 05:53:34.659266 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:34.659282 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:34.659286 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:34.659290 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:34.659294 | orchestrator | 2026-04-24 05:53:34.659297 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:53:34.659301 | orchestrator | Friday 24 April 2026 05:53:21 +0000 (0:00:01.177) 0:51:03.542 ********** 2026-04-24 05:53:34.659317 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:53:14.106085', 'end': '2026-04-24 05:53:14.160690', 'delta': '0:00:00.054605', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:53:34.659323 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:53:15.014748', 'end': '2026-04-24 05:53:15.069456', 'delta': '0:00:00.054708', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:53:34.659327 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:53:15.554343', 'end': '2026-04-24 05:53:15.603653', 'delta': '0:00:00.049310', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:53:34.659335 | orchestrator | 2026-04-24 05:53:34.659339 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:53:34.659343 | orchestrator | Friday 24 April 2026 05:53:23 +0000 (0:00:01.273) 0:51:04.816 ********** 2026-04-24 05:53:34.659347 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:34.659350 | orchestrator | 2026-04-24 05:53:34.659354 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:53:34.659358 | orchestrator | Friday 24 April 2026 05:53:24 +0000 (0:00:01.273) 0:51:06.089 ********** 2026-04-24 05:53:34.659362 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:34.659366 | orchestrator | 2026-04-24 05:53:34.659370 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:53:34.659373 | orchestrator | Friday 24 April 2026 05:53:25 +0000 (0:00:01.269) 0:51:07.358 ********** 2026-04-24 05:53:34.659377 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:34.659381 | orchestrator | 2026-04-24 05:53:34.659385 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:53:34.659389 | orchestrator | Friday 24 April 2026 05:53:26 +0000 (0:00:01.126) 0:51:08.486 ********** 2026-04-24 05:53:34.659392 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:53:34.659396 | orchestrator | 2026-04-24 05:53:34.659400 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:53:34.659404 | orchestrator | Friday 24 April 2026 05:53:28 +0000 (0:00:02.014) 0:51:10.500 ********** 2026-04-24 05:53:34.659408 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:34.659411 | orchestrator | 2026-04-24 05:53:34.659415 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:53:34.659422 | orchestrator | Friday 24 April 2026 05:53:29 +0000 (0:00:01.151) 0:51:11.651 ********** 2026-04-24 05:53:34.659426 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:34.659430 | orchestrator | 2026-04-24 05:53:34.659433 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:53:34.659437 | orchestrator | Friday 24 April 2026 05:53:31 +0000 (0:00:01.154) 0:51:12.806 ********** 2026-04-24 05:53:34.659441 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:34.659445 | orchestrator | 2026-04-24 05:53:34.659449 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:53:34.659452 | orchestrator | Friday 24 April 2026 05:53:32 +0000 (0:00:01.212) 0:51:14.019 ********** 2026-04-24 05:53:34.659456 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:34.659460 | orchestrator | 2026-04-24 05:53:34.659464 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:53:34.659467 | orchestrator | Friday 24 April 2026 05:53:33 +0000 (0:00:01.111) 0:51:15.131 ********** 2026-04-24 05:53:34.659471 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:34.659475 | orchestrator | 2026-04-24 05:53:34.659479 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:53:34.659483 | orchestrator | Friday 24 April 2026 05:53:34 +0000 (0:00:01.144) 0:51:16.275 ********** 2026-04-24 05:53:34.659489 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:40.598328 | orchestrator | 2026-04-24 05:53:40.598437 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:53:40.598454 | orchestrator | Friday 24 April 2026 05:53:35 +0000 (0:00:01.149) 0:51:17.425 ********** 2026-04-24 05:53:40.598466 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:40.598478 | orchestrator | 2026-04-24 05:53:40.598489 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:53:40.598500 | orchestrator | Friday 24 April 2026 05:53:36 +0000 (0:00:01.187) 0:51:18.613 ********** 2026-04-24 05:53:40.598511 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:40.598522 | orchestrator | 2026-04-24 05:53:40.598533 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:53:40.598545 | orchestrator | Friday 24 April 2026 05:53:38 +0000 (0:00:01.190) 0:51:19.803 ********** 2026-04-24 05:53:40.598578 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:40.598589 | orchestrator | 2026-04-24 05:53:40.598600 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:53:40.598612 | orchestrator | Friday 24 April 2026 05:53:39 +0000 (0:00:01.125) 0:51:20.928 ********** 2026-04-24 05:53:40.598622 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:53:40.598633 | orchestrator | 2026-04-24 05:53:40.598644 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:53:40.598655 | orchestrator | Friday 24 April 2026 05:53:40 +0000 (0:00:01.176) 0:51:22.105 ********** 2026-04-24 05:53:40.598668 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:53:40.598684 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'uuids': ['6d15df4f-c4ce-4002-ae8a-c5ea103b6315'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R']}})  2026-04-24 05:53:40.598699 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '92dd2642', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:53:40.598725 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3']}})  2026-04-24 05:53:40.598738 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:53:40.598767 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:53:40.598788 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-05-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:53:40.598800 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:53:40.598812 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx', 'dm-uuid-CRYPT-LUKS2-7bd2335635b44d1cb53d2df716853f40-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:53:40.598823 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:53:40.598835 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'uuids': ['7bd23356-35b4-4d1c-b53d-2df716853f40'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx']}})  2026-04-24 05:53:40.598851 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f']}})  2026-04-24 05:53:40.598871 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:53:41.887703 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3ccf7d33', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:53:41.887807 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:53:41.887827 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:53:41.887858 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R', 'dm-uuid-CRYPT-LUKS2-6d15df4fc4ce4002ae8ac5ea103b6315-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:53:41.887873 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:53:41.887887 | orchestrator | 2026-04-24 05:53:41.887899 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:53:41.887933 | orchestrator | Friday 24 April 2026 05:53:41 +0000 (0:00:01.336) 0:51:23.441 ********** 2026-04-24 05:53:41.888055 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:41.888074 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'uuids': ['6d15df4f-c4ce-4002-ae8a-c5ea103b6315'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:41.888087 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '92dd2642', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:41.888100 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:41.888120 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:41.888155 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.008728 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-05-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.008821 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.008835 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx', 'dm-uuid-CRYPT-LUKS2-7bd2335635b44d1cb53d2df716853f40-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.008847 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.008876 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'uuids': ['7bd23356-35b4-4d1c-b53d-2df716853f40'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.008929 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.008946 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.008966 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3ccf7d33', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.009030 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:53:42.009052 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:54:17.719084 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R', 'dm-uuid-CRYPT-LUKS2-6d15df4fc4ce4002ae8ac5ea103b6315-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:54:17.719209 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.719229 | orchestrator | 2026-04-24 05:54:17.719242 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:54:17.719254 | orchestrator | Friday 24 April 2026 05:53:43 +0000 (0:00:01.393) 0:51:24.835 ********** 2026-04-24 05:54:17.719266 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:54:17.719278 | orchestrator | 2026-04-24 05:54:17.719289 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:54:17.719300 | orchestrator | Friday 24 April 2026 05:53:44 +0000 (0:00:01.489) 0:51:26.325 ********** 2026-04-24 05:54:17.719310 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:54:17.719321 | orchestrator | 2026-04-24 05:54:17.719332 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:54:17.719343 | orchestrator | Friday 24 April 2026 05:53:45 +0000 (0:00:01.099) 0:51:27.425 ********** 2026-04-24 05:54:17.719353 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:54:17.719364 | orchestrator | 2026-04-24 05:54:17.719375 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:54:17.719386 | orchestrator | Friday 24 April 2026 05:53:47 +0000 (0:00:01.485) 0:51:28.910 ********** 2026-04-24 05:54:17.719397 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.719407 | orchestrator | 2026-04-24 05:54:17.719418 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:54:17.719429 | orchestrator | Friday 24 April 2026 05:53:48 +0000 (0:00:01.098) 0:51:30.008 ********** 2026-04-24 05:54:17.719440 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.719452 | orchestrator | 2026-04-24 05:54:17.719471 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:54:17.719522 | orchestrator | Friday 24 April 2026 05:53:49 +0000 (0:00:01.227) 0:51:31.236 ********** 2026-04-24 05:54:17.719543 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.719561 | orchestrator | 2026-04-24 05:54:17.719581 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:54:17.719601 | orchestrator | Friday 24 April 2026 05:53:50 +0000 (0:00:01.180) 0:51:32.417 ********** 2026-04-24 05:54:17.719619 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-24 05:54:17.719639 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-24 05:54:17.719657 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-24 05:54:17.719675 | orchestrator | 2026-04-24 05:54:17.719711 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:54:17.719730 | orchestrator | Friday 24 April 2026 05:53:52 +0000 (0:00:02.068) 0:51:34.485 ********** 2026-04-24 05:54:17.719749 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 05:54:17.719768 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 05:54:17.719788 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 05:54:17.719805 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.719824 | orchestrator | 2026-04-24 05:54:17.719842 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:54:17.719860 | orchestrator | Friday 24 April 2026 05:53:54 +0000 (0:00:01.236) 0:51:35.721 ********** 2026-04-24 05:54:17.719878 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3 2026-04-24 05:54:17.719899 | orchestrator | 2026-04-24 05:54:17.719918 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:54:17.719939 | orchestrator | Friday 24 April 2026 05:53:55 +0000 (0:00:01.157) 0:51:36.879 ********** 2026-04-24 05:54:17.719958 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.719970 | orchestrator | 2026-04-24 05:54:17.720006 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:54:17.720017 | orchestrator | Friday 24 April 2026 05:53:56 +0000 (0:00:01.139) 0:51:38.019 ********** 2026-04-24 05:54:17.720028 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.720039 | orchestrator | 2026-04-24 05:54:17.720050 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:54:17.720060 | orchestrator | Friday 24 April 2026 05:53:57 +0000 (0:00:01.126) 0:51:39.145 ********** 2026-04-24 05:54:17.720071 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.720082 | orchestrator | 2026-04-24 05:54:17.720092 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:54:17.720103 | orchestrator | Friday 24 April 2026 05:53:58 +0000 (0:00:01.126) 0:51:40.271 ********** 2026-04-24 05:54:17.720114 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:54:17.720124 | orchestrator | 2026-04-24 05:54:17.720142 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:54:17.720162 | orchestrator | Friday 24 April 2026 05:53:59 +0000 (0:00:01.216) 0:51:41.488 ********** 2026-04-24 05:54:17.720181 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:54:17.720222 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:54:17.720242 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:54:17.720263 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.720281 | orchestrator | 2026-04-24 05:54:17.720301 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:54:17.720313 | orchestrator | Friday 24 April 2026 05:54:01 +0000 (0:00:01.401) 0:51:42.889 ********** 2026-04-24 05:54:17.720324 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:54:17.720334 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:54:17.720358 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:54:17.720369 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.720379 | orchestrator | 2026-04-24 05:54:17.720390 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:54:17.720401 | orchestrator | Friday 24 April 2026 05:54:02 +0000 (0:00:01.413) 0:51:44.302 ********** 2026-04-24 05:54:17.720412 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:54:17.720422 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:54:17.720433 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:54:17.720443 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.720454 | orchestrator | 2026-04-24 05:54:17.720465 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:54:17.720476 | orchestrator | Friday 24 April 2026 05:54:03 +0000 (0:00:01.376) 0:51:45.679 ********** 2026-04-24 05:54:17.720487 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:54:17.720498 | orchestrator | 2026-04-24 05:54:17.720508 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:54:17.720519 | orchestrator | Friday 24 April 2026 05:54:05 +0000 (0:00:01.159) 0:51:46.838 ********** 2026-04-24 05:54:17.720530 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 05:54:17.720540 | orchestrator | 2026-04-24 05:54:17.720551 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:54:17.720562 | orchestrator | Friday 24 April 2026 05:54:06 +0000 (0:00:01.354) 0:51:48.192 ********** 2026-04-24 05:54:17.720573 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:54:17.720583 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:54:17.720594 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:54:17.720605 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 05:54:17.720616 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:54:17.720626 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:54:17.720637 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:54:17.720648 | orchestrator | 2026-04-24 05:54:17.720659 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:54:17.720669 | orchestrator | Friday 24 April 2026 05:54:08 +0000 (0:00:02.152) 0:51:50.345 ********** 2026-04-24 05:54:17.720680 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:54:17.720698 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:54:17.720709 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:54:17.720720 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 05:54:17.720731 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 05:54:17.720742 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:54:17.720753 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:54:17.720763 | orchestrator | 2026-04-24 05:54:17.720774 | orchestrator | TASK [Prevent restart from the packaging] ************************************** 2026-04-24 05:54:17.720785 | orchestrator | Friday 24 April 2026 05:54:11 +0000 (0:00:02.984) 0:51:53.330 ********** 2026-04-24 05:54:17.720795 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.720806 | orchestrator | 2026-04-24 05:54:17.720817 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:54:17.720828 | orchestrator | Friday 24 April 2026 05:54:12 +0000 (0:00:01.121) 0:51:54.451 ********** 2026-04-24 05:54:17.720838 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3 2026-04-24 05:54:17.720856 | orchestrator | 2026-04-24 05:54:17.720866 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:54:17.720877 | orchestrator | Friday 24 April 2026 05:54:13 +0000 (0:00:01.097) 0:51:55.549 ********** 2026-04-24 05:54:17.720888 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3 2026-04-24 05:54:17.720899 | orchestrator | 2026-04-24 05:54:17.720910 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:54:17.720921 | orchestrator | Friday 24 April 2026 05:54:15 +0000 (0:00:01.210) 0:51:56.760 ********** 2026-04-24 05:54:17.720931 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:54:17.720942 | orchestrator | 2026-04-24 05:54:17.720953 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:54:17.720963 | orchestrator | Friday 24 April 2026 05:54:16 +0000 (0:00:01.162) 0:51:57.922 ********** 2026-04-24 05:54:17.720974 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:54:17.721007 | orchestrator | 2026-04-24 05:54:17.721027 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:54:17.721088 | orchestrator | Friday 24 April 2026 05:54:17 +0000 (0:00:01.496) 0:51:59.419 ********** 2026-04-24 05:55:08.185180 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.185299 | orchestrator | 2026-04-24 05:55:08.185317 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:55:08.185331 | orchestrator | Friday 24 April 2026 05:54:19 +0000 (0:00:01.528) 0:52:00.947 ********** 2026-04-24 05:55:08.185342 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.185353 | orchestrator | 2026-04-24 05:55:08.185365 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:55:08.185376 | orchestrator | Friday 24 April 2026 05:54:20 +0000 (0:00:01.589) 0:52:02.537 ********** 2026-04-24 05:55:08.185387 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.185399 | orchestrator | 2026-04-24 05:55:08.185410 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:55:08.185420 | orchestrator | Friday 24 April 2026 05:54:21 +0000 (0:00:01.119) 0:52:03.657 ********** 2026-04-24 05:55:08.185431 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.185442 | orchestrator | 2026-04-24 05:55:08.185453 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:55:08.185464 | orchestrator | Friday 24 April 2026 05:54:23 +0000 (0:00:01.126) 0:52:04.783 ********** 2026-04-24 05:55:08.185475 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.185486 | orchestrator | 2026-04-24 05:55:08.185497 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:55:08.185508 | orchestrator | Friday 24 April 2026 05:54:24 +0000 (0:00:01.169) 0:52:05.952 ********** 2026-04-24 05:55:08.185518 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.185529 | orchestrator | 2026-04-24 05:55:08.185540 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:55:08.185551 | orchestrator | Friday 24 April 2026 05:54:25 +0000 (0:00:01.571) 0:52:07.523 ********** 2026-04-24 05:55:08.185561 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.185572 | orchestrator | 2026-04-24 05:55:08.185583 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:55:08.185594 | orchestrator | Friday 24 April 2026 05:54:27 +0000 (0:00:01.549) 0:52:09.073 ********** 2026-04-24 05:55:08.185605 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.185615 | orchestrator | 2026-04-24 05:55:08.185627 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:55:08.185641 | orchestrator | Friday 24 April 2026 05:54:28 +0000 (0:00:01.110) 0:52:10.184 ********** 2026-04-24 05:55:08.185654 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.185667 | orchestrator | 2026-04-24 05:55:08.185680 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:55:08.185693 | orchestrator | Friday 24 April 2026 05:54:29 +0000 (0:00:01.103) 0:52:11.287 ********** 2026-04-24 05:55:08.185732 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.185746 | orchestrator | 2026-04-24 05:55:08.185759 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:55:08.185771 | orchestrator | Friday 24 April 2026 05:54:30 +0000 (0:00:01.136) 0:52:12.423 ********** 2026-04-24 05:55:08.185784 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.185797 | orchestrator | 2026-04-24 05:55:08.185810 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:55:08.185823 | orchestrator | Friday 24 April 2026 05:54:31 +0000 (0:00:01.133) 0:52:13.556 ********** 2026-04-24 05:55:08.185835 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.185847 | orchestrator | 2026-04-24 05:55:08.185857 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:55:08.185882 | orchestrator | Friday 24 April 2026 05:54:33 +0000 (0:00:01.231) 0:52:14.788 ********** 2026-04-24 05:55:08.185893 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.185904 | orchestrator | 2026-04-24 05:55:08.185915 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:55:08.185925 | orchestrator | Friday 24 April 2026 05:54:34 +0000 (0:00:01.119) 0:52:15.907 ********** 2026-04-24 05:55:08.185936 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.185947 | orchestrator | 2026-04-24 05:55:08.185957 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:55:08.185990 | orchestrator | Friday 24 April 2026 05:54:35 +0000 (0:00:01.123) 0:52:17.031 ********** 2026-04-24 05:55:08.186004 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186096 | orchestrator | 2026-04-24 05:55:08.186109 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:55:08.186120 | orchestrator | Friday 24 April 2026 05:54:36 +0000 (0:00:01.107) 0:52:18.139 ********** 2026-04-24 05:55:08.186131 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.186141 | orchestrator | 2026-04-24 05:55:08.186175 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:55:08.186186 | orchestrator | Friday 24 April 2026 05:54:37 +0000 (0:00:01.136) 0:52:19.275 ********** 2026-04-24 05:55:08.186197 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.186208 | orchestrator | 2026-04-24 05:55:08.186219 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:55:08.186230 | orchestrator | Friday 24 April 2026 05:54:38 +0000 (0:00:01.164) 0:52:20.439 ********** 2026-04-24 05:55:08.186241 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186252 | orchestrator | 2026-04-24 05:55:08.186263 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:55:08.186274 | orchestrator | Friday 24 April 2026 05:54:39 +0000 (0:00:01.210) 0:52:21.649 ********** 2026-04-24 05:55:08.186285 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186296 | orchestrator | 2026-04-24 05:55:08.186307 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:55:08.186317 | orchestrator | Friday 24 April 2026 05:54:41 +0000 (0:00:01.111) 0:52:22.762 ********** 2026-04-24 05:55:08.186328 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186339 | orchestrator | 2026-04-24 05:55:08.186350 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:55:08.186360 | orchestrator | Friday 24 April 2026 05:54:42 +0000 (0:00:01.125) 0:52:23.888 ********** 2026-04-24 05:55:08.186371 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186382 | orchestrator | 2026-04-24 05:55:08.186393 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:55:08.186422 | orchestrator | Friday 24 April 2026 05:54:43 +0000 (0:00:01.115) 0:52:25.003 ********** 2026-04-24 05:55:08.186434 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186445 | orchestrator | 2026-04-24 05:55:08.186456 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:55:08.186466 | orchestrator | Friday 24 April 2026 05:54:44 +0000 (0:00:01.136) 0:52:26.139 ********** 2026-04-24 05:55:08.186488 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186499 | orchestrator | 2026-04-24 05:55:08.186509 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:55:08.186520 | orchestrator | Friday 24 April 2026 05:54:45 +0000 (0:00:01.142) 0:52:27.282 ********** 2026-04-24 05:55:08.186531 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186542 | orchestrator | 2026-04-24 05:55:08.186553 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:55:08.186565 | orchestrator | Friday 24 April 2026 05:54:46 +0000 (0:00:01.118) 0:52:28.401 ********** 2026-04-24 05:55:08.186575 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186586 | orchestrator | 2026-04-24 05:55:08.186597 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:55:08.186608 | orchestrator | Friday 24 April 2026 05:54:47 +0000 (0:00:01.157) 0:52:29.558 ********** 2026-04-24 05:55:08.186618 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186629 | orchestrator | 2026-04-24 05:55:08.186640 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:55:08.186651 | orchestrator | Friday 24 April 2026 05:54:48 +0000 (0:00:01.116) 0:52:30.675 ********** 2026-04-24 05:55:08.186661 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186672 | orchestrator | 2026-04-24 05:55:08.186683 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:55:08.186694 | orchestrator | Friday 24 April 2026 05:54:50 +0000 (0:00:01.167) 0:52:31.842 ********** 2026-04-24 05:55:08.186704 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186715 | orchestrator | 2026-04-24 05:55:08.186726 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:55:08.186736 | orchestrator | Friday 24 April 2026 05:54:51 +0000 (0:00:01.166) 0:52:33.009 ********** 2026-04-24 05:55:08.186747 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186758 | orchestrator | 2026-04-24 05:55:08.186769 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:55:08.186780 | orchestrator | Friday 24 April 2026 05:54:52 +0000 (0:00:01.266) 0:52:34.276 ********** 2026-04-24 05:55:08.186790 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.186801 | orchestrator | 2026-04-24 05:55:08.186812 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:55:08.186823 | orchestrator | Friday 24 April 2026 05:54:54 +0000 (0:00:02.005) 0:52:36.281 ********** 2026-04-24 05:55:08.186833 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.186844 | orchestrator | 2026-04-24 05:55:08.186855 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:55:08.186865 | orchestrator | Friday 24 April 2026 05:54:56 +0000 (0:00:02.231) 0:52:38.513 ********** 2026-04-24 05:55:08.186876 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3 2026-04-24 05:55:08.186888 | orchestrator | 2026-04-24 05:55:08.186898 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:55:08.186915 | orchestrator | Friday 24 April 2026 05:54:57 +0000 (0:00:01.143) 0:52:39.656 ********** 2026-04-24 05:55:08.186926 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.186937 | orchestrator | 2026-04-24 05:55:08.186948 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:55:08.186959 | orchestrator | Friday 24 April 2026 05:54:59 +0000 (0:00:01.113) 0:52:40.769 ********** 2026-04-24 05:55:08.186990 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.187001 | orchestrator | 2026-04-24 05:55:08.187012 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:55:08.187023 | orchestrator | Friday 24 April 2026 05:55:00 +0000 (0:00:01.137) 0:52:41.907 ********** 2026-04-24 05:55:08.187034 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:55:08.187044 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:55:08.187061 | orchestrator | 2026-04-24 05:55:08.187072 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:55:08.187083 | orchestrator | Friday 24 April 2026 05:55:01 +0000 (0:00:01.781) 0:52:43.688 ********** 2026-04-24 05:55:08.187094 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:08.187104 | orchestrator | 2026-04-24 05:55:08.187115 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:55:08.187126 | orchestrator | Friday 24 April 2026 05:55:03 +0000 (0:00:01.489) 0:52:45.177 ********** 2026-04-24 05:55:08.187136 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.187147 | orchestrator | 2026-04-24 05:55:08.187158 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:55:08.187168 | orchestrator | Friday 24 April 2026 05:55:04 +0000 (0:00:01.184) 0:52:46.362 ********** 2026-04-24 05:55:08.187179 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.187190 | orchestrator | 2026-04-24 05:55:08.187201 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:55:08.187211 | orchestrator | Friday 24 April 2026 05:55:05 +0000 (0:00:01.208) 0:52:47.571 ********** 2026-04-24 05:55:08.187222 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:08.187233 | orchestrator | 2026-04-24 05:55:08.187243 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:55:08.187254 | orchestrator | Friday 24 April 2026 05:55:07 +0000 (0:00:01.190) 0:52:48.761 ********** 2026-04-24 05:55:08.187265 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3 2026-04-24 05:55:08.187275 | orchestrator | 2026-04-24 05:55:08.187286 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:55:08.187304 | orchestrator | Friday 24 April 2026 05:55:08 +0000 (0:00:01.120) 0:52:49.883 ********** 2026-04-24 05:55:54.623063 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:54.623180 | orchestrator | 2026-04-24 05:55:54.623197 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:55:54.623210 | orchestrator | Friday 24 April 2026 05:55:09 +0000 (0:00:01.821) 0:52:51.705 ********** 2026-04-24 05:55:54.623222 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:55:54.623233 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:55:54.623244 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:55:54.623255 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623267 | orchestrator | 2026-04-24 05:55:54.623278 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:55:54.623288 | orchestrator | Friday 24 April 2026 05:55:11 +0000 (0:00:01.188) 0:52:52.893 ********** 2026-04-24 05:55:54.623299 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623310 | orchestrator | 2026-04-24 05:55:54.623321 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:55:54.623332 | orchestrator | Friday 24 April 2026 05:55:12 +0000 (0:00:01.160) 0:52:54.054 ********** 2026-04-24 05:55:54.623342 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623353 | orchestrator | 2026-04-24 05:55:54.623364 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:55:54.623375 | orchestrator | Friday 24 April 2026 05:55:13 +0000 (0:00:01.186) 0:52:55.241 ********** 2026-04-24 05:55:54.623386 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623396 | orchestrator | 2026-04-24 05:55:54.623407 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:55:54.623418 | orchestrator | Friday 24 April 2026 05:55:14 +0000 (0:00:01.176) 0:52:56.418 ********** 2026-04-24 05:55:54.623429 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623439 | orchestrator | 2026-04-24 05:55:54.623450 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:55:54.623484 | orchestrator | Friday 24 April 2026 05:55:15 +0000 (0:00:01.160) 0:52:57.579 ********** 2026-04-24 05:55:54.623496 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623506 | orchestrator | 2026-04-24 05:55:54.623517 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:55:54.623528 | orchestrator | Friday 24 April 2026 05:55:17 +0000 (0:00:01.325) 0:52:58.905 ********** 2026-04-24 05:55:54.623541 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:54.623554 | orchestrator | 2026-04-24 05:55:54.623567 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:55:54.623579 | orchestrator | Friday 24 April 2026 05:55:19 +0000 (0:00:02.507) 0:53:01.412 ********** 2026-04-24 05:55:54.623592 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:54.623604 | orchestrator | 2026-04-24 05:55:54.623616 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:55:54.623628 | orchestrator | Friday 24 April 2026 05:55:20 +0000 (0:00:01.172) 0:53:02.585 ********** 2026-04-24 05:55:54.623642 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3 2026-04-24 05:55:54.623654 | orchestrator | 2026-04-24 05:55:54.623667 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:55:54.623693 | orchestrator | Friday 24 April 2026 05:55:22 +0000 (0:00:01.190) 0:53:03.775 ********** 2026-04-24 05:55:54.623705 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623718 | orchestrator | 2026-04-24 05:55:54.623731 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:55:54.623743 | orchestrator | Friday 24 April 2026 05:55:23 +0000 (0:00:01.149) 0:53:04.925 ********** 2026-04-24 05:55:54.623755 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623767 | orchestrator | 2026-04-24 05:55:54.623779 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:55:54.623792 | orchestrator | Friday 24 April 2026 05:55:24 +0000 (0:00:01.203) 0:53:06.128 ********** 2026-04-24 05:55:54.623804 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623817 | orchestrator | 2026-04-24 05:55:54.623829 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:55:54.623841 | orchestrator | Friday 24 April 2026 05:55:25 +0000 (0:00:01.156) 0:53:07.284 ********** 2026-04-24 05:55:54.623854 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623866 | orchestrator | 2026-04-24 05:55:54.623879 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:55:54.623891 | orchestrator | Friday 24 April 2026 05:55:26 +0000 (0:00:01.293) 0:53:08.578 ********** 2026-04-24 05:55:54.623901 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623912 | orchestrator | 2026-04-24 05:55:54.623923 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:55:54.623959 | orchestrator | Friday 24 April 2026 05:55:28 +0000 (0:00:01.162) 0:53:09.741 ********** 2026-04-24 05:55:54.623970 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.623981 | orchestrator | 2026-04-24 05:55:54.623992 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:55:54.624002 | orchestrator | Friday 24 April 2026 05:55:29 +0000 (0:00:01.144) 0:53:10.885 ********** 2026-04-24 05:55:54.624013 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624024 | orchestrator | 2026-04-24 05:55:54.624034 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 05:55:54.624045 | orchestrator | Friday 24 April 2026 05:55:30 +0000 (0:00:01.146) 0:53:12.032 ********** 2026-04-24 05:55:54.624056 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624067 | orchestrator | 2026-04-24 05:55:54.624078 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 05:55:54.624089 | orchestrator | Friday 24 April 2026 05:55:31 +0000 (0:00:01.170) 0:53:13.202 ********** 2026-04-24 05:55:54.624099 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:55:54.624110 | orchestrator | 2026-04-24 05:55:54.624121 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 05:55:54.624157 | orchestrator | Friday 24 April 2026 05:55:32 +0000 (0:00:01.199) 0:53:14.402 ********** 2026-04-24 05:55:54.624169 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3 2026-04-24 05:55:54.624180 | orchestrator | 2026-04-24 05:55:54.624191 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 05:55:54.624202 | orchestrator | Friday 24 April 2026 05:55:33 +0000 (0:00:01.175) 0:53:15.577 ********** 2026-04-24 05:55:54.624213 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-24 05:55:54.624224 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-24 05:55:54.624234 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-24 05:55:54.624245 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-24 05:55:54.624255 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-24 05:55:54.624266 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-24 05:55:54.624276 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-24 05:55:54.624287 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-24 05:55:54.624298 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 05:55:54.624309 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 05:55:54.624319 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 05:55:54.624330 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 05:55:54.624341 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 05:55:54.624351 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 05:55:54.624362 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-24 05:55:54.624373 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-24 05:55:54.624383 | orchestrator | 2026-04-24 05:55:54.624394 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 05:55:54.624405 | orchestrator | Friday 24 April 2026 05:55:40 +0000 (0:00:06.513) 0:53:22.091 ********** 2026-04-24 05:55:54.624415 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3 2026-04-24 05:55:54.624426 | orchestrator | 2026-04-24 05:55:54.624437 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 05:55:54.624447 | orchestrator | Friday 24 April 2026 05:55:41 +0000 (0:00:01.150) 0:53:23.241 ********** 2026-04-24 05:55:54.624458 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 05:55:54.624469 | orchestrator | 2026-04-24 05:55:54.624480 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 05:55:54.624491 | orchestrator | Friday 24 April 2026 05:55:43 +0000 (0:00:01.491) 0:53:24.733 ********** 2026-04-24 05:55:54.624502 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 05:55:54.624513 | orchestrator | 2026-04-24 05:55:54.624523 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 05:55:54.624539 | orchestrator | Friday 24 April 2026 05:55:45 +0000 (0:00:02.085) 0:53:26.818 ********** 2026-04-24 05:55:54.624550 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624561 | orchestrator | 2026-04-24 05:55:54.624571 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 05:55:54.624582 | orchestrator | Friday 24 April 2026 05:55:46 +0000 (0:00:01.152) 0:53:27.971 ********** 2026-04-24 05:55:54.624593 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624603 | orchestrator | 2026-04-24 05:55:54.624614 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 05:55:54.624625 | orchestrator | Friday 24 April 2026 05:55:47 +0000 (0:00:01.147) 0:53:29.118 ********** 2026-04-24 05:55:54.624642 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624653 | orchestrator | 2026-04-24 05:55:54.624664 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 05:55:54.624674 | orchestrator | Friday 24 April 2026 05:55:48 +0000 (0:00:01.141) 0:53:30.259 ********** 2026-04-24 05:55:54.624685 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624696 | orchestrator | 2026-04-24 05:55:54.624706 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 05:55:54.624717 | orchestrator | Friday 24 April 2026 05:55:49 +0000 (0:00:01.179) 0:53:31.439 ********** 2026-04-24 05:55:54.624728 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624738 | orchestrator | 2026-04-24 05:55:54.624749 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 05:55:54.624760 | orchestrator | Friday 24 April 2026 05:55:50 +0000 (0:00:01.155) 0:53:32.594 ********** 2026-04-24 05:55:54.624771 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624781 | orchestrator | 2026-04-24 05:55:54.624792 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 05:55:54.624803 | orchestrator | Friday 24 April 2026 05:55:52 +0000 (0:00:01.168) 0:53:33.763 ********** 2026-04-24 05:55:54.624813 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624824 | orchestrator | 2026-04-24 05:55:54.624834 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 05:55:54.624845 | orchestrator | Friday 24 April 2026 05:55:53 +0000 (0:00:01.245) 0:53:35.008 ********** 2026-04-24 05:55:54.624856 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624866 | orchestrator | 2026-04-24 05:55:54.624877 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 05:55:54.624888 | orchestrator | Friday 24 April 2026 05:55:54 +0000 (0:00:01.148) 0:53:36.157 ********** 2026-04-24 05:55:54.624898 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:55:54.624909 | orchestrator | 2026-04-24 05:55:54.624926 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 05:56:51.530397 | orchestrator | Friday 24 April 2026 05:55:55 +0000 (0:00:01.167) 0:53:37.324 ********** 2026-04-24 05:56:51.530535 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.530560 | orchestrator | 2026-04-24 05:56:51.530578 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 05:56:51.530595 | orchestrator | Friday 24 April 2026 05:55:56 +0000 (0:00:01.139) 0:53:38.464 ********** 2026-04-24 05:56:51.530611 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.530627 | orchestrator | 2026-04-24 05:56:51.530643 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 05:56:51.530660 | orchestrator | Friday 24 April 2026 05:55:57 +0000 (0:00:01.177) 0:53:39.642 ********** 2026-04-24 05:56:51.530678 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-24 05:56:51.530692 | orchestrator | 2026-04-24 05:56:51.530707 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 05:56:51.530721 | orchestrator | Friday 24 April 2026 05:56:02 +0000 (0:00:04.492) 0:53:44.134 ********** 2026-04-24 05:56:51.530738 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 05:56:51.530755 | orchestrator | 2026-04-24 05:56:51.530772 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 05:56:51.530788 | orchestrator | Friday 24 April 2026 05:56:03 +0000 (0:00:01.299) 0:53:45.434 ********** 2026-04-24 05:56:51.530807 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-24 05:56:51.530877 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-24 05:56:51.530926 | orchestrator | 2026-04-24 05:56:51.530942 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 05:56:51.530959 | orchestrator | Friday 24 April 2026 05:56:08 +0000 (0:00:04.754) 0:53:50.188 ********** 2026-04-24 05:56:51.530975 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.530991 | orchestrator | 2026-04-24 05:56:51.531008 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 05:56:51.531023 | orchestrator | Friday 24 April 2026 05:56:09 +0000 (0:00:01.172) 0:53:51.361 ********** 2026-04-24 05:56:51.531038 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.531054 | orchestrator | 2026-04-24 05:56:51.531089 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:56:51.531105 | orchestrator | Friday 24 April 2026 05:56:10 +0000 (0:00:01.141) 0:53:52.502 ********** 2026-04-24 05:56:51.531119 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.531136 | orchestrator | 2026-04-24 05:56:51.531150 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:56:51.531167 | orchestrator | Friday 24 April 2026 05:56:12 +0000 (0:00:01.215) 0:53:53.718 ********** 2026-04-24 05:56:51.531181 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.531197 | orchestrator | 2026-04-24 05:56:51.531212 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:56:51.531227 | orchestrator | Friday 24 April 2026 05:56:13 +0000 (0:00:01.172) 0:53:54.891 ********** 2026-04-24 05:56:51.531242 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.531258 | orchestrator | 2026-04-24 05:56:51.531273 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:56:51.531289 | orchestrator | Friday 24 April 2026 05:56:14 +0000 (0:00:01.223) 0:53:56.115 ********** 2026-04-24 05:56:51.531305 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.531321 | orchestrator | 2026-04-24 05:56:51.531337 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:56:51.531353 | orchestrator | Friday 24 April 2026 05:56:15 +0000 (0:00:01.283) 0:53:57.398 ********** 2026-04-24 05:56:51.531370 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:56:51.531387 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:56:51.531402 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:56:51.531418 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.531435 | orchestrator | 2026-04-24 05:56:51.531450 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:56:51.531466 | orchestrator | Friday 24 April 2026 05:56:17 +0000 (0:00:01.462) 0:53:58.861 ********** 2026-04-24 05:56:51.531482 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:56:51.531498 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:56:51.531514 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:56:51.531531 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.531547 | orchestrator | 2026-04-24 05:56:51.531564 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:56:51.531577 | orchestrator | Friday 24 April 2026 05:56:18 +0000 (0:00:01.435) 0:54:00.297 ********** 2026-04-24 05:56:51.531594 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 05:56:51.531610 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 05:56:51.531626 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 05:56:51.531666 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.531702 | orchestrator | 2026-04-24 05:56:51.531717 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:56:51.531732 | orchestrator | Friday 24 April 2026 05:56:20 +0000 (0:00:01.540) 0:54:01.837 ********** 2026-04-24 05:56:51.531746 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.531762 | orchestrator | 2026-04-24 05:56:51.531778 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:56:51.531794 | orchestrator | Friday 24 April 2026 05:56:21 +0000 (0:00:01.266) 0:54:03.104 ********** 2026-04-24 05:56:51.531811 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 05:56:51.531827 | orchestrator | 2026-04-24 05:56:51.531843 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 05:56:51.531859 | orchestrator | Friday 24 April 2026 05:56:23 +0000 (0:00:02.147) 0:54:05.252 ********** 2026-04-24 05:56:51.531875 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.531918 | orchestrator | 2026-04-24 05:56:51.531935 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-24 05:56:51.531951 | orchestrator | Friday 24 April 2026 05:56:25 +0000 (0:00:01.820) 0:54:07.072 ********** 2026-04-24 05:56:51.531968 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.531984 | orchestrator | 2026-04-24 05:56:51.531999 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-24 05:56:51.532015 | orchestrator | Friday 24 April 2026 05:56:26 +0000 (0:00:01.123) 0:54:08.196 ********** 2026-04-24 05:56:51.532028 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-3 2026-04-24 05:56:51.532038 | orchestrator | 2026-04-24 05:56:51.532047 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-24 05:56:51.532057 | orchestrator | Friday 24 April 2026 05:56:27 +0000 (0:00:01.468) 0:54:09.664 ********** 2026-04-24 05:56:51.532066 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-24 05:56:51.532076 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds/ceph-testbed-node-3) 2026-04-24 05:56:51.532085 | orchestrator | 2026-04-24 05:56:51.532095 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-24 05:56:51.532105 | orchestrator | Friday 24 April 2026 05:56:29 +0000 (0:00:01.868) 0:54:11.533 ********** 2026-04-24 05:56:51.532114 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 05:56:51.532124 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 05:56:51.532133 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 05:56:51.532143 | orchestrator | 2026-04-24 05:56:51.532153 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-24 05:56:51.532162 | orchestrator | Friday 24 April 2026 05:56:33 +0000 (0:00:03.356) 0:54:14.889 ********** 2026-04-24 05:56:51.532172 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-24 05:56:51.532181 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 05:56:51.532191 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.532200 | orchestrator | 2026-04-24 05:56:51.532210 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-24 05:56:51.532219 | orchestrator | Friday 24 April 2026 05:56:35 +0000 (0:00:02.006) 0:54:16.895 ********** 2026-04-24 05:56:51.532237 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.532247 | orchestrator | 2026-04-24 05:56:51.532257 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-24 05:56:51.532267 | orchestrator | Friday 24 April 2026 05:56:36 +0000 (0:00:01.616) 0:54:18.512 ********** 2026-04-24 05:56:51.532276 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:56:51.532286 | orchestrator | 2026-04-24 05:56:51.532295 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-24 05:56:51.532305 | orchestrator | Friday 24 April 2026 05:56:37 +0000 (0:00:01.136) 0:54:19.649 ********** 2026-04-24 05:56:51.532314 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-3 2026-04-24 05:56:51.532334 | orchestrator | 2026-04-24 05:56:51.532344 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-24 05:56:51.532353 | orchestrator | Friday 24 April 2026 05:56:39 +0000 (0:00:01.503) 0:54:21.152 ********** 2026-04-24 05:56:51.532363 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-3 2026-04-24 05:56:51.532372 | orchestrator | 2026-04-24 05:56:51.532382 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-24 05:56:51.532391 | orchestrator | Friday 24 April 2026 05:56:41 +0000 (0:00:01.768) 0:54:22.921 ********** 2026-04-24 05:56:51.532400 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.532410 | orchestrator | 2026-04-24 05:56:51.532420 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-24 05:56:51.532430 | orchestrator | Friday 24 April 2026 05:56:43 +0000 (0:00:02.040) 0:54:24.962 ********** 2026-04-24 05:56:51.532439 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.532449 | orchestrator | 2026-04-24 05:56:51.532458 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-24 05:56:51.532468 | orchestrator | Friday 24 April 2026 05:56:45 +0000 (0:00:01.910) 0:54:26.872 ********** 2026-04-24 05:56:51.532477 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.532487 | orchestrator | 2026-04-24 05:56:51.532496 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-24 05:56:51.532506 | orchestrator | Friday 24 April 2026 05:56:47 +0000 (0:00:02.353) 0:54:29.226 ********** 2026-04-24 05:56:51.532515 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.532525 | orchestrator | 2026-04-24 05:56:51.532534 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-24 05:56:51.532544 | orchestrator | Friday 24 April 2026 05:56:49 +0000 (0:00:02.280) 0:54:31.506 ********** 2026-04-24 05:56:51.532553 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:56:51.532563 | orchestrator | 2026-04-24 05:56:51.532573 | orchestrator | TASK [Restart ceph mds] ******************************************************** 2026-04-24 05:56:51.532582 | orchestrator | Friday 24 April 2026 05:56:51 +0000 (0:00:01.676) 0:54:33.183 ********** 2026-04-24 05:56:51.532602 | orchestrator | skipping: [testbed-node-3] 2026-04-24 05:57:25.504601 | orchestrator | 2026-04-24 05:57:25.504694 | orchestrator | TASK [Restart active mds] ****************************************************** 2026-04-24 05:57:25.504706 | orchestrator | Friday 24 April 2026 05:56:52 +0000 (0:00:01.139) 0:54:34.322 ********** 2026-04-24 05:57:25.504715 | orchestrator | ok: [testbed-node-3] 2026-04-24 05:57:25.504723 | orchestrator | 2026-04-24 05:57:25.504731 | orchestrator | PLAY [Upgrade standbys ceph mdss cluster] ************************************** 2026-04-24 05:57:25.504738 | orchestrator | 2026-04-24 05:57:25.504745 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 05:57:25.504753 | orchestrator | Friday 24 April 2026 05:57:01 +0000 (0:00:09.079) 0:54:43.402 ********** 2026-04-24 05:57:25.504760 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4, testbed-node-5 2026-04-24 05:57:25.504768 | orchestrator | 2026-04-24 05:57:25.504776 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 05:57:25.504783 | orchestrator | Friday 24 April 2026 05:57:03 +0000 (0:00:01.527) 0:54:44.930 ********** 2026-04-24 05:57:25.504790 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:25.504797 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:25.504804 | orchestrator | 2026-04-24 05:57:25.504812 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 05:57:25.504819 | orchestrator | Friday 24 April 2026 05:57:04 +0000 (0:00:01.600) 0:54:46.530 ********** 2026-04-24 05:57:25.504826 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:25.504833 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:25.504840 | orchestrator | 2026-04-24 05:57:25.504888 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 05:57:25.504897 | orchestrator | Friday 24 April 2026 05:57:06 +0000 (0:00:01.313) 0:54:47.844 ********** 2026-04-24 05:57:25.504925 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:25.504933 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:25.504940 | orchestrator | 2026-04-24 05:57:25.504948 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 05:57:25.504955 | orchestrator | Friday 24 April 2026 05:57:07 +0000 (0:00:01.639) 0:54:49.484 ********** 2026-04-24 05:57:25.504962 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:25.504969 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:25.504976 | orchestrator | 2026-04-24 05:57:25.504983 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 05:57:25.504990 | orchestrator | Friday 24 April 2026 05:57:09 +0000 (0:00:01.236) 0:54:50.721 ********** 2026-04-24 05:57:25.504997 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:25.505005 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:25.505012 | orchestrator | 2026-04-24 05:57:25.505019 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 05:57:25.505026 | orchestrator | Friday 24 April 2026 05:57:10 +0000 (0:00:01.236) 0:54:51.958 ********** 2026-04-24 05:57:25.505033 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:25.505041 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:25.505048 | orchestrator | 2026-04-24 05:57:25.505055 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 05:57:25.505062 | orchestrator | Friday 24 April 2026 05:57:11 +0000 (0:00:01.327) 0:54:53.285 ********** 2026-04-24 05:57:25.505069 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:25.505077 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:57:25.505084 | orchestrator | 2026-04-24 05:57:25.505103 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 05:57:25.505110 | orchestrator | Friday 24 April 2026 05:57:12 +0000 (0:00:01.258) 0:54:54.543 ********** 2026-04-24 05:57:25.505117 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:25.505124 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:25.505132 | orchestrator | 2026-04-24 05:57:25.505139 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 05:57:25.505146 | orchestrator | Friday 24 April 2026 05:57:14 +0000 (0:00:01.317) 0:54:55.861 ********** 2026-04-24 05:57:25.505153 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:57:25.505162 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:57:25.505170 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:57:25.505179 | orchestrator | 2026-04-24 05:57:25.505187 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 05:57:25.505196 | orchestrator | Friday 24 April 2026 05:57:15 +0000 (0:00:01.683) 0:54:57.545 ********** 2026-04-24 05:57:25.505203 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:25.505212 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:25.505220 | orchestrator | 2026-04-24 05:57:25.505229 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 05:57:25.505237 | orchestrator | Friday 24 April 2026 05:57:17 +0000 (0:00:01.423) 0:54:58.969 ********** 2026-04-24 05:57:25.505246 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:57:25.505254 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:57:25.505262 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:57:25.505270 | orchestrator | 2026-04-24 05:57:25.505279 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 05:57:25.505287 | orchestrator | Friday 24 April 2026 05:57:20 +0000 (0:00:03.282) 0:55:02.252 ********** 2026-04-24 05:57:25.505295 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 05:57:25.505304 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 05:57:25.505312 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 05:57:25.505326 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:25.505334 | orchestrator | 2026-04-24 05:57:25.505342 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 05:57:25.505351 | orchestrator | Friday 24 April 2026 05:57:22 +0000 (0:00:01.552) 0:55:03.804 ********** 2026-04-24 05:57:25.505376 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 05:57:25.505388 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 05:57:25.505396 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 05:57:25.505405 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:25.505414 | orchestrator | 2026-04-24 05:57:25.505422 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 05:57:25.505431 | orchestrator | Friday 24 April 2026 05:57:24 +0000 (0:00:02.114) 0:55:05.918 ********** 2026-04-24 05:57:25.505441 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:25.505453 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:25.505461 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:25.505470 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:25.505479 | orchestrator | 2026-04-24 05:57:25.505491 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 05:57:25.505500 | orchestrator | Friday 24 April 2026 05:57:25 +0000 (0:00:01.177) 0:55:07.096 ********** 2026-04-24 05:57:25.505511 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 05:57:17.841698', 'end': '2026-04-24 05:57:17.897438', 'delta': '0:00:00.055740', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 05:57:25.505522 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 05:57:18.428070', 'end': '2026-04-24 05:57:18.471410', 'delta': '0:00:00.043340', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 05:57:25.505541 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 05:57:19.330972', 'end': '2026-04-24 05:57:19.373667', 'delta': '0:00:00.042695', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 05:57:46.361135 | orchestrator | 2026-04-24 05:57:46.361252 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 05:57:46.361270 | orchestrator | Friday 24 April 2026 05:57:26 +0000 (0:00:01.249) 0:55:08.346 ********** 2026-04-24 05:57:46.361282 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:46.361295 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:46.361306 | orchestrator | 2026-04-24 05:57:46.361317 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 05:57:46.361328 | orchestrator | Friday 24 April 2026 05:57:28 +0000 (0:00:01.818) 0:55:10.164 ********** 2026-04-24 05:57:46.361339 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:46.361351 | orchestrator | 2026-04-24 05:57:46.361362 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 05:57:46.361373 | orchestrator | Friday 24 April 2026 05:57:29 +0000 (0:00:01.280) 0:55:11.445 ********** 2026-04-24 05:57:46.361384 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:46.361395 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:46.361405 | orchestrator | 2026-04-24 05:57:46.361416 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 05:57:46.361427 | orchestrator | Friday 24 April 2026 05:57:31 +0000 (0:00:01.270) 0:55:12.715 ********** 2026-04-24 05:57:46.361438 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:57:46.361450 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 05:57:46.361460 | orchestrator | 2026-04-24 05:57:46.361472 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:57:46.361491 | orchestrator | Friday 24 April 2026 05:57:33 +0000 (0:00:02.304) 0:55:15.020 ********** 2026-04-24 05:57:46.361510 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:46.361528 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:46.361546 | orchestrator | 2026-04-24 05:57:46.361564 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 05:57:46.361582 | orchestrator | Friday 24 April 2026 05:57:34 +0000 (0:00:01.288) 0:55:16.309 ********** 2026-04-24 05:57:46.361600 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:46.361620 | orchestrator | 2026-04-24 05:57:46.361640 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 05:57:46.361659 | orchestrator | Friday 24 April 2026 05:57:35 +0000 (0:00:01.141) 0:55:17.450 ********** 2026-04-24 05:57:46.361679 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:46.361695 | orchestrator | 2026-04-24 05:57:46.361708 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 05:57:46.361737 | orchestrator | Friday 24 April 2026 05:57:37 +0000 (0:00:01.278) 0:55:18.729 ********** 2026-04-24 05:57:46.361776 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:46.361789 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:57:46.361801 | orchestrator | 2026-04-24 05:57:46.361814 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 05:57:46.361852 | orchestrator | Friday 24 April 2026 05:57:38 +0000 (0:00:01.267) 0:55:19.997 ********** 2026-04-24 05:57:46.361864 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:46.361877 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:57:46.361890 | orchestrator | 2026-04-24 05:57:46.361903 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 05:57:46.361915 | orchestrator | Friday 24 April 2026 05:57:39 +0000 (0:00:01.574) 0:55:21.572 ********** 2026-04-24 05:57:46.361927 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:46.361940 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:46.361953 | orchestrator | 2026-04-24 05:57:46.361965 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 05:57:46.361977 | orchestrator | Friday 24 April 2026 05:57:41 +0000 (0:00:01.326) 0:55:22.898 ********** 2026-04-24 05:57:46.361990 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:46.362002 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:57:46.362014 | orchestrator | 2026-04-24 05:57:46.362077 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 05:57:46.362089 | orchestrator | Friday 24 April 2026 05:57:42 +0000 (0:00:01.239) 0:55:24.138 ********** 2026-04-24 05:57:46.362101 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:46.362120 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:46.362150 | orchestrator | 2026-04-24 05:57:46.362179 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 05:57:46.362198 | orchestrator | Friday 24 April 2026 05:57:43 +0000 (0:00:01.276) 0:55:25.415 ********** 2026-04-24 05:57:46.362217 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:46.362236 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:57:46.362255 | orchestrator | 2026-04-24 05:57:46.362273 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 05:57:46.362294 | orchestrator | Friday 24 April 2026 05:57:44 +0000 (0:00:01.205) 0:55:26.620 ********** 2026-04-24 05:57:46.362313 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:57:46.362331 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:57:46.362343 | orchestrator | 2026-04-24 05:57:46.362354 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 05:57:46.362364 | orchestrator | Friday 24 April 2026 05:57:46 +0000 (0:00:01.242) 0:55:27.863 ********** 2026-04-24 05:57:46.362394 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.362443 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'uuids': ['69ee4aae-da3e-49ce-8e1d-04f23a1ac1f1'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13']}})  2026-04-24 05:57:46.362460 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '36b4f46e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:57:46.362493 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1']}})  2026-04-24 05:57:46.362506 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.362518 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.362531 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:57:46.362543 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.362562 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.414411 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'uuids': ['6d348d92-84de-4a0c-bfda-a8ce4c95c396'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve']}})  2026-04-24 05:57:46.414565 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF', 'dm-uuid-CRYPT-LUKS2-57e78844afcf406497404f4a368c2f85-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:57:46.414613 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '076ca587', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:57:46.414637 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.414660 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71']}})  2026-04-24 05:57:46.414681 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'uuids': ['57e78844-afcf-4064-9740-4f4a368c2f85'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF']}})  2026-04-24 05:57:46.414713 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.414752 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3']}})  2026-04-24 05:57:46.414765 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.414791 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.414810 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-04-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 05:57:46.414875 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8aa3c015', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:57:46.512123 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512195 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512214 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512221 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7', 'dm-uuid-CRYPT-LUKS2-99c37d5f37cf4f86bc5baee17726ca8d-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512229 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13', 'dm-uuid-CRYPT-LUKS2-69ee4aaeda3e49ce8e1d04f23a1ac1f1-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512236 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512242 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:46.512249 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'uuids': ['99c37d5f-37cf-4f86-bc5b-aee17726ca8d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7']}})  2026-04-24 05:57:46.512284 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f']}})  2026-04-24 05:57:46.512291 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512302 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '457a59b4', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 05:57:46.512309 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512318 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 05:57:46.512328 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve', 'dm-uuid-CRYPT-LUKS2-6d348d9284de4a0cbfdaa8ce4c95c396-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 05:57:47.920568 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:57:47.920668 | orchestrator | 2026-04-24 05:57:47.920683 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 05:57:47.920724 | orchestrator | Friday 24 April 2026 05:57:47 +0000 (0:00:01.548) 0:55:29.412 ********** 2026-04-24 05:57:47.920740 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.920774 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'uuids': ['69ee4aae-da3e-49ce-8e1d-04f23a1ac1f1'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.920788 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '36b4f46e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.920801 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.920941 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.920966 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.920996 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.921018 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.921039 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF', 'dm-uuid-CRYPT-LUKS2-57e78844afcf406497404f4a368c2f85-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.921071 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.921092 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.921125 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'uuids': ['57e78844-afcf-4064-9740-4f4a368c2f85'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.979700 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'uuids': ['6d348d92-84de-4a0c-bfda-a8ce4c95c396'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.979816 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.979956 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.979978 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '076ca587', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.980037 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8aa3c015', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.980060 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.980090 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.980110 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:47.980146 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089166 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089264 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13', 'dm-uuid-CRYPT-LUKS2-69ee4aaeda3e49ce8e1d04f23a1ac1f1-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089304 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-04-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089317 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:57:48.089332 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089344 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7', 'dm-uuid-CRYPT-LUKS2-99c37d5f37cf4f86bc5baee17726ca8d-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089386 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089400 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'uuids': ['99c37d5f-37cf-4f86-bc5b-aee17726ca8d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089421 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f']}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089435 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:57:48.089463 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '457a59b4', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:58:15.891297 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:58:15.891454 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:58:15.891479 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve', 'dm-uuid-CRYPT-LUKS2-6d348d9284de4a0cbfdaa8ce4c95c396-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 05:58:15.891494 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:58:15.891510 | orchestrator | 2026-04-24 05:58:15.891526 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 05:58:15.891542 | orchestrator | Friday 24 April 2026 05:57:49 +0000 (0:00:01.581) 0:55:30.994 ********** 2026-04-24 05:58:15.891556 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:58:15.891570 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:58:15.891583 | orchestrator | 2026-04-24 05:58:15.891597 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 05:58:15.891610 | orchestrator | Friday 24 April 2026 05:57:50 +0000 (0:00:01.628) 0:55:32.623 ********** 2026-04-24 05:58:15.891623 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:58:15.891636 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:58:15.891649 | orchestrator | 2026-04-24 05:58:15.891658 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:58:15.891666 | orchestrator | Friday 24 April 2026 05:57:52 +0000 (0:00:01.270) 0:55:33.893 ********** 2026-04-24 05:58:15.891674 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:58:15.891682 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:58:15.891690 | orchestrator | 2026-04-24 05:58:15.891697 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:58:15.891705 | orchestrator | Friday 24 April 2026 05:57:53 +0000 (0:00:01.614) 0:55:35.508 ********** 2026-04-24 05:58:15.891713 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.891721 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:58:15.891729 | orchestrator | 2026-04-24 05:58:15.891737 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 05:58:15.891745 | orchestrator | Friday 24 April 2026 05:57:55 +0000 (0:00:01.307) 0:55:36.816 ********** 2026-04-24 05:58:15.891752 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.891760 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:58:15.891768 | orchestrator | 2026-04-24 05:58:15.891821 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 05:58:15.891834 | orchestrator | Friday 24 April 2026 05:57:56 +0000 (0:00:01.365) 0:55:38.181 ********** 2026-04-24 05:58:15.891852 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.891861 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:58:15.891870 | orchestrator | 2026-04-24 05:58:15.891879 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 05:58:15.891888 | orchestrator | Friday 24 April 2026 05:57:58 +0000 (0:00:01.595) 0:55:39.777 ********** 2026-04-24 05:58:15.891898 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-24 05:58:15.891907 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-24 05:58:15.891916 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-24 05:58:15.891925 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-24 05:58:15.891934 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-24 05:58:15.891944 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-24 05:58:15.891952 | orchestrator | 2026-04-24 05:58:15.891960 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 05:58:15.891968 | orchestrator | Friday 24 April 2026 05:58:00 +0000 (0:00:01.951) 0:55:41.729 ********** 2026-04-24 05:58:15.891991 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 05:58:15.892000 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 05:58:15.892008 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 05:58:15.892015 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.892023 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 05:58:15.892031 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 05:58:15.892039 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 05:58:15.892046 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:58:15.892054 | orchestrator | 2026-04-24 05:58:15.892062 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 05:58:15.892070 | orchestrator | Friday 24 April 2026 05:58:01 +0000 (0:00:01.321) 0:55:43.050 ********** 2026-04-24 05:58:15.892078 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4, testbed-node-5 2026-04-24 05:58:15.892087 | orchestrator | 2026-04-24 05:58:15.892095 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 05:58:15.892104 | orchestrator | Friday 24 April 2026 05:58:02 +0000 (0:00:01.230) 0:55:44.281 ********** 2026-04-24 05:58:15.892112 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.892120 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:58:15.892127 | orchestrator | 2026-04-24 05:58:15.892135 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 05:58:15.892142 | orchestrator | Friday 24 April 2026 05:58:03 +0000 (0:00:01.220) 0:55:45.501 ********** 2026-04-24 05:58:15.892150 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.892158 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:58:15.892165 | orchestrator | 2026-04-24 05:58:15.892173 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 05:58:15.892181 | orchestrator | Friday 24 April 2026 05:58:05 +0000 (0:00:01.316) 0:55:46.817 ********** 2026-04-24 05:58:15.892188 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.892196 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:58:15.892204 | orchestrator | 2026-04-24 05:58:15.892211 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 05:58:15.892219 | orchestrator | Friday 24 April 2026 05:58:06 +0000 (0:00:01.221) 0:55:48.039 ********** 2026-04-24 05:58:15.892227 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:58:15.892235 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:58:15.892242 | orchestrator | 2026-04-24 05:58:15.892250 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 05:58:15.892258 | orchestrator | Friday 24 April 2026 05:58:07 +0000 (0:00:01.380) 0:55:49.419 ********** 2026-04-24 05:58:15.892271 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:58:15.892279 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:58:15.892286 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:58:15.892294 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.892302 | orchestrator | 2026-04-24 05:58:15.892311 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 05:58:15.892325 | orchestrator | Friday 24 April 2026 05:58:09 +0000 (0:00:01.392) 0:55:50.812 ********** 2026-04-24 05:58:15.892337 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:58:15.892350 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:58:15.892363 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:58:15.892376 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.892388 | orchestrator | 2026-04-24 05:58:15.892401 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 05:58:15.892414 | orchestrator | Friday 24 April 2026 05:58:10 +0000 (0:00:01.471) 0:55:52.283 ********** 2026-04-24 05:58:15.892427 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 05:58:15.892442 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 05:58:15.892454 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 05:58:15.892468 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:58:15.892476 | orchestrator | 2026-04-24 05:58:15.892484 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 05:58:15.892492 | orchestrator | Friday 24 April 2026 05:58:12 +0000 (0:00:01.454) 0:55:53.737 ********** 2026-04-24 05:58:15.892500 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:58:15.892508 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:58:15.892515 | orchestrator | 2026-04-24 05:58:15.892529 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 05:58:15.892537 | orchestrator | Friday 24 April 2026 05:58:13 +0000 (0:00:01.317) 0:55:55.055 ********** 2026-04-24 05:58:15.892544 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 05:58:15.892552 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 05:58:15.892559 | orchestrator | 2026-04-24 05:58:15.892567 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 05:58:15.892575 | orchestrator | Friday 24 April 2026 05:58:14 +0000 (0:00:01.450) 0:55:56.506 ********** 2026-04-24 05:58:15.892583 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:58:15.892590 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:58:15.892598 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:58:15.892606 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:58:15.892613 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-24 05:58:15.892621 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:58:15.892636 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:59:00.936357 | orchestrator | 2026-04-24 05:59:00.936472 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 05:59:00.936490 | orchestrator | Friday 24 April 2026 05:58:16 +0000 (0:00:02.145) 0:55:58.652 ********** 2026-04-24 05:59:00.936502 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 05:59:00.936513 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 05:59:00.936524 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 05:59:00.936535 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 05:59:00.936573 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-24 05:59:00.936586 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 05:59:00.936596 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 05:59:00.936607 | orchestrator | 2026-04-24 05:59:00.936618 | orchestrator | TASK [Prevent restarts from the packaging] ************************************* 2026-04-24 05:59:00.936629 | orchestrator | Friday 24 April 2026 05:58:20 +0000 (0:00:03.073) 0:56:01.726 ********** 2026-04-24 05:59:00.936640 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.936652 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.936663 | orchestrator | 2026-04-24 05:59:00.936674 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 05:59:00.936685 | orchestrator | Friday 24 April 2026 05:58:21 +0000 (0:00:01.260) 0:56:02.987 ********** 2026-04-24 05:59:00.936696 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4, testbed-node-5 2026-04-24 05:59:00.936708 | orchestrator | 2026-04-24 05:59:00.936718 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 05:59:00.936729 | orchestrator | Friday 24 April 2026 05:58:22 +0000 (0:00:01.301) 0:56:04.288 ********** 2026-04-24 05:59:00.936739 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4, testbed-node-5 2026-04-24 05:59:00.936750 | orchestrator | 2026-04-24 05:59:00.936820 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 05:59:00.936831 | orchestrator | Friday 24 April 2026 05:58:23 +0000 (0:00:01.289) 0:56:05.578 ********** 2026-04-24 05:59:00.936842 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.936853 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.936863 | orchestrator | 2026-04-24 05:59:00.936874 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 05:59:00.936885 | orchestrator | Friday 24 April 2026 05:58:25 +0000 (0:00:01.346) 0:56:06.924 ********** 2026-04-24 05:59:00.936898 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.936911 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.936924 | orchestrator | 2026-04-24 05:59:00.936936 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 05:59:00.936949 | orchestrator | Friday 24 April 2026 05:58:26 +0000 (0:00:01.663) 0:56:08.588 ********** 2026-04-24 05:59:00.936962 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.936974 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.936986 | orchestrator | 2026-04-24 05:59:00.936999 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 05:59:00.937012 | orchestrator | Friday 24 April 2026 05:58:28 +0000 (0:00:01.583) 0:56:10.172 ********** 2026-04-24 05:59:00.937024 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.937037 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.937049 | orchestrator | 2026-04-24 05:59:00.937062 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 05:59:00.937075 | orchestrator | Friday 24 April 2026 05:58:30 +0000 (0:00:01.688) 0:56:11.860 ********** 2026-04-24 05:59:00.937088 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937100 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937113 | orchestrator | 2026-04-24 05:59:00.937125 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 05:59:00.937138 | orchestrator | Friday 24 April 2026 05:58:31 +0000 (0:00:01.250) 0:56:13.111 ********** 2026-04-24 05:59:00.937151 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937163 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937176 | orchestrator | 2026-04-24 05:59:00.937189 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 05:59:00.937201 | orchestrator | Friday 24 April 2026 05:58:32 +0000 (0:00:01.260) 0:56:14.371 ********** 2026-04-24 05:59:00.937228 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937249 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937261 | orchestrator | 2026-04-24 05:59:00.937272 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 05:59:00.937282 | orchestrator | Friday 24 April 2026 05:58:33 +0000 (0:00:01.265) 0:56:15.637 ********** 2026-04-24 05:59:00.937293 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.937304 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.937314 | orchestrator | 2026-04-24 05:59:00.937325 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 05:59:00.937335 | orchestrator | Friday 24 April 2026 05:58:35 +0000 (0:00:02.022) 0:56:17.659 ********** 2026-04-24 05:59:00.937346 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.937357 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.937368 | orchestrator | 2026-04-24 05:59:00.937379 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 05:59:00.937389 | orchestrator | Friday 24 April 2026 05:58:37 +0000 (0:00:01.674) 0:56:19.334 ********** 2026-04-24 05:59:00.937400 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937411 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937421 | orchestrator | 2026-04-24 05:59:00.937432 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 05:59:00.937443 | orchestrator | Friday 24 April 2026 05:58:38 +0000 (0:00:01.258) 0:56:20.592 ********** 2026-04-24 05:59:00.937453 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937481 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937492 | orchestrator | 2026-04-24 05:59:00.937503 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 05:59:00.937514 | orchestrator | Friday 24 April 2026 05:58:40 +0000 (0:00:01.210) 0:56:21.803 ********** 2026-04-24 05:59:00.937524 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.937535 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.937546 | orchestrator | 2026-04-24 05:59:00.937556 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 05:59:00.937567 | orchestrator | Friday 24 April 2026 05:58:41 +0000 (0:00:01.240) 0:56:23.044 ********** 2026-04-24 05:59:00.937578 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.937588 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.937599 | orchestrator | 2026-04-24 05:59:00.937610 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 05:59:00.937620 | orchestrator | Friday 24 April 2026 05:58:42 +0000 (0:00:01.356) 0:56:24.400 ********** 2026-04-24 05:59:00.937631 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.937642 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.937652 | orchestrator | 2026-04-24 05:59:00.937663 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 05:59:00.937673 | orchestrator | Friday 24 April 2026 05:58:43 +0000 (0:00:01.271) 0:56:25.672 ********** 2026-04-24 05:59:00.937684 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937695 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937705 | orchestrator | 2026-04-24 05:59:00.937716 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 05:59:00.937727 | orchestrator | Friday 24 April 2026 05:58:45 +0000 (0:00:01.258) 0:56:26.930 ********** 2026-04-24 05:59:00.937737 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937748 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937778 | orchestrator | 2026-04-24 05:59:00.937789 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 05:59:00.937800 | orchestrator | Friday 24 April 2026 05:58:46 +0000 (0:00:01.240) 0:56:28.171 ********** 2026-04-24 05:59:00.937810 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937821 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937832 | orchestrator | 2026-04-24 05:59:00.937842 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 05:59:00.937853 | orchestrator | Friday 24 April 2026 05:58:47 +0000 (0:00:01.290) 0:56:29.462 ********** 2026-04-24 05:59:00.937871 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.937882 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.937892 | orchestrator | 2026-04-24 05:59:00.937903 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 05:59:00.937914 | orchestrator | Friday 24 April 2026 05:58:49 +0000 (0:00:01.298) 0:56:30.760 ********** 2026-04-24 05:59:00.937924 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:00.937935 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:00.937945 | orchestrator | 2026-04-24 05:59:00.937956 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 05:59:00.937967 | orchestrator | Friday 24 April 2026 05:58:50 +0000 (0:00:01.232) 0:56:31.993 ********** 2026-04-24 05:59:00.937977 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.937988 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.937998 | orchestrator | 2026-04-24 05:59:00.938009 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 05:59:00.938072 | orchestrator | Friday 24 April 2026 05:58:51 +0000 (0:00:01.327) 0:56:33.320 ********** 2026-04-24 05:59:00.938087 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.938097 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.938108 | orchestrator | 2026-04-24 05:59:00.938119 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 05:59:00.938130 | orchestrator | Friday 24 April 2026 05:58:52 +0000 (0:00:01.235) 0:56:34.556 ********** 2026-04-24 05:59:00.938140 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.938151 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.938162 | orchestrator | 2026-04-24 05:59:00.938172 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 05:59:00.938183 | orchestrator | Friday 24 April 2026 05:58:54 +0000 (0:00:01.288) 0:56:35.844 ********** 2026-04-24 05:59:00.938193 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.938204 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.938215 | orchestrator | 2026-04-24 05:59:00.938226 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 05:59:00.938236 | orchestrator | Friday 24 April 2026 05:58:55 +0000 (0:00:01.291) 0:56:37.135 ********** 2026-04-24 05:59:00.938247 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.938257 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.938268 | orchestrator | 2026-04-24 05:59:00.938285 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 05:59:00.938296 | orchestrator | Friday 24 April 2026 05:58:56 +0000 (0:00:01.227) 0:56:38.362 ********** 2026-04-24 05:59:00.938306 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.938317 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.938328 | orchestrator | 2026-04-24 05:59:00.938338 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 05:59:00.938349 | orchestrator | Friday 24 April 2026 05:58:57 +0000 (0:00:01.258) 0:56:39.620 ********** 2026-04-24 05:59:00.938360 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.938370 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.938381 | orchestrator | 2026-04-24 05:59:00.938392 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 05:59:00.938403 | orchestrator | Friday 24 April 2026 05:58:59 +0000 (0:00:01.253) 0:56:40.874 ********** 2026-04-24 05:59:00.938413 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.938424 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.938434 | orchestrator | 2026-04-24 05:59:00.938445 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 05:59:00.938456 | orchestrator | Friday 24 April 2026 05:59:00 +0000 (0:00:01.540) 0:56:42.414 ********** 2026-04-24 05:59:00.938467 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:00.938477 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:00.938488 | orchestrator | 2026-04-24 05:59:00.938506 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 05:59:45.556596 | orchestrator | Friday 24 April 2026 05:59:01 +0000 (0:00:01.207) 0:56:43.622 ********** 2026-04-24 05:59:45.556766 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.556787 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.556799 | orchestrator | 2026-04-24 05:59:45.556810 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 05:59:45.556822 | orchestrator | Friday 24 April 2026 05:59:03 +0000 (0:00:01.242) 0:56:44.865 ********** 2026-04-24 05:59:45.556833 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.556844 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.556855 | orchestrator | 2026-04-24 05:59:45.556866 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 05:59:45.556877 | orchestrator | Friday 24 April 2026 05:59:04 +0000 (0:00:01.205) 0:56:46.071 ********** 2026-04-24 05:59:45.556888 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.556899 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.556910 | orchestrator | 2026-04-24 05:59:45.556921 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 05:59:45.556932 | orchestrator | Friday 24 April 2026 05:59:05 +0000 (0:00:01.307) 0:56:47.378 ********** 2026-04-24 05:59:45.556943 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:45.556955 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:45.556966 | orchestrator | 2026-04-24 05:59:45.556978 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 05:59:45.556989 | orchestrator | Friday 24 April 2026 05:59:07 +0000 (0:00:02.047) 0:56:49.426 ********** 2026-04-24 05:59:45.557000 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:45.557011 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:45.557022 | orchestrator | 2026-04-24 05:59:45.557033 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 05:59:45.557044 | orchestrator | Friday 24 April 2026 05:59:09 +0000 (0:00:02.250) 0:56:51.676 ********** 2026-04-24 05:59:45.557056 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4, testbed-node-5 2026-04-24 05:59:45.557067 | orchestrator | 2026-04-24 05:59:45.557078 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 05:59:45.557089 | orchestrator | Friday 24 April 2026 05:59:11 +0000 (0:00:01.301) 0:56:52.978 ********** 2026-04-24 05:59:45.557100 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557111 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.557122 | orchestrator | 2026-04-24 05:59:45.557135 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 05:59:45.557148 | orchestrator | Friday 24 April 2026 05:59:12 +0000 (0:00:01.274) 0:56:54.253 ********** 2026-04-24 05:59:45.557160 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557173 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.557185 | orchestrator | 2026-04-24 05:59:45.557198 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 05:59:45.557210 | orchestrator | Friday 24 April 2026 05:59:13 +0000 (0:00:01.235) 0:56:55.488 ********** 2026-04-24 05:59:45.557223 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:59:45.557235 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 05:59:45.557247 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:59:45.557260 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 05:59:45.557272 | orchestrator | 2026-04-24 05:59:45.557285 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 05:59:45.557297 | orchestrator | Friday 24 April 2026 05:59:15 +0000 (0:00:01.966) 0:56:57.454 ********** 2026-04-24 05:59:45.557309 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:45.557322 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:45.557334 | orchestrator | 2026-04-24 05:59:45.557347 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 05:59:45.557383 | orchestrator | Friday 24 April 2026 05:59:17 +0000 (0:00:01.597) 0:56:59.051 ********** 2026-04-24 05:59:45.557397 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557411 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.557421 | orchestrator | 2026-04-24 05:59:45.557432 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 05:59:45.557443 | orchestrator | Friday 24 April 2026 05:59:18 +0000 (0:00:01.259) 0:57:00.311 ********** 2026-04-24 05:59:45.557454 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557465 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.557476 | orchestrator | 2026-04-24 05:59:45.557500 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 05:59:45.557512 | orchestrator | Friday 24 April 2026 05:59:19 +0000 (0:00:01.220) 0:57:01.531 ********** 2026-04-24 05:59:45.557523 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557534 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.557544 | orchestrator | 2026-04-24 05:59:45.557555 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 05:59:45.557566 | orchestrator | Friday 24 April 2026 05:59:21 +0000 (0:00:01.254) 0:57:02.786 ********** 2026-04-24 05:59:45.557577 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4, testbed-node-5 2026-04-24 05:59:45.557588 | orchestrator | 2026-04-24 05:59:45.557599 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 05:59:45.557610 | orchestrator | Friday 24 April 2026 05:59:22 +0000 (0:00:01.229) 0:57:04.016 ********** 2026-04-24 05:59:45.557621 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:45.557632 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:45.557643 | orchestrator | 2026-04-24 05:59:45.557654 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 05:59:45.557665 | orchestrator | Friday 24 April 2026 05:59:24 +0000 (0:00:01.751) 0:57:05.767 ********** 2026-04-24 05:59:45.557676 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:59:45.557704 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:59:45.557749 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:59:45.557761 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557772 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 05:59:45.557783 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 05:59:45.557794 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 05:59:45.557804 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.557815 | orchestrator | 2026-04-24 05:59:45.557826 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 05:59:45.557837 | orchestrator | Friday 24 April 2026 05:59:25 +0000 (0:00:01.585) 0:57:07.353 ********** 2026-04-24 05:59:45.557848 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557858 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.557869 | orchestrator | 2026-04-24 05:59:45.557880 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 05:59:45.557891 | orchestrator | Friday 24 April 2026 05:59:26 +0000 (0:00:01.247) 0:57:08.600 ********** 2026-04-24 05:59:45.557902 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557913 | orchestrator | 2026-04-24 05:59:45.557924 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 05:59:45.557934 | orchestrator | Friday 24 April 2026 05:59:28 +0000 (0:00:01.189) 0:57:09.790 ********** 2026-04-24 05:59:45.557945 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.557956 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.557967 | orchestrator | 2026-04-24 05:59:45.557977 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 05:59:45.557997 | orchestrator | Friday 24 April 2026 05:59:29 +0000 (0:00:01.258) 0:57:11.048 ********** 2026-04-24 05:59:45.558008 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558081 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558094 | orchestrator | 2026-04-24 05:59:45.558105 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 05:59:45.558116 | orchestrator | Friday 24 April 2026 05:59:30 +0000 (0:00:01.284) 0:57:12.333 ********** 2026-04-24 05:59:45.558127 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558138 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558148 | orchestrator | 2026-04-24 05:59:45.558159 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 05:59:45.558170 | orchestrator | Friday 24 April 2026 05:59:31 +0000 (0:00:01.236) 0:57:13.569 ********** 2026-04-24 05:59:45.558181 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:45.558192 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:45.558203 | orchestrator | 2026-04-24 05:59:45.558214 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 05:59:45.558225 | orchestrator | Friday 24 April 2026 05:59:34 +0000 (0:00:02.510) 0:57:16.080 ********** 2026-04-24 05:59:45.558235 | orchestrator | ok: [testbed-node-4] 2026-04-24 05:59:45.558246 | orchestrator | ok: [testbed-node-5] 2026-04-24 05:59:45.558257 | orchestrator | 2026-04-24 05:59:45.558268 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 05:59:45.558279 | orchestrator | Friday 24 April 2026 05:59:35 +0000 (0:00:01.573) 0:57:17.653 ********** 2026-04-24 05:59:45.558290 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4, testbed-node-5 2026-04-24 05:59:45.558302 | orchestrator | 2026-04-24 05:59:45.558313 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 05:59:45.558323 | orchestrator | Friday 24 April 2026 05:59:37 +0000 (0:00:01.241) 0:57:18.895 ********** 2026-04-24 05:59:45.558334 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558345 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558356 | orchestrator | 2026-04-24 05:59:45.558367 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 05:59:45.558378 | orchestrator | Friday 24 April 2026 05:59:38 +0000 (0:00:01.244) 0:57:20.139 ********** 2026-04-24 05:59:45.558389 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558399 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558410 | orchestrator | 2026-04-24 05:59:45.558421 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 05:59:45.558432 | orchestrator | Friday 24 April 2026 05:59:40 +0000 (0:00:01.598) 0:57:21.737 ********** 2026-04-24 05:59:45.558443 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558454 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558464 | orchestrator | 2026-04-24 05:59:45.558481 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 05:59:45.558492 | orchestrator | Friday 24 April 2026 05:59:41 +0000 (0:00:01.282) 0:57:23.020 ********** 2026-04-24 05:59:45.558503 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558514 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558525 | orchestrator | 2026-04-24 05:59:45.558536 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 05:59:45.558547 | orchestrator | Friday 24 April 2026 05:59:42 +0000 (0:00:01.306) 0:57:24.326 ********** 2026-04-24 05:59:45.558558 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558569 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558580 | orchestrator | 2026-04-24 05:59:45.558591 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 05:59:45.558602 | orchestrator | Friday 24 April 2026 05:59:43 +0000 (0:00:01.320) 0:57:25.647 ********** 2026-04-24 05:59:45.558612 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558623 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558641 | orchestrator | 2026-04-24 05:59:45.558652 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 05:59:45.558663 | orchestrator | Friday 24 April 2026 05:59:45 +0000 (0:00:01.334) 0:57:26.982 ********** 2026-04-24 05:59:45.558674 | orchestrator | skipping: [testbed-node-4] 2026-04-24 05:59:45.558685 | orchestrator | skipping: [testbed-node-5] 2026-04-24 05:59:45.558696 | orchestrator | 2026-04-24 05:59:45.558733 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 06:00:24.731837 | orchestrator | Friday 24 April 2026 05:59:46 +0000 (0:00:01.236) 0:57:28.218 ********** 2026-04-24 06:00:24.731951 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.731969 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.731981 | orchestrator | 2026-04-24 06:00:24.731993 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 06:00:24.732005 | orchestrator | Friday 24 April 2026 05:59:47 +0000 (0:00:01.340) 0:57:29.559 ********** 2026-04-24 06:00:24.732016 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:00:24.732028 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:00:24.732038 | orchestrator | 2026-04-24 06:00:24.732050 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 06:00:24.732061 | orchestrator | Friday 24 April 2026 05:59:49 +0000 (0:00:01.245) 0:57:30.805 ********** 2026-04-24 06:00:24.732073 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4, testbed-node-5 2026-04-24 06:00:24.732084 | orchestrator | 2026-04-24 06:00:24.732095 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 06:00:24.732106 | orchestrator | Friday 24 April 2026 05:59:50 +0000 (0:00:01.447) 0:57:32.252 ********** 2026-04-24 06:00:24.732117 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-24 06:00:24.732128 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-24 06:00:24.732139 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-24 06:00:24.732150 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-24 06:00:24.732161 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-24 06:00:24.732171 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-24 06:00:24.732182 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-24 06:00:24.732193 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-24 06:00:24.732203 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-24 06:00:24.732214 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-24 06:00:24.732225 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-24 06:00:24.732236 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-24 06:00:24.732246 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-24 06:00:24.732258 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-24 06:00:24.732272 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-24 06:00:24.732292 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-24 06:00:24.732311 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 06:00:24.732328 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 06:00:24.732345 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 06:00:24.732364 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 06:00:24.732384 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 06:00:24.732405 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 06:00:24.732420 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 06:00:24.732433 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 06:00:24.732446 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 06:00:24.732488 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 06:00:24.732501 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 06:00:24.732514 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 06:00:24.732527 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-24 06:00:24.732539 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-24 06:00:24.732552 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-24 06:00:24.732566 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-24 06:00:24.732578 | orchestrator | 2026-04-24 06:00:24.732591 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 06:00:24.732604 | orchestrator | Friday 24 April 2026 05:59:57 +0000 (0:00:06.699) 0:57:38.952 ********** 2026-04-24 06:00:24.732631 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4, testbed-node-5 2026-04-24 06:00:24.732644 | orchestrator | 2026-04-24 06:00:24.732657 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 06:00:24.732670 | orchestrator | Friday 24 April 2026 05:59:58 +0000 (0:00:01.207) 0:57:40.159 ********** 2026-04-24 06:00:24.732684 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:00:24.732720 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:00:24.732731 | orchestrator | 2026-04-24 06:00:24.732742 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 06:00:24.732753 | orchestrator | Friday 24 April 2026 06:00:00 +0000 (0:00:01.597) 0:57:41.757 ********** 2026-04-24 06:00:24.732764 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:00:24.732775 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:00:24.732785 | orchestrator | 2026-04-24 06:00:24.732796 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 06:00:24.732827 | orchestrator | Friday 24 April 2026 06:00:02 +0000 (0:00:02.107) 0:57:43.864 ********** 2026-04-24 06:00:24.732839 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.732850 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.732861 | orchestrator | 2026-04-24 06:00:24.732871 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 06:00:24.732882 | orchestrator | Friday 24 April 2026 06:00:04 +0000 (0:00:01.875) 0:57:45.740 ********** 2026-04-24 06:00:24.732893 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.732904 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.732915 | orchestrator | 2026-04-24 06:00:24.732926 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 06:00:24.732937 | orchestrator | Friday 24 April 2026 06:00:05 +0000 (0:00:01.247) 0:57:46.987 ********** 2026-04-24 06:00:24.732948 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.732958 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.732969 | orchestrator | 2026-04-24 06:00:24.732980 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 06:00:24.732991 | orchestrator | Friday 24 April 2026 06:00:06 +0000 (0:00:01.196) 0:57:48.184 ********** 2026-04-24 06:00:24.733002 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.733013 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.733024 | orchestrator | 2026-04-24 06:00:24.733035 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 06:00:24.733046 | orchestrator | Friday 24 April 2026 06:00:07 +0000 (0:00:01.200) 0:57:49.385 ********** 2026-04-24 06:00:24.733057 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.733077 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.733088 | orchestrator | 2026-04-24 06:00:24.733099 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 06:00:24.733110 | orchestrator | Friday 24 April 2026 06:00:08 +0000 (0:00:01.177) 0:57:50.563 ********** 2026-04-24 06:00:24.733120 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.733131 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.733142 | orchestrator | 2026-04-24 06:00:24.733153 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 06:00:24.733164 | orchestrator | Friday 24 April 2026 06:00:10 +0000 (0:00:01.258) 0:57:51.821 ********** 2026-04-24 06:00:24.733175 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.733185 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.733196 | orchestrator | 2026-04-24 06:00:24.733207 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 06:00:24.733218 | orchestrator | Friday 24 April 2026 06:00:11 +0000 (0:00:01.220) 0:57:53.042 ********** 2026-04-24 06:00:24.733229 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.733239 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.733250 | orchestrator | 2026-04-24 06:00:24.733261 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 06:00:24.733271 | orchestrator | Friday 24 April 2026 06:00:12 +0000 (0:00:01.288) 0:57:54.331 ********** 2026-04-24 06:00:24.733282 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.733293 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.733304 | orchestrator | 2026-04-24 06:00:24.733314 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 06:00:24.733325 | orchestrator | Friday 24 April 2026 06:00:13 +0000 (0:00:01.259) 0:57:55.590 ********** 2026-04-24 06:00:24.733336 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.733347 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.733358 | orchestrator | 2026-04-24 06:00:24.733369 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 06:00:24.733380 | orchestrator | Friday 24 April 2026 06:00:15 +0000 (0:00:01.278) 0:57:56.868 ********** 2026-04-24 06:00:24.733391 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:00:24.733402 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:00:24.733412 | orchestrator | 2026-04-24 06:00:24.733423 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 06:00:24.733434 | orchestrator | Friday 24 April 2026 06:00:16 +0000 (0:00:01.282) 0:57:58.151 ********** 2026-04-24 06:00:24.733445 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-24 06:00:24.733456 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-24 06:00:24.733467 | orchestrator | 2026-04-24 06:00:24.733477 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 06:00:24.733493 | orchestrator | Friday 24 April 2026 06:00:20 +0000 (0:00:04.476) 0:58:02.627 ********** 2026-04-24 06:00:24.733505 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:00:24.733516 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:00:24.733527 | orchestrator | 2026-04-24 06:00:24.733537 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 06:00:24.733548 | orchestrator | Friday 24 April 2026 06:00:22 +0000 (0:00:01.384) 0:58:04.012 ********** 2026-04-24 06:00:24.733561 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-24 06:00:24.733589 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-24 06:01:15.115775 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-24 06:01:15.115834 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-24 06:01:15.115839 | orchestrator | 2026-04-24 06:01:15.115845 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 06:01:15.115850 | orchestrator | Friday 24 April 2026 06:00:27 +0000 (0:00:05.235) 0:58:09.247 ********** 2026-04-24 06:01:15.115854 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.115859 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:01:15.115863 | orchestrator | 2026-04-24 06:01:15.115867 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 06:01:15.115871 | orchestrator | Friday 24 April 2026 06:00:28 +0000 (0:00:01.336) 0:58:10.584 ********** 2026-04-24 06:01:15.115875 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.115879 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:01:15.115883 | orchestrator | 2026-04-24 06:01:15.115887 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 06:01:15.115892 | orchestrator | Friday 24 April 2026 06:00:30 +0000 (0:00:01.279) 0:58:11.864 ********** 2026-04-24 06:01:15.115896 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.115900 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:01:15.115904 | orchestrator | 2026-04-24 06:01:15.115908 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 06:01:15.115912 | orchestrator | Friday 24 April 2026 06:00:31 +0000 (0:00:01.344) 0:58:13.208 ********** 2026-04-24 06:01:15.115915 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.115919 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:01:15.115923 | orchestrator | 2026-04-24 06:01:15.115927 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 06:01:15.115931 | orchestrator | Friday 24 April 2026 06:00:32 +0000 (0:00:01.253) 0:58:14.462 ********** 2026-04-24 06:01:15.115935 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.115938 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:01:15.115942 | orchestrator | 2026-04-24 06:01:15.115946 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 06:01:15.115950 | orchestrator | Friday 24 April 2026 06:00:34 +0000 (0:00:01.296) 0:58:15.759 ********** 2026-04-24 06:01:15.115953 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.115958 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.115962 | orchestrator | 2026-04-24 06:01:15.115966 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 06:01:15.115970 | orchestrator | Friday 24 April 2026 06:00:35 +0000 (0:00:01.491) 0:58:17.250 ********** 2026-04-24 06:01:15.115974 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:01:15.115978 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:01:15.115981 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:01:15.115985 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.115989 | orchestrator | 2026-04-24 06:01:15.116006 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 06:01:15.116010 | orchestrator | Friday 24 April 2026 06:00:36 +0000 (0:00:01.419) 0:58:18.670 ********** 2026-04-24 06:01:15.116013 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:01:15.116017 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:01:15.116021 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:01:15.116025 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.116028 | orchestrator | 2026-04-24 06:01:15.116038 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 06:01:15.116042 | orchestrator | Friday 24 April 2026 06:00:38 +0000 (0:00:01.474) 0:58:20.144 ********** 2026-04-24 06:01:15.116046 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:01:15.116049 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:01:15.116053 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:01:15.116057 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.116060 | orchestrator | 2026-04-24 06:01:15.116064 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 06:01:15.116068 | orchestrator | Friday 24 April 2026 06:00:39 +0000 (0:00:01.417) 0:58:21.562 ********** 2026-04-24 06:01:15.116072 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.116075 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.116079 | orchestrator | 2026-04-24 06:01:15.116083 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 06:01:15.116087 | orchestrator | Friday 24 April 2026 06:00:41 +0000 (0:00:01.308) 0:58:22.870 ********** 2026-04-24 06:01:15.116090 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 06:01:15.116094 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 06:01:15.116098 | orchestrator | 2026-04-24 06:01:15.116102 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 06:01:15.116106 | orchestrator | Friday 24 April 2026 06:00:42 +0000 (0:00:01.505) 0:58:24.376 ********** 2026-04-24 06:01:15.116109 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.116113 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.116117 | orchestrator | 2026-04-24 06:01:15.116129 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-24 06:01:15.116133 | orchestrator | Friday 24 April 2026 06:00:44 +0000 (0:00:01.932) 0:58:26.309 ********** 2026-04-24 06:01:15.116136 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.116140 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:01:15.116144 | orchestrator | 2026-04-24 06:01:15.116148 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-24 06:01:15.116151 | orchestrator | Friday 24 April 2026 06:00:46 +0000 (0:00:01.627) 0:58:27.937 ********** 2026-04-24 06:01:15.116155 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-4, testbed-node-5 2026-04-24 06:01:15.116159 | orchestrator | 2026-04-24 06:01:15.116163 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-24 06:01:15.116167 | orchestrator | Friday 24 April 2026 06:00:47 +0000 (0:00:01.234) 0:58:29.171 ********** 2026-04-24 06:01:15.116171 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-24 06:01:15.116174 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-24 06:01:15.116178 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds/ceph-testbed-node-4) 2026-04-24 06:01:15.116182 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds/ceph-testbed-node-5) 2026-04-24 06:01:15.116186 | orchestrator | 2026-04-24 06:01:15.116189 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-24 06:01:15.116193 | orchestrator | Friday 24 April 2026 06:00:49 +0000 (0:00:02.095) 0:58:31.266 ********** 2026-04-24 06:01:15.116197 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:01:15.116204 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 06:01:15.116208 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 06:01:15.116212 | orchestrator | 2026-04-24 06:01:15.116215 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-24 06:01:15.116219 | orchestrator | Friday 24 April 2026 06:00:52 +0000 (0:00:03.267) 0:58:34.534 ********** 2026-04-24 06:01:15.116223 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-24 06:01:15.116227 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 06:01:15.116230 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.116234 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-24 06:01:15.116238 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-24 06:01:15.116242 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.116245 | orchestrator | 2026-04-24 06:01:15.116249 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-24 06:01:15.116253 | orchestrator | Friday 24 April 2026 06:00:54 +0000 (0:00:02.047) 0:58:36.582 ********** 2026-04-24 06:01:15.116256 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.116260 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.116264 | orchestrator | 2026-04-24 06:01:15.116267 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-24 06:01:15.116271 | orchestrator | Friday 24 April 2026 06:00:56 +0000 (0:00:01.625) 0:58:38.208 ********** 2026-04-24 06:01:15.116275 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.116279 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:01:15.116282 | orchestrator | 2026-04-24 06:01:15.116286 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-24 06:01:15.116290 | orchestrator | Friday 24 April 2026 06:00:58 +0000 (0:00:01.580) 0:58:39.788 ********** 2026-04-24 06:01:15.116293 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-4, testbed-node-5 2026-04-24 06:01:15.116297 | orchestrator | 2026-04-24 06:01:15.116301 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-24 06:01:15.116305 | orchestrator | Friday 24 April 2026 06:00:59 +0000 (0:00:01.312) 0:58:41.101 ********** 2026-04-24 06:01:15.116308 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-4, testbed-node-5 2026-04-24 06:01:15.116312 | orchestrator | 2026-04-24 06:01:15.116316 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-24 06:01:15.116320 | orchestrator | Friday 24 April 2026 06:01:00 +0000 (0:00:01.230) 0:58:42.332 ********** 2026-04-24 06:01:15.116323 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.116327 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.116331 | orchestrator | 2026-04-24 06:01:15.116337 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-24 06:01:15.116341 | orchestrator | Friday 24 April 2026 06:01:02 +0000 (0:00:02.155) 0:58:44.488 ********** 2026-04-24 06:01:15.116345 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.116348 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.116352 | orchestrator | 2026-04-24 06:01:15.116356 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-24 06:01:15.116360 | orchestrator | Friday 24 April 2026 06:01:04 +0000 (0:00:02.142) 0:58:46.631 ********** 2026-04-24 06:01:15.116363 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.116368 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.116372 | orchestrator | 2026-04-24 06:01:15.116377 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-24 06:01:15.116381 | orchestrator | Friday 24 April 2026 06:01:07 +0000 (0:00:02.354) 0:58:48.986 ********** 2026-04-24 06:01:15.116386 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:01:15.116390 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:01:15.116394 | orchestrator | 2026-04-24 06:01:15.116399 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-24 06:01:15.116403 | orchestrator | Friday 24 April 2026 06:01:11 +0000 (0:00:03.732) 0:58:52.719 ********** 2026-04-24 06:01:15.116411 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:01:15.116415 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:01:15.116420 | orchestrator | 2026-04-24 06:01:15.116424 | orchestrator | TASK [Set max_mds] ************************************************************* 2026-04-24 06:01:15.116429 | orchestrator | Friday 24 April 2026 06:01:13 +0000 (0:00:02.005) 0:58:54.725 ********** 2026-04-24 06:01:15.116433 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:01:15.116439 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 06:01:40.155561 | orchestrator | 2026-04-24 06:01:40.155773 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-24 06:01:40.155808 | orchestrator | 2026-04-24 06:01:40.155827 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 06:01:40.155842 | orchestrator | Friday 24 April 2026 06:01:16 +0000 (0:00:03.379) 0:58:58.104 ********** 2026-04-24 06:01:40.155853 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3 2026-04-24 06:01:40.155864 | orchestrator | 2026-04-24 06:01:40.155875 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 06:01:40.155885 | orchestrator | Friday 24 April 2026 06:01:17 +0000 (0:00:01.390) 0:58:59.494 ********** 2026-04-24 06:01:40.155896 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:40.155908 | orchestrator | 2026-04-24 06:01:40.155919 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 06:01:40.155930 | orchestrator | Friday 24 April 2026 06:01:19 +0000 (0:00:01.527) 0:59:01.022 ********** 2026-04-24 06:01:40.155940 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:40.155951 | orchestrator | 2026-04-24 06:01:40.155962 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 06:01:40.155972 | orchestrator | Friday 24 April 2026 06:01:20 +0000 (0:00:01.135) 0:59:02.158 ********** 2026-04-24 06:01:40.155983 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:40.155993 | orchestrator | 2026-04-24 06:01:40.156004 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 06:01:40.156015 | orchestrator | Friday 24 April 2026 06:01:21 +0000 (0:00:01.457) 0:59:03.615 ********** 2026-04-24 06:01:40.156026 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:40.156037 | orchestrator | 2026-04-24 06:01:40.156047 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 06:01:40.156058 | orchestrator | Friday 24 April 2026 06:01:23 +0000 (0:00:01.160) 0:59:04.776 ********** 2026-04-24 06:01:40.156069 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:40.156079 | orchestrator | 2026-04-24 06:01:40.156090 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 06:01:40.156101 | orchestrator | Friday 24 April 2026 06:01:24 +0000 (0:00:01.185) 0:59:05.962 ********** 2026-04-24 06:01:40.156114 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:40.156127 | orchestrator | 2026-04-24 06:01:40.156140 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 06:01:40.156154 | orchestrator | Friday 24 April 2026 06:01:25 +0000 (0:00:01.189) 0:59:07.151 ********** 2026-04-24 06:01:40.156167 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:40.156181 | orchestrator | 2026-04-24 06:01:40.156194 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 06:01:40.156207 | orchestrator | Friday 24 April 2026 06:01:26 +0000 (0:00:01.152) 0:59:08.304 ********** 2026-04-24 06:01:40.156220 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:40.156233 | orchestrator | 2026-04-24 06:01:40.156246 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 06:01:40.156258 | orchestrator | Friday 24 April 2026 06:01:27 +0000 (0:00:01.137) 0:59:09.442 ********** 2026-04-24 06:01:40.156270 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:01:40.156283 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:01:40.156295 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:01:40.156333 | orchestrator | 2026-04-24 06:01:40.156346 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 06:01:40.156358 | orchestrator | Friday 24 April 2026 06:01:29 +0000 (0:00:02.086) 0:59:11.528 ********** 2026-04-24 06:01:40.156370 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:40.156383 | orchestrator | 2026-04-24 06:01:40.156396 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 06:01:40.156409 | orchestrator | Friday 24 April 2026 06:01:31 +0000 (0:00:01.336) 0:59:12.865 ********** 2026-04-24 06:01:40.156422 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:01:40.156434 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:01:40.156458 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:01:40.156470 | orchestrator | 2026-04-24 06:01:40.156481 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 06:01:40.156491 | orchestrator | Friday 24 April 2026 06:01:34 +0000 (0:00:03.390) 0:59:16.255 ********** 2026-04-24 06:01:40.156502 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 06:01:40.156513 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 06:01:40.156523 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 06:01:40.156533 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:40.156544 | orchestrator | 2026-04-24 06:01:40.156555 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 06:01:40.156565 | orchestrator | Friday 24 April 2026 06:01:36 +0000 (0:00:01.826) 0:59:18.082 ********** 2026-04-24 06:01:40.156578 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 06:01:40.156592 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 06:01:40.156623 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 06:01:40.156635 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:40.156689 | orchestrator | 2026-04-24 06:01:40.156700 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 06:01:40.156711 | orchestrator | Friday 24 April 2026 06:01:38 +0000 (0:00:02.383) 0:59:20.466 ********** 2026-04-24 06:01:40.156724 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:01:40.156737 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:01:40.156749 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:01:40.156769 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:40.156780 | orchestrator | 2026-04-24 06:01:40.156790 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 06:01:40.156801 | orchestrator | Friday 24 April 2026 06:01:39 +0000 (0:00:01.166) 0:59:21.633 ********** 2026-04-24 06:01:40.156814 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 06:01:31.724479', 'end': '2026-04-24 06:01:31.764746', 'delta': '0:00:00.040267', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 06:01:40.156834 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 06:01:32.769666', 'end': '2026-04-24 06:01:32.817708', 'delta': '0:00:00.048042', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 06:01:40.156846 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 06:01:33.348016', 'end': '2026-04-24 06:01:33.396766', 'delta': '0:00:00.048750', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 06:01:40.156857 | orchestrator | 2026-04-24 06:01:40.156876 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 06:01:58.859901 | orchestrator | Friday 24 April 2026 06:01:41 +0000 (0:00:01.190) 0:59:22.823 ********** 2026-04-24 06:01:58.860000 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:58.860013 | orchestrator | 2026-04-24 06:01:58.860025 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 06:01:58.860035 | orchestrator | Friday 24 April 2026 06:01:42 +0000 (0:00:01.241) 0:59:24.064 ********** 2026-04-24 06:01:58.860043 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:58.860053 | orchestrator | 2026-04-24 06:01:58.860061 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 06:01:58.860070 | orchestrator | Friday 24 April 2026 06:01:43 +0000 (0:00:01.260) 0:59:25.325 ********** 2026-04-24 06:01:58.860078 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:58.860087 | orchestrator | 2026-04-24 06:01:58.860095 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 06:01:58.860104 | orchestrator | Friday 24 April 2026 06:01:44 +0000 (0:00:01.158) 0:59:26.484 ********** 2026-04-24 06:01:58.860135 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 06:01:58.860144 | orchestrator | 2026-04-24 06:01:58.860153 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 06:01:58.860161 | orchestrator | Friday 24 April 2026 06:01:46 +0000 (0:00:02.016) 0:59:28.501 ********** 2026-04-24 06:01:58.860169 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:58.860178 | orchestrator | 2026-04-24 06:01:58.860186 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 06:01:58.860194 | orchestrator | Friday 24 April 2026 06:01:47 +0000 (0:00:01.162) 0:59:29.663 ********** 2026-04-24 06:01:58.860203 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:58.860211 | orchestrator | 2026-04-24 06:01:58.860220 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 06:01:58.860228 | orchestrator | Friday 24 April 2026 06:01:49 +0000 (0:00:01.153) 0:59:30.816 ********** 2026-04-24 06:01:58.860236 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:58.860245 | orchestrator | 2026-04-24 06:01:58.860253 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 06:01:58.860261 | orchestrator | Friday 24 April 2026 06:01:50 +0000 (0:00:01.242) 0:59:32.058 ********** 2026-04-24 06:01:58.860270 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:58.860278 | orchestrator | 2026-04-24 06:01:58.860287 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 06:01:58.860295 | orchestrator | Friday 24 April 2026 06:01:51 +0000 (0:00:01.177) 0:59:33.236 ********** 2026-04-24 06:01:58.860303 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:58.860312 | orchestrator | 2026-04-24 06:01:58.860320 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 06:01:58.860328 | orchestrator | Friday 24 April 2026 06:01:52 +0000 (0:00:01.182) 0:59:34.418 ********** 2026-04-24 06:01:58.860337 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:58.860345 | orchestrator | 2026-04-24 06:01:58.860353 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 06:01:58.860362 | orchestrator | Friday 24 April 2026 06:01:53 +0000 (0:00:01.209) 0:59:35.627 ********** 2026-04-24 06:01:58.860370 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:58.860379 | orchestrator | 2026-04-24 06:01:58.860387 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 06:01:58.860395 | orchestrator | Friday 24 April 2026 06:01:55 +0000 (0:00:01.209) 0:59:36.837 ********** 2026-04-24 06:01:58.860404 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:58.860412 | orchestrator | 2026-04-24 06:01:58.860420 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 06:01:58.860429 | orchestrator | Friday 24 April 2026 06:01:56 +0000 (0:00:01.177) 0:59:38.015 ********** 2026-04-24 06:01:58.860437 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:01:58.860445 | orchestrator | 2026-04-24 06:01:58.860454 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 06:01:58.860465 | orchestrator | Friday 24 April 2026 06:01:57 +0000 (0:00:01.138) 0:59:39.153 ********** 2026-04-24 06:01:58.860475 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:01:58.860485 | orchestrator | 2026-04-24 06:01:58.860494 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 06:01:58.860517 | orchestrator | Friday 24 April 2026 06:01:58 +0000 (0:00:01.200) 0:59:40.353 ********** 2026-04-24 06:01:58.860530 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:01:58.860544 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'uuids': ['6d15df4f-c4ce-4002-ae8a-c5ea103b6315'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R']}})  2026-04-24 06:01:58.860579 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '92dd2642', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 06:01:58.860591 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3']}})  2026-04-24 06:01:58.860603 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:01:58.860613 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:01:58.860625 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-05-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 06:01:58.860683 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:01:58.860693 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx', 'dm-uuid-CRYPT-LUKS2-7bd2335635b44d1cb53d2df716853f40-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 06:01:58.860714 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:02:00.209479 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'uuids': ['7bd23356-35b4-4d1c-b53d-2df716853f40'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx']}})  2026-04-24 06:02:00.209587 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f']}})  2026-04-24 06:02:00.209605 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:02:00.209675 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3ccf7d33', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 06:02:00.209736 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:02:00.209750 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:02:00.209763 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R', 'dm-uuid-CRYPT-LUKS2-6d15df4fc4ce4002ae8ac5ea103b6315-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 06:02:00.209775 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:00.209788 | orchestrator | 2026-04-24 06:02:00.209800 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 06:02:00.209813 | orchestrator | Friday 24 April 2026 06:02:00 +0000 (0:00:01.396) 0:59:41.750 ********** 2026-04-24 06:02:00.209826 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.209844 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f', 'dm-uuid-LVM-99ipvaRduIKeUleMerRANx29eSdElmj8doBTOLf7ZtVQfw8ZFPjAv51lS9tg2k0R'], 'uuids': ['6d15df4f-c4ce-4002-ae8a-c5ea103b6315'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.209865 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76', 'scsi-SQEMU_QEMU_HARDDISK_92dd2642-12ef-4670-adde-b0a5f7905f76'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '92dd2642', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.209886 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-wxLyc7-1fSo-8qQj-sS5D-PEcN-nzhq-mACo8t', 'scsi-0QEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23', 'scsi-SQEMU_QEMU_HARDDISK_b35d6460-4113-4a0d-a6ba-fa54e4693f23'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.365726 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.365830 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.365864 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-05-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.365901 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.365914 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx', 'dm-uuid-CRYPT-LUKS2-7bd2335635b44d1cb53d2df716853f40-XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.365927 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.365958 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--30beaf4b--e88f--5ba2--bed2--60586ab1edc3-osd--block--30beaf4b--e88f--5ba2--bed2--60586ab1edc3', 'dm-uuid-LVM-jbalaGQai8GnxM6FPPIfSJBPrNv9lyXiXeQQ6fzawPyv0RXSWZS7y4upGyw9klrx'], 'uuids': ['7bd23356-35b4-4d1c-b53d-2df716853f40'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'b35d6460', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XeQQ6f-zawP-yv0R-XSWZ-S7y4-upGy-w9klrx']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.365973 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-srcEnF-hYje-T7Ay-skYc-zemt-tXdg-THnFQi', 'scsi-0QEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c', 'scsi-SQEMU_QEMU_HARDDISK_1241754e-3b17-41ae-8e6a-e32bbefa282c'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '1241754e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--02e41f6c--bc12--5c7e--a521--6aced039912f-osd--block--02e41f6c--bc12--5c7e--a521--6aced039912f']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.366000 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:00.366075 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3ccf7d33', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1', 'scsi-SQEMU_QEMU_HARDDISK_3ccf7d33-589c-4274-be28-035704dd3951-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:33.194149 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:33.194285 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:33.194356 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R', 'dm-uuid-CRYPT-LUKS2-6d15df4fc4ce4002ae8ac5ea103b6315-doBTOL-f7Zt-VQfw-8ZFP-jAv5-1lS9-tg2k0R'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:02:33.194378 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.194396 | orchestrator | 2026-04-24 06:02:33.194414 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 06:02:33.194511 | orchestrator | Friday 24 April 2026 06:02:01 +0000 (0:00:01.483) 0:59:43.233 ********** 2026-04-24 06:02:33.194531 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:02:33.194549 | orchestrator | 2026-04-24 06:02:33.194567 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 06:02:33.194583 | orchestrator | Friday 24 April 2026 06:02:03 +0000 (0:00:01.516) 0:59:44.750 ********** 2026-04-24 06:02:33.194599 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:02:33.194710 | orchestrator | 2026-04-24 06:02:33.194725 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 06:02:33.194737 | orchestrator | Friday 24 April 2026 06:02:04 +0000 (0:00:01.172) 0:59:45.922 ********** 2026-04-24 06:02:33.194749 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:02:33.194761 | orchestrator | 2026-04-24 06:02:33.194773 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 06:02:33.194785 | orchestrator | Friday 24 April 2026 06:02:05 +0000 (0:00:01.629) 0:59:47.552 ********** 2026-04-24 06:02:33.194796 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.194807 | orchestrator | 2026-04-24 06:02:33.194819 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 06:02:33.194830 | orchestrator | Friday 24 April 2026 06:02:07 +0000 (0:00:01.178) 0:59:48.730 ********** 2026-04-24 06:02:33.194843 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.194855 | orchestrator | 2026-04-24 06:02:33.194866 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 06:02:33.194879 | orchestrator | Friday 24 April 2026 06:02:08 +0000 (0:00:01.331) 0:59:50.062 ********** 2026-04-24 06:02:33.194890 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.194902 | orchestrator | 2026-04-24 06:02:33.194913 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 06:02:33.194925 | orchestrator | Friday 24 April 2026 06:02:09 +0000 (0:00:01.235) 0:59:51.297 ********** 2026-04-24 06:02:33.194937 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-24 06:02:33.194948 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-24 06:02:33.194959 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-24 06:02:33.194971 | orchestrator | 2026-04-24 06:02:33.194983 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 06:02:33.194996 | orchestrator | Friday 24 April 2026 06:02:12 +0000 (0:00:02.578) 0:59:53.875 ********** 2026-04-24 06:02:33.195014 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-24 06:02:33.195036 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-24 06:02:33.195058 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-24 06:02:33.195091 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.195168 | orchestrator | 2026-04-24 06:02:33.195184 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 06:02:33.195194 | orchestrator | Friday 24 April 2026 06:02:13 +0000 (0:00:01.335) 0:59:55.211 ********** 2026-04-24 06:02:33.195226 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3 2026-04-24 06:02:33.195237 | orchestrator | 2026-04-24 06:02:33.195248 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 06:02:33.195260 | orchestrator | Friday 24 April 2026 06:02:14 +0000 (0:00:01.346) 0:59:56.557 ********** 2026-04-24 06:02:33.195270 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.195280 | orchestrator | 2026-04-24 06:02:33.195290 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 06:02:33.195299 | orchestrator | Friday 24 April 2026 06:02:16 +0000 (0:00:01.238) 0:59:57.796 ********** 2026-04-24 06:02:33.195310 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.195319 | orchestrator | 2026-04-24 06:02:33.195329 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 06:02:33.195339 | orchestrator | Friday 24 April 2026 06:02:17 +0000 (0:00:01.331) 0:59:59.128 ********** 2026-04-24 06:02:33.195349 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.195358 | orchestrator | 2026-04-24 06:02:33.195368 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 06:02:33.195377 | orchestrator | Friday 24 April 2026 06:02:18 +0000 (0:00:01.229) 1:00:00.357 ********** 2026-04-24 06:02:33.195387 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:02:33.195397 | orchestrator | 2026-04-24 06:02:33.195406 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 06:02:33.195416 | orchestrator | Friday 24 April 2026 06:02:20 +0000 (0:00:01.401) 1:00:01.759 ********** 2026-04-24 06:02:33.195426 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 06:02:33.195435 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 06:02:33.195456 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 06:02:33.195466 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.195476 | orchestrator | 2026-04-24 06:02:33.195485 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 06:02:33.195495 | orchestrator | Friday 24 April 2026 06:02:21 +0000 (0:00:01.631) 1:00:03.391 ********** 2026-04-24 06:02:33.195504 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 06:02:33.195514 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 06:02:33.195524 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 06:02:33.195533 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.195543 | orchestrator | 2026-04-24 06:02:33.195553 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 06:02:33.195562 | orchestrator | Friday 24 April 2026 06:02:23 +0000 (0:00:01.472) 1:00:04.863 ********** 2026-04-24 06:02:33.195572 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 06:02:33.195582 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 06:02:33.195592 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 06:02:33.195601 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:02:33.195639 | orchestrator | 2026-04-24 06:02:33.195657 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 06:02:33.195684 | orchestrator | Friday 24 April 2026 06:02:24 +0000 (0:00:01.543) 1:00:06.406 ********** 2026-04-24 06:02:33.195700 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:02:33.195716 | orchestrator | 2026-04-24 06:02:33.195730 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 06:02:33.195744 | orchestrator | Friday 24 April 2026 06:02:25 +0000 (0:00:01.261) 1:00:07.668 ********** 2026-04-24 06:02:33.195774 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 06:02:33.195791 | orchestrator | 2026-04-24 06:02:33.195807 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 06:02:33.195843 | orchestrator | Friday 24 April 2026 06:02:27 +0000 (0:00:01.519) 1:00:09.188 ********** 2026-04-24 06:02:33.195874 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:02:33.195891 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:02:33.195908 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:02:33.195924 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 06:02:33.195940 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 06:02:33.195957 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 06:02:33.195975 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 06:02:33.195992 | orchestrator | 2026-04-24 06:02:33.196007 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 06:02:33.196022 | orchestrator | Friday 24 April 2026 06:02:29 +0000 (0:00:02.415) 1:00:11.604 ********** 2026-04-24 06:02:33.196038 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:02:33.196056 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:02:33.196075 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:02:33.196097 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-24 06:02:33.196114 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 06:02:33.196129 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 06:02:33.196146 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 06:02:33.196164 | orchestrator | 2026-04-24 06:02:33.196194 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-24 06:03:32.245972 | orchestrator | Friday 24 April 2026 06:02:34 +0000 (0:00:04.352) 1:00:15.956 ********** 2026-04-24 06:03:32.246122 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:03:32.246136 | orchestrator | 2026-04-24 06:03:32.246143 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-24 06:03:32.246150 | orchestrator | Friday 24 April 2026 06:02:36 +0000 (0:00:02.469) 1:00:18.425 ********** 2026-04-24 06:03:32.246157 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 06:03:32.246165 | orchestrator | 2026-04-24 06:03:32.246171 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-24 06:03:32.246178 | orchestrator | Friday 24 April 2026 06:02:39 +0000 (0:00:03.049) 1:00:21.475 ********** 2026-04-24 06:03:32.246184 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 06:03:32.246190 | orchestrator | 2026-04-24 06:03:32.246196 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 06:03:32.246202 | orchestrator | Friday 24 April 2026 06:02:42 +0000 (0:00:02.394) 1:00:23.870 ********** 2026-04-24 06:03:32.246208 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3 2026-04-24 06:03:32.246215 | orchestrator | 2026-04-24 06:03:32.246221 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 06:03:32.246226 | orchestrator | Friday 24 April 2026 06:02:43 +0000 (0:00:01.332) 1:00:25.203 ********** 2026-04-24 06:03:32.246233 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3 2026-04-24 06:03:32.246261 | orchestrator | 2026-04-24 06:03:32.246283 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 06:03:32.246289 | orchestrator | Friday 24 April 2026 06:02:44 +0000 (0:00:01.256) 1:00:26.459 ********** 2026-04-24 06:03:32.246295 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246300 | orchestrator | 2026-04-24 06:03:32.246306 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 06:03:32.246312 | orchestrator | Friday 24 April 2026 06:02:46 +0000 (0:00:01.412) 1:00:27.872 ********** 2026-04-24 06:03:32.246318 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246325 | orchestrator | 2026-04-24 06:03:32.246331 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 06:03:32.246337 | orchestrator | Friday 24 April 2026 06:02:47 +0000 (0:00:01.600) 1:00:29.472 ********** 2026-04-24 06:03:32.246342 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246347 | orchestrator | 2026-04-24 06:03:32.246354 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 06:03:32.246360 | orchestrator | Friday 24 April 2026 06:02:49 +0000 (0:00:01.713) 1:00:31.186 ********** 2026-04-24 06:03:32.246366 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246371 | orchestrator | 2026-04-24 06:03:32.246377 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 06:03:32.246382 | orchestrator | Friday 24 April 2026 06:02:51 +0000 (0:00:01.714) 1:00:32.901 ********** 2026-04-24 06:03:32.246387 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246392 | orchestrator | 2026-04-24 06:03:32.246398 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 06:03:32.246403 | orchestrator | Friday 24 April 2026 06:02:52 +0000 (0:00:01.395) 1:00:34.296 ********** 2026-04-24 06:03:32.246408 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246413 | orchestrator | 2026-04-24 06:03:32.246418 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 06:03:32.246424 | orchestrator | Friday 24 April 2026 06:02:53 +0000 (0:00:01.203) 1:00:35.499 ********** 2026-04-24 06:03:32.246429 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246434 | orchestrator | 2026-04-24 06:03:32.246440 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 06:03:32.246445 | orchestrator | Friday 24 April 2026 06:02:55 +0000 (0:00:01.247) 1:00:36.747 ********** 2026-04-24 06:03:32.246451 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246457 | orchestrator | 2026-04-24 06:03:32.246463 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 06:03:32.246469 | orchestrator | Friday 24 April 2026 06:02:56 +0000 (0:00:01.599) 1:00:38.347 ********** 2026-04-24 06:03:32.246474 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246479 | orchestrator | 2026-04-24 06:03:32.246486 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 06:03:32.246492 | orchestrator | Friday 24 April 2026 06:02:58 +0000 (0:00:01.686) 1:00:40.034 ********** 2026-04-24 06:03:32.246500 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246507 | orchestrator | 2026-04-24 06:03:32.246514 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 06:03:32.246521 | orchestrator | Friday 24 April 2026 06:02:59 +0000 (0:00:01.212) 1:00:41.246 ********** 2026-04-24 06:03:32.246531 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246540 | orchestrator | 2026-04-24 06:03:32.246549 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 06:03:32.246559 | orchestrator | Friday 24 April 2026 06:03:00 +0000 (0:00:01.280) 1:00:42.527 ********** 2026-04-24 06:03:32.246568 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246578 | orchestrator | 2026-04-24 06:03:32.246657 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 06:03:32.246668 | orchestrator | Friday 24 April 2026 06:03:02 +0000 (0:00:01.287) 1:00:43.815 ********** 2026-04-24 06:03:32.246690 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246699 | orchestrator | 2026-04-24 06:03:32.246711 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 06:03:32.246720 | orchestrator | Friday 24 April 2026 06:03:03 +0000 (0:00:01.308) 1:00:45.124 ********** 2026-04-24 06:03:32.246730 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246740 | orchestrator | 2026-04-24 06:03:32.246772 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 06:03:32.246779 | orchestrator | Friday 24 April 2026 06:03:04 +0000 (0:00:01.283) 1:00:46.407 ********** 2026-04-24 06:03:32.246784 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246790 | orchestrator | 2026-04-24 06:03:32.246796 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 06:03:32.246802 | orchestrator | Friday 24 April 2026 06:03:06 +0000 (0:00:01.334) 1:00:47.742 ********** 2026-04-24 06:03:32.246809 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246815 | orchestrator | 2026-04-24 06:03:32.246821 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 06:03:32.246827 | orchestrator | Friday 24 April 2026 06:03:07 +0000 (0:00:01.502) 1:00:49.244 ********** 2026-04-24 06:03:32.246834 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246840 | orchestrator | 2026-04-24 06:03:32.246846 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 06:03:32.246852 | orchestrator | Friday 24 April 2026 06:03:08 +0000 (0:00:01.331) 1:00:50.576 ********** 2026-04-24 06:03:32.246858 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246864 | orchestrator | 2026-04-24 06:03:32.246870 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 06:03:32.246876 | orchestrator | Friday 24 April 2026 06:03:10 +0000 (0:00:01.272) 1:00:51.848 ********** 2026-04-24 06:03:32.246882 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.246887 | orchestrator | 2026-04-24 06:03:32.246893 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 06:03:32.246899 | orchestrator | Friday 24 April 2026 06:03:11 +0000 (0:00:01.451) 1:00:53.300 ********** 2026-04-24 06:03:32.246905 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246911 | orchestrator | 2026-04-24 06:03:32.246917 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 06:03:32.246932 | orchestrator | Friday 24 April 2026 06:03:12 +0000 (0:00:01.188) 1:00:54.489 ********** 2026-04-24 06:03:32.246938 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246944 | orchestrator | 2026-04-24 06:03:32.246950 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 06:03:32.246956 | orchestrator | Friday 24 April 2026 06:03:14 +0000 (0:00:01.244) 1:00:55.733 ********** 2026-04-24 06:03:32.246962 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246968 | orchestrator | 2026-04-24 06:03:32.246975 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 06:03:32.246980 | orchestrator | Friday 24 April 2026 06:03:15 +0000 (0:00:01.331) 1:00:57.065 ********** 2026-04-24 06:03:32.246986 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.246992 | orchestrator | 2026-04-24 06:03:32.246998 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 06:03:32.247004 | orchestrator | Friday 24 April 2026 06:03:16 +0000 (0:00:01.193) 1:00:58.259 ********** 2026-04-24 06:03:32.247010 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.247016 | orchestrator | 2026-04-24 06:03:32.247022 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 06:03:32.247028 | orchestrator | Friday 24 April 2026 06:03:17 +0000 (0:00:01.189) 1:00:59.448 ********** 2026-04-24 06:03:32.247033 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.247039 | orchestrator | 2026-04-24 06:03:32.247045 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 06:03:32.247051 | orchestrator | Friday 24 April 2026 06:03:18 +0000 (0:00:01.209) 1:01:00.657 ********** 2026-04-24 06:03:32.247087 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.247094 | orchestrator | 2026-04-24 06:03:32.247100 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 06:03:32.247108 | orchestrator | Friday 24 April 2026 06:03:20 +0000 (0:00:01.157) 1:01:01.814 ********** 2026-04-24 06:03:32.247114 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.247120 | orchestrator | 2026-04-24 06:03:32.247125 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 06:03:32.247131 | orchestrator | Friday 24 April 2026 06:03:21 +0000 (0:00:01.241) 1:01:03.056 ********** 2026-04-24 06:03:32.247137 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.247142 | orchestrator | 2026-04-24 06:03:32.247148 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 06:03:32.247154 | orchestrator | Friday 24 April 2026 06:03:22 +0000 (0:00:01.188) 1:01:04.244 ********** 2026-04-24 06:03:32.247160 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.247166 | orchestrator | 2026-04-24 06:03:32.247172 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 06:03:32.247178 | orchestrator | Friday 24 April 2026 06:03:23 +0000 (0:00:01.232) 1:01:05.477 ********** 2026-04-24 06:03:32.247184 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.247190 | orchestrator | 2026-04-24 06:03:32.247196 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 06:03:32.247202 | orchestrator | Friday 24 April 2026 06:03:25 +0000 (0:00:01.290) 1:01:06.767 ********** 2026-04-24 06:03:32.247208 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:03:32.247213 | orchestrator | 2026-04-24 06:03:32.247219 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 06:03:32.247224 | orchestrator | Friday 24 April 2026 06:03:26 +0000 (0:00:01.525) 1:01:08.292 ********** 2026-04-24 06:03:32.247230 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.247236 | orchestrator | 2026-04-24 06:03:32.247243 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 06:03:32.247248 | orchestrator | Friday 24 April 2026 06:03:28 +0000 (0:00:01.996) 1:01:10.289 ********** 2026-04-24 06:03:32.247254 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:03:32.247260 | orchestrator | 2026-04-24 06:03:32.247266 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 06:03:32.247272 | orchestrator | Friday 24 April 2026 06:03:30 +0000 (0:00:02.370) 1:01:12.660 ********** 2026-04-24 06:03:32.247278 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3 2026-04-24 06:03:32.247284 | orchestrator | 2026-04-24 06:03:32.247290 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 06:03:32.247309 | orchestrator | Friday 24 April 2026 06:03:32 +0000 (0:00:01.287) 1:01:13.947 ********** 2026-04-24 06:04:23.171520 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171609 | orchestrator | 2026-04-24 06:04:23.171618 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 06:04:23.171624 | orchestrator | Friday 24 April 2026 06:03:33 +0000 (0:00:01.237) 1:01:15.185 ********** 2026-04-24 06:04:23.171629 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171634 | orchestrator | 2026-04-24 06:04:23.171639 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 06:04:23.171644 | orchestrator | Friday 24 April 2026 06:03:34 +0000 (0:00:01.227) 1:01:16.412 ********** 2026-04-24 06:04:23.171649 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 06:04:23.171654 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 06:04:23.171660 | orchestrator | 2026-04-24 06:04:23.171665 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 06:04:23.171669 | orchestrator | Friday 24 April 2026 06:03:36 +0000 (0:00:01.958) 1:01:18.371 ********** 2026-04-24 06:04:23.171674 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:04:23.171698 | orchestrator | 2026-04-24 06:04:23.171703 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 06:04:23.171724 | orchestrator | Friday 24 April 2026 06:03:38 +0000 (0:00:01.604) 1:01:19.976 ********** 2026-04-24 06:04:23.171729 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171734 | orchestrator | 2026-04-24 06:04:23.171739 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 06:04:23.171743 | orchestrator | Friday 24 April 2026 06:03:39 +0000 (0:00:01.248) 1:01:21.224 ********** 2026-04-24 06:04:23.171748 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171752 | orchestrator | 2026-04-24 06:04:23.171768 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 06:04:23.171773 | orchestrator | Friday 24 April 2026 06:03:40 +0000 (0:00:01.248) 1:01:22.472 ********** 2026-04-24 06:04:23.171778 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171782 | orchestrator | 2026-04-24 06:04:23.171787 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 06:04:23.171791 | orchestrator | Friday 24 April 2026 06:03:42 +0000 (0:00:01.364) 1:01:23.836 ********** 2026-04-24 06:04:23.171796 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3 2026-04-24 06:04:23.171802 | orchestrator | 2026-04-24 06:04:23.171807 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 06:04:23.171822 | orchestrator | Friday 24 April 2026 06:03:43 +0000 (0:00:01.456) 1:01:25.293 ********** 2026-04-24 06:04:23.171827 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:04:23.171832 | orchestrator | 2026-04-24 06:04:23.171836 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 06:04:23.171841 | orchestrator | Friday 24 April 2026 06:03:45 +0000 (0:00:01.897) 1:01:27.190 ********** 2026-04-24 06:04:23.171846 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 06:04:23.171851 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 06:04:23.171855 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 06:04:23.171860 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171864 | orchestrator | 2026-04-24 06:04:23.171869 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 06:04:23.171873 | orchestrator | Friday 24 April 2026 06:03:46 +0000 (0:00:01.311) 1:01:28.502 ********** 2026-04-24 06:04:23.171878 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171883 | orchestrator | 2026-04-24 06:04:23.171887 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 06:04:23.171892 | orchestrator | Friday 24 April 2026 06:03:48 +0000 (0:00:01.272) 1:01:29.774 ********** 2026-04-24 06:04:23.171896 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171901 | orchestrator | 2026-04-24 06:04:23.171906 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 06:04:23.171910 | orchestrator | Friday 24 April 2026 06:03:49 +0000 (0:00:01.301) 1:01:31.075 ********** 2026-04-24 06:04:23.171915 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171919 | orchestrator | 2026-04-24 06:04:23.171924 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 06:04:23.171929 | orchestrator | Friday 24 April 2026 06:03:50 +0000 (0:00:01.269) 1:01:32.345 ********** 2026-04-24 06:04:23.171933 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171938 | orchestrator | 2026-04-24 06:04:23.171942 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 06:04:23.171947 | orchestrator | Friday 24 April 2026 06:03:51 +0000 (0:00:01.244) 1:01:33.589 ********** 2026-04-24 06:04:23.171951 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.171956 | orchestrator | 2026-04-24 06:04:23.171961 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 06:04:23.171965 | orchestrator | Friday 24 April 2026 06:03:53 +0000 (0:00:01.327) 1:01:34.917 ********** 2026-04-24 06:04:23.171975 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:04:23.171980 | orchestrator | 2026-04-24 06:04:23.171984 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 06:04:23.171989 | orchestrator | Friday 24 April 2026 06:03:55 +0000 (0:00:02.663) 1:01:37.580 ********** 2026-04-24 06:04:23.171993 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:04:23.171998 | orchestrator | 2026-04-24 06:04:23.172003 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 06:04:23.172007 | orchestrator | Friday 24 April 2026 06:03:57 +0000 (0:00:01.276) 1:01:38.857 ********** 2026-04-24 06:04:23.172012 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3 2026-04-24 06:04:23.172016 | orchestrator | 2026-04-24 06:04:23.172021 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 06:04:23.172036 | orchestrator | Friday 24 April 2026 06:03:58 +0000 (0:00:01.164) 1:01:40.021 ********** 2026-04-24 06:04:23.172041 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.172045 | orchestrator | 2026-04-24 06:04:23.172050 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 06:04:23.172055 | orchestrator | Friday 24 April 2026 06:03:59 +0000 (0:00:01.249) 1:01:41.271 ********** 2026-04-24 06:04:23.172059 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.172064 | orchestrator | 2026-04-24 06:04:23.172068 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 06:04:23.172073 | orchestrator | Friday 24 April 2026 06:04:00 +0000 (0:00:01.251) 1:01:42.523 ********** 2026-04-24 06:04:23.172077 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.172082 | orchestrator | 2026-04-24 06:04:23.172088 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 06:04:23.172093 | orchestrator | Friday 24 April 2026 06:04:02 +0000 (0:00:01.224) 1:01:43.747 ********** 2026-04-24 06:04:23.172098 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.172104 | orchestrator | 2026-04-24 06:04:23.172109 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 06:04:23.172114 | orchestrator | Friday 24 April 2026 06:04:03 +0000 (0:00:01.525) 1:01:45.273 ********** 2026-04-24 06:04:23.172120 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.172125 | orchestrator | 2026-04-24 06:04:23.172130 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 06:04:23.172136 | orchestrator | Friday 24 April 2026 06:04:04 +0000 (0:00:01.205) 1:01:46.478 ********** 2026-04-24 06:04:23.172141 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.172147 | orchestrator | 2026-04-24 06:04:23.172152 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 06:04:23.172160 | orchestrator | Friday 24 April 2026 06:04:06 +0000 (0:00:01.268) 1:01:47.746 ********** 2026-04-24 06:04:23.172166 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.172171 | orchestrator | 2026-04-24 06:04:23.172177 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 06:04:23.172182 | orchestrator | Friday 24 April 2026 06:04:07 +0000 (0:00:01.272) 1:01:49.019 ********** 2026-04-24 06:04:23.172188 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:04:23.172193 | orchestrator | 2026-04-24 06:04:23.172198 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 06:04:23.172204 | orchestrator | Friday 24 April 2026 06:04:08 +0000 (0:00:01.205) 1:01:50.225 ********** 2026-04-24 06:04:23.172209 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:04:23.172215 | orchestrator | 2026-04-24 06:04:23.172220 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 06:04:23.172225 | orchestrator | Friday 24 April 2026 06:04:09 +0000 (0:00:01.340) 1:01:51.565 ********** 2026-04-24 06:04:23.172231 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3 2026-04-24 06:04:23.172236 | orchestrator | 2026-04-24 06:04:23.172242 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 06:04:23.172254 | orchestrator | Friday 24 April 2026 06:04:11 +0000 (0:00:01.285) 1:01:52.851 ********** 2026-04-24 06:04:23.172259 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-24 06:04:23.172265 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-24 06:04:23.172271 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-24 06:04:23.172276 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-24 06:04:23.172282 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-24 06:04:23.172287 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-24 06:04:23.172292 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-24 06:04:23.172298 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-24 06:04:23.172304 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 06:04:23.172309 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 06:04:23.172315 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 06:04:23.172320 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 06:04:23.172325 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 06:04:23.172331 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 06:04:23.172337 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-24 06:04:23.172342 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-24 06:04:23.172348 | orchestrator | 2026-04-24 06:04:23.172353 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 06:04:23.172358 | orchestrator | Friday 24 April 2026 06:04:17 +0000 (0:00:06.638) 1:01:59.489 ********** 2026-04-24 06:04:23.172364 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3 2026-04-24 06:04:23.172370 | orchestrator | 2026-04-24 06:04:23.172375 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 06:04:23.172380 | orchestrator | Friday 24 April 2026 06:04:19 +0000 (0:00:01.493) 1:02:00.983 ********** 2026-04-24 06:04:23.172386 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 06:04:23.172392 | orchestrator | 2026-04-24 06:04:23.172398 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 06:04:23.172403 | orchestrator | Friday 24 April 2026 06:04:20 +0000 (0:00:01.630) 1:02:02.613 ********** 2026-04-24 06:04:23.172409 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 06:04:23.172414 | orchestrator | 2026-04-24 06:04:23.172419 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 06:04:23.172428 | orchestrator | Friday 24 April 2026 06:04:23 +0000 (0:00:02.261) 1:02:04.875 ********** 2026-04-24 06:05:18.812911 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813066 | orchestrator | 2026-04-24 06:05:18.813093 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 06:05:18.813114 | orchestrator | Friday 24 April 2026 06:04:24 +0000 (0:00:01.227) 1:02:06.102 ********** 2026-04-24 06:05:18.813131 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813149 | orchestrator | 2026-04-24 06:05:18.813167 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 06:05:18.813187 | orchestrator | Friday 24 April 2026 06:04:25 +0000 (0:00:01.308) 1:02:07.410 ********** 2026-04-24 06:05:18.813205 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813223 | orchestrator | 2026-04-24 06:05:18.813242 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 06:05:18.813261 | orchestrator | Friday 24 April 2026 06:04:27 +0000 (0:00:01.398) 1:02:08.809 ********** 2026-04-24 06:05:18.813279 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813356 | orchestrator | 2026-04-24 06:05:18.813379 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 06:05:18.813400 | orchestrator | Friday 24 April 2026 06:04:28 +0000 (0:00:01.244) 1:02:10.054 ********** 2026-04-24 06:05:18.813421 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813443 | orchestrator | 2026-04-24 06:05:18.813463 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 06:05:18.813484 | orchestrator | Friday 24 April 2026 06:04:29 +0000 (0:00:01.436) 1:02:11.490 ********** 2026-04-24 06:05:18.813504 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813522 | orchestrator | 2026-04-24 06:05:18.813615 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 06:05:18.813638 | orchestrator | Friday 24 April 2026 06:04:31 +0000 (0:00:01.315) 1:02:12.806 ********** 2026-04-24 06:05:18.813657 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813676 | orchestrator | 2026-04-24 06:05:18.813694 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 06:05:18.813714 | orchestrator | Friday 24 April 2026 06:04:32 +0000 (0:00:01.165) 1:02:13.972 ********** 2026-04-24 06:05:18.813731 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813749 | orchestrator | 2026-04-24 06:05:18.813768 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 06:05:18.813787 | orchestrator | Friday 24 April 2026 06:04:33 +0000 (0:00:01.301) 1:02:15.273 ********** 2026-04-24 06:05:18.813805 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813823 | orchestrator | 2026-04-24 06:05:18.813839 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 06:05:18.813850 | orchestrator | Friday 24 April 2026 06:04:34 +0000 (0:00:01.260) 1:02:16.534 ********** 2026-04-24 06:05:18.813860 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813871 | orchestrator | 2026-04-24 06:05:18.813882 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 06:05:18.813894 | orchestrator | Friday 24 April 2026 06:04:36 +0000 (0:00:01.322) 1:02:17.857 ********** 2026-04-24 06:05:18.813905 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.813915 | orchestrator | 2026-04-24 06:05:18.813927 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 06:05:18.813937 | orchestrator | Friday 24 April 2026 06:04:37 +0000 (0:00:01.353) 1:02:19.210 ********** 2026-04-24 06:05:18.813948 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-24 06:05:18.813959 | orchestrator | 2026-04-24 06:05:18.813970 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 06:05:18.813981 | orchestrator | Friday 24 April 2026 06:04:42 +0000 (0:00:04.775) 1:02:23.986 ********** 2026-04-24 06:05:18.813993 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 06:05:18.814180 | orchestrator | 2026-04-24 06:05:18.814196 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 06:05:18.814207 | orchestrator | Friday 24 April 2026 06:04:43 +0000 (0:00:01.377) 1:02:25.364 ********** 2026-04-24 06:05:18.814221 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-24 06:05:18.814237 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-24 06:05:18.814266 | orchestrator | 2026-04-24 06:05:18.814277 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 06:05:18.814288 | orchestrator | Friday 24 April 2026 06:04:48 +0000 (0:00:05.345) 1:02:30.709 ********** 2026-04-24 06:05:18.814299 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.814310 | orchestrator | 2026-04-24 06:05:18.814320 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 06:05:18.814331 | orchestrator | Friday 24 April 2026 06:04:50 +0000 (0:00:01.289) 1:02:31.998 ********** 2026-04-24 06:05:18.814342 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.814353 | orchestrator | 2026-04-24 06:05:18.814364 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 06:05:18.814399 | orchestrator | Friday 24 April 2026 06:04:51 +0000 (0:00:01.257) 1:02:33.256 ********** 2026-04-24 06:05:18.814411 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.814422 | orchestrator | 2026-04-24 06:05:18.814433 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 06:05:18.814444 | orchestrator | Friday 24 April 2026 06:04:52 +0000 (0:00:01.425) 1:02:34.681 ********** 2026-04-24 06:05:18.814455 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.814466 | orchestrator | 2026-04-24 06:05:18.814477 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 06:05:18.814488 | orchestrator | Friday 24 April 2026 06:04:54 +0000 (0:00:01.336) 1:02:36.017 ********** 2026-04-24 06:05:18.814498 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.814509 | orchestrator | 2026-04-24 06:05:18.814520 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 06:05:18.814531 | orchestrator | Friday 24 April 2026 06:04:55 +0000 (0:00:01.377) 1:02:37.394 ********** 2026-04-24 06:05:18.814684 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:05:18.814706 | orchestrator | 2026-04-24 06:05:18.814723 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 06:05:18.814739 | orchestrator | Friday 24 April 2026 06:04:57 +0000 (0:00:01.433) 1:02:38.828 ********** 2026-04-24 06:05:18.814750 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 06:05:18.814761 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 06:05:18.814773 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 06:05:18.814784 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.814794 | orchestrator | 2026-04-24 06:05:18.814805 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 06:05:18.814826 | orchestrator | Friday 24 April 2026 06:04:58 +0000 (0:00:01.549) 1:02:40.377 ********** 2026-04-24 06:05:18.814837 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 06:05:18.814848 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 06:05:18.814859 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 06:05:18.814870 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.814880 | orchestrator | 2026-04-24 06:05:18.814891 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 06:05:18.814902 | orchestrator | Friday 24 April 2026 06:05:00 +0000 (0:00:02.115) 1:02:42.493 ********** 2026-04-24 06:05:18.814912 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-24 06:05:18.814923 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-24 06:05:18.814934 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-24 06:05:18.814944 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.814955 | orchestrator | 2026-04-24 06:05:18.814966 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 06:05:18.814976 | orchestrator | Friday 24 April 2026 06:05:02 +0000 (0:00:02.070) 1:02:44.563 ********** 2026-04-24 06:05:18.814987 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:05:18.814998 | orchestrator | 2026-04-24 06:05:18.815019 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 06:05:18.815030 | orchestrator | Friday 24 April 2026 06:05:04 +0000 (0:00:01.388) 1:02:45.951 ********** 2026-04-24 06:05:18.815041 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-24 06:05:18.815051 | orchestrator | 2026-04-24 06:05:18.815062 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 06:05:18.815073 | orchestrator | Friday 24 April 2026 06:05:05 +0000 (0:00:01.516) 1:02:47.468 ********** 2026-04-24 06:05:18.815083 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:05:18.815094 | orchestrator | 2026-04-24 06:05:18.815105 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-24 06:05:18.815116 | orchestrator | Friday 24 April 2026 06:05:08 +0000 (0:00:02.323) 1:02:49.791 ********** 2026-04-24 06:05:18.815127 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-3 2026-04-24 06:05:18.815137 | orchestrator | 2026-04-24 06:05:18.815149 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-24 06:05:18.815159 | orchestrator | Friday 24 April 2026 06:05:09 +0000 (0:00:01.686) 1:02:51.478 ********** 2026-04-24 06:05:18.815170 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:05:18.815181 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 06:05:18.815192 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 06:05:18.815203 | orchestrator | 2026-04-24 06:05:18.815214 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-24 06:05:18.815225 | orchestrator | Friday 24 April 2026 06:05:13 +0000 (0:00:03.495) 1:02:54.973 ********** 2026-04-24 06:05:18.815235 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-24 06:05:18.815246 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-24 06:05:18.815257 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:05:18.815268 | orchestrator | 2026-04-24 06:05:18.815278 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-24 06:05:18.815289 | orchestrator | Friday 24 April 2026 06:05:15 +0000 (0:00:02.090) 1:02:57.064 ********** 2026-04-24 06:05:18.815300 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:05:18.815311 | orchestrator | 2026-04-24 06:05:18.815321 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-24 06:05:18.815332 | orchestrator | Friday 24 April 2026 06:05:16 +0000 (0:00:01.242) 1:02:58.306 ********** 2026-04-24 06:05:18.815343 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-3 2026-04-24 06:05:18.815386 | orchestrator | 2026-04-24 06:05:18.815398 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-24 06:05:18.815408 | orchestrator | Friday 24 April 2026 06:05:18 +0000 (0:00:01.629) 1:02:59.935 ********** 2026-04-24 06:05:18.815431 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 06:06:35.048933 | orchestrator | 2026-04-24 06:06:35.049281 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-24 06:06:35.049327 | orchestrator | Friday 24 April 2026 06:05:19 +0000 (0:00:01.773) 1:03:01.709 ********** 2026-04-24 06:06:35.049343 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:06:35.049371 | orchestrator | changed: [testbed-node-3 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-24 06:06:35.049385 | orchestrator | 2026-04-24 06:06:35.049399 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-24 06:06:35.049412 | orchestrator | Friday 24 April 2026 06:05:25 +0000 (0:00:05.929) 1:03:07.638 ********** 2026-04-24 06:06:35.049426 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:06:35.049473 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 06:06:35.049584 | orchestrator | 2026-04-24 06:06:35.049606 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-24 06:06:35.049623 | orchestrator | Friday 24 April 2026 06:05:29 +0000 (0:00:03.109) 1:03:10.747 ********** 2026-04-24 06:06:35.049641 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-24 06:06:35.049659 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:06:35.049695 | orchestrator | 2026-04-24 06:06:35.049715 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-24 06:06:35.049732 | orchestrator | Friday 24 April 2026 06:05:31 +0000 (0:00:02.069) 1:03:12.817 ********** 2026-04-24 06:06:35.049758 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-3 2026-04-24 06:06:35.049769 | orchestrator | 2026-04-24 06:06:35.049780 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-24 06:06:35.049791 | orchestrator | Friday 24 April 2026 06:05:32 +0000 (0:00:01.557) 1:03:14.375 ********** 2026-04-24 06:06:35.049802 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049827 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049839 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049850 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049861 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049871 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:06:35.049883 | orchestrator | 2026-04-24 06:06:35.049894 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-24 06:06:35.049905 | orchestrator | Friday 24 April 2026 06:05:34 +0000 (0:00:01.683) 1:03:16.058 ********** 2026-04-24 06:06:35.049916 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049927 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049938 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049949 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049960 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:06:35.049971 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:06:35.049982 | orchestrator | 2026-04-24 06:06:35.049992 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-24 06:06:35.050003 | orchestrator | Friday 24 April 2026 06:05:36 +0000 (0:00:01.715) 1:03:17.774 ********** 2026-04-24 06:06:35.050068 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:06:35.050095 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:06:35.050112 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:06:35.050131 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:06:35.050151 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:06:35.050182 | orchestrator | 2026-04-24 06:06:35.050239 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-24 06:06:35.050285 | orchestrator | Friday 24 April 2026 06:06:07 +0000 (0:00:31.889) 1:03:49.664 ********** 2026-04-24 06:06:35.050298 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:06:35.050309 | orchestrator | 2026-04-24 06:06:35.050319 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-24 06:06:35.050331 | orchestrator | Friday 24 April 2026 06:06:09 +0000 (0:00:01.109) 1:03:50.774 ********** 2026-04-24 06:06:35.050342 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:06:35.050353 | orchestrator | 2026-04-24 06:06:35.050364 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-24 06:06:35.050374 | orchestrator | Friday 24 April 2026 06:06:10 +0000 (0:00:01.109) 1:03:51.884 ********** 2026-04-24 06:06:35.050385 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-3 2026-04-24 06:06:35.050396 | orchestrator | 2026-04-24 06:06:35.050407 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-24 06:06:35.050418 | orchestrator | Friday 24 April 2026 06:06:11 +0000 (0:00:01.505) 1:03:53.389 ********** 2026-04-24 06:06:35.050428 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-3 2026-04-24 06:06:35.050439 | orchestrator | 2026-04-24 06:06:35.050450 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-24 06:06:35.050461 | orchestrator | Friday 24 April 2026 06:06:13 +0000 (0:00:01.610) 1:03:55.000 ********** 2026-04-24 06:06:35.050472 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:06:35.050482 | orchestrator | 2026-04-24 06:06:35.050493 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-24 06:06:35.050547 | orchestrator | Friday 24 April 2026 06:06:15 +0000 (0:00:02.063) 1:03:57.063 ********** 2026-04-24 06:06:35.050568 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:06:35.050585 | orchestrator | 2026-04-24 06:06:35.050601 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-24 06:06:35.050613 | orchestrator | Friday 24 April 2026 06:06:17 +0000 (0:00:01.966) 1:03:59.030 ********** 2026-04-24 06:06:35.050623 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:06:35.050634 | orchestrator | 2026-04-24 06:06:35.050645 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-24 06:06:35.050656 | orchestrator | Friday 24 April 2026 06:06:19 +0000 (0:00:02.230) 1:04:01.260 ********** 2026-04-24 06:06:35.050667 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-24 06:06:35.050678 | orchestrator | 2026-04-24 06:06:35.050688 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-24 06:06:35.050699 | orchestrator | 2026-04-24 06:06:35.050710 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 06:06:35.050721 | orchestrator | Friday 24 April 2026 06:06:22 +0000 (0:00:02.802) 1:04:04.063 ********** 2026-04-24 06:06:35.050731 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4 2026-04-24 06:06:35.050742 | orchestrator | 2026-04-24 06:06:35.050753 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 06:06:35.050764 | orchestrator | Friday 24 April 2026 06:06:23 +0000 (0:00:01.217) 1:04:05.281 ********** 2026-04-24 06:06:35.050774 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:06:35.050785 | orchestrator | 2026-04-24 06:06:35.050796 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 06:06:35.050806 | orchestrator | Friday 24 April 2026 06:06:25 +0000 (0:00:01.475) 1:04:06.756 ********** 2026-04-24 06:06:35.050817 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:06:35.050828 | orchestrator | 2026-04-24 06:06:35.050839 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 06:06:35.050859 | orchestrator | Friday 24 April 2026 06:06:26 +0000 (0:00:01.108) 1:04:07.864 ********** 2026-04-24 06:06:35.050870 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:06:35.050881 | orchestrator | 2026-04-24 06:06:35.050892 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 06:06:35.050902 | orchestrator | Friday 24 April 2026 06:06:27 +0000 (0:00:01.459) 1:04:09.324 ********** 2026-04-24 06:06:35.050913 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:06:35.050924 | orchestrator | 2026-04-24 06:06:35.050935 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 06:06:35.050945 | orchestrator | Friday 24 April 2026 06:06:28 +0000 (0:00:01.151) 1:04:10.475 ********** 2026-04-24 06:06:35.050956 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:06:35.050967 | orchestrator | 2026-04-24 06:06:35.050978 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 06:06:35.050988 | orchestrator | Friday 24 April 2026 06:06:29 +0000 (0:00:01.176) 1:04:11.652 ********** 2026-04-24 06:06:35.050999 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:06:35.051010 | orchestrator | 2026-04-24 06:06:35.051021 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 06:06:35.051032 | orchestrator | Friday 24 April 2026 06:06:31 +0000 (0:00:01.148) 1:04:12.801 ********** 2026-04-24 06:06:35.051042 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:06:35.051053 | orchestrator | 2026-04-24 06:06:35.051064 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 06:06:35.051075 | orchestrator | Friday 24 April 2026 06:06:32 +0000 (0:00:01.131) 1:04:13.932 ********** 2026-04-24 06:06:35.051086 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:06:35.051096 | orchestrator | 2026-04-24 06:06:35.051107 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 06:06:35.051118 | orchestrator | Friday 24 April 2026 06:06:33 +0000 (0:00:01.136) 1:04:15.069 ********** 2026-04-24 06:06:35.051129 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:06:35.051140 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:06:35.051150 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:06:35.051161 | orchestrator | 2026-04-24 06:06:35.051172 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 06:06:35.051190 | orchestrator | Friday 24 April 2026 06:06:35 +0000 (0:00:01.681) 1:04:16.750 ********** 2026-04-24 06:07:00.112800 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:00.112931 | orchestrator | 2026-04-24 06:07:00.112948 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 06:07:00.112961 | orchestrator | Friday 24 April 2026 06:06:36 +0000 (0:00:01.236) 1:04:17.987 ********** 2026-04-24 06:07:00.112972 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:07:00.112984 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:07:00.112996 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:07:00.113006 | orchestrator | 2026-04-24 06:07:00.113018 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 06:07:00.113028 | orchestrator | Friday 24 April 2026 06:06:39 +0000 (0:00:02.900) 1:04:20.887 ********** 2026-04-24 06:07:00.113040 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 06:07:00.113051 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 06:07:00.113062 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 06:07:00.113073 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.113084 | orchestrator | 2026-04-24 06:07:00.113095 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 06:07:00.113106 | orchestrator | Friday 24 April 2026 06:06:40 +0000 (0:00:01.474) 1:04:22.361 ********** 2026-04-24 06:07:00.113144 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 06:07:00.113205 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 06:07:00.113217 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 06:07:00.113228 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.113239 | orchestrator | 2026-04-24 06:07:00.113250 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 06:07:00.113262 | orchestrator | Friday 24 April 2026 06:06:42 +0000 (0:00:01.960) 1:04:24.322 ********** 2026-04-24 06:07:00.113274 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:00.113288 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:00.113300 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:00.113311 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.113322 | orchestrator | 2026-04-24 06:07:00.113332 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 06:07:00.113343 | orchestrator | Friday 24 April 2026 06:06:43 +0000 (0:00:01.158) 1:04:25.481 ********** 2026-04-24 06:07:00.113373 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 06:06:36.827165', 'end': '2026-04-24 06:06:36.864576', 'delta': '0:00:00.037411', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 06:07:00.113530 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 06:06:37.434819', 'end': '2026-04-24 06:06:37.489266', 'delta': '0:00:00.054447', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 06:07:00.113568 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 06:06:38.014073', 'end': '2026-04-24 06:06:38.062220', 'delta': '0:00:00.048147', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 06:07:00.113580 | orchestrator | 2026-04-24 06:07:00.113592 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 06:07:00.113602 | orchestrator | Friday 24 April 2026 06:06:45 +0000 (0:00:01.234) 1:04:26.716 ********** 2026-04-24 06:07:00.113613 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:00.113624 | orchestrator | 2026-04-24 06:07:00.113635 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 06:07:00.113646 | orchestrator | Friday 24 April 2026 06:06:46 +0000 (0:00:01.328) 1:04:28.044 ********** 2026-04-24 06:07:00.113657 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.113668 | orchestrator | 2026-04-24 06:07:00.113679 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 06:07:00.113690 | orchestrator | Friday 24 April 2026 06:06:47 +0000 (0:00:01.285) 1:04:29.330 ********** 2026-04-24 06:07:00.113701 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:00.113711 | orchestrator | 2026-04-24 06:07:00.113722 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 06:07:00.113733 | orchestrator | Friday 24 April 2026 06:06:48 +0000 (0:00:01.218) 1:04:30.549 ********** 2026-04-24 06:07:00.113744 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-24 06:07:00.113755 | orchestrator | 2026-04-24 06:07:00.113766 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 06:07:00.113777 | orchestrator | Friday 24 April 2026 06:06:50 +0000 (0:00:01.996) 1:04:32.546 ********** 2026-04-24 06:07:00.113787 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:00.113798 | orchestrator | 2026-04-24 06:07:00.113809 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 06:07:00.113820 | orchestrator | Friday 24 April 2026 06:06:52 +0000 (0:00:01.177) 1:04:33.723 ********** 2026-04-24 06:07:00.113830 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.113841 | orchestrator | 2026-04-24 06:07:00.113852 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 06:07:00.113863 | orchestrator | Friday 24 April 2026 06:06:53 +0000 (0:00:01.160) 1:04:34.883 ********** 2026-04-24 06:07:00.113874 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.113884 | orchestrator | 2026-04-24 06:07:00.113895 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 06:07:00.113906 | orchestrator | Friday 24 April 2026 06:06:54 +0000 (0:00:01.216) 1:04:36.100 ********** 2026-04-24 06:07:00.113916 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.113927 | orchestrator | 2026-04-24 06:07:00.113938 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 06:07:00.113949 | orchestrator | Friday 24 April 2026 06:06:55 +0000 (0:00:01.158) 1:04:37.258 ********** 2026-04-24 06:07:00.113959 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.113970 | orchestrator | 2026-04-24 06:07:00.113981 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 06:07:00.113999 | orchestrator | Friday 24 April 2026 06:06:56 +0000 (0:00:01.146) 1:04:38.405 ********** 2026-04-24 06:07:00.114010 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:00.114098 | orchestrator | 2026-04-24 06:07:00.114111 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 06:07:00.114122 | orchestrator | Friday 24 April 2026 06:06:57 +0000 (0:00:01.153) 1:04:39.558 ********** 2026-04-24 06:07:00.114133 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:00.114144 | orchestrator | 2026-04-24 06:07:00.114154 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 06:07:00.114165 | orchestrator | Friday 24 April 2026 06:06:58 +0000 (0:00:01.097) 1:04:40.655 ********** 2026-04-24 06:07:00.114176 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:00.114187 | orchestrator | 2026-04-24 06:07:00.114198 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 06:07:00.114221 | orchestrator | Friday 24 April 2026 06:07:00 +0000 (0:00:01.157) 1:04:41.813 ********** 2026-04-24 06:07:02.628538 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:02.628646 | orchestrator | 2026-04-24 06:07:02.628673 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 06:07:02.628694 | orchestrator | Friday 24 April 2026 06:07:01 +0000 (0:00:01.132) 1:04:42.945 ********** 2026-04-24 06:07:02.628707 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:02.628719 | orchestrator | 2026-04-24 06:07:02.628730 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 06:07:02.628742 | orchestrator | Friday 24 April 2026 06:07:02 +0000 (0:00:01.169) 1:04:44.115 ********** 2026-04-24 06:07:02.628755 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:07:02.628788 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'uuids': ['69ee4aae-da3e-49ce-8e1d-04f23a1ac1f1'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13']}})  2026-04-24 06:07:02.628804 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '36b4f46e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 06:07:02.628818 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1']}})  2026-04-24 06:07:02.628853 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:07:02.628865 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:07:02.628942 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 06:07:02.628957 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:07:02.628975 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF', 'dm-uuid-CRYPT-LUKS2-57e78844afcf406497404f4a368c2f85-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 06:07:02.628987 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:07:02.628999 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'uuids': ['57e78844-afcf-4064-9740-4f4a368c2f85'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF']}})  2026-04-24 06:07:02.629019 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3']}})  2026-04-24 06:07:02.629031 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:07:02.629064 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8aa3c015', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 06:07:04.006658 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:07:04.006752 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:07:04.006794 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13', 'dm-uuid-CRYPT-LUKS2-69ee4aaeda3e49ce8e1d04f23a1ac1f1-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 06:07:04.006811 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:04.006824 | orchestrator | 2026-04-24 06:07:04.006836 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 06:07:04.006848 | orchestrator | Friday 24 April 2026 06:07:03 +0000 (0:00:01.389) 1:04:45.504 ********** 2026-04-24 06:07:04.006861 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:04.006875 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3', 'dm-uuid-LVM-ebJmnmXjwIzoJdvWsFSjhNILTPmzelTEhfxWKnnt3SUPDnUCk1lLvgc3RNL4RR13'], 'uuids': ['69ee4aae-da3e-49ce-8e1d-04f23a1ac1f1'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:04.006950 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd', 'scsi-SQEMU_QEMU_HARDDISK_36b4f46e-172b-4813-855c-03c71aa1e4cd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '36b4f46e', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:04.006983 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YWzuXV-8n2K-NHYv-1GKm-1omZ-eeUs-CiYHN5', 'scsi-0QEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5', 'scsi-SQEMU_QEMU_HARDDISK_f6fcddf9-6575-4466-bfb5-c404028d7cf5'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:04.007008 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:04.007020 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:04.007032 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:04.007050 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:04.007069 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF', 'dm-uuid-CRYPT-LUKS2-57e78844afcf406497404f4a368c2f85-XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467195 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467410 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d69a3297--462a--55c2--bfb1--0665b5ed4cb1-osd--block--d69a3297--462a--55c2--bfb1--0665b5ed4cb1', 'dm-uuid-LVM-0rpScfBFk7fbfLWmprpjbRE1N8SLRJzCXOXkSh7221Go1oo37yp7abVXDJHQInyF'], 'uuids': ['57e78844-afcf-4064-9740-4f4a368c2f85'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f6fcddf9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['XOXkSh-7221-Go1o-o37y-p7ab-VXDJ-HQInyF']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467447 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-KprXpL-soA0-M46u-e2Ay-m2cV-RP3i-0WO3xB', 'scsi-0QEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1', 'scsi-SQEMU_QEMU_HARDDISK_dbcc85a9-d466-4412-94d7-531bcea533f1'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'dbcc85a9', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--33584b54--1593--569e--98b0--f98fe2b18be3-osd--block--33584b54--1593--569e--98b0--f98fe2b18be3']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467530 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467608 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '8aa3c015', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1', 'scsi-SQEMU_QEMU_HARDDISK_8aa3c015-a6b1-410f-8914-592a6a65cb5b-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467644 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467656 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467676 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13', 'dm-uuid-CRYPT-LUKS2-69ee4aaeda3e49ce8e1d04f23a1ac1f1-hfxWKn-nt3S-UPDn-UCk1-lLvg-c3RN-L4RR13'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:07:09.467696 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:09.467718 | orchestrator | 2026-04-24 06:07:09.467737 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 06:07:09.467756 | orchestrator | Friday 24 April 2026 06:07:05 +0000 (0:00:01.560) 1:04:47.065 ********** 2026-04-24 06:07:09.467773 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:09.467791 | orchestrator | 2026-04-24 06:07:09.467809 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 06:07:09.467825 | orchestrator | Friday 24 April 2026 06:07:06 +0000 (0:00:01.472) 1:04:48.538 ********** 2026-04-24 06:07:09.467853 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:09.467870 | orchestrator | 2026-04-24 06:07:09.467887 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 06:07:09.467904 | orchestrator | Friday 24 April 2026 06:07:07 +0000 (0:00:01.133) 1:04:49.672 ********** 2026-04-24 06:07:09.467920 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:09.467936 | orchestrator | 2026-04-24 06:07:09.467953 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 06:07:09.467982 | orchestrator | Friday 24 April 2026 06:07:09 +0000 (0:00:01.501) 1:04:51.173 ********** 2026-04-24 06:07:51.713720 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.713827 | orchestrator | 2026-04-24 06:07:51.713844 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 06:07:51.713858 | orchestrator | Friday 24 April 2026 06:07:10 +0000 (0:00:01.111) 1:04:52.285 ********** 2026-04-24 06:07:51.713869 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.713880 | orchestrator | 2026-04-24 06:07:51.713891 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 06:07:51.713902 | orchestrator | Friday 24 April 2026 06:07:11 +0000 (0:00:01.233) 1:04:53.518 ********** 2026-04-24 06:07:51.713913 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.713925 | orchestrator | 2026-04-24 06:07:51.713937 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 06:07:51.713948 | orchestrator | Friday 24 April 2026 06:07:13 +0000 (0:00:01.201) 1:04:54.720 ********** 2026-04-24 06:07:51.713960 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-24 06:07:51.713972 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-24 06:07:51.713984 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-24 06:07:51.713994 | orchestrator | 2026-04-24 06:07:51.714005 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 06:07:51.714053 | orchestrator | Friday 24 April 2026 06:07:14 +0000 (0:00:01.771) 1:04:56.491 ********** 2026-04-24 06:07:51.714067 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-24 06:07:51.714078 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-24 06:07:51.714089 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-24 06:07:51.714101 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.714111 | orchestrator | 2026-04-24 06:07:51.714122 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 06:07:51.714133 | orchestrator | Friday 24 April 2026 06:07:15 +0000 (0:00:01.176) 1:04:57.668 ********** 2026-04-24 06:07:51.714144 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4 2026-04-24 06:07:51.714157 | orchestrator | 2026-04-24 06:07:51.714169 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 06:07:51.714181 | orchestrator | Friday 24 April 2026 06:07:17 +0000 (0:00:01.171) 1:04:58.839 ********** 2026-04-24 06:07:51.714192 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.714204 | orchestrator | 2026-04-24 06:07:51.714214 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 06:07:51.714225 | orchestrator | Friday 24 April 2026 06:07:18 +0000 (0:00:01.219) 1:05:00.058 ********** 2026-04-24 06:07:51.714238 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.714251 | orchestrator | 2026-04-24 06:07:51.714263 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 06:07:51.714276 | orchestrator | Friday 24 April 2026 06:07:19 +0000 (0:00:01.132) 1:05:01.191 ********** 2026-04-24 06:07:51.714289 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.714302 | orchestrator | 2026-04-24 06:07:51.714315 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 06:07:51.714329 | orchestrator | Friday 24 April 2026 06:07:20 +0000 (0:00:01.291) 1:05:02.483 ********** 2026-04-24 06:07:51.714366 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:51.714379 | orchestrator | 2026-04-24 06:07:51.714392 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 06:07:51.714404 | orchestrator | Friday 24 April 2026 06:07:22 +0000 (0:00:01.236) 1:05:03.720 ********** 2026-04-24 06:07:51.714418 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:07:51.714469 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:07:51.714482 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:07:51.714495 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.714508 | orchestrator | 2026-04-24 06:07:51.714520 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 06:07:51.714533 | orchestrator | Friday 24 April 2026 06:07:23 +0000 (0:00:01.437) 1:05:05.157 ********** 2026-04-24 06:07:51.714545 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:07:51.714558 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:07:51.714571 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:07:51.714583 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.714597 | orchestrator | 2026-04-24 06:07:51.714608 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 06:07:51.714618 | orchestrator | Friday 24 April 2026 06:07:24 +0000 (0:00:01.402) 1:05:06.560 ********** 2026-04-24 06:07:51.714644 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:07:51.714655 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:07:51.714666 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:07:51.714677 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.714688 | orchestrator | 2026-04-24 06:07:51.714698 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 06:07:51.714709 | orchestrator | Friday 24 April 2026 06:07:26 +0000 (0:00:01.465) 1:05:08.025 ********** 2026-04-24 06:07:51.714720 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:51.714730 | orchestrator | 2026-04-24 06:07:51.714741 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 06:07:51.714752 | orchestrator | Friday 24 April 2026 06:07:27 +0000 (0:00:01.175) 1:05:09.201 ********** 2026-04-24 06:07:51.714762 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 06:07:51.714773 | orchestrator | 2026-04-24 06:07:51.714784 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 06:07:51.714795 | orchestrator | Friday 24 April 2026 06:07:28 +0000 (0:00:01.332) 1:05:10.534 ********** 2026-04-24 06:07:51.714823 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:07:51.714834 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:07:51.714845 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:07:51.714856 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 06:07:51.714866 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-24 06:07:51.714877 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 06:07:51.714887 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 06:07:51.714898 | orchestrator | 2026-04-24 06:07:51.714909 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 06:07:51.714920 | orchestrator | Friday 24 April 2026 06:07:31 +0000 (0:00:02.218) 1:05:12.752 ********** 2026-04-24 06:07:51.714930 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:07:51.714941 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:07:51.714952 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:07:51.714971 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 06:07:51.714982 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-24 06:07:51.714993 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-24 06:07:51.715004 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 06:07:51.715014 | orchestrator | 2026-04-24 06:07:51.715025 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-24 06:07:51.715036 | orchestrator | Friday 24 April 2026 06:07:33 +0000 (0:00:02.317) 1:05:15.070 ********** 2026-04-24 06:07:51.715046 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:07:51.715057 | orchestrator | 2026-04-24 06:07:51.715068 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-24 06:07:51.715079 | orchestrator | Friday 24 April 2026 06:07:35 +0000 (0:00:01.967) 1:05:17.038 ********** 2026-04-24 06:07:51.715090 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:07:51.715101 | orchestrator | 2026-04-24 06:07:51.715112 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-24 06:07:51.715122 | orchestrator | Friday 24 April 2026 06:07:37 +0000 (0:00:02.622) 1:05:19.660 ********** 2026-04-24 06:07:51.715133 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:07:51.715144 | orchestrator | 2026-04-24 06:07:51.715155 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 06:07:51.715165 | orchestrator | Friday 24 April 2026 06:07:39 +0000 (0:00:01.924) 1:05:21.584 ********** 2026-04-24 06:07:51.715176 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4 2026-04-24 06:07:51.715187 | orchestrator | 2026-04-24 06:07:51.715198 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 06:07:51.715208 | orchestrator | Friday 24 April 2026 06:07:41 +0000 (0:00:01.344) 1:05:22.929 ********** 2026-04-24 06:07:51.715219 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4 2026-04-24 06:07:51.715230 | orchestrator | 2026-04-24 06:07:51.715240 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 06:07:51.715251 | orchestrator | Friday 24 April 2026 06:07:42 +0000 (0:00:01.147) 1:05:24.077 ********** 2026-04-24 06:07:51.715262 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.715273 | orchestrator | 2026-04-24 06:07:51.715283 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 06:07:51.715294 | orchestrator | Friday 24 April 2026 06:07:43 +0000 (0:00:01.174) 1:05:25.251 ********** 2026-04-24 06:07:51.715305 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:51.715315 | orchestrator | 2026-04-24 06:07:51.715326 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 06:07:51.715337 | orchestrator | Friday 24 April 2026 06:07:45 +0000 (0:00:01.492) 1:05:26.744 ********** 2026-04-24 06:07:51.715348 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:51.715359 | orchestrator | 2026-04-24 06:07:51.715374 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 06:07:51.715385 | orchestrator | Friday 24 April 2026 06:07:46 +0000 (0:00:01.613) 1:05:28.357 ********** 2026-04-24 06:07:51.715396 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:07:51.715407 | orchestrator | 2026-04-24 06:07:51.715418 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 06:07:51.715481 | orchestrator | Friday 24 April 2026 06:07:48 +0000 (0:00:01.573) 1:05:29.931 ********** 2026-04-24 06:07:51.715494 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.715505 | orchestrator | 2026-04-24 06:07:51.715517 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 06:07:51.715535 | orchestrator | Friday 24 April 2026 06:07:49 +0000 (0:00:01.215) 1:05:31.146 ********** 2026-04-24 06:07:51.715546 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.715557 | orchestrator | 2026-04-24 06:07:51.715568 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 06:07:51.715579 | orchestrator | Friday 24 April 2026 06:07:50 +0000 (0:00:01.161) 1:05:32.308 ********** 2026-04-24 06:07:51.715589 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:07:51.715600 | orchestrator | 2026-04-24 06:07:51.715611 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 06:07:51.715629 | orchestrator | Friday 24 April 2026 06:07:51 +0000 (0:00:01.107) 1:05:33.415 ********** 2026-04-24 06:08:32.401344 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.401488 | orchestrator | 2026-04-24 06:08:32.401506 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 06:08:32.401519 | orchestrator | Friday 24 April 2026 06:07:53 +0000 (0:00:01.620) 1:05:35.035 ********** 2026-04-24 06:08:32.401531 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.401543 | orchestrator | 2026-04-24 06:08:32.401554 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 06:08:32.401565 | orchestrator | Friday 24 April 2026 06:07:54 +0000 (0:00:01.563) 1:05:36.599 ********** 2026-04-24 06:08:32.401577 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.401588 | orchestrator | 2026-04-24 06:08:32.401599 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 06:08:32.401611 | orchestrator | Friday 24 April 2026 06:07:55 +0000 (0:00:00.876) 1:05:37.476 ********** 2026-04-24 06:08:32.401621 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.401632 | orchestrator | 2026-04-24 06:08:32.401643 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 06:08:32.401654 | orchestrator | Friday 24 April 2026 06:07:56 +0000 (0:00:00.775) 1:05:38.252 ********** 2026-04-24 06:08:32.401665 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.401676 | orchestrator | 2026-04-24 06:08:32.401687 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 06:08:32.401698 | orchestrator | Friday 24 April 2026 06:07:57 +0000 (0:00:00.828) 1:05:39.081 ********** 2026-04-24 06:08:32.401709 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.401719 | orchestrator | 2026-04-24 06:08:32.401730 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 06:08:32.401742 | orchestrator | Friday 24 April 2026 06:07:58 +0000 (0:00:00.809) 1:05:39.890 ********** 2026-04-24 06:08:32.401753 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.401764 | orchestrator | 2026-04-24 06:08:32.401775 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 06:08:32.401786 | orchestrator | Friday 24 April 2026 06:07:58 +0000 (0:00:00.815) 1:05:40.706 ********** 2026-04-24 06:08:32.401796 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.401807 | orchestrator | 2026-04-24 06:08:32.401818 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 06:08:32.401829 | orchestrator | Friday 24 April 2026 06:07:59 +0000 (0:00:00.804) 1:05:41.511 ********** 2026-04-24 06:08:32.401840 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.401851 | orchestrator | 2026-04-24 06:08:32.401862 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 06:08:32.401873 | orchestrator | Friday 24 April 2026 06:08:00 +0000 (0:00:00.820) 1:05:42.331 ********** 2026-04-24 06:08:32.401884 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.401897 | orchestrator | 2026-04-24 06:08:32.401911 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 06:08:32.401923 | orchestrator | Friday 24 April 2026 06:08:01 +0000 (0:00:00.801) 1:05:43.132 ********** 2026-04-24 06:08:32.401936 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.401957 | orchestrator | 2026-04-24 06:08:32.401977 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 06:08:32.402081 | orchestrator | Friday 24 April 2026 06:08:02 +0000 (0:00:00.839) 1:05:43.972 ********** 2026-04-24 06:08:32.402100 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.402113 | orchestrator | 2026-04-24 06:08:32.402126 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 06:08:32.402139 | orchestrator | Friday 24 April 2026 06:08:03 +0000 (0:00:00.781) 1:05:44.753 ********** 2026-04-24 06:08:32.402152 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402164 | orchestrator | 2026-04-24 06:08:32.402177 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 06:08:32.402190 | orchestrator | Friday 24 April 2026 06:08:03 +0000 (0:00:00.802) 1:05:45.556 ********** 2026-04-24 06:08:32.402202 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402215 | orchestrator | 2026-04-24 06:08:32.402227 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 06:08:32.402241 | orchestrator | Friday 24 April 2026 06:08:04 +0000 (0:00:00.778) 1:05:46.335 ********** 2026-04-24 06:08:32.402252 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402263 | orchestrator | 2026-04-24 06:08:32.402273 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 06:08:32.402284 | orchestrator | Friday 24 April 2026 06:08:05 +0000 (0:00:00.813) 1:05:47.148 ********** 2026-04-24 06:08:32.402295 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402305 | orchestrator | 2026-04-24 06:08:32.402316 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 06:08:32.402341 | orchestrator | Friday 24 April 2026 06:08:06 +0000 (0:00:00.861) 1:05:48.010 ********** 2026-04-24 06:08:32.402352 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402363 | orchestrator | 2026-04-24 06:08:32.402374 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 06:08:32.402412 | orchestrator | Friday 24 April 2026 06:08:07 +0000 (0:00:00.769) 1:05:48.780 ********** 2026-04-24 06:08:32.402424 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402434 | orchestrator | 2026-04-24 06:08:32.402445 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 06:08:32.402456 | orchestrator | Friday 24 April 2026 06:08:07 +0000 (0:00:00.741) 1:05:49.522 ********** 2026-04-24 06:08:32.402467 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402478 | orchestrator | 2026-04-24 06:08:32.402489 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 06:08:32.402501 | orchestrator | Friday 24 April 2026 06:08:08 +0000 (0:00:00.762) 1:05:50.285 ********** 2026-04-24 06:08:32.402512 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402523 | orchestrator | 2026-04-24 06:08:32.402534 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 06:08:32.402544 | orchestrator | Friday 24 April 2026 06:08:09 +0000 (0:00:00.775) 1:05:51.061 ********** 2026-04-24 06:08:32.402555 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402566 | orchestrator | 2026-04-24 06:08:32.402595 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 06:08:32.402607 | orchestrator | Friday 24 April 2026 06:08:10 +0000 (0:00:00.756) 1:05:51.818 ********** 2026-04-24 06:08:32.402618 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402629 | orchestrator | 2026-04-24 06:08:32.402640 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 06:08:32.402651 | orchestrator | Friday 24 April 2026 06:08:10 +0000 (0:00:00.763) 1:05:52.581 ********** 2026-04-24 06:08:32.402661 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402672 | orchestrator | 2026-04-24 06:08:32.402683 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 06:08:32.402694 | orchestrator | Friday 24 April 2026 06:08:11 +0000 (0:00:00.762) 1:05:53.344 ********** 2026-04-24 06:08:32.402705 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402716 | orchestrator | 2026-04-24 06:08:32.402726 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 06:08:32.402747 | orchestrator | Friday 24 April 2026 06:08:12 +0000 (0:00:00.767) 1:05:54.111 ********** 2026-04-24 06:08:32.402758 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.402768 | orchestrator | 2026-04-24 06:08:32.402780 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 06:08:32.402791 | orchestrator | Friday 24 April 2026 06:08:13 +0000 (0:00:01.547) 1:05:55.659 ********** 2026-04-24 06:08:32.402802 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.402812 | orchestrator | 2026-04-24 06:08:32.402823 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 06:08:32.402834 | orchestrator | Friday 24 April 2026 06:08:15 +0000 (0:00:01.947) 1:05:57.606 ********** 2026-04-24 06:08:32.402845 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4 2026-04-24 06:08:32.402857 | orchestrator | 2026-04-24 06:08:32.402868 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 06:08:32.402879 | orchestrator | Friday 24 April 2026 06:08:17 +0000 (0:00:01.269) 1:05:58.876 ********** 2026-04-24 06:08:32.402890 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402901 | orchestrator | 2026-04-24 06:08:32.402911 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 06:08:32.402922 | orchestrator | Friday 24 April 2026 06:08:18 +0000 (0:00:01.166) 1:06:00.043 ********** 2026-04-24 06:08:32.402933 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.402944 | orchestrator | 2026-04-24 06:08:32.402955 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 06:08:32.402966 | orchestrator | Friday 24 April 2026 06:08:19 +0000 (0:00:01.152) 1:06:01.195 ********** 2026-04-24 06:08:32.402976 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 06:08:32.402987 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 06:08:32.402998 | orchestrator | 2026-04-24 06:08:32.403015 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 06:08:32.403034 | orchestrator | Friday 24 April 2026 06:08:21 +0000 (0:00:01.839) 1:06:03.035 ********** 2026-04-24 06:08:32.403054 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.403073 | orchestrator | 2026-04-24 06:08:32.403092 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 06:08:32.403110 | orchestrator | Friday 24 April 2026 06:08:22 +0000 (0:00:01.520) 1:06:04.555 ********** 2026-04-24 06:08:32.403123 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.403133 | orchestrator | 2026-04-24 06:08:32.403144 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 06:08:32.403155 | orchestrator | Friday 24 April 2026 06:08:23 +0000 (0:00:01.155) 1:06:05.711 ********** 2026-04-24 06:08:32.403165 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.403176 | orchestrator | 2026-04-24 06:08:32.403187 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 06:08:32.403198 | orchestrator | Friday 24 April 2026 06:08:24 +0000 (0:00:00.828) 1:06:06.539 ********** 2026-04-24 06:08:32.403209 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.403219 | orchestrator | 2026-04-24 06:08:32.403230 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 06:08:32.403241 | orchestrator | Friday 24 April 2026 06:08:25 +0000 (0:00:00.834) 1:06:07.373 ********** 2026-04-24 06:08:32.403252 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4 2026-04-24 06:08:32.403262 | orchestrator | 2026-04-24 06:08:32.403273 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 06:08:32.403290 | orchestrator | Friday 24 April 2026 06:08:26 +0000 (0:00:01.108) 1:06:08.482 ********** 2026-04-24 06:08:32.403301 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:08:32.403312 | orchestrator | 2026-04-24 06:08:32.403323 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 06:08:32.403342 | orchestrator | Friday 24 April 2026 06:08:29 +0000 (0:00:02.819) 1:06:11.302 ********** 2026-04-24 06:08:32.403353 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 06:08:32.403363 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 06:08:32.403374 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 06:08:32.403417 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.403428 | orchestrator | 2026-04-24 06:08:32.403439 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 06:08:32.403450 | orchestrator | Friday 24 April 2026 06:08:30 +0000 (0:00:01.132) 1:06:12.435 ********** 2026-04-24 06:08:32.403460 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.403471 | orchestrator | 2026-04-24 06:08:32.403482 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 06:08:32.403493 | orchestrator | Friday 24 April 2026 06:08:31 +0000 (0:00:01.110) 1:06:13.545 ********** 2026-04-24 06:08:32.403504 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:08:32.403515 | orchestrator | 2026-04-24 06:08:32.403533 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 06:09:15.274926 | orchestrator | Friday 24 April 2026 06:08:33 +0000 (0:00:01.275) 1:06:14.821 ********** 2026-04-24 06:09:15.275031 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275048 | orchestrator | 2026-04-24 06:09:15.275060 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 06:09:15.275073 | orchestrator | Friday 24 April 2026 06:08:34 +0000 (0:00:01.145) 1:06:15.966 ********** 2026-04-24 06:09:15.275084 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275095 | orchestrator | 2026-04-24 06:09:15.275107 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 06:09:15.275118 | orchestrator | Friday 24 April 2026 06:08:35 +0000 (0:00:01.170) 1:06:17.137 ********** 2026-04-24 06:09:15.275129 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275140 | orchestrator | 2026-04-24 06:09:15.275151 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 06:09:15.275172 | orchestrator | Friday 24 April 2026 06:08:36 +0000 (0:00:00.784) 1:06:17.921 ********** 2026-04-24 06:09:15.275186 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:09:15.275199 | orchestrator | 2026-04-24 06:09:15.275210 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 06:09:15.275221 | orchestrator | Friday 24 April 2026 06:08:38 +0000 (0:00:02.104) 1:06:20.025 ********** 2026-04-24 06:09:15.275232 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:09:15.275243 | orchestrator | 2026-04-24 06:09:15.275254 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 06:09:15.275265 | orchestrator | Friday 24 April 2026 06:08:39 +0000 (0:00:00.777) 1:06:20.802 ********** 2026-04-24 06:09:15.275276 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4 2026-04-24 06:09:15.275287 | orchestrator | 2026-04-24 06:09:15.275298 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 06:09:15.275350 | orchestrator | Friday 24 April 2026 06:08:40 +0000 (0:00:01.123) 1:06:21.926 ********** 2026-04-24 06:09:15.275362 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275373 | orchestrator | 2026-04-24 06:09:15.275384 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 06:09:15.275395 | orchestrator | Friday 24 April 2026 06:08:41 +0000 (0:00:01.165) 1:06:23.091 ********** 2026-04-24 06:09:15.275406 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275417 | orchestrator | 2026-04-24 06:09:15.275428 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 06:09:15.275439 | orchestrator | Friday 24 April 2026 06:08:42 +0000 (0:00:01.137) 1:06:24.229 ********** 2026-04-24 06:09:15.275452 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275465 | orchestrator | 2026-04-24 06:09:15.275503 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 06:09:15.275518 | orchestrator | Friday 24 April 2026 06:08:43 +0000 (0:00:01.135) 1:06:25.364 ********** 2026-04-24 06:09:15.275531 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275542 | orchestrator | 2026-04-24 06:09:15.275554 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 06:09:15.275564 | orchestrator | Friday 24 April 2026 06:08:44 +0000 (0:00:01.209) 1:06:26.574 ********** 2026-04-24 06:09:15.275575 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275586 | orchestrator | 2026-04-24 06:09:15.275597 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 06:09:15.275608 | orchestrator | Friday 24 April 2026 06:08:46 +0000 (0:00:01.165) 1:06:27.739 ********** 2026-04-24 06:09:15.275619 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275630 | orchestrator | 2026-04-24 06:09:15.275641 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 06:09:15.275652 | orchestrator | Friday 24 April 2026 06:08:47 +0000 (0:00:01.199) 1:06:28.938 ********** 2026-04-24 06:09:15.275663 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275673 | orchestrator | 2026-04-24 06:09:15.275685 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 06:09:15.275696 | orchestrator | Friday 24 April 2026 06:08:48 +0000 (0:00:01.165) 1:06:30.104 ********** 2026-04-24 06:09:15.275707 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.275717 | orchestrator | 2026-04-24 06:09:15.275728 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 06:09:15.275739 | orchestrator | Friday 24 April 2026 06:08:49 +0000 (0:00:01.129) 1:06:31.233 ********** 2026-04-24 06:09:15.275750 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:09:15.275761 | orchestrator | 2026-04-24 06:09:15.275772 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 06:09:15.275802 | orchestrator | Friday 24 April 2026 06:08:50 +0000 (0:00:00.813) 1:06:32.046 ********** 2026-04-24 06:09:15.275817 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4 2026-04-24 06:09:15.275829 | orchestrator | 2026-04-24 06:09:15.275841 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 06:09:15.275852 | orchestrator | Friday 24 April 2026 06:08:51 +0000 (0:00:01.150) 1:06:33.197 ********** 2026-04-24 06:09:15.275863 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-24 06:09:15.275876 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-24 06:09:15.275887 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-24 06:09:15.275898 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-24 06:09:15.275909 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-24 06:09:15.275920 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-24 06:09:15.275931 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-24 06:09:15.275941 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-24 06:09:15.275953 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 06:09:15.275964 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 06:09:15.275975 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 06:09:15.276003 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 06:09:15.276014 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 06:09:15.276025 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 06:09:15.276036 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-24 06:09:15.276047 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-24 06:09:15.276058 | orchestrator | 2026-04-24 06:09:15.276069 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 06:09:15.276088 | orchestrator | Friday 24 April 2026 06:08:57 +0000 (0:00:06.196) 1:06:39.394 ********** 2026-04-24 06:09:15.276107 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4 2026-04-24 06:09:15.276123 | orchestrator | 2026-04-24 06:09:15.276134 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 06:09:15.276145 | orchestrator | Friday 24 April 2026 06:08:58 +0000 (0:00:01.159) 1:06:40.553 ********** 2026-04-24 06:09:15.276156 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:09:15.276168 | orchestrator | 2026-04-24 06:09:15.276179 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 06:09:15.276190 | orchestrator | Friday 24 April 2026 06:09:00 +0000 (0:00:01.541) 1:06:42.095 ********** 2026-04-24 06:09:15.276201 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:09:15.276212 | orchestrator | 2026-04-24 06:09:15.276223 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 06:09:15.276234 | orchestrator | Friday 24 April 2026 06:09:02 +0000 (0:00:01.704) 1:06:43.800 ********** 2026-04-24 06:09:15.276244 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276255 | orchestrator | 2026-04-24 06:09:15.276266 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 06:09:15.276277 | orchestrator | Friday 24 April 2026 06:09:02 +0000 (0:00:00.752) 1:06:44.553 ********** 2026-04-24 06:09:15.276288 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276298 | orchestrator | 2026-04-24 06:09:15.276330 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 06:09:15.276341 | orchestrator | Friday 24 April 2026 06:09:03 +0000 (0:00:00.841) 1:06:45.394 ********** 2026-04-24 06:09:15.276356 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276375 | orchestrator | 2026-04-24 06:09:15.276389 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 06:09:15.276406 | orchestrator | Friday 24 April 2026 06:09:04 +0000 (0:00:00.829) 1:06:46.224 ********** 2026-04-24 06:09:15.276417 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276428 | orchestrator | 2026-04-24 06:09:15.276439 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 06:09:15.276450 | orchestrator | Friday 24 April 2026 06:09:05 +0000 (0:00:00.813) 1:06:47.037 ********** 2026-04-24 06:09:15.276461 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276472 | orchestrator | 2026-04-24 06:09:15.276483 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 06:09:15.276494 | orchestrator | Friday 24 April 2026 06:09:06 +0000 (0:00:00.765) 1:06:47.802 ********** 2026-04-24 06:09:15.276506 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276525 | orchestrator | 2026-04-24 06:09:15.276537 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 06:09:15.276548 | orchestrator | Friday 24 April 2026 06:09:06 +0000 (0:00:00.795) 1:06:48.598 ********** 2026-04-24 06:09:15.276559 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276570 | orchestrator | 2026-04-24 06:09:15.276581 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 06:09:15.276592 | orchestrator | Friday 24 April 2026 06:09:07 +0000 (0:00:00.840) 1:06:49.439 ********** 2026-04-24 06:09:15.276602 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276613 | orchestrator | 2026-04-24 06:09:15.276624 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 06:09:15.276635 | orchestrator | Friday 24 April 2026 06:09:08 +0000 (0:00:00.875) 1:06:50.314 ********** 2026-04-24 06:09:15.276646 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276657 | orchestrator | 2026-04-24 06:09:15.276673 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 06:09:15.276691 | orchestrator | Friday 24 April 2026 06:09:09 +0000 (0:00:00.774) 1:06:51.089 ********** 2026-04-24 06:09:15.276702 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276713 | orchestrator | 2026-04-24 06:09:15.276723 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 06:09:15.276734 | orchestrator | Friday 24 April 2026 06:09:10 +0000 (0:00:00.766) 1:06:51.856 ********** 2026-04-24 06:09:15.276745 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:15.276756 | orchestrator | 2026-04-24 06:09:15.276767 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 06:09:15.276777 | orchestrator | Friday 24 April 2026 06:09:10 +0000 (0:00:00.795) 1:06:52.651 ********** 2026-04-24 06:09:15.276788 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-24 06:09:15.276799 | orchestrator | 2026-04-24 06:09:15.276810 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 06:09:15.276820 | orchestrator | Friday 24 April 2026 06:09:15 +0000 (0:00:04.127) 1:06:56.779 ********** 2026-04-24 06:09:15.276832 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:09:15.276843 | orchestrator | 2026-04-24 06:09:15.276861 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 06:09:56.285917 | orchestrator | Friday 24 April 2026 06:09:15 +0000 (0:00:00.837) 1:06:57.616 ********** 2026-04-24 06:09:56.286816 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-24 06:09:56.286862 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-24 06:09:56.286877 | orchestrator | 2026-04-24 06:09:56.286889 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 06:09:56.286901 | orchestrator | Friday 24 April 2026 06:09:20 +0000 (0:00:04.423) 1:07:02.040 ********** 2026-04-24 06:09:56.286913 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.286925 | orchestrator | 2026-04-24 06:09:56.286936 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 06:09:56.286947 | orchestrator | Friday 24 April 2026 06:09:21 +0000 (0:00:00.761) 1:07:02.801 ********** 2026-04-24 06:09:56.286958 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.286969 | orchestrator | 2026-04-24 06:09:56.286981 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 06:09:56.286994 | orchestrator | Friday 24 April 2026 06:09:22 +0000 (0:00:01.260) 1:07:04.062 ********** 2026-04-24 06:09:56.287005 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.287016 | orchestrator | 2026-04-24 06:09:56.287027 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 06:09:56.287038 | orchestrator | Friday 24 April 2026 06:09:23 +0000 (0:00:00.809) 1:07:04.872 ********** 2026-04-24 06:09:56.287049 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.287060 | orchestrator | 2026-04-24 06:09:56.287071 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 06:09:56.287082 | orchestrator | Friday 24 April 2026 06:09:24 +0000 (0:00:00.843) 1:07:05.715 ********** 2026-04-24 06:09:56.287093 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.287104 | orchestrator | 2026-04-24 06:09:56.287115 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 06:09:56.287154 | orchestrator | Friday 24 April 2026 06:09:24 +0000 (0:00:00.835) 1:07:06.550 ********** 2026-04-24 06:09:56.287166 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:09:56.287178 | orchestrator | 2026-04-24 06:09:56.287189 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 06:09:56.287200 | orchestrator | Friday 24 April 2026 06:09:25 +0000 (0:00:00.895) 1:07:07.446 ********** 2026-04-24 06:09:56.287210 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:09:56.287222 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:09:56.287232 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:09:56.287243 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.287281 | orchestrator | 2026-04-24 06:09:56.287292 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 06:09:56.287303 | orchestrator | Friday 24 April 2026 06:09:26 +0000 (0:00:01.060) 1:07:08.506 ********** 2026-04-24 06:09:56.287313 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:09:56.287324 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:09:56.287335 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:09:56.287345 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.287356 | orchestrator | 2026-04-24 06:09:56.287367 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 06:09:56.287378 | orchestrator | Friday 24 April 2026 06:09:27 +0000 (0:00:01.120) 1:07:09.627 ********** 2026-04-24 06:09:56.287388 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-24 06:09:56.287399 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-24 06:09:56.287424 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-24 06:09:56.287436 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.287446 | orchestrator | 2026-04-24 06:09:56.287457 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 06:09:56.287468 | orchestrator | Friday 24 April 2026 06:09:28 +0000 (0:00:01.074) 1:07:10.701 ********** 2026-04-24 06:09:56.287479 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:09:56.287490 | orchestrator | 2026-04-24 06:09:56.287500 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 06:09:56.287511 | orchestrator | Friday 24 April 2026 06:09:29 +0000 (0:00:00.801) 1:07:11.502 ********** 2026-04-24 06:09:56.287522 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-24 06:09:56.287533 | orchestrator | 2026-04-24 06:09:56.287544 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 06:09:56.287555 | orchestrator | Friday 24 April 2026 06:09:30 +0000 (0:00:00.965) 1:07:12.468 ********** 2026-04-24 06:09:56.287565 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:09:56.287576 | orchestrator | 2026-04-24 06:09:56.287587 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-24 06:09:56.287597 | orchestrator | Friday 24 April 2026 06:09:32 +0000 (0:00:01.385) 1:07:13.854 ********** 2026-04-24 06:09:56.287609 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-4 2026-04-24 06:09:56.287619 | orchestrator | 2026-04-24 06:09:56.287652 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-24 06:09:56.287663 | orchestrator | Friday 24 April 2026 06:09:33 +0000 (0:00:01.283) 1:07:15.138 ********** 2026-04-24 06:09:56.287674 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:09:56.287685 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 06:09:56.287697 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 06:09:56.287708 | orchestrator | 2026-04-24 06:09:56.287718 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-24 06:09:56.287729 | orchestrator | Friday 24 April 2026 06:09:36 +0000 (0:00:03.305) 1:07:18.444 ********** 2026-04-24 06:09:56.287740 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-24 06:09:56.287759 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-24 06:09:56.287770 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:09:56.287781 | orchestrator | 2026-04-24 06:09:56.287792 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-24 06:09:56.287803 | orchestrator | Friday 24 April 2026 06:09:38 +0000 (0:00:02.004) 1:07:20.448 ********** 2026-04-24 06:09:56.287813 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.287824 | orchestrator | 2026-04-24 06:09:56.287835 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-24 06:09:56.287846 | orchestrator | Friday 24 April 2026 06:09:39 +0000 (0:00:00.782) 1:07:21.231 ********** 2026-04-24 06:09:56.287856 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-4 2026-04-24 06:09:56.287869 | orchestrator | 2026-04-24 06:09:56.287879 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-24 06:09:56.287890 | orchestrator | Friday 24 April 2026 06:09:40 +0000 (0:00:01.120) 1:07:22.351 ********** 2026-04-24 06:09:56.287901 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:09:56.287913 | orchestrator | 2026-04-24 06:09:56.287924 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-24 06:09:56.287935 | orchestrator | Friday 24 April 2026 06:09:42 +0000 (0:00:01.675) 1:07:24.027 ********** 2026-04-24 06:09:56.287946 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:09:56.288005 | orchestrator | changed: [testbed-node-4 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-24 06:09:56.288019 | orchestrator | 2026-04-24 06:09:56.288030 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-24 06:09:56.288041 | orchestrator | Friday 24 April 2026 06:09:47 +0000 (0:00:05.259) 1:07:29.287 ********** 2026-04-24 06:09:56.288051 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:09:56.288062 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 06:09:56.288073 | orchestrator | 2026-04-24 06:09:56.288083 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-24 06:09:56.288094 | orchestrator | Friday 24 April 2026 06:09:50 +0000 (0:00:03.157) 1:07:32.444 ********** 2026-04-24 06:09:56.288105 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-24 06:09:56.288116 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:09:56.288158 | orchestrator | 2026-04-24 06:09:56.288170 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-24 06:09:56.288181 | orchestrator | Friday 24 April 2026 06:09:52 +0000 (0:00:01.690) 1:07:34.135 ********** 2026-04-24 06:09:56.288192 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-4 2026-04-24 06:09:56.288203 | orchestrator | 2026-04-24 06:09:56.288214 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-24 06:09:56.288224 | orchestrator | Friday 24 April 2026 06:09:53 +0000 (0:00:01.228) 1:07:35.363 ********** 2026-04-24 06:09:56.288236 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:09:56.288268 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:09:56.288286 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:09:56.288298 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:09:56.288309 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:09:56.288327 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:09:56.288338 | orchestrator | 2026-04-24 06:09:56.288349 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-24 06:09:56.288360 | orchestrator | Friday 24 April 2026 06:09:55 +0000 (0:00:02.207) 1:07:37.571 ********** 2026-04-24 06:09:56.288371 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:09:56.288382 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:09:56.288393 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:09:56.288411 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:11:04.302116 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:11:04.302253 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:11:04.302271 | orchestrator | 2026-04-24 06:11:04.302284 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-24 06:11:04.302297 | orchestrator | Friday 24 April 2026 06:09:57 +0000 (0:00:01.590) 1:07:39.161 ********** 2026-04-24 06:11:04.302309 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:11:04.302322 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:11:04.302333 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:11:04.302345 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:11:04.302357 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:11:04.302368 | orchestrator | 2026-04-24 06:11:04.302380 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-24 06:11:04.302391 | orchestrator | Friday 24 April 2026 06:10:29 +0000 (0:00:31.867) 1:08:11.029 ********** 2026-04-24 06:11:04.302402 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:11:04.302413 | orchestrator | 2026-04-24 06:11:04.302424 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-24 06:11:04.302435 | orchestrator | Friday 24 April 2026 06:10:30 +0000 (0:00:00.789) 1:08:11.818 ********** 2026-04-24 06:11:04.302446 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:11:04.302456 | orchestrator | 2026-04-24 06:11:04.302467 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-24 06:11:04.302478 | orchestrator | Friday 24 April 2026 06:10:30 +0000 (0:00:00.803) 1:08:12.622 ********** 2026-04-24 06:11:04.302489 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-4 2026-04-24 06:11:04.302501 | orchestrator | 2026-04-24 06:11:04.302512 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-24 06:11:04.302523 | orchestrator | Friday 24 April 2026 06:10:31 +0000 (0:00:01.087) 1:08:13.709 ********** 2026-04-24 06:11:04.302534 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-4 2026-04-24 06:11:04.302546 | orchestrator | 2026-04-24 06:11:04.302557 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-24 06:11:04.302568 | orchestrator | Friday 24 April 2026 06:10:33 +0000 (0:00:01.159) 1:08:14.869 ********** 2026-04-24 06:11:04.302604 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:11:04.302617 | orchestrator | 2026-04-24 06:11:04.302630 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-24 06:11:04.302643 | orchestrator | Friday 24 April 2026 06:10:35 +0000 (0:00:02.030) 1:08:16.900 ********** 2026-04-24 06:11:04.302655 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:11:04.302668 | orchestrator | 2026-04-24 06:11:04.302681 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-24 06:11:04.302694 | orchestrator | Friday 24 April 2026 06:10:37 +0000 (0:00:01.984) 1:08:18.885 ********** 2026-04-24 06:11:04.302721 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:11:04.302734 | orchestrator | 2026-04-24 06:11:04.302748 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-24 06:11:04.302761 | orchestrator | Friday 24 April 2026 06:10:39 +0000 (0:00:02.213) 1:08:21.098 ********** 2026-04-24 06:11:04.302774 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-24 06:11:04.302787 | orchestrator | 2026-04-24 06:11:04.302814 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-24 06:11:04.302827 | orchestrator | 2026-04-24 06:11:04.302841 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 06:11:04.302854 | orchestrator | Friday 24 April 2026 06:10:42 +0000 (0:00:03.156) 1:08:24.255 ********** 2026-04-24 06:11:04.302867 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-5 2026-04-24 06:11:04.302881 | orchestrator | 2026-04-24 06:11:04.302892 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-24 06:11:04.302903 | orchestrator | Friday 24 April 2026 06:10:43 +0000 (0:00:01.132) 1:08:25.388 ********** 2026-04-24 06:11:04.302913 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:04.302924 | orchestrator | 2026-04-24 06:11:04.302935 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-24 06:11:04.302946 | orchestrator | Friday 24 April 2026 06:10:45 +0000 (0:00:01.504) 1:08:26.893 ********** 2026-04-24 06:11:04.302956 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:04.302967 | orchestrator | 2026-04-24 06:11:04.302978 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 06:11:04.302989 | orchestrator | Friday 24 April 2026 06:10:46 +0000 (0:00:01.126) 1:08:28.019 ********** 2026-04-24 06:11:04.303000 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:04.303011 | orchestrator | 2026-04-24 06:11:04.303022 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 06:11:04.303033 | orchestrator | Friday 24 April 2026 06:10:47 +0000 (0:00:01.420) 1:08:29.439 ********** 2026-04-24 06:11:04.303044 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:04.303055 | orchestrator | 2026-04-24 06:11:04.303083 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-24 06:11:04.303094 | orchestrator | Friday 24 April 2026 06:10:48 +0000 (0:00:01.156) 1:08:30.595 ********** 2026-04-24 06:11:04.303105 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:04.303116 | orchestrator | 2026-04-24 06:11:04.303153 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-24 06:11:04.303165 | orchestrator | Friday 24 April 2026 06:10:50 +0000 (0:00:01.140) 1:08:31.736 ********** 2026-04-24 06:11:04.303192 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:04.303204 | orchestrator | 2026-04-24 06:11:04.303214 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-24 06:11:04.303225 | orchestrator | Friday 24 April 2026 06:10:51 +0000 (0:00:01.166) 1:08:32.902 ********** 2026-04-24 06:11:04.303236 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:04.303247 | orchestrator | 2026-04-24 06:11:04.303258 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-24 06:11:04.303270 | orchestrator | Friday 24 April 2026 06:10:52 +0000 (0:00:01.167) 1:08:34.070 ********** 2026-04-24 06:11:04.303281 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:04.303301 | orchestrator | 2026-04-24 06:11:04.303312 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-24 06:11:04.303323 | orchestrator | Friday 24 April 2026 06:10:53 +0000 (0:00:01.281) 1:08:35.352 ********** 2026-04-24 06:11:04.303334 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:11:04.303345 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:11:04.303356 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:11:04.303367 | orchestrator | 2026-04-24 06:11:04.303377 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-24 06:11:04.303388 | orchestrator | Friday 24 April 2026 06:10:55 +0000 (0:00:02.106) 1:08:37.458 ********** 2026-04-24 06:11:04.303399 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:04.303410 | orchestrator | 2026-04-24 06:11:04.303421 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-24 06:11:04.303432 | orchestrator | Friday 24 April 2026 06:10:57 +0000 (0:00:01.733) 1:08:39.192 ********** 2026-04-24 06:11:04.303443 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:11:04.303453 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:11:04.303464 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:11:04.303475 | orchestrator | 2026-04-24 06:11:04.303486 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-24 06:11:04.303497 | orchestrator | Friday 24 April 2026 06:11:01 +0000 (0:00:03.615) 1:08:42.807 ********** 2026-04-24 06:11:04.303507 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 06:11:04.303519 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 06:11:04.303529 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 06:11:04.303540 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:04.303551 | orchestrator | 2026-04-24 06:11:04.303562 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-24 06:11:04.303573 | orchestrator | Friday 24 April 2026 06:11:02 +0000 (0:00:01.465) 1:08:44.273 ********** 2026-04-24 06:11:04.303586 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-24 06:11:04.303600 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-24 06:11:04.303616 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-24 06:11:04.303628 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:04.303639 | orchestrator | 2026-04-24 06:11:04.303650 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-24 06:11:04.303662 | orchestrator | Friday 24 April 2026 06:11:04 +0000 (0:00:01.658) 1:08:45.931 ********** 2026-04-24 06:11:04.303683 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:04.303714 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:24.158804 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:24.158901 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:24.158915 | orchestrator | 2026-04-24 06:11:24.158926 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-24 06:11:24.158936 | orchestrator | Friday 24 April 2026 06:11:05 +0000 (0:00:01.189) 1:08:47.120 ********** 2026-04-24 06:11:24.158948 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '720ea55c4301', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-24 06:10:58.656568', 'end': '2026-04-24 06:10:58.704921', 'delta': '0:00:00.048353', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['720ea55c4301'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-24 06:11:24.158961 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '95908a2faae5', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-24 06:10:59.217295', 'end': '2026-04-24 06:10:59.278271', 'delta': '0:00:00.060976', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['95908a2faae5'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-24 06:11:24.158971 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'b915fa5df795', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-24 06:10:59.824856', 'end': '2026-04-24 06:10:59.870430', 'delta': '0:00:00.045574', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['b915fa5df795'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-24 06:11:24.158980 | orchestrator | 2026-04-24 06:11:24.159004 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-24 06:11:24.159014 | orchestrator | Friday 24 April 2026 06:11:06 +0000 (0:00:01.197) 1:08:48.318 ********** 2026-04-24 06:11:24.159023 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:24.159032 | orchestrator | 2026-04-24 06:11:24.159041 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-24 06:11:24.159050 | orchestrator | Friday 24 April 2026 06:11:07 +0000 (0:00:01.314) 1:08:49.632 ********** 2026-04-24 06:11:24.159058 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:24.159087 | orchestrator | 2026-04-24 06:11:24.159097 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-24 06:11:24.159105 | orchestrator | Friday 24 April 2026 06:11:09 +0000 (0:00:01.259) 1:08:50.892 ********** 2026-04-24 06:11:24.159114 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:24.159122 | orchestrator | 2026-04-24 06:11:24.159131 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-24 06:11:24.159139 | orchestrator | Friday 24 April 2026 06:11:10 +0000 (0:00:01.220) 1:08:52.112 ********** 2026-04-24 06:11:24.159195 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 06:11:24.159204 | orchestrator | 2026-04-24 06:11:24.159213 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 06:11:24.159221 | orchestrator | Friday 24 April 2026 06:11:12 +0000 (0:00:01.963) 1:08:54.076 ********** 2026-04-24 06:11:24.159230 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:24.159239 | orchestrator | 2026-04-24 06:11:24.159247 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-24 06:11:24.159256 | orchestrator | Friday 24 April 2026 06:11:13 +0000 (0:00:01.130) 1:08:55.207 ********** 2026-04-24 06:11:24.159279 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:24.159289 | orchestrator | 2026-04-24 06:11:24.159297 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-24 06:11:24.159306 | orchestrator | Friday 24 April 2026 06:11:14 +0000 (0:00:01.117) 1:08:56.324 ********** 2026-04-24 06:11:24.159340 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:24.159349 | orchestrator | 2026-04-24 06:11:24.159357 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-24 06:11:24.159366 | orchestrator | Friday 24 April 2026 06:11:15 +0000 (0:00:01.246) 1:08:57.571 ********** 2026-04-24 06:11:24.159375 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:24.159383 | orchestrator | 2026-04-24 06:11:24.159392 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-24 06:11:24.159401 | orchestrator | Friday 24 April 2026 06:11:17 +0000 (0:00:01.167) 1:08:58.738 ********** 2026-04-24 06:11:24.159409 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:24.159418 | orchestrator | 2026-04-24 06:11:24.159427 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-24 06:11:24.159435 | orchestrator | Friday 24 April 2026 06:11:18 +0000 (0:00:01.223) 1:08:59.961 ********** 2026-04-24 06:11:24.159444 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:24.159453 | orchestrator | 2026-04-24 06:11:24.159462 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-24 06:11:24.159471 | orchestrator | Friday 24 April 2026 06:11:19 +0000 (0:00:01.180) 1:09:01.142 ********** 2026-04-24 06:11:24.159479 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:24.159488 | orchestrator | 2026-04-24 06:11:24.159497 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-24 06:11:24.159505 | orchestrator | Friday 24 April 2026 06:11:20 +0000 (0:00:01.142) 1:09:02.284 ********** 2026-04-24 06:11:24.159514 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:24.159522 | orchestrator | 2026-04-24 06:11:24.159531 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-24 06:11:24.159540 | orchestrator | Friday 24 April 2026 06:11:21 +0000 (0:00:01.146) 1:09:03.431 ********** 2026-04-24 06:11:24.159548 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:24.159557 | orchestrator | 2026-04-24 06:11:24.159566 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-24 06:11:24.159575 | orchestrator | Friday 24 April 2026 06:11:22 +0000 (0:00:01.136) 1:09:04.567 ********** 2026-04-24 06:11:24.159583 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:24.159592 | orchestrator | 2026-04-24 06:11:24.159600 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-24 06:11:24.159609 | orchestrator | Friday 24 April 2026 06:11:24 +0000 (0:00:01.164) 1:09:05.732 ********** 2026-04-24 06:11:24.159618 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:11:24.159636 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'uuids': ['6d348d92-84de-4a0c-bfda-a8ce4c95c396'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve']}})  2026-04-24 06:11:24.159652 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '076ca587', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 06:11:24.159670 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71']}})  2026-04-24 06:11:24.311362 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:11:24.311458 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:11:24.311475 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-04-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-24 06:11:24.311529 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:11:24.311553 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7', 'dm-uuid-CRYPT-LUKS2-99c37d5f37cf4f86bc5baee17726ca8d-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 06:11:24.311580 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:11:24.311593 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'uuids': ['99c37d5f-37cf-4f86-bc5b-aee17726ca8d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7']}})  2026-04-24 06:11:24.311624 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f']}})  2026-04-24 06:11:24.311638 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:11:24.311660 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '457a59b4', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-24 06:11:24.311683 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:11:24.311695 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-24 06:11:24.311714 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve', 'dm-uuid-CRYPT-LUKS2-6d348d9284de4a0cbfdaa8ce4c95c396-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-24 06:11:25.654097 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:25.654255 | orchestrator | 2026-04-24 06:11:25.654272 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-24 06:11:25.654285 | orchestrator | Friday 24 April 2026 06:11:25 +0000 (0:00:01.416) 1:09:07.148 ********** 2026-04-24 06:11:25.654300 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654340 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f', 'dm-uuid-LVM-WU0GQGJBGzbGN1T2uMZaQatyqKqXP2q1qoTCm2ZjmyUegIa9m405P7ZwEnMqDJve'], 'uuids': ['6d348d92-84de-4a0c-bfda-a8ce4c95c396'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654367 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229', 'scsi-SQEMU_QEMU_HARDDISK_076ca587-f8dc-4c3d-b6bc-5e82e8686229'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '076ca587', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654380 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-WOcz9x-mZgc-rOjv-D7OW-QjIT-Tl8H-t3vnbQ', 'scsi-0QEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d', 'scsi-SQEMU_QEMU_HARDDISK_67f938a5-276d-4b3e-96c0-2eb342d0722d'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654413 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654426 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654446 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-24-01-42-04-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654457 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654474 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7', 'dm-uuid-CRYPT-LUKS2-99c37d5f37cf4f86bc5baee17726ca8d-1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654486 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:25.654504 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--010e5db2--c467--553c--8ec0--8c3d6c1ddd71-osd--block--010e5db2--c467--553c--8ec0--8c3d6c1ddd71', 'dm-uuid-LVM-CCxci3b5mnY0MvBtYASzqde8wLNku6ea1vCWs1zckTONTdpbvS2P8bXDQRYQBHJ7'], 'uuids': ['99c37d5f-37cf-4f86-bc5b-aee17726ca8d'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '67f938a5', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['1vCWs1-zckT-ONTd-pbvS-2P8b-XDQR-YQBHJ7']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:37.884320 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-JX2pXe-CagC-J59F-BTNa-iSSc-JZ4Z-9rgglF', 'scsi-0QEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025', 'scsi-SQEMU_QEMU_HARDDISK_730aee50-bba4-43d1-8d84-d1615bb19025'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '730aee50', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--91b687e8--7bed--5064--bb30--d809c43c423f-osd--block--91b687e8--7bed--5064--bb30--d809c43c423f']}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:37.884496 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:37.884535 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '457a59b4', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1', 'scsi-SQEMU_QEMU_HARDDISK_457a59b4-1b41-430f-abbe-5f9506edbd5c-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:37.884571 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:37.884593 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:37.884606 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve', 'dm-uuid-CRYPT-LUKS2-6d348d9284de4a0cbfdaa8ce4c95c396-qoTCm2-Zjmy-UegI-a9m4-05P7-ZwEn-MqDJve'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-24 06:11:37.884619 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:37.884633 | orchestrator | 2026-04-24 06:11:37.884646 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-24 06:11:37.884659 | orchestrator | Friday 24 April 2026 06:11:26 +0000 (0:00:01.411) 1:09:08.560 ********** 2026-04-24 06:11:37.884670 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:37.884682 | orchestrator | 2026-04-24 06:11:37.884693 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-24 06:11:37.884704 | orchestrator | Friday 24 April 2026 06:11:28 +0000 (0:00:01.461) 1:09:10.021 ********** 2026-04-24 06:11:37.884715 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:37.884726 | orchestrator | 2026-04-24 06:11:37.884737 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 06:11:37.884753 | orchestrator | Friday 24 April 2026 06:11:29 +0000 (0:00:01.164) 1:09:11.186 ********** 2026-04-24 06:11:37.884765 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:11:37.884776 | orchestrator | 2026-04-24 06:11:37.884787 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 06:11:37.884798 | orchestrator | Friday 24 April 2026 06:11:31 +0000 (0:00:01.526) 1:09:12.713 ********** 2026-04-24 06:11:37.884809 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:37.884820 | orchestrator | 2026-04-24 06:11:37.884833 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-24 06:11:37.884845 | orchestrator | Friday 24 April 2026 06:11:32 +0000 (0:00:01.156) 1:09:13.870 ********** 2026-04-24 06:11:37.884858 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:37.884871 | orchestrator | 2026-04-24 06:11:37.884884 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-24 06:11:37.884896 | orchestrator | Friday 24 April 2026 06:11:33 +0000 (0:00:01.241) 1:09:15.112 ********** 2026-04-24 06:11:37.884909 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:37.884922 | orchestrator | 2026-04-24 06:11:37.884933 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-24 06:11:37.884944 | orchestrator | Friday 24 April 2026 06:11:34 +0000 (0:00:01.224) 1:09:16.336 ********** 2026-04-24 06:11:37.884955 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-24 06:11:37.884967 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-24 06:11:37.884996 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-24 06:11:37.885016 | orchestrator | 2026-04-24 06:11:37.885034 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-24 06:11:37.885053 | orchestrator | Friday 24 April 2026 06:11:36 +0000 (0:00:01.738) 1:09:18.074 ********** 2026-04-24 06:11:37.885070 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-24 06:11:37.885088 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-24 06:11:37.885105 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-24 06:11:37.885122 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:11:37.885170 | orchestrator | 2026-04-24 06:11:37.885190 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-24 06:11:37.885208 | orchestrator | Friday 24 April 2026 06:11:37 +0000 (0:00:01.225) 1:09:19.300 ********** 2026-04-24 06:11:37.885227 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-5 2026-04-24 06:11:37.885248 | orchestrator | 2026-04-24 06:11:37.885280 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 06:12:20.324865 | orchestrator | Friday 24 April 2026 06:11:38 +0000 (0:00:01.158) 1:09:20.459 ********** 2026-04-24 06:12:20.324967 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.324981 | orchestrator | 2026-04-24 06:12:20.324991 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 06:12:20.325001 | orchestrator | Friday 24 April 2026 06:11:39 +0000 (0:00:01.125) 1:09:21.584 ********** 2026-04-24 06:12:20.325010 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.325019 | orchestrator | 2026-04-24 06:12:20.325028 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 06:12:20.325037 | orchestrator | Friday 24 April 2026 06:11:41 +0000 (0:00:01.177) 1:09:22.761 ********** 2026-04-24 06:12:20.325045 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.325054 | orchestrator | 2026-04-24 06:12:20.325063 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 06:12:20.325072 | orchestrator | Friday 24 April 2026 06:11:42 +0000 (0:00:01.164) 1:09:23.926 ********** 2026-04-24 06:12:20.325081 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.325114 | orchestrator | 2026-04-24 06:12:20.325123 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 06:12:20.325132 | orchestrator | Friday 24 April 2026 06:11:43 +0000 (0:00:01.236) 1:09:25.162 ********** 2026-04-24 06:12:20.325142 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 06:12:20.325152 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 06:12:20.325160 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 06:12:20.325169 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.325178 | orchestrator | 2026-04-24 06:12:20.325186 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 06:12:20.325195 | orchestrator | Friday 24 April 2026 06:11:44 +0000 (0:00:01.406) 1:09:26.569 ********** 2026-04-24 06:12:20.325204 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 06:12:20.325213 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 06:12:20.325221 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 06:12:20.325230 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.325238 | orchestrator | 2026-04-24 06:12:20.325247 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 06:12:20.325256 | orchestrator | Friday 24 April 2026 06:11:46 +0000 (0:00:01.406) 1:09:27.975 ********** 2026-04-24 06:12:20.325264 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 06:12:20.325273 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 06:12:20.325281 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 06:12:20.325313 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.325322 | orchestrator | 2026-04-24 06:12:20.325331 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 06:12:20.325340 | orchestrator | Friday 24 April 2026 06:11:48 +0000 (0:00:01.825) 1:09:29.801 ********** 2026-04-24 06:12:20.325348 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.325357 | orchestrator | 2026-04-24 06:12:20.325365 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 06:12:20.325375 | orchestrator | Friday 24 April 2026 06:11:49 +0000 (0:00:01.150) 1:09:30.951 ********** 2026-04-24 06:12:20.325396 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 06:12:20.325407 | orchestrator | 2026-04-24 06:12:20.325417 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-24 06:12:20.325428 | orchestrator | Friday 24 April 2026 06:11:50 +0000 (0:00:01.738) 1:09:32.690 ********** 2026-04-24 06:12:20.325437 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:12:20.325448 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:12:20.325459 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:12:20.325469 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 06:12:20.325479 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 06:12:20.325490 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-24 06:12:20.325500 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 06:12:20.325510 | orchestrator | 2026-04-24 06:12:20.325521 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-24 06:12:20.325531 | orchestrator | Friday 24 April 2026 06:11:52 +0000 (0:00:01.821) 1:09:34.512 ********** 2026-04-24 06:12:20.325542 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-24 06:12:20.325552 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-24 06:12:20.325562 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-24 06:12:20.325573 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-24 06:12:20.325583 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-24 06:12:20.325593 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-24 06:12:20.325603 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-24 06:12:20.325613 | orchestrator | 2026-04-24 06:12:20.325623 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-24 06:12:20.325633 | orchestrator | Friday 24 April 2026 06:11:55 +0000 (0:00:02.359) 1:09:36.871 ********** 2026-04-24 06:12:20.325644 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:12:20.325654 | orchestrator | 2026-04-24 06:12:20.325681 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-24 06:12:20.325691 | orchestrator | Friday 24 April 2026 06:11:57 +0000 (0:00:01.888) 1:09:38.760 ********** 2026-04-24 06:12:20.325701 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:12:20.325713 | orchestrator | 2026-04-24 06:12:20.325723 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-24 06:12:20.325733 | orchestrator | Friday 24 April 2026 06:11:59 +0000 (0:00:02.630) 1:09:41.391 ********** 2026-04-24 06:12:20.325742 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:12:20.325750 | orchestrator | 2026-04-24 06:12:20.325759 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 06:12:20.325775 | orchestrator | Friday 24 April 2026 06:12:01 +0000 (0:00:01.908) 1:09:43.299 ********** 2026-04-24 06:12:20.325783 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-5 2026-04-24 06:12:20.325792 | orchestrator | 2026-04-24 06:12:20.325801 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 06:12:20.325809 | orchestrator | Friday 24 April 2026 06:12:02 +0000 (0:00:01.104) 1:09:44.404 ********** 2026-04-24 06:12:20.325818 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-5 2026-04-24 06:12:20.325827 | orchestrator | 2026-04-24 06:12:20.325836 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 06:12:20.325844 | orchestrator | Friday 24 April 2026 06:12:03 +0000 (0:00:01.134) 1:09:45.539 ********** 2026-04-24 06:12:20.325853 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.325861 | orchestrator | 2026-04-24 06:12:20.325870 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 06:12:20.325878 | orchestrator | Friday 24 April 2026 06:12:04 +0000 (0:00:01.140) 1:09:46.679 ********** 2026-04-24 06:12:20.325887 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.325895 | orchestrator | 2026-04-24 06:12:20.325904 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 06:12:20.325913 | orchestrator | Friday 24 April 2026 06:12:06 +0000 (0:00:01.528) 1:09:48.208 ********** 2026-04-24 06:12:20.325921 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.325930 | orchestrator | 2026-04-24 06:12:20.325938 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 06:12:20.325947 | orchestrator | Friday 24 April 2026 06:12:08 +0000 (0:00:01.605) 1:09:49.814 ********** 2026-04-24 06:12:20.325955 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.325964 | orchestrator | 2026-04-24 06:12:20.325973 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 06:12:20.325981 | orchestrator | Friday 24 April 2026 06:12:09 +0000 (0:00:01.548) 1:09:51.362 ********** 2026-04-24 06:12:20.325990 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.325999 | orchestrator | 2026-04-24 06:12:20.326008 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 06:12:20.326060 | orchestrator | Friday 24 April 2026 06:12:10 +0000 (0:00:01.183) 1:09:52.546 ********** 2026-04-24 06:12:20.326072 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.326081 | orchestrator | 2026-04-24 06:12:20.326124 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 06:12:20.326134 | orchestrator | Friday 24 April 2026 06:12:11 +0000 (0:00:01.115) 1:09:53.662 ********** 2026-04-24 06:12:20.326142 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.326151 | orchestrator | 2026-04-24 06:12:20.326160 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 06:12:20.326168 | orchestrator | Friday 24 April 2026 06:12:13 +0000 (0:00:01.136) 1:09:54.798 ********** 2026-04-24 06:12:20.326177 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.326186 | orchestrator | 2026-04-24 06:12:20.326194 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 06:12:20.326203 | orchestrator | Friday 24 April 2026 06:12:14 +0000 (0:00:01.568) 1:09:56.367 ********** 2026-04-24 06:12:20.326211 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.326220 | orchestrator | 2026-04-24 06:12:20.326229 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 06:12:20.326237 | orchestrator | Friday 24 April 2026 06:12:16 +0000 (0:00:01.548) 1:09:57.916 ********** 2026-04-24 06:12:20.326246 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.326254 | orchestrator | 2026-04-24 06:12:20.326263 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 06:12:20.326272 | orchestrator | Friday 24 April 2026 06:12:16 +0000 (0:00:00.757) 1:09:58.673 ********** 2026-04-24 06:12:20.326280 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.326289 | orchestrator | 2026-04-24 06:12:20.326306 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 06:12:20.326314 | orchestrator | Friday 24 April 2026 06:12:17 +0000 (0:00:00.787) 1:09:59.461 ********** 2026-04-24 06:12:20.326323 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.326332 | orchestrator | 2026-04-24 06:12:20.326340 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 06:12:20.326349 | orchestrator | Friday 24 April 2026 06:12:18 +0000 (0:00:00.799) 1:10:00.261 ********** 2026-04-24 06:12:20.326357 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.326367 | orchestrator | 2026-04-24 06:12:20.326375 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 06:12:20.326384 | orchestrator | Friday 24 April 2026 06:12:19 +0000 (0:00:00.819) 1:10:01.080 ********** 2026-04-24 06:12:20.326392 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:12:20.326401 | orchestrator | 2026-04-24 06:12:20.326409 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 06:12:20.326418 | orchestrator | Friday 24 April 2026 06:12:20 +0000 (0:00:00.800) 1:10:01.881 ********** 2026-04-24 06:12:20.326427 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:12:20.326436 | orchestrator | 2026-04-24 06:12:20.326450 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 06:13:01.903620 | orchestrator | Friday 24 April 2026 06:12:20 +0000 (0:00:00.794) 1:10:02.676 ********** 2026-04-24 06:13:01.903727 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.903743 | orchestrator | 2026-04-24 06:13:01.903756 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 06:13:01.903772 | orchestrator | Friday 24 April 2026 06:12:21 +0000 (0:00:00.879) 1:10:03.555 ********** 2026-04-24 06:13:01.903784 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.903796 | orchestrator | 2026-04-24 06:13:01.903808 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 06:13:01.903820 | orchestrator | Friday 24 April 2026 06:12:22 +0000 (0:00:00.767) 1:10:04.323 ********** 2026-04-24 06:13:01.903832 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:01.903844 | orchestrator | 2026-04-24 06:13:01.903856 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 06:13:01.903868 | orchestrator | Friday 24 April 2026 06:12:23 +0000 (0:00:00.844) 1:10:05.168 ********** 2026-04-24 06:13:01.903879 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:01.903891 | orchestrator | 2026-04-24 06:13:01.903902 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-24 06:13:01.903914 | orchestrator | Friday 24 April 2026 06:12:24 +0000 (0:00:00.812) 1:10:05.980 ********** 2026-04-24 06:13:01.903925 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.903937 | orchestrator | 2026-04-24 06:13:01.903948 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-24 06:13:01.903966 | orchestrator | Friday 24 April 2026 06:12:25 +0000 (0:00:00.802) 1:10:06.783 ********** 2026-04-24 06:13:01.903985 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904002 | orchestrator | 2026-04-24 06:13:01.904018 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-24 06:13:01.904075 | orchestrator | Friday 24 April 2026 06:12:25 +0000 (0:00:00.786) 1:10:07.570 ********** 2026-04-24 06:13:01.904100 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904118 | orchestrator | 2026-04-24 06:13:01.904136 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-24 06:13:01.904153 | orchestrator | Friday 24 April 2026 06:12:26 +0000 (0:00:00.793) 1:10:08.363 ********** 2026-04-24 06:13:01.904172 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904192 | orchestrator | 2026-04-24 06:13:01.904210 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-24 06:13:01.904230 | orchestrator | Friday 24 April 2026 06:12:27 +0000 (0:00:00.785) 1:10:09.149 ********** 2026-04-24 06:13:01.904250 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904269 | orchestrator | 2026-04-24 06:13:01.904313 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-24 06:13:01.904326 | orchestrator | Friday 24 April 2026 06:12:28 +0000 (0:00:00.760) 1:10:09.910 ********** 2026-04-24 06:13:01.904340 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904353 | orchestrator | 2026-04-24 06:13:01.904366 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-24 06:13:01.904379 | orchestrator | Friday 24 April 2026 06:12:28 +0000 (0:00:00.778) 1:10:10.688 ********** 2026-04-24 06:13:01.904391 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904404 | orchestrator | 2026-04-24 06:13:01.904417 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-24 06:13:01.904445 | orchestrator | Friday 24 April 2026 06:12:29 +0000 (0:00:00.782) 1:10:11.471 ********** 2026-04-24 06:13:01.904458 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904471 | orchestrator | 2026-04-24 06:13:01.904483 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-24 06:13:01.904496 | orchestrator | Friday 24 April 2026 06:12:30 +0000 (0:00:00.825) 1:10:12.296 ********** 2026-04-24 06:13:01.904509 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904522 | orchestrator | 2026-04-24 06:13:01.904533 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-24 06:13:01.904543 | orchestrator | Friday 24 April 2026 06:12:31 +0000 (0:00:00.791) 1:10:13.087 ********** 2026-04-24 06:13:01.904554 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904565 | orchestrator | 2026-04-24 06:13:01.904576 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-24 06:13:01.904587 | orchestrator | Friday 24 April 2026 06:12:32 +0000 (0:00:00.837) 1:10:13.925 ********** 2026-04-24 06:13:01.904597 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904608 | orchestrator | 2026-04-24 06:13:01.904619 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-24 06:13:01.904630 | orchestrator | Friday 24 April 2026 06:12:33 +0000 (0:00:00.787) 1:10:14.713 ********** 2026-04-24 06:13:01.904640 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904651 | orchestrator | 2026-04-24 06:13:01.904662 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-24 06:13:01.904673 | orchestrator | Friday 24 April 2026 06:12:33 +0000 (0:00:00.791) 1:10:15.504 ********** 2026-04-24 06:13:01.904684 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:01.904695 | orchestrator | 2026-04-24 06:13:01.904706 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-24 06:13:01.904716 | orchestrator | Friday 24 April 2026 06:12:35 +0000 (0:00:01.598) 1:10:17.103 ********** 2026-04-24 06:13:01.904727 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:01.904738 | orchestrator | 2026-04-24 06:13:01.904749 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-24 06:13:01.904760 | orchestrator | Friday 24 April 2026 06:12:37 +0000 (0:00:01.874) 1:10:18.977 ********** 2026-04-24 06:13:01.904770 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-5 2026-04-24 06:13:01.904782 | orchestrator | 2026-04-24 06:13:01.904793 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-24 06:13:01.904804 | orchestrator | Friday 24 April 2026 06:12:38 +0000 (0:00:01.127) 1:10:20.104 ********** 2026-04-24 06:13:01.904815 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904826 | orchestrator | 2026-04-24 06:13:01.904837 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-24 06:13:01.904866 | orchestrator | Friday 24 April 2026 06:12:39 +0000 (0:00:01.171) 1:10:21.276 ********** 2026-04-24 06:13:01.904894 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.904916 | orchestrator | 2026-04-24 06:13:01.904927 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-24 06:13:01.904938 | orchestrator | Friday 24 April 2026 06:12:40 +0000 (0:00:01.171) 1:10:22.448 ********** 2026-04-24 06:13:01.904958 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-24 06:13:01.904969 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-24 06:13:01.904986 | orchestrator | 2026-04-24 06:13:01.905005 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-24 06:13:01.905069 | orchestrator | Friday 24 April 2026 06:12:42 +0000 (0:00:01.844) 1:10:24.292 ********** 2026-04-24 06:13:01.905089 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:01.905107 | orchestrator | 2026-04-24 06:13:01.905124 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-24 06:13:01.905142 | orchestrator | Friday 24 April 2026 06:12:44 +0000 (0:00:01.438) 1:10:25.730 ********** 2026-04-24 06:13:01.905159 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905179 | orchestrator | 2026-04-24 06:13:01.905197 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-24 06:13:01.905217 | orchestrator | Friday 24 April 2026 06:12:45 +0000 (0:00:01.176) 1:10:26.907 ********** 2026-04-24 06:13:01.905236 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905254 | orchestrator | 2026-04-24 06:13:01.905271 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-24 06:13:01.905289 | orchestrator | Friday 24 April 2026 06:12:46 +0000 (0:00:00.846) 1:10:27.754 ********** 2026-04-24 06:13:01.905306 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905323 | orchestrator | 2026-04-24 06:13:01.905340 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-24 06:13:01.905359 | orchestrator | Friday 24 April 2026 06:12:46 +0000 (0:00:00.778) 1:10:28.532 ********** 2026-04-24 06:13:01.905378 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-5 2026-04-24 06:13:01.905398 | orchestrator | 2026-04-24 06:13:01.905417 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-24 06:13:01.905432 | orchestrator | Friday 24 April 2026 06:12:47 +0000 (0:00:01.140) 1:10:29.672 ********** 2026-04-24 06:13:01.905443 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:01.905454 | orchestrator | 2026-04-24 06:13:01.905465 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-24 06:13:01.905476 | orchestrator | Friday 24 April 2026 06:12:49 +0000 (0:00:01.753) 1:10:31.426 ********** 2026-04-24 06:13:01.905486 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-24 06:13:01.905497 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-24 06:13:01.905508 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-24 06:13:01.905519 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905529 | orchestrator | 2026-04-24 06:13:01.905540 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-24 06:13:01.905559 | orchestrator | Friday 24 April 2026 06:12:50 +0000 (0:00:01.135) 1:10:32.561 ********** 2026-04-24 06:13:01.905570 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905581 | orchestrator | 2026-04-24 06:13:01.905592 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-24 06:13:01.905602 | orchestrator | Friday 24 April 2026 06:12:52 +0000 (0:00:01.153) 1:10:33.715 ********** 2026-04-24 06:13:01.905613 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905624 | orchestrator | 2026-04-24 06:13:01.905635 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-24 06:13:01.905646 | orchestrator | Friday 24 April 2026 06:12:53 +0000 (0:00:01.162) 1:10:34.877 ********** 2026-04-24 06:13:01.905656 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905667 | orchestrator | 2026-04-24 06:13:01.905678 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-24 06:13:01.905689 | orchestrator | Friday 24 April 2026 06:12:54 +0000 (0:00:01.207) 1:10:36.084 ********** 2026-04-24 06:13:01.905699 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905720 | orchestrator | 2026-04-24 06:13:01.905731 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-24 06:13:01.905742 | orchestrator | Friday 24 April 2026 06:12:55 +0000 (0:00:01.170) 1:10:37.254 ********** 2026-04-24 06:13:01.905752 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905763 | orchestrator | 2026-04-24 06:13:01.905774 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-24 06:13:01.905784 | orchestrator | Friday 24 April 2026 06:12:56 +0000 (0:00:00.814) 1:10:38.069 ********** 2026-04-24 06:13:01.905795 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:01.905806 | orchestrator | 2026-04-24 06:13:01.905817 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-24 06:13:01.905828 | orchestrator | Friday 24 April 2026 06:12:58 +0000 (0:00:02.138) 1:10:40.207 ********** 2026-04-24 06:13:01.905838 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:01.905849 | orchestrator | 2026-04-24 06:13:01.905860 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-24 06:13:01.905871 | orchestrator | Friday 24 April 2026 06:12:59 +0000 (0:00:00.805) 1:10:41.012 ********** 2026-04-24 06:13:01.905882 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-5 2026-04-24 06:13:01.905892 | orchestrator | 2026-04-24 06:13:01.905903 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-24 06:13:01.905914 | orchestrator | Friday 24 April 2026 06:13:00 +0000 (0:00:01.441) 1:10:42.454 ********** 2026-04-24 06:13:01.905924 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:01.905935 | orchestrator | 2026-04-24 06:13:01.905946 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-24 06:13:01.905968 | orchestrator | Friday 24 April 2026 06:13:01 +0000 (0:00:01.153) 1:10:43.608 ********** 2026-04-24 06:13:42.888726 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.888836 | orchestrator | 2026-04-24 06:13:42.888854 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-24 06:13:42.888869 | orchestrator | Friday 24 April 2026 06:13:03 +0000 (0:00:01.133) 1:10:44.741 ********** 2026-04-24 06:13:42.888880 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.888891 | orchestrator | 2026-04-24 06:13:42.888903 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-24 06:13:42.888938 | orchestrator | Friday 24 April 2026 06:13:04 +0000 (0:00:01.188) 1:10:45.930 ********** 2026-04-24 06:13:42.888949 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.888960 | orchestrator | 2026-04-24 06:13:42.888972 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-24 06:13:42.888983 | orchestrator | Friday 24 April 2026 06:13:05 +0000 (0:00:01.143) 1:10:47.073 ********** 2026-04-24 06:13:42.888994 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.889005 | orchestrator | 2026-04-24 06:13:42.889016 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-24 06:13:42.889027 | orchestrator | Friday 24 April 2026 06:13:06 +0000 (0:00:01.143) 1:10:48.216 ********** 2026-04-24 06:13:42.889039 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.889050 | orchestrator | 2026-04-24 06:13:42.889061 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-24 06:13:42.889072 | orchestrator | Friday 24 April 2026 06:13:07 +0000 (0:00:01.188) 1:10:49.404 ********** 2026-04-24 06:13:42.889083 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.889094 | orchestrator | 2026-04-24 06:13:42.889132 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-24 06:13:42.889144 | orchestrator | Friday 24 April 2026 06:13:08 +0000 (0:00:01.134) 1:10:50.539 ********** 2026-04-24 06:13:42.889155 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.889166 | orchestrator | 2026-04-24 06:13:42.889177 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-24 06:13:42.889189 | orchestrator | Friday 24 April 2026 06:13:09 +0000 (0:00:01.142) 1:10:51.681 ********** 2026-04-24 06:13:42.889223 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:13:42.889235 | orchestrator | 2026-04-24 06:13:42.889246 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-24 06:13:42.889257 | orchestrator | Friday 24 April 2026 06:13:10 +0000 (0:00:00.826) 1:10:52.508 ********** 2026-04-24 06:13:42.889268 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-5 2026-04-24 06:13:42.889281 | orchestrator | 2026-04-24 06:13:42.889294 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-24 06:13:42.889306 | orchestrator | Friday 24 April 2026 06:13:12 +0000 (0:00:01.212) 1:10:53.720 ********** 2026-04-24 06:13:42.889319 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-24 06:13:42.889332 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-24 06:13:42.889345 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-24 06:13:42.889357 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-24 06:13:42.889370 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-24 06:13:42.889396 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-24 06:13:42.889409 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-24 06:13:42.889421 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-24 06:13:42.889434 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-24 06:13:42.889447 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-24 06:13:42.889459 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-24 06:13:42.889472 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-24 06:13:42.889485 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-24 06:13:42.889498 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-24 06:13:42.889510 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-24 06:13:42.889523 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-24 06:13:42.889535 | orchestrator | 2026-04-24 06:13:42.889547 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-24 06:13:42.889560 | orchestrator | Friday 24 April 2026 06:13:18 +0000 (0:00:06.047) 1:10:59.768 ********** 2026-04-24 06:13:42.889572 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-5 2026-04-24 06:13:42.889585 | orchestrator | 2026-04-24 06:13:42.889597 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-24 06:13:42.889610 | orchestrator | Friday 24 April 2026 06:13:19 +0000 (0:00:01.130) 1:11:00.899 ********** 2026-04-24 06:13:42.889623 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:13:42.889637 | orchestrator | 2026-04-24 06:13:42.889650 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-24 06:13:42.889661 | orchestrator | Friday 24 April 2026 06:13:20 +0000 (0:00:01.507) 1:11:02.407 ********** 2026-04-24 06:13:42.889672 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:13:42.889683 | orchestrator | 2026-04-24 06:13:42.889694 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-24 06:13:42.889705 | orchestrator | Friday 24 April 2026 06:13:22 +0000 (0:00:01.645) 1:11:04.053 ********** 2026-04-24 06:13:42.889716 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.889726 | orchestrator | 2026-04-24 06:13:42.889737 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-24 06:13:42.889765 | orchestrator | Friday 24 April 2026 06:13:23 +0000 (0:00:00.781) 1:11:04.834 ********** 2026-04-24 06:13:42.889777 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.889788 | orchestrator | 2026-04-24 06:13:42.889799 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-24 06:13:42.889817 | orchestrator | Friday 24 April 2026 06:13:23 +0000 (0:00:00.795) 1:11:05.630 ********** 2026-04-24 06:13:42.889828 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.889839 | orchestrator | 2026-04-24 06:13:42.889850 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-24 06:13:42.889861 | orchestrator | Friday 24 April 2026 06:13:24 +0000 (0:00:00.778) 1:11:06.409 ********** 2026-04-24 06:13:42.889872 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.889883 | orchestrator | 2026-04-24 06:13:42.889894 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-24 06:13:42.889974 | orchestrator | Friday 24 April 2026 06:13:25 +0000 (0:00:00.817) 1:11:07.226 ********** 2026-04-24 06:13:42.889989 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890000 | orchestrator | 2026-04-24 06:13:42.890011 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-24 06:13:42.890078 | orchestrator | Friday 24 April 2026 06:13:26 +0000 (0:00:00.797) 1:11:08.024 ********** 2026-04-24 06:13:42.890089 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890100 | orchestrator | 2026-04-24 06:13:42.890111 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-24 06:13:42.890122 | orchestrator | Friday 24 April 2026 06:13:27 +0000 (0:00:00.835) 1:11:08.859 ********** 2026-04-24 06:13:42.890133 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890144 | orchestrator | 2026-04-24 06:13:42.890154 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-24 06:13:42.890165 | orchestrator | Friday 24 April 2026 06:13:27 +0000 (0:00:00.768) 1:11:09.627 ********** 2026-04-24 06:13:42.890176 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890187 | orchestrator | 2026-04-24 06:13:42.890197 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-24 06:13:42.890208 | orchestrator | Friday 24 April 2026 06:13:28 +0000 (0:00:00.842) 1:11:10.470 ********** 2026-04-24 06:13:42.890219 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890231 | orchestrator | 2026-04-24 06:13:42.890241 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-24 06:13:42.890252 | orchestrator | Friday 24 April 2026 06:13:29 +0000 (0:00:00.892) 1:11:11.362 ********** 2026-04-24 06:13:42.890263 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890273 | orchestrator | 2026-04-24 06:13:42.890284 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-24 06:13:42.890295 | orchestrator | Friday 24 April 2026 06:13:30 +0000 (0:00:00.814) 1:11:12.177 ********** 2026-04-24 06:13:42.890305 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890316 | orchestrator | 2026-04-24 06:13:42.890327 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-24 06:13:42.890337 | orchestrator | Friday 24 April 2026 06:13:31 +0000 (0:00:00.839) 1:11:13.017 ********** 2026-04-24 06:13:42.890355 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-24 06:13:42.890366 | orchestrator | 2026-04-24 06:13:42.890377 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-24 06:13:42.890388 | orchestrator | Friday 24 April 2026 06:13:35 +0000 (0:00:03.881) 1:11:16.898 ********** 2026-04-24 06:13:42.890398 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:13:42.890409 | orchestrator | 2026-04-24 06:13:42.890420 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-24 06:13:42.890430 | orchestrator | Friday 24 April 2026 06:13:36 +0000 (0:00:00.841) 1:11:17.740 ********** 2026-04-24 06:13:42.890444 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-24 06:13:42.890467 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-24 06:13:42.890479 | orchestrator | 2026-04-24 06:13:42.890490 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-24 06:13:42.890501 | orchestrator | Friday 24 April 2026 06:13:40 +0000 (0:00:04.394) 1:11:22.134 ********** 2026-04-24 06:13:42.890511 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890522 | orchestrator | 2026-04-24 06:13:42.890533 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-24 06:13:42.890543 | orchestrator | Friday 24 April 2026 06:13:41 +0000 (0:00:00.778) 1:11:22.913 ********** 2026-04-24 06:13:42.890554 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890565 | orchestrator | 2026-04-24 06:13:42.890575 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-24 06:13:42.890586 | orchestrator | Friday 24 April 2026 06:13:42 +0000 (0:00:00.885) 1:11:23.798 ********** 2026-04-24 06:13:42.890597 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:13:42.890608 | orchestrator | 2026-04-24 06:13:42.890619 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-24 06:13:42.890639 | orchestrator | Friday 24 April 2026 06:13:42 +0000 (0:00:00.791) 1:11:24.590 ********** 2026-04-24 06:14:49.828955 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.829056 | orchestrator | 2026-04-24 06:14:49.829073 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-24 06:14:49.829087 | orchestrator | Friday 24 April 2026 06:13:43 +0000 (0:00:00.829) 1:11:25.420 ********** 2026-04-24 06:14:49.829098 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.829109 | orchestrator | 2026-04-24 06:14:49.829121 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-24 06:14:49.829132 | orchestrator | Friday 24 April 2026 06:13:44 +0000 (0:00:00.797) 1:11:26.218 ********** 2026-04-24 06:14:49.829149 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:14:49.829168 | orchestrator | 2026-04-24 06:14:49.829186 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-24 06:14:49.829204 | orchestrator | Friday 24 April 2026 06:13:45 +0000 (0:00:00.876) 1:11:27.094 ********** 2026-04-24 06:14:49.829223 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 06:14:49.829263 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 06:14:49.829284 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 06:14:49.829304 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.829323 | orchestrator | 2026-04-24 06:14:49.829338 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-24 06:14:49.829362 | orchestrator | Friday 24 April 2026 06:13:46 +0000 (0:00:01.435) 1:11:28.530 ********** 2026-04-24 06:14:49.829407 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 06:14:49.829427 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 06:14:49.829444 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 06:14:49.829460 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.829480 | orchestrator | 2026-04-24 06:14:49.829501 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-24 06:14:49.829522 | orchestrator | Friday 24 April 2026 06:13:48 +0000 (0:00:01.586) 1:11:30.116 ********** 2026-04-24 06:14:49.829542 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-24 06:14:49.829556 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-24 06:14:49.829626 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-24 06:14:49.829640 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.829653 | orchestrator | 2026-04-24 06:14:49.829666 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-24 06:14:49.829678 | orchestrator | Friday 24 April 2026 06:13:49 +0000 (0:00:01.088) 1:11:31.205 ********** 2026-04-24 06:14:49.829690 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:14:49.829703 | orchestrator | 2026-04-24 06:14:49.829715 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-24 06:14:49.829727 | orchestrator | Friday 24 April 2026 06:13:50 +0000 (0:00:00.797) 1:11:32.003 ********** 2026-04-24 06:14:49.829740 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-24 06:14:49.829752 | orchestrator | 2026-04-24 06:14:49.829764 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-24 06:14:49.829792 | orchestrator | Friday 24 April 2026 06:13:51 +0000 (0:00:01.038) 1:11:33.042 ********** 2026-04-24 06:14:49.829805 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:14:49.829817 | orchestrator | 2026-04-24 06:14:49.829830 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-24 06:14:49.829871 | orchestrator | Friday 24 April 2026 06:13:52 +0000 (0:00:01.380) 1:11:34.423 ********** 2026-04-24 06:14:49.829883 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-5 2026-04-24 06:14:49.829893 | orchestrator | 2026-04-24 06:14:49.829904 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-24 06:14:49.829915 | orchestrator | Friday 24 April 2026 06:13:53 +0000 (0:00:01.154) 1:11:35.578 ********** 2026-04-24 06:14:49.829926 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:14:49.829937 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-24 06:14:49.829948 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 06:14:49.829959 | orchestrator | 2026-04-24 06:14:49.829977 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-24 06:14:49.829996 | orchestrator | Friday 24 April 2026 06:13:57 +0000 (0:00:03.378) 1:11:38.957 ********** 2026-04-24 06:14:49.830119 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-24 06:14:49.830137 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-24 06:14:49.830156 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:14:49.830175 | orchestrator | 2026-04-24 06:14:49.830194 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-24 06:14:49.830214 | orchestrator | Friday 24 April 2026 06:13:59 +0000 (0:00:01.999) 1:11:40.956 ********** 2026-04-24 06:14:49.830232 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.830246 | orchestrator | 2026-04-24 06:14:49.830257 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-24 06:14:49.830267 | orchestrator | Friday 24 April 2026 06:14:00 +0000 (0:00:00.805) 1:11:41.762 ********** 2026-04-24 06:14:49.830278 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-5 2026-04-24 06:14:49.830290 | orchestrator | 2026-04-24 06:14:49.830300 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-24 06:14:49.830311 | orchestrator | Friday 24 April 2026 06:14:01 +0000 (0:00:01.289) 1:11:43.052 ********** 2026-04-24 06:14:49.830323 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:14:49.830335 | orchestrator | 2026-04-24 06:14:49.830346 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-24 06:14:49.830357 | orchestrator | Friday 24 April 2026 06:14:02 +0000 (0:00:01.618) 1:11:44.670 ********** 2026-04-24 06:14:49.830386 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:14:49.830398 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-24 06:14:49.830421 | orchestrator | 2026-04-24 06:14:49.830432 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-24 06:14:49.830443 | orchestrator | Friday 24 April 2026 06:14:08 +0000 (0:00:05.231) 1:11:49.902 ********** 2026-04-24 06:14:49.830453 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-24 06:14:49.830464 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-24 06:14:49.830475 | orchestrator | 2026-04-24 06:14:49.830486 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-24 06:14:49.830497 | orchestrator | Friday 24 April 2026 06:14:11 +0000 (0:00:03.139) 1:11:53.041 ********** 2026-04-24 06:14:49.830507 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-24 06:14:49.830518 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:14:49.830529 | orchestrator | 2026-04-24 06:14:49.830540 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-24 06:14:49.830550 | orchestrator | Friday 24 April 2026 06:14:13 +0000 (0:00:01.671) 1:11:54.713 ********** 2026-04-24 06:14:49.830561 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-5 2026-04-24 06:14:49.830572 | orchestrator | 2026-04-24 06:14:49.830583 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-24 06:14:49.830594 | orchestrator | Friday 24 April 2026 06:14:14 +0000 (0:00:01.187) 1:11:55.901 ********** 2026-04-24 06:14:49.830604 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830616 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830627 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830637 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830648 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830659 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.830669 | orchestrator | 2026-04-24 06:14:49.830680 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-24 06:14:49.830691 | orchestrator | Friday 24 April 2026 06:14:15 +0000 (0:00:01.657) 1:11:57.559 ********** 2026-04-24 06:14:49.830708 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830720 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830730 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830756 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830767 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-24 06:14:49.830778 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.830789 | orchestrator | 2026-04-24 06:14:49.830800 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-24 06:14:49.830810 | orchestrator | Friday 24 April 2026 06:14:17 +0000 (0:00:01.599) 1:11:59.159 ********** 2026-04-24 06:14:49.830821 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:14:49.830832 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:14:49.830880 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:14:49.830901 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:14:49.830920 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-24 06:14:49.830937 | orchestrator | 2026-04-24 06:14:49.830949 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-24 06:14:49.830960 | orchestrator | Friday 24 April 2026 06:14:49 +0000 (0:00:31.598) 1:12:30.757 ********** 2026-04-24 06:14:49.830970 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:14:49.830981 | orchestrator | 2026-04-24 06:14:49.830992 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-24 06:14:49.831010 | orchestrator | Friday 24 April 2026 06:14:49 +0000 (0:00:00.772) 1:12:31.530 ********** 2026-04-24 06:15:41.134722 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:15:41.134945 | orchestrator | 2026-04-24 06:15:41.134966 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-24 06:15:41.134993 | orchestrator | Friday 24 April 2026 06:14:50 +0000 (0:00:00.809) 1:12:32.340 ********** 2026-04-24 06:15:41.135006 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-5 2026-04-24 06:15:41.135029 | orchestrator | 2026-04-24 06:15:41.135042 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-24 06:15:41.135054 | orchestrator | Friday 24 April 2026 06:14:51 +0000 (0:00:01.269) 1:12:33.610 ********** 2026-04-24 06:15:41.135066 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-5 2026-04-24 06:15:41.135078 | orchestrator | 2026-04-24 06:15:41.135090 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-24 06:15:41.135102 | orchestrator | Friday 24 April 2026 06:14:53 +0000 (0:00:01.141) 1:12:34.751 ********** 2026-04-24 06:15:41.135113 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.135124 | orchestrator | 2026-04-24 06:15:41.135134 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-24 06:15:41.135144 | orchestrator | Friday 24 April 2026 06:14:55 +0000 (0:00:01.981) 1:12:36.732 ********** 2026-04-24 06:15:41.135154 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.135164 | orchestrator | 2026-04-24 06:15:41.135174 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-24 06:15:41.135185 | orchestrator | Friday 24 April 2026 06:14:56 +0000 (0:00:01.892) 1:12:38.625 ********** 2026-04-24 06:15:41.135196 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.135205 | orchestrator | 2026-04-24 06:15:41.135215 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-24 06:15:41.135226 | orchestrator | Friday 24 April 2026 06:14:59 +0000 (0:00:02.345) 1:12:40.971 ********** 2026-04-24 06:15:41.135237 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-24 06:15:41.135249 | orchestrator | 2026-04-24 06:15:41.135259 | orchestrator | PLAY [Upgrade ceph rbd mirror node] ******************************************** 2026-04-24 06:15:41.135270 | orchestrator | skipping: no hosts matched 2026-04-24 06:15:41.135280 | orchestrator | 2026-04-24 06:15:41.135291 | orchestrator | PLAY [Upgrade ceph nfs node] *************************************************** 2026-04-24 06:15:41.135301 | orchestrator | skipping: no hosts matched 2026-04-24 06:15:41.135312 | orchestrator | 2026-04-24 06:15:41.135323 | orchestrator | PLAY [Upgrade ceph client node] ************************************************ 2026-04-24 06:15:41.135335 | orchestrator | skipping: no hosts matched 2026-04-24 06:15:41.135346 | orchestrator | 2026-04-24 06:15:41.135357 | orchestrator | PLAY [Upgrade ceph-crash daemons] ********************************************** 2026-04-24 06:15:41.135390 | orchestrator | 2026-04-24 06:15:41.135402 | orchestrator | TASK [Stop the ceph-crash service] ********************************************* 2026-04-24 06:15:41.135413 | orchestrator | Friday 24 April 2026 06:15:03 +0000 (0:00:04.177) 1:12:45.148 ********** 2026-04-24 06:15:41.135423 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:15:41.135448 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:15:41.135460 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:15:41.135470 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:15:41.135480 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:15:41.135491 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:15:41.135501 | orchestrator | 2026-04-24 06:15:41.135512 | orchestrator | TASK [Mask and disable the ceph-crash service] ********************************* 2026-04-24 06:15:41.135519 | orchestrator | Friday 24 April 2026 06:15:06 +0000 (0:00:02.781) 1:12:47.930 ********** 2026-04-24 06:15:41.135525 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:15:41.135531 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:15:41.135537 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:15:41.135543 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:15:41.135549 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:15:41.135555 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:15:41.135561 | orchestrator | 2026-04-24 06:15:41.135568 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 06:15:41.135574 | orchestrator | Friday 24 April 2026 06:15:09 +0000 (0:00:03.011) 1:12:50.941 ********** 2026-04-24 06:15:41.135580 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:15:41.135586 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:15:41.135592 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:15:41.135598 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:15:41.135605 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:15:41.135611 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.135617 | orchestrator | 2026-04-24 06:15:41.135623 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 06:15:41.135629 | orchestrator | Friday 24 April 2026 06:15:11 +0000 (0:00:02.211) 1:12:53.153 ********** 2026-04-24 06:15:41.135635 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:15:41.135641 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:15:41.135647 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:15:41.135653 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:15:41.135659 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:15:41.135666 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.135672 | orchestrator | 2026-04-24 06:15:41.135678 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-24 06:15:41.135684 | orchestrator | Friday 24 April 2026 06:15:13 +0000 (0:00:02.260) 1:12:55.414 ********** 2026-04-24 06:15:41.135691 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:15:41.135699 | orchestrator | 2026-04-24 06:15:41.135710 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-24 06:15:41.135720 | orchestrator | Friday 24 April 2026 06:15:16 +0000 (0:00:02.328) 1:12:57.743 ********** 2026-04-24 06:15:41.135730 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:15:41.135739 | orchestrator | 2026-04-24 06:15:41.135816 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-24 06:15:41.135831 | orchestrator | Friday 24 April 2026 06:15:18 +0000 (0:00:02.281) 1:13:00.025 ********** 2026-04-24 06:15:41.135841 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:15:41.135852 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:15:41.135863 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:15:41.135874 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:15:41.135885 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:15:41.135907 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:15:41.135918 | orchestrator | 2026-04-24 06:15:41.135930 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-24 06:15:41.135942 | orchestrator | Friday 24 April 2026 06:15:20 +0000 (0:00:02.042) 1:13:02.067 ********** 2026-04-24 06:15:41.135953 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:15:41.135963 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:15:41.135974 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:15:41.135981 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:15:41.135987 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:15:41.135993 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.136003 | orchestrator | 2026-04-24 06:15:41.136013 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-24 06:15:41.136039 | orchestrator | Friday 24 April 2026 06:15:22 +0000 (0:00:02.108) 1:13:04.175 ********** 2026-04-24 06:15:41.136051 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:15:41.136062 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:15:41.136073 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:15:41.136080 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:15:41.136086 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:15:41.136092 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.136098 | orchestrator | 2026-04-24 06:15:41.136108 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-24 06:15:41.136118 | orchestrator | Friday 24 April 2026 06:15:24 +0000 (0:00:02.236) 1:13:06.412 ********** 2026-04-24 06:15:41.136128 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:15:41.136138 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:15:41.136148 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:15:41.136157 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:15:41.136168 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:15:41.136178 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.136187 | orchestrator | 2026-04-24 06:15:41.136198 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-24 06:15:41.136207 | orchestrator | Friday 24 April 2026 06:15:26 +0000 (0:00:02.168) 1:13:08.581 ********** 2026-04-24 06:15:41.136218 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:15:41.136228 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:15:41.136239 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:15:41.136250 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:15:41.136258 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:15:41.136265 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:15:41.136274 | orchestrator | 2026-04-24 06:15:41.136285 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-24 06:15:41.136295 | orchestrator | Friday 24 April 2026 06:15:29 +0000 (0:00:02.482) 1:13:11.063 ********** 2026-04-24 06:15:41.136306 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:15:41.136316 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:15:41.136327 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:15:41.136345 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:15:41.136355 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:15:41.136365 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:15:41.136377 | orchestrator | 2026-04-24 06:15:41.136388 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-24 06:15:41.136398 | orchestrator | Friday 24 April 2026 06:15:31 +0000 (0:00:01.870) 1:13:12.934 ********** 2026-04-24 06:15:41.136408 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:15:41.136419 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:15:41.136430 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:15:41.136440 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:15:41.136450 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:15:41.136460 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:15:41.136471 | orchestrator | 2026-04-24 06:15:41.136481 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-24 06:15:41.136491 | orchestrator | Friday 24 April 2026 06:15:33 +0000 (0:00:02.101) 1:13:15.035 ********** 2026-04-24 06:15:41.136510 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:15:41.136517 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:15:41.136523 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:15:41.136530 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:15:41.136536 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:15:41.136542 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.136548 | orchestrator | 2026-04-24 06:15:41.136554 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-24 06:15:41.136560 | orchestrator | Friday 24 April 2026 06:15:35 +0000 (0:00:02.166) 1:13:17.202 ********** 2026-04-24 06:15:41.136566 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:15:41.136572 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:15:41.136578 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:15:41.136584 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:15:41.136590 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:15:41.136596 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:15:41.136602 | orchestrator | 2026-04-24 06:15:41.136608 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-24 06:15:41.136615 | orchestrator | Friday 24 April 2026 06:15:38 +0000 (0:00:02.621) 1:13:19.824 ********** 2026-04-24 06:15:41.136621 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:15:41.136627 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:15:41.136633 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:15:41.136639 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:15:41.136645 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:15:41.136651 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:15:41.136657 | orchestrator | 2026-04-24 06:15:41.136665 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-24 06:15:41.136676 | orchestrator | Friday 24 April 2026 06:15:40 +0000 (0:00:01.973) 1:13:21.798 ********** 2026-04-24 06:15:41.136686 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:15:41.136695 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:15:41.136705 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:15:41.136716 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:15:41.136727 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:15:41.136734 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:15:41.136740 | orchestrator | 2026-04-24 06:15:41.136754 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-24 06:16:38.193832 | orchestrator | Friday 24 April 2026 06:15:42 +0000 (0:00:02.050) 1:13:23.848 ********** 2026-04-24 06:16:38.193937 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.193953 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.193965 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.193975 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:16:38.193987 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:16:38.193998 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:16:38.194009 | orchestrator | 2026-04-24 06:16:38.194069 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-24 06:16:38.194081 | orchestrator | Friday 24 April 2026 06:15:44 +0000 (0:00:02.153) 1:13:26.002 ********** 2026-04-24 06:16:38.194092 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.194104 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.194115 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.194125 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:16:38.194136 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:16:38.194147 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:16:38.194158 | orchestrator | 2026-04-24 06:16:38.194169 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-24 06:16:38.194180 | orchestrator | Friday 24 April 2026 06:15:46 +0000 (0:00:02.107) 1:13:28.110 ********** 2026-04-24 06:16:38.194191 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.194202 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.194213 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.194224 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:16:38.194258 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:16:38.194270 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:16:38.194281 | orchestrator | 2026-04-24 06:16:38.194291 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-24 06:16:38.194302 | orchestrator | Friday 24 April 2026 06:15:48 +0000 (0:00:02.099) 1:13:30.209 ********** 2026-04-24 06:16:38.194313 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.194325 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.194336 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.194346 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:16:38.194359 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:16:38.194372 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:16:38.194384 | orchestrator | 2026-04-24 06:16:38.194397 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-24 06:16:38.194409 | orchestrator | Friday 24 April 2026 06:15:50 +0000 (0:00:01.938) 1:13:32.147 ********** 2026-04-24 06:16:38.194421 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.194433 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.194446 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.194458 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:16:38.194470 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:16:38.194482 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:16:38.194494 | orchestrator | 2026-04-24 06:16:38.194507 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-24 06:16:38.194519 | orchestrator | Friday 24 April 2026 06:15:52 +0000 (0:00:02.220) 1:13:34.368 ********** 2026-04-24 06:16:38.194531 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.194543 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:16:38.194566 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:16:38.194579 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:16:38.194592 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:16:38.194604 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:16:38.194616 | orchestrator | 2026-04-24 06:16:38.194628 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-24 06:16:38.194640 | orchestrator | Friday 24 April 2026 06:15:54 +0000 (0:00:02.028) 1:13:36.396 ********** 2026-04-24 06:16:38.194652 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.194665 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:16:38.194677 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:16:38.194690 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:16:38.194702 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:16:38.194714 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:16:38.194727 | orchestrator | 2026-04-24 06:16:38.194759 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-24 06:16:38.194771 | orchestrator | Friday 24 April 2026 06:15:56 +0000 (0:00:02.205) 1:13:38.602 ********** 2026-04-24 06:16:38.194781 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.194792 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:16:38.194803 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:16:38.194813 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:16:38.194823 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:16:38.194834 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:16:38.194845 | orchestrator | 2026-04-24 06:16:38.194858 | orchestrator | TASK [ceph-crash : Create client.crash keyring] ******************************** 2026-04-24 06:16:38.194876 | orchestrator | Friday 24 April 2026 06:15:59 +0000 (0:00:02.171) 1:13:40.773 ********** 2026-04-24 06:16:38.194895 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.194913 | orchestrator | 2026-04-24 06:16:38.194924 | orchestrator | TASK [ceph-crash : Get keys from monitors] ************************************* 2026-04-24 06:16:38.194935 | orchestrator | Friday 24 April 2026 06:16:02 +0000 (0:00:03.215) 1:13:43.988 ********** 2026-04-24 06:16:38.194945 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.194956 | orchestrator | 2026-04-24 06:16:38.194967 | orchestrator | TASK [ceph-crash : Copy ceph key(s) if needed] ********************************* 2026-04-24 06:16:38.194977 | orchestrator | Friday 24 April 2026 06:16:05 +0000 (0:00:03.193) 1:13:47.182 ********** 2026-04-24 06:16:38.194997 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.195007 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:16:38.195018 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:16:38.195029 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:16:38.195039 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:16:38.195050 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:16:38.195060 | orchestrator | 2026-04-24 06:16:38.195071 | orchestrator | TASK [ceph-crash : Create /var/lib/ceph/crash/posted] ************************** 2026-04-24 06:16:38.195082 | orchestrator | Friday 24 April 2026 06:16:08 +0000 (0:00:02.671) 1:13:49.853 ********** 2026-04-24 06:16:38.195092 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.195103 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:16:38.195113 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:16:38.195124 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:16:38.195134 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:16:38.195145 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:16:38.195155 | orchestrator | 2026-04-24 06:16:38.195166 | orchestrator | TASK [ceph-crash : Include_tasks systemd.yml] ********************************** 2026-04-24 06:16:38.195193 | orchestrator | Friday 24 April 2026 06:16:10 +0000 (0:00:02.448) 1:13:52.302 ********** 2026-04-24 06:16:38.195206 | orchestrator | included: /ansible/roles/ceph-crash/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:16:38.195218 | orchestrator | 2026-04-24 06:16:38.195229 | orchestrator | TASK [ceph-crash : Generate systemd unit file for ceph-crash container] ******** 2026-04-24 06:16:38.195240 | orchestrator | Friday 24 April 2026 06:16:13 +0000 (0:00:02.483) 1:13:54.786 ********** 2026-04-24 06:16:38.195251 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.195261 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:16:38.195272 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:16:38.195282 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:16:38.195293 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:16:38.195303 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:16:38.195314 | orchestrator | 2026-04-24 06:16:38.195324 | orchestrator | TASK [ceph-crash : Start the ceph-crash service] ******************************* 2026-04-24 06:16:38.195335 | orchestrator | Friday 24 April 2026 06:16:15 +0000 (0:00:02.634) 1:13:57.420 ********** 2026-04-24 06:16:38.195346 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:16:38.195357 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:16:38.195367 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:16:38.195378 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:16:38.195389 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:16:38.195399 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:16:38.195410 | orchestrator | 2026-04-24 06:16:38.195421 | orchestrator | PLAY [Complete upgrade] ******************************************************** 2026-04-24 06:16:38.195431 | orchestrator | 2026-04-24 06:16:38.195442 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 06:16:38.195453 | orchestrator | Friday 24 April 2026 06:16:20 +0000 (0:00:04.497) 1:14:01.918 ********** 2026-04-24 06:16:38.195464 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.195474 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:16:38.195485 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:16:38.195495 | orchestrator | 2026-04-24 06:16:38.195506 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 06:16:38.195517 | orchestrator | Friday 24 April 2026 06:16:21 +0000 (0:00:01.647) 1:14:03.566 ********** 2026-04-24 06:16:38.195527 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.195538 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:16:38.195549 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:16:38.195559 | orchestrator | 2026-04-24 06:16:38.195570 | orchestrator | TASK [Container | disallow pre-reef OSDs and enable all new reef-only functionality] *** 2026-04-24 06:16:38.195582 | orchestrator | Friday 24 April 2026 06:16:23 +0000 (0:00:01.598) 1:14:05.165 ********** 2026-04-24 06:16:38.195592 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:16:38.195610 | orchestrator | 2026-04-24 06:16:38.195621 | orchestrator | TASK [Non container | disallow pre-reef OSDs and enable all new reef-only functionality] *** 2026-04-24 06:16:38.195632 | orchestrator | Friday 24 April 2026 06:16:25 +0000 (0:00:02.285) 1:14:07.451 ********** 2026-04-24 06:16:38.195642 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.195653 | orchestrator | 2026-04-24 06:16:38.195669 | orchestrator | PLAY [Upgrade node-exporter] *************************************************** 2026-04-24 06:16:38.195680 | orchestrator | 2026-04-24 06:16:38.195691 | orchestrator | TASK [Stop node-exporter] ****************************************************** 2026-04-24 06:16:38.195702 | orchestrator | Friday 24 April 2026 06:16:27 +0000 (0:00:02.253) 1:14:09.704 ********** 2026-04-24 06:16:38.195713 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.195724 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.195734 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.195763 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:16:38.195774 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:16:38.195785 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:16:38.195796 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:16:38.195806 | orchestrator | 2026-04-24 06:16:38.195817 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 06:16:38.195828 | orchestrator | Friday 24 April 2026 06:16:29 +0000 (0:00:01.891) 1:14:11.596 ********** 2026-04-24 06:16:38.195839 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.195849 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.195860 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.195870 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:16:38.195881 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:16:38.195891 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:16:38.195902 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:16:38.195913 | orchestrator | 2026-04-24 06:16:38.195923 | orchestrator | TASK [ceph-container-engine : Include pre_requisites/prerequisites.yml] ******** 2026-04-24 06:16:38.195934 | orchestrator | Friday 24 April 2026 06:16:32 +0000 (0:00:02.515) 1:14:14.111 ********** 2026-04-24 06:16:38.195945 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.195955 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.195966 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.195976 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:16:38.195987 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:16:38.195997 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:16:38.196008 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:16:38.196018 | orchestrator | 2026-04-24 06:16:38.196029 | orchestrator | TASK [ceph-container-common : Container registry authentication] *************** 2026-04-24 06:16:38.196040 | orchestrator | Friday 24 April 2026 06:16:34 +0000 (0:00:02.427) 1:14:16.539 ********** 2026-04-24 06:16:38.196051 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.196061 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.196071 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.196082 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:16:38.196092 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:16:38.196103 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:16:38.196114 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:16:38.196124 | orchestrator | 2026-04-24 06:16:38.196135 | orchestrator | TASK [ceph-node-exporter : Include setup_container.yml] ************************ 2026-04-24 06:16:38.196146 | orchestrator | Friday 24 April 2026 06:16:37 +0000 (0:00:02.810) 1:14:19.350 ********** 2026-04-24 06:16:38.196157 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:16:38.196167 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:16:38.196178 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:16:38.196196 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:17:25.374878 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:17:25.374986 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:17:25.375002 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375014 | orchestrator | 2026-04-24 06:17:25.375050 | orchestrator | PLAY [Upgrade monitoring node] ************************************************* 2026-04-24 06:17:25.375063 | orchestrator | 2026-04-24 06:17:25.375074 | orchestrator | TASK [Stop monitoring services] ************************************************ 2026-04-24 06:17:25.375085 | orchestrator | Friday 24 April 2026 06:16:40 +0000 (0:00:02.979) 1:14:22.330 ********** 2026-04-24 06:17:25.375097 | orchestrator | skipping: [testbed-manager] => (item=alertmanager)  2026-04-24 06:17:25.375109 | orchestrator | skipping: [testbed-manager] => (item=prometheus)  2026-04-24 06:17:25.375120 | orchestrator | skipping: [testbed-manager] => (item=grafana-server)  2026-04-24 06:17:25.375131 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375142 | orchestrator | 2026-04-24 06:17:25.375153 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv4] ************************ 2026-04-24 06:17:25.375163 | orchestrator | Friday 24 April 2026 06:16:41 +0000 (0:00:01.135) 1:14:23.465 ********** 2026-04-24 06:17:25.375174 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375185 | orchestrator | 2026-04-24 06:17:25.375196 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv6] ************************ 2026-04-24 06:17:25.375207 | orchestrator | Friday 24 April 2026 06:16:42 +0000 (0:00:01.111) 1:14:24.577 ********** 2026-04-24 06:17:25.375217 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375228 | orchestrator | 2026-04-24 06:17:25.375239 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv4] *********************** 2026-04-24 06:17:25.375250 | orchestrator | Friday 24 April 2026 06:16:43 +0000 (0:00:01.121) 1:14:25.699 ********** 2026-04-24 06:17:25.375261 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375272 | orchestrator | 2026-04-24 06:17:25.375282 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv6] *********************** 2026-04-24 06:17:25.375293 | orchestrator | Friday 24 April 2026 06:16:45 +0000 (0:00:01.149) 1:14:26.849 ********** 2026-04-24 06:17:25.375304 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375315 | orchestrator | 2026-04-24 06:17:25.375326 | orchestrator | TASK [ceph-prometheus : Create prometheus directories] ************************* 2026-04-24 06:17:25.375337 | orchestrator | Friday 24 April 2026 06:16:46 +0000 (0:00:01.134) 1:14:27.984 ********** 2026-04-24 06:17:25.375348 | orchestrator | skipping: [testbed-manager] => (item=/etc/prometheus)  2026-04-24 06:17:25.375359 | orchestrator | skipping: [testbed-manager] => (item=/var/lib/prometheus)  2026-04-24 06:17:25.375370 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375381 | orchestrator | 2026-04-24 06:17:25.375392 | orchestrator | TASK [ceph-prometheus : Write prometheus config file] ************************** 2026-04-24 06:17:25.375403 | orchestrator | Friday 24 April 2026 06:16:47 +0000 (0:00:01.257) 1:14:29.241 ********** 2026-04-24 06:17:25.375414 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375424 | orchestrator | 2026-04-24 06:17:25.375435 | orchestrator | TASK [ceph-prometheus : Make sure the alerting rules directory exists] ********* 2026-04-24 06:17:25.375460 | orchestrator | Friday 24 April 2026 06:16:48 +0000 (0:00:01.094) 1:14:30.336 ********** 2026-04-24 06:17:25.375472 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375483 | orchestrator | 2026-04-24 06:17:25.375494 | orchestrator | TASK [ceph-prometheus : Copy alerting rules] *********************************** 2026-04-24 06:17:25.375505 | orchestrator | Friday 24 April 2026 06:16:49 +0000 (0:00:01.126) 1:14:31.463 ********** 2026-04-24 06:17:25.375515 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375526 | orchestrator | 2026-04-24 06:17:25.375537 | orchestrator | TASK [ceph-prometheus : Create alertmanager directories] *********************** 2026-04-24 06:17:25.375549 | orchestrator | Friday 24 April 2026 06:16:50 +0000 (0:00:01.178) 1:14:32.641 ********** 2026-04-24 06:17:25.375560 | orchestrator | skipping: [testbed-manager] => (item=/etc/alertmanager)  2026-04-24 06:17:25.375570 | orchestrator | skipping: [testbed-manager] => (item=/var/lib/alertmanager)  2026-04-24 06:17:25.375581 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375592 | orchestrator | 2026-04-24 06:17:25.375603 | orchestrator | TASK [ceph-prometheus : Write alertmanager config file] ************************ 2026-04-24 06:17:25.375622 | orchestrator | Friday 24 April 2026 06:16:52 +0000 (0:00:01.163) 1:14:33.805 ********** 2026-04-24 06:17:25.375633 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375643 | orchestrator | 2026-04-24 06:17:25.375654 | orchestrator | TASK [ceph-prometheus : Include setup_container.yml] *************************** 2026-04-24 06:17:25.375665 | orchestrator | Friday 24 April 2026 06:16:53 +0000 (0:00:01.122) 1:14:34.927 ********** 2026-04-24 06:17:25.375675 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375686 | orchestrator | 2026-04-24 06:17:25.375697 | orchestrator | TASK [ceph-grafana : Include setup_container.yml] ****************************** 2026-04-24 06:17:25.375772 | orchestrator | Friday 24 April 2026 06:16:54 +0000 (0:00:01.203) 1:14:36.131 ********** 2026-04-24 06:17:25.375785 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375796 | orchestrator | 2026-04-24 06:17:25.375807 | orchestrator | TASK [ceph-grafana : Include configure_grafana.yml] **************************** 2026-04-24 06:17:25.375817 | orchestrator | Friday 24 April 2026 06:16:55 +0000 (0:00:01.186) 1:14:37.318 ********** 2026-04-24 06:17:25.375828 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:25.375839 | orchestrator | 2026-04-24 06:17:25.375850 | orchestrator | PLAY [Upgrade ceph dashboard] ************************************************** 2026-04-24 06:17:25.375860 | orchestrator | 2026-04-24 06:17:25.375871 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-24 06:17:25.375881 | orchestrator | Friday 24 April 2026 06:16:57 +0000 (0:00:01.982) 1:14:39.300 ********** 2026-04-24 06:17:25.375892 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:17:25.375903 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:17:25.375914 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:17:25.375924 | orchestrator | 2026-04-24 06:17:25.375935 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv4] ************************ 2026-04-24 06:17:25.375946 | orchestrator | Friday 24 April 2026 06:16:58 +0000 (0:00:01.407) 1:14:40.707 ********** 2026-04-24 06:17:25.375956 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:17:25.375967 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:17:25.375993 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:17:25.376005 | orchestrator | 2026-04-24 06:17:25.376015 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv6] ************************ 2026-04-24 06:17:25.376026 | orchestrator | Friday 24 April 2026 06:17:00 +0000 (0:00:01.379) 1:14:42.086 ********** 2026-04-24 06:17:25.376037 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:17:25.376047 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:17:25.376058 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:17:25.376069 | orchestrator | 2026-04-24 06:17:25.376080 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv4] *********************** 2026-04-24 06:17:25.376090 | orchestrator | Friday 24 April 2026 06:17:02 +0000 (0:00:01.703) 1:14:43.790 ********** 2026-04-24 06:17:25.376101 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:17:25.376112 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:17:25.376123 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:17:25.376134 | orchestrator | 2026-04-24 06:17:25.376145 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv6] *********************** 2026-04-24 06:17:25.376155 | orchestrator | Friday 24 April 2026 06:17:03 +0000 (0:00:01.441) 1:14:45.231 ********** 2026-04-24 06:17:25.376166 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:17:25.376177 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:17:25.376187 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:17:25.376198 | orchestrator | 2026-04-24 06:17:25.376209 | orchestrator | TASK [ceph-dashboard : Include configure_dashboard.yml] ************************ 2026-04-24 06:17:25.376220 | orchestrator | Friday 24 April 2026 06:17:04 +0000 (0:00:01.339) 1:14:46.570 ********** 2026-04-24 06:17:25.376230 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:17:25.376241 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:17:25.376252 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:17:25.376262 | orchestrator | 2026-04-24 06:17:25.376273 | orchestrator | TASK [ceph-dashboard : Print dashboard URL] ************************************ 2026-04-24 06:17:25.376292 | orchestrator | Friday 24 April 2026 06:17:06 +0000 (0:00:01.472) 1:14:48.043 ********** 2026-04-24 06:17:25.376302 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:17:25.376313 | orchestrator | 2026-04-24 06:17:25.376324 | orchestrator | PLAY [Switch any existing crush buckets to straw2] ***************************** 2026-04-24 06:17:25.376334 | orchestrator | 2026-04-24 06:17:25.376345 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-24 06:17:25.376356 | orchestrator | Friday 24 April 2026 06:17:08 +0000 (0:00:01.702) 1:14:49.746 ********** 2026-04-24 06:17:25.376367 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:17:25.376378 | orchestrator | 2026-04-24 06:17:25.376389 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-24 06:17:25.376400 | orchestrator | Friday 24 April 2026 06:17:09 +0000 (0:00:01.460) 1:14:51.207 ********** 2026-04-24 06:17:25.376410 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:17:25.376421 | orchestrator | 2026-04-24 06:17:25.376432 | orchestrator | TASK [Set_fact ceph_cmd] ******************************************************* 2026-04-24 06:17:25.376443 | orchestrator | Friday 24 April 2026 06:17:10 +0000 (0:00:01.174) 1:14:52.382 ********** 2026-04-24 06:17:25.376454 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:17:25.376465 | orchestrator | 2026-04-24 06:17:25.376482 | orchestrator | TASK [Backup the crushmap] ***************************************************** 2026-04-24 06:17:25.376493 | orchestrator | Friday 24 April 2026 06:17:11 +0000 (0:00:01.141) 1:14:53.524 ********** 2026-04-24 06:17:25.376503 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:17:25.376514 | orchestrator | 2026-04-24 06:17:25.376525 | orchestrator | TASK [Switch crush buckets to straw2] ****************************************** 2026-04-24 06:17:25.376536 | orchestrator | Friday 24 April 2026 06:17:14 +0000 (0:00:02.893) 1:14:56.417 ********** 2026-04-24 06:17:25.376547 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:17:25.376557 | orchestrator | 2026-04-24 06:17:25.376568 | orchestrator | TASK [Remove crushmap backup] ************************************************** 2026-04-24 06:17:25.376579 | orchestrator | Friday 24 April 2026 06:17:18 +0000 (0:00:03.704) 1:15:00.122 ********** 2026-04-24 06:17:25.376589 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:17:25.376600 | orchestrator | 2026-04-24 06:17:25.376612 | orchestrator | PLAY [Show ceph status] ******************************************************** 2026-04-24 06:17:25.376622 | orchestrator | 2026-04-24 06:17:25.376633 | orchestrator | TASK [Set_fact container_exec_cmd_status] ************************************** 2026-04-24 06:17:25.376644 | orchestrator | Friday 24 April 2026 06:17:20 +0000 (0:00:02.107) 1:15:02.230 ********** 2026-04-24 06:17:25.376655 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:17:25.376666 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:17:25.376677 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:17:25.376688 | orchestrator | 2026-04-24 06:17:25.376699 | orchestrator | TASK [Show ceph status] ******************************************************** 2026-04-24 06:17:25.376728 | orchestrator | Friday 24 April 2026 06:17:21 +0000 (0:00:01.407) 1:15:03.638 ********** 2026-04-24 06:17:25.376739 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:17:25.376750 | orchestrator | 2026-04-24 06:17:25.376761 | orchestrator | TASK [Show all daemons version] ************************************************ 2026-04-24 06:17:25.376772 | orchestrator | Friday 24 April 2026 06:17:24 +0000 (0:00:02.243) 1:15:05.881 ********** 2026-04-24 06:17:25.376783 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:17:25.376794 | orchestrator | 2026-04-24 06:17:25.376805 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:17:25.376816 | orchestrator | localhost : ok=0 changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 06:17:25.376828 | orchestrator | testbed-manager : ok=25  changed=1  unreachable=0 failed=0 skipped=76  rescued=0 ignored=0 2026-04-24 06:17:25.376839 | orchestrator | testbed-node-0 : ok=248  changed=19  unreachable=0 failed=0 skipped=369  rescued=0 ignored=0 2026-04-24 06:17:25.376857 | orchestrator | testbed-node-1 : ok=191  changed=14  unreachable=0 failed=0 skipped=343  rescued=0 ignored=0 2026-04-24 06:17:25.376875 | orchestrator | testbed-node-2 : ok=196  changed=14  unreachable=0 failed=0 skipped=344  rescued=0 ignored=0 2026-04-24 06:17:28.651398 | orchestrator | testbed-node-3 : ok=317  changed=20  unreachable=0 failed=0 skipped=355  rescued=0 ignored=0 2026-04-24 06:17:28.651488 | orchestrator | testbed-node-4 : ok=307  changed=17  unreachable=0 failed=0 skipped=352  rescued=0 ignored=0 2026-04-24 06:17:28.651501 | orchestrator | testbed-node-5 : ok=303  changed=17  unreachable=0 failed=0 skipped=337  rescued=0 ignored=0 2026-04-24 06:17:28.651513 | orchestrator | 2026-04-24 06:17:28.651525 | orchestrator | 2026-04-24 06:17:28.651536 | orchestrator | 2026-04-24 06:17:28.651548 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:17:28.651560 | orchestrator | Friday 24 April 2026 06:17:27 +0000 (0:00:03.785) 1:15:09.667 ********** 2026-04-24 06:17:28.651572 | orchestrator | =============================================================================== 2026-04-24 06:17:28.651583 | orchestrator | Disable pg autoscale on pools ------------------------------------------ 75.61s 2026-04-24 06:17:28.651594 | orchestrator | Re-enable pg autoscale on pools ---------------------------------------- 73.50s 2026-04-24 06:17:28.651605 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 31.89s 2026-04-24 06:17:28.651616 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 31.87s 2026-04-24 06:17:28.651627 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 31.60s 2026-04-24 06:17:28.651638 | orchestrator | Gather and delegate facts ---------------------------------------------- 30.62s 2026-04-24 06:17:28.651649 | orchestrator | Waiting for clean pgs... ----------------------------------------------- 30.15s 2026-04-24 06:17:28.651660 | orchestrator | ceph-mon : Set cluster configs ----------------------------------------- 28.32s 2026-04-24 06:17:28.651672 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 22.89s 2026-04-24 06:17:28.651683 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 22.85s 2026-04-24 06:17:28.651694 | orchestrator | ceph-config : Set config to cluster ------------------------------------ 21.73s 2026-04-24 06:17:28.651746 | orchestrator | Stop ceph mgr ---------------------------------------------------------- 18.15s 2026-04-24 06:17:28.651758 | orchestrator | Create potentially missing keys (rbd and rbd-mirror) ------------------- 16.02s 2026-04-24 06:17:28.651769 | orchestrator | ceph-osd : Wait for all osd to be up ----------------------------------- 15.55s 2026-04-24 06:17:28.651779 | orchestrator | ceph-config : Set config to cluster ------------------------------------ 14.16s 2026-04-24 06:17:28.651809 | orchestrator | ceph-config : Set osd_memory_target to cluster host config ------------- 12.79s 2026-04-24 06:17:28.651820 | orchestrator | ceph-config : Set osd_memory_target to cluster host config ------------- 12.52s 2026-04-24 06:17:28.651831 | orchestrator | Stop ceph osd ---------------------------------------------------------- 11.59s 2026-04-24 06:17:28.651841 | orchestrator | ceph-infra : Update cache for Debian based OSs ------------------------- 11.27s 2026-04-24 06:17:28.651852 | orchestrator | Set cluster configs ---------------------------------------------------- 10.41s 2026-04-24 06:17:28.838791 | orchestrator | + osism apply cephclient 2026-04-24 06:17:30.130439 | orchestrator | 2026-04-24 06:17:30 | INFO  | Prepare task for execution of cephclient. 2026-04-24 06:17:30.211859 | orchestrator | 2026-04-24 06:17:30 | INFO  | Task c8879ba9-9ec5-4fae-ab8c-d08181534c58 (cephclient) was prepared for execution. 2026-04-24 06:17:30.211962 | orchestrator | 2026-04-24 06:17:30 | INFO  | It takes a moment until task c8879ba9-9ec5-4fae-ab8c-d08181534c58 (cephclient) has been started and output is visible here. 2026-04-24 06:17:48.378208 | orchestrator | 2026-04-24 06:17:48.378318 | orchestrator | PLAY [Apply role cephclient] *************************************************** 2026-04-24 06:17:48.378336 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 06:17:48.378350 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 06:17:48.378372 | orchestrator | 2026-04-24 06:17:48.378383 | orchestrator | TASK [osism.services.cephclient : Include container tasks] ********************* 2026-04-24 06:17:48.378394 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 06:17:48.378405 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 06:17:48.378427 | orchestrator | Friday 24 April 2026 06:17:35 +0000 (0:00:01.598) 0:00:01.598 ********** 2026-04-24 06:17:48.378438 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/cephclient/tasks/container.yml for testbed-manager 2026-04-24 06:17:48.378451 | orchestrator | 2026-04-24 06:17:48.378462 | orchestrator | TASK [osism.services.cephclient : Create required directories] ***************** 2026-04-24 06:17:48.378473 | orchestrator | Friday 24 April 2026 06:17:36 +0000 (0:00:00.865) 0:00:02.463 ********** 2026-04-24 06:17:48.378484 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient/configuration) 2026-04-24 06:17:48.378494 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient/data) 2026-04-24 06:17:48.378506 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient) 2026-04-24 06:17:48.378516 | orchestrator | 2026-04-24 06:17:48.378527 | orchestrator | TASK [osism.services.cephclient : Copy configuration files] ******************** 2026-04-24 06:17:48.378538 | orchestrator | Friday 24 April 2026 06:17:38 +0000 (0:00:01.638) 0:00:04.102 ********** 2026-04-24 06:17:48.378549 | orchestrator | ok: [testbed-manager] => (item={'src': 'ceph.conf.j2', 'dest': '/opt/cephclient/configuration/ceph.conf'}) 2026-04-24 06:17:48.378560 | orchestrator | 2026-04-24 06:17:48.378571 | orchestrator | TASK [osism.services.cephclient : Copy keyring file] *************************** 2026-04-24 06:17:48.378582 | orchestrator | Friday 24 April 2026 06:17:39 +0000 (0:00:01.094) 0:00:05.196 ********** 2026-04-24 06:17:48.378593 | orchestrator | ok: [testbed-manager] 2026-04-24 06:17:48.378604 | orchestrator | 2026-04-24 06:17:48.378615 | orchestrator | TASK [osism.services.cephclient : Copy docker-compose.yml file] **************** 2026-04-24 06:17:48.378628 | orchestrator | Friday 24 April 2026 06:17:40 +0000 (0:00:00.905) 0:00:06.102 ********** 2026-04-24 06:17:48.378645 | orchestrator | ok: [testbed-manager] 2026-04-24 06:17:48.378663 | orchestrator | 2026-04-24 06:17:48.378674 | orchestrator | TASK [osism.services.cephclient : Manage cephclient service] ******************* 2026-04-24 06:17:48.378685 | orchestrator | Friday 24 April 2026 06:17:41 +0000 (0:00:00.927) 0:00:07.029 ********** 2026-04-24 06:17:48.378734 | orchestrator | ok: [testbed-manager] 2026-04-24 06:17:48.378753 | orchestrator | 2026-04-24 06:17:48.378770 | orchestrator | TASK [osism.services.cephclient : Copy wrapper scripts] ************************ 2026-04-24 06:17:48.378784 | orchestrator | Friday 24 April 2026 06:17:42 +0000 (0:00:01.385) 0:00:08.415 ********** 2026-04-24 06:17:48.378797 | orchestrator | ok: [testbed-manager] => (item=ceph) 2026-04-24 06:17:48.378810 | orchestrator | ok: [testbed-manager] => (item=ceph-authtool) 2026-04-24 06:17:48.378823 | orchestrator | ok: [testbed-manager] => (item=rados) 2026-04-24 06:17:48.378835 | orchestrator | ok: [testbed-manager] => (item=radosgw-admin) 2026-04-24 06:17:48.378848 | orchestrator | ok: [testbed-manager] => (item=rbd) 2026-04-24 06:17:48.378860 | orchestrator | 2026-04-24 06:17:48.378872 | orchestrator | TASK [osism.services.cephclient : Remove old wrapper scripts] ****************** 2026-04-24 06:17:48.378884 | orchestrator | Friday 24 April 2026 06:17:46 +0000 (0:00:04.004) 0:00:12.419 ********** 2026-04-24 06:17:48.378897 | orchestrator | ok: [testbed-manager] => (item=crushtool) 2026-04-24 06:17:48.378938 | orchestrator | 2026-04-24 06:17:48.378951 | orchestrator | TASK [osism.services.cephclient : Include package tasks] *********************** 2026-04-24 06:17:48.378963 | orchestrator | Friday 24 April 2026 06:17:46 +0000 (0:00:00.494) 0:00:12.914 ********** 2026-04-24 06:17:48.378976 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:48.378989 | orchestrator | 2026-04-24 06:17:48.379001 | orchestrator | TASK [osism.services.cephclient : Include rook task] *************************** 2026-04-24 06:17:48.379014 | orchestrator | Friday 24 April 2026 06:17:47 +0000 (0:00:00.177) 0:00:13.091 ********** 2026-04-24 06:17:48.379026 | orchestrator | skipping: [testbed-manager] 2026-04-24 06:17:48.379038 | orchestrator | 2026-04-24 06:17:48.379050 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:17:48.379077 | orchestrator | testbed-manager : ok=8  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 06:17:48.379090 | orchestrator | 2026-04-24 06:17:48.379102 | orchestrator | 2026-04-24 06:17:48.379115 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:17:48.379125 | orchestrator | Friday 24 April 2026 06:17:48 +0000 (0:00:00.877) 0:00:13.969 ********** 2026-04-24 06:17:48.379136 | orchestrator | =============================================================================== 2026-04-24 06:17:48.379146 | orchestrator | osism.services.cephclient : Copy wrapper scripts ------------------------ 4.00s 2026-04-24 06:17:48.379157 | orchestrator | osism.services.cephclient : Create required directories ----------------- 1.64s 2026-04-24 06:17:48.379167 | orchestrator | osism.services.cephclient : Manage cephclient service ------------------- 1.39s 2026-04-24 06:17:48.379178 | orchestrator | osism.services.cephclient : Copy configuration files -------------------- 1.09s 2026-04-24 06:17:48.379188 | orchestrator | osism.services.cephclient : Copy docker-compose.yml file ---------------- 0.93s 2026-04-24 06:17:48.379199 | orchestrator | osism.services.cephclient : Copy keyring file --------------------------- 0.91s 2026-04-24 06:17:48.379228 | orchestrator | osism.services.cephclient : Include rook task --------------------------- 0.88s 2026-04-24 06:17:48.379239 | orchestrator | osism.services.cephclient : Include container tasks --------------------- 0.87s 2026-04-24 06:17:48.379257 | orchestrator | osism.services.cephclient : Remove old wrapper scripts ------------------ 0.49s 2026-04-24 06:17:48.379275 | orchestrator | osism.services.cephclient : Include package tasks ----------------------- 0.18s 2026-04-24 06:17:48.566459 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-24 06:17:48.566551 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/300-openstack.sh 2026-04-24 06:17:48.572431 | orchestrator | + set -e 2026-04-24 06:17:48.572485 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 06:17:48.572507 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 06:17:48.572523 | orchestrator | ++ INTERACTIVE=false 2026-04-24 06:17:48.572534 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 06:17:48.572843 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 06:17:48.572866 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 06:17:48.572877 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 06:17:48.572888 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 06:17:48.572898 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 06:17:48.572909 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 06:17:48.572920 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 06:17:48.572931 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 06:17:48.572941 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 06:17:48.572952 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 06:17:48.572963 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 06:17:48.572974 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 06:17:48.572984 | orchestrator | ++ export ARA=false 2026-04-24 06:17:48.572995 | orchestrator | ++ ARA=false 2026-04-24 06:17:48.573005 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 06:17:48.573016 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 06:17:48.573026 | orchestrator | ++ export TEMPEST=false 2026-04-24 06:17:48.573036 | orchestrator | ++ TEMPEST=false 2026-04-24 06:17:48.573047 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 06:17:48.573057 | orchestrator | ++ IS_ZUUL=true 2026-04-24 06:17:48.573068 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 06:17:48.573079 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 06:17:48.573116 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 06:17:48.573127 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 06:17:48.573138 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 06:17:48.573148 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 06:17:48.573159 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 06:17:48.573170 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 06:17:48.573180 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 06:17:48.573191 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 06:17:48.573201 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-24 06:17:48.573212 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-24 06:17:48.573223 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 06:17:48.573848 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 06:17:48.584353 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-24 06:17:48.584405 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-24 06:17:48.584417 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-24 06:17:48.584429 | orchestrator | + osism migrate rabbitmq3to4 prepare 2026-04-24 06:17:57.704425 | orchestrator | 2026-04-24 06:17:57 | ERROR  | Unable to get ansible vault password 2026-04-24 06:17:57.704551 | orchestrator | 2026-04-24 06:17:57 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-24 06:17:57.704579 | orchestrator | 2026-04-24 06:17:57 | ERROR  | Dropping encrypted entries 2026-04-24 06:17:57.753416 | orchestrator | 2026-04-24 06:17:57 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-24 06:17:57.754487 | orchestrator | 2026-04-24 06:17:57 | INFO  | Kolla configuration check passed 2026-04-24 06:17:57.962065 | orchestrator | 2026-04-24 06:17:57 | INFO  | Created vhost 'openstack' with default_queue_type=quorum 2026-04-24 06:17:57.979158 | orchestrator | 2026-04-24 06:17:57 | INFO  | Set permissions for user 'openstack' on vhost 'openstack' 2026-04-24 06:17:58.224223 | orchestrator | + osism migrate rabbitmq3to4 list 2026-04-24 06:18:04.363542 | orchestrator | 2026-04-24 06:18:04 | ERROR  | Unable to get ansible vault password 2026-04-24 06:18:04.363634 | orchestrator | 2026-04-24 06:18:04 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-24 06:18:04.363647 | orchestrator | 2026-04-24 06:18:04 | ERROR  | Dropping encrypted entries 2026-04-24 06:18:04.396606 | orchestrator | 2026-04-24 06:18:04 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-24 06:18:04.566889 | orchestrator | 2026-04-24 06:18:04 | INFO  | Found 208 classic queue(s) in vhost '/': 2026-04-24 06:18:04.567073 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - alarm.all.sample (vhost: /, messages: 0) 2026-04-24 06:18:04.567093 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - alarming.sample (vhost: /, messages: 0) 2026-04-24 06:18:04.567105 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - barbican.workers (vhost: /, messages: 0) 2026-04-24 06:18:04.567117 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - barbican.workers.barbican.queue (vhost: /, messages: 0) 2026-04-24 06:18:04.567129 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - barbican.workers_fanout_5654fe38e51c413b8ca697c01813e421 (vhost: /, messages: 0) 2026-04-24 06:18:04.567142 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - barbican.workers_fanout_7730d1e7c1a540dc8f4a5a262198ece6 (vhost: /, messages: 0) 2026-04-24 06:18:04.567245 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - barbican.workers_fanout_927797a05f5548b1a995a3384d4f01b7 (vhost: /, messages: 0) 2026-04-24 06:18:04.567257 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - barbican_notifications.info (vhost: /, messages: 0) 2026-04-24 06:18:04.567294 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central (vhost: /, messages: 1) 2026-04-24 06:18:04.567306 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.567809 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.567849 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.567941 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central_fanout_130da31f625b4731afc79c4855431b9f (vhost: /, messages: 0) 2026-04-24 06:18:04.568242 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central_fanout_151f71e4103642f383d713017715e3ac (vhost: /, messages: 0) 2026-04-24 06:18:04.568270 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central_fanout_3085af900251476aab7b40755ddfb61f (vhost: /, messages: 0) 2026-04-24 06:18:04.568957 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central_fanout_72603ae84ebe457a9a913cdb79d9f346 (vhost: /, messages: 0) 2026-04-24 06:18:04.569088 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central_fanout_eafff618510b47d78b0a62076809ae04 (vhost: /, messages: 0) 2026-04-24 06:18:04.569122 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - central_fanout_f367dcde0390415894b159af18895703 (vhost: /, messages: 0) 2026-04-24 06:18:04.569536 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-backup (vhost: /, messages: 0) 2026-04-24 06:18:04.569565 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-backup.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.569646 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-backup.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.569668 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-backup.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.569838 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-backup_fanout_444b3857a4ea40dd8b719a2eb4e6da1f (vhost: /, messages: 0) 2026-04-24 06:18:04.570215 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-backup_fanout_97d8e168e9814995909861d77c331e4c (vhost: /, messages: 0) 2026-04-24 06:18:04.570425 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-backup_fanout_f2857c6a6c1448abb36079b7b3dda35c (vhost: /, messages: 0) 2026-04-24 06:18:04.570445 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-scheduler (vhost: /, messages: 0) 2026-04-24 06:18:04.570780 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.570802 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.570813 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.570986 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-scheduler_fanout_3f0d4b4845a240238090cd0c677d4ab5 (vhost: /, messages: 0) 2026-04-24 06:18:04.571274 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-scheduler_fanout_60bf90ccb4414834ae6f06022d576a00 (vhost: /, messages: 0) 2026-04-24 06:18:04.571294 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-scheduler_fanout_61fa299a8ad848c192529435ec097d46 (vhost: /, messages: 0) 2026-04-24 06:18:04.571305 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume (vhost: /, messages: 0) 2026-04-24 06:18:04.571465 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes (vhost: /, messages: 0) 2026-04-24 06:18:04.571483 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.571812 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout_cfb4b46c64f24d82ad9c2738592b3cfc (vhost: /, messages: 0) 2026-04-24 06:18:04.571973 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes (vhost: /, messages: 0) 2026-04-24 06:18:04.571989 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.572000 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout_fcabb05e0aa94eceba9b3dbec8b5c7e1 (vhost: /, messages: 0) 2026-04-24 06:18:04.572174 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes (vhost: /, messages: 0) 2026-04-24 06:18:04.572191 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.572300 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout_c32d2dfdb5fb45d4926233a9f7103d66 (vhost: /, messages: 0) 2026-04-24 06:18:04.572592 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume_fanout_161e33c589e045df9f029edf8cfebb01 (vhost: /, messages: 0) 2026-04-24 06:18:04.572614 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume_fanout_50c37df6d3244555b2ecdd32367db633 (vhost: /, messages: 0) 2026-04-24 06:18:04.572624 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - cinder-volume_fanout_7c1ed00034be4af7b1e889475d180ec5 (vhost: /, messages: 0) 2026-04-24 06:18:04.572762 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - compute (vhost: /, messages: 0) 2026-04-24 06:18:04.572834 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - compute.testbed-node-3 (vhost: /, messages: 0) 2026-04-24 06:18:04.573159 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - compute.testbed-node-4 (vhost: /, messages: 0) 2026-04-24 06:18:04.573461 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - compute.testbed-node-5 (vhost: /, messages: 0) 2026-04-24 06:18:04.573477 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - compute_fanout_7edec15b18eb4e94a8850b038c7a3689 (vhost: /, messages: 0) 2026-04-24 06:18:04.573487 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - compute_fanout_b452018f8f7d46f68c143290cc3b3564 (vhost: /, messages: 0) 2026-04-24 06:18:04.573497 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - compute_fanout_eaee2c69cdba449a8ed1844d35c8d946 (vhost: /, messages: 0) 2026-04-24 06:18:04.573507 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor (vhost: /, messages: 1) 2026-04-24 06:18:04.573726 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.573743 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.573884 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.573899 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor_fanout_1a9ea1b743e549a38360fe38e112b199 (vhost: /, messages: 0) 2026-04-24 06:18:04.574120 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor_fanout_1ff7121be6264f428821fe00316fe997 (vhost: /, messages: 0) 2026-04-24 06:18:04.574140 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor_fanout_7c4874c0852a40519d0628c5a596503e (vhost: /, messages: 0) 2026-04-24 06:18:04.574285 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor_fanout_8d82379e7cbc420fa2cb16dd73d8cf1b (vhost: /, messages: 0) 2026-04-24 06:18:04.574301 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor_fanout_f27391de010647d9a556ecd9b97656cd (vhost: /, messages: 0) 2026-04-24 06:18:04.574505 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - conductor_fanout_fbb2bd4bc5fb4961b49b7341a6678b1d (vhost: /, messages: 0) 2026-04-24 06:18:04.574517 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - event.sample (vhost: /, messages: 7) 2026-04-24 06:18:04.574670 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor (vhost: /, messages: 0) 2026-04-24 06:18:04.574904 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor.4o55btlllkt4 (vhost: /, messages: 0) 2026-04-24 06:18:04.574926 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor.6pvc7wylozkj (vhost: /, messages: 0) 2026-04-24 06:18:04.574991 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor.rmzip36to2n6 (vhost: /, messages: 0) 2026-04-24 06:18:04.575042 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_0250d2169be344f089f4ba0f5747d528 (vhost: /, messages: 0) 2026-04-24 06:18:04.575210 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_17b0a7ad71bb4a0b90de86fc11c8b5ff (vhost: /, messages: 0) 2026-04-24 06:18:04.575414 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_36b8e58eee7643d497a0a6fd2ff342f9 (vhost: /, messages: 0) 2026-04-24 06:18:04.575462 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_4d59dcfc9ff249a7a65b7c57823b879d (vhost: /, messages: 0) 2026-04-24 06:18:04.575473 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_6f06eae86ff0433eb842a1d2d4dd933d (vhost: /, messages: 0) 2026-04-24 06:18:04.575701 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_979ee6972d9a4395accc561139e7aefd (vhost: /, messages: 0) 2026-04-24 06:18:04.575767 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_dea39d31789a463dbf57dcf3f1112751 (vhost: /, messages: 0) 2026-04-24 06:18:04.575837 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_e176bacec11440ac9a91d173d1a91d01 (vhost: /, messages: 0) 2026-04-24 06:18:04.575851 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - magnum-conductor_fanout_f646013dfe354c1abcf666d37019e365 (vhost: /, messages: 0) 2026-04-24 06:18:04.576014 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-data (vhost: /, messages: 0) 2026-04-24 06:18:04.576027 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-data.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.576123 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-data.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.576337 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-data.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.576350 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-data_fanout_191c3dc8693b4183bd10bceac48ea6d2 (vhost: /, messages: 0) 2026-04-24 06:18:04.576449 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-data_fanout_54706f194a3c4c73860b1b99f2d0038f (vhost: /, messages: 0) 2026-04-24 06:18:04.576513 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-data_fanout_8488164158e049c788ef9ba095290e68 (vhost: /, messages: 0) 2026-04-24 06:18:04.576609 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-scheduler (vhost: /, messages: 0) 2026-04-24 06:18:04.576672 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.576868 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.576942 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.577057 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-scheduler_fanout_35081af844fd47be9517ad130c620c8b (vhost: /, messages: 0) 2026-04-24 06:18:04.577129 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-scheduler_fanout_4c4d2c3737144b5db50cb5562201e895 (vhost: /, messages: 0) 2026-04-24 06:18:04.577253 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-scheduler_fanout_6f2bca9b785f4b8bb83805f95da6cae0 (vhost: /, messages: 0) 2026-04-24 06:18:04.577362 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-share (vhost: /, messages: 0) 2026-04-24 06:18:04.577373 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-share.testbed-node-0@cephfsnative1 (vhost: /, messages: 0) 2026-04-24 06:18:04.577486 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-share.testbed-node-1@cephfsnative1 (vhost: /, messages: 0) 2026-04-24 06:18:04.577530 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-share.testbed-node-2@cephfsnative1 (vhost: /, messages: 0) 2026-04-24 06:18:04.577633 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-share_fanout_4859c8a75edd428bbdfcc76cf0e6c994 (vhost: /, messages: 0) 2026-04-24 06:18:04.577676 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-share_fanout_a64e989c852f41cdba33ffe08c29098a (vhost: /, messages: 0) 2026-04-24 06:18:04.577826 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - manila-share_fanout_fc0e16881dfa441b87ba064c46afd1e3 (vhost: /, messages: 0) 2026-04-24 06:18:04.578058 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - notifications.audit (vhost: /, messages: 0) 2026-04-24 06:18:04.578230 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - notifications.critical (vhost: /, messages: 0) 2026-04-24 06:18:04.578362 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - notifications.debug (vhost: /, messages: 0) 2026-04-24 06:18:04.578374 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - notifications.error (vhost: /, messages: 0) 2026-04-24 06:18:04.578381 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - notifications.info (vhost: /, messages: 0) 2026-04-24 06:18:04.578656 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - notifications.sample (vhost: /, messages: 0) 2026-04-24 06:18:04.578668 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - notifications.warn (vhost: /, messages: 0) 2026-04-24 06:18:04.578849 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - octavia_provisioning_v2 (vhost: /, messages: 0) 2026-04-24 06:18:04.578862 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - octavia_provisioning_v2.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.578941 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - octavia_provisioning_v2.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.579025 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - octavia_provisioning_v2.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.579068 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - octavia_provisioning_v2_fanout_507e2bcc110c44bba048ae04ed19c2f4 (vhost: /, messages: 0) 2026-04-24 06:18:04.579232 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - octavia_provisioning_v2_fanout_6e706f8812cd44ebb7c0e7f7233eebea (vhost: /, messages: 0) 2026-04-24 06:18:04.579273 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - octavia_provisioning_v2_fanout_da0a14dc63cb49d2b3d8a0256eec0b0b (vhost: /, messages: 0) 2026-04-24 06:18:04.579367 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer (vhost: /, messages: 0) 2026-04-24 06:18:04.579376 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.579499 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.579576 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.579674 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer_fanout_32d58eb574ed496895f8b6dd541cab68 (vhost: /, messages: 0) 2026-04-24 06:18:04.579807 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer_fanout_67f6fdb198064747a9c5cc359bc95615 (vhost: /, messages: 0) 2026-04-24 06:18:04.579817 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer_fanout_69404dc8b79e4d028f2e56daa8c56dd8 (vhost: /, messages: 0) 2026-04-24 06:18:04.579946 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer_fanout_9b57ebcabaf5475cbcc7f9419034dbb7 (vhost: /, messages: 0) 2026-04-24 06:18:04.580023 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer_fanout_d0141389c0274ca9be4bb7d4ca8c926f (vhost: /, messages: 0) 2026-04-24 06:18:04.580116 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - producer_fanout_ee2cbc0bb6fb43c4a9a08fda741160f0 (vhost: /, messages: 0) 2026-04-24 06:18:04.580125 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin (vhost: /, messages: 0) 2026-04-24 06:18:04.580235 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.580276 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.580392 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.580509 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_18f6952732bb48719c4cf6b6f8a5f157 (vhost: /, messages: 0) 2026-04-24 06:18:04.580582 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_1ed3e88c55cf40c4ae503e731edaeaa4 (vhost: /, messages: 0) 2026-04-24 06:18:04.580622 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_2ef826d77e784c408e8cfb12406f8c7d (vhost: /, messages: 0) 2026-04-24 06:18:04.580751 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_42e1fa6c0556452687e3ecafdd540bd0 (vhost: /, messages: 0) 2026-04-24 06:18:04.580826 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_7127586c299444fb975ea6bd51a761c3 (vhost: /, messages: 0) 2026-04-24 06:18:04.580921 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_9d8c50ec2a314630a8b44039c6eb620f (vhost: /, messages: 0) 2026-04-24 06:18:04.581005 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_b47629f0268f44b6ab1fa30783d31fb8 (vhost: /, messages: 0) 2026-04-24 06:18:04.581149 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_ba6d6d7180794c1084f177bae7b860c7 (vhost: /, messages: 0) 2026-04-24 06:18:04.581243 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-plugin_fanout_cf379e3dbc104adcad28c3890d52822b (vhost: /, messages: 0) 2026-04-24 06:18:04.581253 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin (vhost: /, messages: 0) 2026-04-24 06:18:04.581292 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.581474 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.581483 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.581639 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_0211b0ed47d449d49a2a559609bdd96e (vhost: /, messages: 0) 2026-04-24 06:18:04.581728 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_0278c1215fa54336a8b477ae46d77d7a (vhost: /, messages: 0) 2026-04-24 06:18:04.581804 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_06c665790a924375aa4f7c7cdcc37e2d (vhost: /, messages: 0) 2026-04-24 06:18:04.581813 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_231f63f3e9da47a9a85a48b81eeca103 (vhost: /, messages: 0) 2026-04-24 06:18:04.582074 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_4cdcfa23500c40a09aed6dcae444dc76 (vhost: /, messages: 0) 2026-04-24 06:18:04.582127 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_5042c3c7b8ca44efa58bf49567f137c9 (vhost: /, messages: 0) 2026-04-24 06:18:04.582163 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_595c281074d04256803dcbc4f6132fd9 (vhost: /, messages: 0) 2026-04-24 06:18:04.582170 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_5d62268025f34e5595d7f147b1444627 (vhost: /, messages: 0) 2026-04-24 06:18:04.582278 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_7641cea5c8c44322a68062abafd996e7 (vhost: /, messages: 0) 2026-04-24 06:18:04.582435 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_809fe7fdc7ac42cba62ce46ad629d02d (vhost: /, messages: 0) 2026-04-24 06:18:04.582484 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_a4d032f9c2e5470ab121d1c9fe935089 (vhost: /, messages: 0) 2026-04-24 06:18:04.582518 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_b53f6d1751494f4aaf8ba4b399760d98 (vhost: /, messages: 0) 2026-04-24 06:18:04.582618 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_b93b328cee294bed80ca3123f9c4b9c2 (vhost: /, messages: 0) 2026-04-24 06:18:04.582657 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_bac8edee3b2d484b8769e9fc7e9b5fc2 (vhost: /, messages: 0) 2026-04-24 06:18:04.582778 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_bb41b600ed344783a2b620920754d5e7 (vhost: /, messages: 0) 2026-04-24 06:18:04.582889 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_c51c02d9a3764071bc9f28575d95eb37 (vhost: /, messages: 0) 2026-04-24 06:18:04.582986 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_d9c0612ad4974cff89b5cba87a8461c7 (vhost: /, messages: 0) 2026-04-24 06:18:04.583065 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-reports-plugin_fanout_e7cc1dba75d34105816a90148e3a545d (vhost: /, messages: 0) 2026-04-24 06:18:04.583165 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions (vhost: /, messages: 0) 2026-04-24 06:18:04.583243 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.583312 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.583438 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.583511 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_115acd80847146278f4ffad79a099ca7 (vhost: /, messages: 0) 2026-04-24 06:18:04.583670 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_440fede69e3946ac8c2ceb758e957537 (vhost: /, messages: 0) 2026-04-24 06:18:04.583692 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_5506da424dc640368746599cfe2aa907 (vhost: /, messages: 0) 2026-04-24 06:18:04.583699 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_678acc98739f4609bcecd90575ad0ffa (vhost: /, messages: 0) 2026-04-24 06:18:04.583852 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_82dda68dac084eee9e8bf854793b8985 (vhost: /, messages: 0) 2026-04-24 06:18:04.583940 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_98ea05786b7942febdd85fcdf7126d9e (vhost: /, messages: 0) 2026-04-24 06:18:04.584043 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_9983b5eb5871474da9a9d603247a5642 (vhost: /, messages: 0) 2026-04-24 06:18:04.584118 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_9eba94312f014ca3948863801b117783 (vhost: /, messages: 0) 2026-04-24 06:18:04.584197 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - q-server-resource-versions_fanout_bb0f7d7078e84dd1acb9a3de0a7b96b6 (vhost: /, messages: 0) 2026-04-24 06:18:04.584276 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_099342ec20334241925d8162aa5a8406 (vhost: /, messages: 0) 2026-04-24 06:18:04.584375 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_169f336b87d348739a9dcfff04eaa249 (vhost: /, messages: 0) 2026-04-24 06:18:04.584516 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_1912064c98cb40aaaac88e0064895566 (vhost: /, messages: 0) 2026-04-24 06:18:04.584575 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_1b3ef516ff3e4549b2cae70bf9fc7b8b (vhost: /, messages: 0) 2026-04-24 06:18:04.584732 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_2d2bce5e2fd64af3bdf4008a6d68ae48 (vhost: /, messages: 0) 2026-04-24 06:18:04.584784 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_2f3a971cb38942de8bd788ab00dab107 (vhost: /, messages: 0) 2026-04-24 06:18:04.584969 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_32c13bbfc19e4d31813135e6bc7211bd (vhost: /, messages: 0) 2026-04-24 06:18:04.585032 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_55d545e4cd76447bb572274b07854ffc (vhost: /, messages: 0) 2026-04-24 06:18:04.585077 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_58a92f98bd674eac8dc398386a78b04f (vhost: /, messages: 0) 2026-04-24 06:18:04.585112 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_60670aad13044e7aa97cb36ecf548d05 (vhost: /, messages: 0) 2026-04-24 06:18:04.585204 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_655c1395c6564114b7e90c9bed42c777 (vhost: /, messages: 0) 2026-04-24 06:18:04.585272 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_6ba5ab2ebfcc46fa8af234c9d864f7c6 (vhost: /, messages: 0) 2026-04-24 06:18:04.585475 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_6be7e6a5c5bb4532bbdd3eea2f2d7646 (vhost: /, messages: 0) 2026-04-24 06:18:04.585486 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_7abde76aae904b7e9fc839d638f3fed3 (vhost: /, messages: 0) 2026-04-24 06:18:04.585562 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_b5e523f0fb2a4fd59d06b68be6e0178f (vhost: /, messages: 0) 2026-04-24 06:18:04.585705 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_cf2af1349c1e4dce9adb9c797a05384c (vhost: /, messages: 0) 2026-04-24 06:18:04.585813 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_cfd076b46d6b4c3d88525b624226f31e (vhost: /, messages: 0) 2026-04-24 06:18:04.585825 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_d7d9f4cadca04c82b5d7c0a9478101b5 (vhost: /, messages: 0) 2026-04-24 06:18:04.585920 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - reply_d8dd7fd4a70c44afbf27e59ad72e1976 (vhost: /, messages: 0) 2026-04-24 06:18:04.585986 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler (vhost: /, messages: 0) 2026-04-24 06:18:04.586108 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.586128 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.586223 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.586273 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler_fanout_305c98a5f2a2424f8bf78c77bc0e8feb (vhost: /, messages: 0) 2026-04-24 06:18:04.586415 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler_fanout_9316723f1c79489eb73fd0c831a77b81 (vhost: /, messages: 0) 2026-04-24 06:18:04.586480 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler_fanout_9bf99eb5405c4e989986d3eb83a536c0 (vhost: /, messages: 0) 2026-04-24 06:18:04.586604 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler_fanout_9d26e247a6cf42488bbf602be0402422 (vhost: /, messages: 0) 2026-04-24 06:18:04.586709 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler_fanout_a678f3bf81b54265bbe30b5e3622b747 (vhost: /, messages: 0) 2026-04-24 06:18:04.586810 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - scheduler_fanout_e5c085a55cbf4f2ea329de4113dfdbee (vhost: /, messages: 0) 2026-04-24 06:18:04.586890 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker (vhost: /, messages: 0) 2026-04-24 06:18:04.586986 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker.testbed-node-0 (vhost: /, messages: 0) 2026-04-24 06:18:04.587070 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker.testbed-node-1 (vhost: /, messages: 0) 2026-04-24 06:18:04.587255 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker.testbed-node-2 (vhost: /, messages: 0) 2026-04-24 06:18:04.587264 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker_fanout_39481638dbf44f0c88322744e5063bf4 (vhost: /, messages: 0) 2026-04-24 06:18:04.587334 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker_fanout_40dec2040a11472d9b47a70e1df1e1fe (vhost: /, messages: 0) 2026-04-24 06:18:04.587431 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker_fanout_64148232d6ee4e8a9ad52f7bd66d64c4 (vhost: /, messages: 0) 2026-04-24 06:18:04.587525 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker_fanout_6d8a9675b0444773b3d3f3812db1a6fa (vhost: /, messages: 0) 2026-04-24 06:18:04.587586 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker_fanout_dfaf9b44999a4c069fba6c0b835d2121 (vhost: /, messages: 0) 2026-04-24 06:18:04.587676 | orchestrator | 2026-04-24 06:18:04 | INFO  |  - worker_fanout_e9dd87dc80434cdf92870bfe5b04be07 (vhost: /, messages: 0) 2026-04-24 06:18:04.825835 | orchestrator | + osism migrate rabbitmq3to4 list-exchanges 2026-04-24 06:18:11.058274 | orchestrator | 2026-04-24 06:18:11 | ERROR  | Unable to get ansible vault password 2026-04-24 06:18:11.058334 | orchestrator | 2026-04-24 06:18:11 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-24 06:18:11.058345 | orchestrator | 2026-04-24 06:18:11 | ERROR  | Dropping encrypted entries 2026-04-24 06:18:11.091016 | orchestrator | 2026-04-24 06:18:11 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-24 06:18:11.116544 | orchestrator | 2026-04-24 06:18:11 | INFO  | Found 46 exchange(s) in vhost '/': 2026-04-24 06:18:11.116607 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - aodh (type: topic, transient) 2026-04-24 06:18:11.116619 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - barbican.workers_fanout (type: fanout, transient) 2026-04-24 06:18:11.116632 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - ceilometer (type: topic, transient) 2026-04-24 06:18:11.116643 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - central_fanout (type: fanout, transient) 2026-04-24 06:18:11.116859 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - cinder (type: topic, transient) 2026-04-24 06:18:11.116878 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - cinder-backup_fanout (type: fanout, transient) 2026-04-24 06:18:11.116889 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - cinder-scheduler_fanout (type: fanout, transient) 2026-04-24 06:18:11.116900 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout (type: fanout, transient) 2026-04-24 06:18:11.116923 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout (type: fanout, transient) 2026-04-24 06:18:11.116934 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout (type: fanout, transient) 2026-04-24 06:18:11.116945 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - cinder-volume_fanout (type: fanout, transient) 2026-04-24 06:18:11.117286 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - compute_fanout (type: fanout, transient) 2026-04-24 06:18:11.117308 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - conductor_fanout (type: fanout, transient) 2026-04-24 06:18:11.117406 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - designate (type: topic, transient) 2026-04-24 06:18:11.117424 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - dns (type: topic, transient) 2026-04-24 06:18:11.117435 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - glance (type: topic, transient) 2026-04-24 06:18:11.117783 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - heat (type: topic, transient) 2026-04-24 06:18:11.117803 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - ironic (type: topic, transient) 2026-04-24 06:18:11.118098 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - keystone (type: topic, transient) 2026-04-24 06:18:11.118188 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - l3_agent_fanout (type: fanout, transient) 2026-04-24 06:18:11.118199 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - magnum (type: topic, transient) 2026-04-24 06:18:11.118215 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - magnum-conductor_fanout (type: fanout, transient) 2026-04-24 06:18:11.118226 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - manila-data_fanout (type: fanout, transient) 2026-04-24 06:18:11.118451 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - manila-scheduler_fanout (type: fanout, transient) 2026-04-24 06:18:11.118471 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - manila-share_fanout (type: fanout, transient) 2026-04-24 06:18:11.118879 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - neutron (type: topic, transient) 2026-04-24 06:18:11.118901 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - neutron-vo-Network-1.1_fanout (type: fanout, transient) 2026-04-24 06:18:11.118912 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - neutron-vo-Port-1.10_fanout (type: fanout, transient) 2026-04-24 06:18:11.119357 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - neutron-vo-SecurityGroup-1.6_fanout (type: fanout, transient) 2026-04-24 06:18:11.119376 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - neutron-vo-SecurityGroupRule-1.3_fanout (type: fanout, transient) 2026-04-24 06:18:11.119386 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - neutron-vo-Subnet-1.2_fanout (type: fanout, transient) 2026-04-24 06:18:11.119395 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - nova (type: topic, transient) 2026-04-24 06:18:11.119405 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - octavia (type: topic, transient) 2026-04-24 06:18:11.119414 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - octavia_provisioning_v2_fanout (type: fanout, transient) 2026-04-24 06:18:11.119437 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - openstack (type: topic, transient) 2026-04-24 06:18:11.119665 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - producer_fanout (type: fanout, transient) 2026-04-24 06:18:11.119709 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - q-agent-notifier-port-update_fanout (type: fanout, transient) 2026-04-24 06:18:11.119720 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - q-agent-notifier-security_group-update_fanout (type: fanout, transient) 2026-04-24 06:18:11.119730 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - q-plugin_fanout (type: fanout, transient) 2026-04-24 06:18:11.119929 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - q-reports-plugin_fanout (type: fanout, transient) 2026-04-24 06:18:11.119946 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - q-server-resource-versions_fanout (type: fanout, transient) 2026-04-24 06:18:11.120040 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - scheduler_fanout (type: fanout, transient) 2026-04-24 06:18:11.120131 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - swift (type: topic, transient) 2026-04-24 06:18:11.120475 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - trove (type: topic, transient) 2026-04-24 06:18:11.120492 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - worker_fanout (type: fanout, transient) 2026-04-24 06:18:11.120503 | orchestrator | 2026-04-24 06:18:11 | INFO  |  - zaqar (type: topic, transient) 2026-04-24 06:18:11.278276 | orchestrator | + osism apply -a upgrade keystone 2026-04-24 06:18:12.439775 | orchestrator | 2026-04-24 06:18:12 | INFO  | Prepare task for execution of keystone. 2026-04-24 06:18:12.496213 | orchestrator | 2026-04-24 06:18:12 | INFO  | Task 9a9c31b7-b6f6-4f0c-ae0e-afcfcb70f64c (keystone) was prepared for execution. 2026-04-24 06:18:12.496294 | orchestrator | 2026-04-24 06:18:12 | INFO  | It takes a moment until task 9a9c31b7-b6f6-4f0c-ae0e-afcfcb70f64c (keystone) has been started and output is visible here. 2026-04-24 06:18:21.639946 | orchestrator | 2026-04-24 06:18:21.640046 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:18:21.640079 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 06:18:21.640094 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 06:18:21.640117 | orchestrator | 2026-04-24 06:18:21.640128 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:18:21.640139 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 06:18:21.640150 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 06:18:21.640172 | orchestrator | Friday 24 April 2026 06:18:16 +0000 (0:00:01.161) 0:00:01.161 ********** 2026-04-24 06:18:21.640184 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:18:21.640196 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:18:21.640207 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:18:21.640217 | orchestrator | 2026-04-24 06:18:21.640228 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:18:21.640239 | orchestrator | Friday 24 April 2026 06:18:17 +0000 (0:00:00.863) 0:00:02.024 ********** 2026-04-24 06:18:21.640250 | orchestrator | ok: [testbed-node-0] => (item=enable_keystone_True) 2026-04-24 06:18:21.640261 | orchestrator | ok: [testbed-node-1] => (item=enable_keystone_True) 2026-04-24 06:18:21.640272 | orchestrator | ok: [testbed-node-2] => (item=enable_keystone_True) 2026-04-24 06:18:21.640282 | orchestrator | 2026-04-24 06:18:21.640293 | orchestrator | PLAY [Apply role keystone] ***************************************************** 2026-04-24 06:18:21.640328 | orchestrator | 2026-04-24 06:18:21.640340 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 06:18:21.640351 | orchestrator | Friday 24 April 2026 06:18:18 +0000 (0:00:00.765) 0:00:02.790 ********** 2026-04-24 06:18:21.640362 | orchestrator | included: /ansible/roles/keystone/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:18:21.640373 | orchestrator | 2026-04-24 06:18:21.640384 | orchestrator | TASK [keystone : Ensuring config directories exist] **************************** 2026-04-24 06:18:21.640395 | orchestrator | Friday 24 April 2026 06:18:19 +0000 (0:00:01.170) 0:00:03.961 ********** 2026-04-24 06:18:21.640412 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:21.640430 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:21.640475 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:21.640490 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:21.640514 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:21.640526 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:21.640539 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:21.640553 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:21.640579 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:27.713842 | orchestrator | 2026-04-24 06:18:27.713944 | orchestrator | TASK [keystone : Check if policies shall be overwritten] *********************** 2026-04-24 06:18:27.713961 | orchestrator | Friday 24 April 2026 06:18:21 +0000 (0:00:02.205) 0:00:06.166 ********** 2026-04-24 06:18:27.713995 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:27.714008 | orchestrator | 2026-04-24 06:18:27.714063 | orchestrator | TASK [keystone : Set keystone policy file] ************************************* 2026-04-24 06:18:27.714077 | orchestrator | Friday 24 April 2026 06:18:21 +0000 (0:00:00.143) 0:00:06.309 ********** 2026-04-24 06:18:27.714088 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:27.714099 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:27.714109 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:27.714120 | orchestrator | 2026-04-24 06:18:27.714131 | orchestrator | TASK [keystone : Check if Keystone domain-specific config is supplied] ********* 2026-04-24 06:18:27.714142 | orchestrator | Friday 24 April 2026 06:18:22 +0000 (0:00:00.344) 0:00:06.654 ********** 2026-04-24 06:18:27.714153 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 06:18:27.714164 | orchestrator | 2026-04-24 06:18:27.714175 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 06:18:27.714186 | orchestrator | Friday 24 April 2026 06:18:23 +0000 (0:00:01.201) 0:00:07.856 ********** 2026-04-24 06:18:27.714198 | orchestrator | included: /ansible/roles/keystone/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:18:27.714209 | orchestrator | 2026-04-24 06:18:27.714220 | orchestrator | TASK [service-cert-copy : keystone | Copying over extra CA certificates] ******* 2026-04-24 06:18:27.714230 | orchestrator | Friday 24 April 2026 06:18:24 +0000 (0:00:01.197) 0:00:09.054 ********** 2026-04-24 06:18:27.714246 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:27.714262 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:27.714308 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:27.714331 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:27.714343 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:27.714355 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:27.714366 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:27.714377 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:27.714395 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:27.714414 | orchestrator | 2026-04-24 06:18:27.714434 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS certificate] *** 2026-04-24 06:18:29.118335 | orchestrator | Friday 24 April 2026 06:18:27 +0000 (0:00:03.095) 0:00:12.150 ********** 2026-04-24 06:18:29.118435 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:29.118456 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:29.118470 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:29.118483 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:29.118496 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:29.118564 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:29.118580 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:29.118591 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:29.118603 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:29.118615 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:29.118626 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:29.118645 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:29.118656 | orchestrator | 2026-04-24 06:18:29.118668 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS key] **** 2026-04-24 06:18:29.118725 | orchestrator | Friday 24 April 2026 06:18:28 +0000 (0:00:00.968) 0:00:13.119 ********** 2026-04-24 06:18:29.118751 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:30.853508 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:30.853628 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:30.853642 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:30.853656 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:30.853731 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:30.853775 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:30.853786 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:30.853795 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:30.853804 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:30.853813 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:30.853821 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:30.853829 | orchestrator | 2026-04-24 06:18:30.853838 | orchestrator | TASK [keystone : Copying over config.json files for services] ****************** 2026-04-24 06:18:30.853855 | orchestrator | Friday 24 April 2026 06:18:29 +0000 (0:00:00.830) 0:00:13.950 ********** 2026-04-24 06:18:30.853864 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:30.853886 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:35.723880 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:35.723990 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:35.724031 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:35.724044 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:18:35.724071 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:35.724101 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:35.724113 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:35.724125 | orchestrator | 2026-04-24 06:18:35.724168 | orchestrator | TASK [keystone : Copying over keystone.conf] *********************************** 2026-04-24 06:18:35.724181 | orchestrator | Friday 24 April 2026 06:18:32 +0000 (0:00:03.293) 0:00:17.243 ********** 2026-04-24 06:18:35.724193 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:35.724223 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:35.724241 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:35.724263 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:41.532637 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:18:41.532826 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:41.532855 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:41.532889 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:41.532902 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:18:41.532914 | orchestrator | 2026-04-24 06:18:41.532927 | orchestrator | TASK [keystone : Copying keystone-startup script for keystone] ***************** 2026-04-24 06:18:41.532940 | orchestrator | Friday 24 April 2026 06:18:38 +0000 (0:00:05.512) 0:00:22.756 ********** 2026-04-24 06:18:41.532951 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:18:41.532963 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:18:41.532974 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:18:41.532985 | orchestrator | 2026-04-24 06:18:41.532996 | orchestrator | TASK [keystone : Create Keystone domain-specific config directory] ************* 2026-04-24 06:18:41.533007 | orchestrator | Friday 24 April 2026 06:18:39 +0000 (0:00:01.408) 0:00:24.164 ********** 2026-04-24 06:18:41.533018 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:41.533049 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:41.533060 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:41.533071 | orchestrator | 2026-04-24 06:18:41.533082 | orchestrator | TASK [keystone : Get file list in custom domains folder] *********************** 2026-04-24 06:18:41.533093 | orchestrator | Friday 24 April 2026 06:18:40 +0000 (0:00:00.549) 0:00:24.713 ********** 2026-04-24 06:18:41.533104 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:41.533115 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:41.533126 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:41.533137 | orchestrator | 2026-04-24 06:18:41.533156 | orchestrator | TASK [keystone : Copying Keystone Domain specific settings] ******************** 2026-04-24 06:18:41.533167 | orchestrator | Friday 24 April 2026 06:18:40 +0000 (0:00:00.338) 0:00:25.052 ********** 2026-04-24 06:18:41.533178 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:41.533189 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:41.533200 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:41.533211 | orchestrator | 2026-04-24 06:18:41.533222 | orchestrator | TASK [keystone : Copying over existing policy file] **************************** 2026-04-24 06:18:41.533233 | orchestrator | Friday 24 April 2026 06:18:41 +0000 (0:00:00.524) 0:00:25.576 ********** 2026-04-24 06:18:41.533246 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:41.533258 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:41.533275 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:41.533287 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:41.533307 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:58.403988 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:58.404129 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:58.404148 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:58.404166 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:18:58.404198 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:18:58.404229 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:18:58.404283 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:58.404321 | orchestrator | 2026-04-24 06:18:58.404334 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-24 06:18:58.404347 | orchestrator | Friday 24 April 2026 06:18:41 +0000 (0:00:00.584) 0:00:26.161 ********** 2026-04-24 06:18:58.404359 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:58.404370 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:58.404381 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:58.404392 | orchestrator | 2026-04-24 06:18:58.404404 | orchestrator | TASK [keystone : Copying over wsgi-keystone.conf] ****************************** 2026-04-24 06:18:58.404433 | orchestrator | Friday 24 April 2026 06:18:42 +0000 (0:00:00.331) 0:00:26.492 ********** 2026-04-24 06:18:58.404445 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-24 06:18:58.404457 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-24 06:18:58.404468 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-24 06:18:58.404479 | orchestrator | 2026-04-24 06:18:58.404490 | orchestrator | TASK [keystone : Checking whether keystone-paste.ini file exists] ************** 2026-04-24 06:18:58.404501 | orchestrator | Friday 24 April 2026 06:18:44 +0000 (0:00:02.025) 0:00:28.518 ********** 2026-04-24 06:18:58.404512 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 06:18:58.404525 | orchestrator | 2026-04-24 06:18:58.404539 | orchestrator | TASK [keystone : Copying over keystone-paste.ini] ****************************** 2026-04-24 06:18:58.404552 | orchestrator | Friday 24 April 2026 06:18:45 +0000 (0:00:00.963) 0:00:29.482 ********** 2026-04-24 06:18:58.404564 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:18:58.404577 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:18:58.404590 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:18:58.404602 | orchestrator | 2026-04-24 06:18:58.404614 | orchestrator | TASK [keystone : Generate the required cron jobs for the node] ***************** 2026-04-24 06:18:58.404626 | orchestrator | Friday 24 April 2026 06:18:45 +0000 (0:00:00.590) 0:00:30.072 ********** 2026-04-24 06:18:58.404639 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 06:18:58.404652 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 06:18:58.404664 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 06:18:58.404739 | orchestrator | 2026-04-24 06:18:58.404752 | orchestrator | TASK [keystone : Set fact with the generated cron jobs for building the crontab later] *** 2026-04-24 06:18:58.404765 | orchestrator | Friday 24 April 2026 06:18:46 +0000 (0:00:01.088) 0:00:31.161 ********** 2026-04-24 06:18:58.404778 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:18:58.404791 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:18:58.404803 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:18:58.404816 | orchestrator | 2026-04-24 06:18:58.404828 | orchestrator | TASK [keystone : Copying files for keystone-fernet] **************************** 2026-04-24 06:18:58.404841 | orchestrator | Friday 24 April 2026 06:18:47 +0000 (0:00:00.348) 0:00:31.509 ********** 2026-04-24 06:18:58.404854 | orchestrator | ok: [testbed-node-0] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-24 06:18:58.404866 | orchestrator | ok: [testbed-node-1] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-24 06:18:58.404878 | orchestrator | ok: [testbed-node-2] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-24 06:18:58.404890 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-24 06:18:58.404923 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-24 06:18:58.404934 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-24 06:18:58.404945 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-24 06:18:58.404956 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-24 06:18:58.404966 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-24 06:18:58.404986 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-24 06:18:58.405005 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-24 06:18:58.405016 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-24 06:18:58.405027 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-24 06:18:58.405038 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-24 06:18:58.405050 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-24 06:18:58.405062 | orchestrator | ok: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:18:58.405073 | orchestrator | ok: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:18:58.405084 | orchestrator | ok: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:18:58.405095 | orchestrator | ok: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:18:58.405106 | orchestrator | ok: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:18:58.405117 | orchestrator | ok: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:18:58.405128 | orchestrator | 2026-04-24 06:18:58.405138 | orchestrator | TASK [keystone : Copying files for keystone-ssh] ******************************* 2026-04-24 06:18:58.405149 | orchestrator | Friday 24 April 2026 06:18:55 +0000 (0:00:08.901) 0:00:40.411 ********** 2026-04-24 06:18:58.405160 | orchestrator | ok: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:18:58.405171 | orchestrator | ok: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:18:58.405182 | orchestrator | ok: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:18:58.405193 | orchestrator | ok: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:18:58.405212 | orchestrator | ok: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:19:02.973866 | orchestrator | ok: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:19:02.973991 | orchestrator | 2026-04-24 06:19:02.974064 | orchestrator | TASK [service-check-containers : keystone | Check containers] ****************** 2026-04-24 06:19:02.974092 | orchestrator | Friday 24 April 2026 06:18:58 +0000 (0:00:02.927) 0:00:43.339 ********** 2026-04-24 06:19:02.974117 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:19:02.974143 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:19:02.974217 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-24 06:19:02.974268 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:19:02.974289 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:19:02.974308 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-24 06:19:02.974328 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:19:02.974369 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:19:02.974390 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-24 06:19:02.974410 | orchestrator | 2026-04-24 06:19:02.974429 | orchestrator | TASK [service-check-containers : keystone | Notify handlers to restart containers] *** 2026-04-24 06:19:02.974449 | orchestrator | Friday 24 April 2026 06:19:02 +0000 (0:00:03.199) 0:00:46.538 ********** 2026-04-24 06:19:02.974467 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 06:19:02.974486 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:19:02.974506 | orchestrator | } 2026-04-24 06:19:02.974526 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 06:19:02.974544 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:19:02.974563 | orchestrator | } 2026-04-24 06:19:02.974581 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 06:19:02.974616 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:19:02.974636 | orchestrator | } 2026-04-24 06:19:02.974655 | orchestrator | 2026-04-24 06:19:02.974743 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:19:02.974765 | orchestrator | Friday 24 April 2026 06:19:02 +0000 (0:00:00.532) 0:00:47.071 ********** 2026-04-24 06:19:02.974805 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:21:06.821670 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:21:06.821783 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:21:06.821799 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:21:06.821831 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:21:06.821846 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:21:06.821858 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:21:06.821870 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:21:06.821900 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-24 06:21:06.821934 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-24 06:21:06.821952 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-24 06:21:06.821964 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:21:06.821975 | orchestrator | 2026-04-24 06:21:06.821987 | orchestrator | TASK [keystone : Enable log_bin_trust_function_creators function] ************** 2026-04-24 06:21:06.821999 | orchestrator | Friday 24 April 2026 06:19:03 +0000 (0:00:01.242) 0:00:48.313 ********** 2026-04-24 06:21:06.822010 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:21:06.822078 | orchestrator | 2026-04-24 06:21:06.822091 | orchestrator | TASK [keystone : Init keystone database upgrade] ******************************* 2026-04-24 06:21:06.822118 | orchestrator | Friday 24 April 2026 06:19:06 +0000 (0:00:02.241) 0:00:50.554 ********** 2026-04-24 06:21:06.822172 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:21:06.822187 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:21:06.822200 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:21:06.822214 | orchestrator | 2026-04-24 06:21:06.822226 | orchestrator | TASK [keystone : Finish keystone database upgrade] ***************************** 2026-04-24 06:21:06.822240 | orchestrator | Friday 24 April 2026 06:19:06 +0000 (0:00:00.475) 0:00:51.030 ********** 2026-04-24 06:21:06.822252 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:21:06.822265 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:21:06.822278 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:21:06.822291 | orchestrator | 2026-04-24 06:21:06.822303 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-24 06:21:06.822316 | orchestrator | Friday 24 April 2026 06:19:07 +0000 (0:00:00.841) 0:00:51.872 ********** 2026-04-24 06:21:06.822326 | orchestrator | 2026-04-24 06:21:06.822337 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-24 06:21:06.822348 | orchestrator | Friday 24 April 2026 06:19:07 +0000 (0:00:00.075) 0:00:51.947 ********** 2026-04-24 06:21:06.822359 | orchestrator | 2026-04-24 06:21:06.822379 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-24 06:21:06.822390 | orchestrator | Friday 24 April 2026 06:19:07 +0000 (0:00:00.077) 0:00:52.025 ********** 2026-04-24 06:21:06.822401 | orchestrator | 2026-04-24 06:21:06.822412 | orchestrator | RUNNING HANDLER [keystone : Init keystone database upgrade] ******************** 2026-04-24 06:21:06.822423 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 06:21:06.822435 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 06:21:06.822456 | orchestrator | Friday 24 April 2026 06:19:07 +0000 (0:00:00.074) 0:00:52.099 ********** 2026-04-24 06:21:06.822467 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:21:06.822478 | orchestrator | 2026-04-24 06:21:06.822489 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-ssh container] ******************** 2026-04-24 06:21:06.822499 | orchestrator | Friday 24 April 2026 06:20:14 +0000 (0:01:06.406) 0:01:58.505 ********** 2026-04-24 06:21:06.822510 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:21:06.822521 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:21:06.822532 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:21:06.822542 | orchestrator | 2026-04-24 06:21:06.822553 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-fernet container] ***************** 2026-04-24 06:21:06.822573 | orchestrator | Friday 24 April 2026 06:21:06 +0000 (0:00:52.743) 0:02:51.249 ********** 2026-04-24 06:21:47.590864 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:21:47.590966 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:21:47.590980 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:21:47.590990 | orchestrator | 2026-04-24 06:21:47.591001 | orchestrator | RUNNING HANDLER [keystone : Restart keystone container] ************************ 2026-04-24 06:21:47.591013 | orchestrator | Friday 24 April 2026 06:21:18 +0000 (0:00:12.133) 0:03:03.383 ********** 2026-04-24 06:21:47.591023 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:21:47.591033 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:21:47.591043 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:21:47.591053 | orchestrator | 2026-04-24 06:21:47.591063 | orchestrator | RUNNING HANDLER [keystone : Finish keystone database upgrade] ****************** 2026-04-24 06:21:47.591073 | orchestrator | Friday 24 April 2026 06:21:31 +0000 (0:00:12.890) 0:03:16.274 ********** 2026-04-24 06:21:47.591083 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:21:47.591092 | orchestrator | 2026-04-24 06:21:47.591102 | orchestrator | TASK [keystone : Disable log_bin_trust_function_creators function] ************* 2026-04-24 06:21:47.591112 | orchestrator | Friday 24 April 2026 06:21:44 +0000 (0:00:12.395) 0:03:28.669 ********** 2026-04-24 06:21:47.591121 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:21:47.591131 | orchestrator | 2026-04-24 06:21:47.591140 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:21:47.591151 | orchestrator | testbed-node-0 : ok=25  changed=11  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-24 06:21:47.591163 | orchestrator | testbed-node-1 : ok=19  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-24 06:21:47.591173 | orchestrator | testbed-node-2 : ok=21  changed=9  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-24 06:21:47.591182 | orchestrator | 2026-04-24 06:21:47.591192 | orchestrator | 2026-04-24 06:21:47.591202 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:21:47.591211 | orchestrator | Friday 24 April 2026 06:21:47 +0000 (0:00:02.940) 0:03:31.610 ********** 2026-04-24 06:21:47.591221 | orchestrator | =============================================================================== 2026-04-24 06:21:47.591247 | orchestrator | keystone : Init keystone database upgrade ------------------------------ 66.41s 2026-04-24 06:21:47.591257 | orchestrator | keystone : Restart keystone-ssh container ------------------------------ 52.74s 2026-04-24 06:21:47.591288 | orchestrator | keystone : Restart keystone container ---------------------------------- 12.89s 2026-04-24 06:21:47.591299 | orchestrator | keystone : Finish keystone database upgrade ---------------------------- 12.40s 2026-04-24 06:21:47.591308 | orchestrator | keystone : Restart keystone-fernet container --------------------------- 12.13s 2026-04-24 06:21:47.591318 | orchestrator | keystone : Copying files for keystone-fernet ---------------------------- 8.90s 2026-04-24 06:21:47.591327 | orchestrator | keystone : Copying over keystone.conf ----------------------------------- 5.51s 2026-04-24 06:21:47.591337 | orchestrator | keystone : Copying over config.json files for services ------------------ 3.29s 2026-04-24 06:21:47.591347 | orchestrator | service-check-containers : keystone | Check containers ------------------ 3.20s 2026-04-24 06:21:47.591356 | orchestrator | service-cert-copy : keystone | Copying over extra CA certificates ------- 3.10s 2026-04-24 06:21:47.591366 | orchestrator | keystone : Disable log_bin_trust_function_creators function ------------- 2.94s 2026-04-24 06:21:47.591376 | orchestrator | keystone : Copying files for keystone-ssh ------------------------------- 2.93s 2026-04-24 06:21:47.591386 | orchestrator | keystone : Enable log_bin_trust_function_creators function -------------- 2.24s 2026-04-24 06:21:47.591395 | orchestrator | keystone : Ensuring config directories exist ---------------------------- 2.21s 2026-04-24 06:21:47.591405 | orchestrator | keystone : Copying over wsgi-keystone.conf ------------------------------ 2.03s 2026-04-24 06:21:47.591415 | orchestrator | keystone : Copying keystone-startup script for keystone ----------------- 1.41s 2026-04-24 06:21:47.591426 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.24s 2026-04-24 06:21:47.591437 | orchestrator | keystone : Check if Keystone domain-specific config is supplied --------- 1.20s 2026-04-24 06:21:47.591448 | orchestrator | keystone : include_tasks ------------------------------------------------ 1.20s 2026-04-24 06:21:47.591459 | orchestrator | keystone : include_tasks ------------------------------------------------ 1.17s 2026-04-24 06:21:47.786659 | orchestrator | + osism apply -a upgrade placement 2026-04-24 06:21:49.068198 | orchestrator | 2026-04-24 06:21:49 | INFO  | Prepare task for execution of placement. 2026-04-24 06:21:49.134463 | orchestrator | 2026-04-24 06:21:49 | INFO  | Task d51d88db-fbde-4458-919a-0be2509fbdae (placement) was prepared for execution. 2026-04-24 06:21:49.134559 | orchestrator | 2026-04-24 06:21:49 | INFO  | It takes a moment until task d51d88db-fbde-4458-919a-0be2509fbdae (placement) has been started and output is visible here. 2026-04-24 06:22:30.580775 | orchestrator | 2026-04-24 06:22:30.580849 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:22:30.580856 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 06:22:30.580863 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 06:22:30.580871 | orchestrator | 2026-04-24 06:22:30.580875 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:22:30.580879 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 06:22:30.580883 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 06:22:30.580891 | orchestrator | Friday 24 April 2026 06:21:53 +0000 (0:00:01.228) 0:00:01.228 ********** 2026-04-24 06:22:30.580895 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:22:30.580900 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:22:30.580903 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:22:30.580907 | orchestrator | 2026-04-24 06:22:30.580911 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:22:30.580915 | orchestrator | Friday 24 April 2026 06:21:54 +0000 (0:00:00.811) 0:00:02.039 ********** 2026-04-24 06:22:30.580919 | orchestrator | ok: [testbed-node-0] => (item=enable_placement_True) 2026-04-24 06:22:30.580936 | orchestrator | ok: [testbed-node-1] => (item=enable_placement_True) 2026-04-24 06:22:30.580940 | orchestrator | ok: [testbed-node-2] => (item=enable_placement_True) 2026-04-24 06:22:30.580944 | orchestrator | 2026-04-24 06:22:30.580948 | orchestrator | PLAY [Apply role placement] **************************************************** 2026-04-24 06:22:30.580952 | orchestrator | 2026-04-24 06:22:30.580955 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-24 06:22:30.580959 | orchestrator | Friday 24 April 2026 06:21:55 +0000 (0:00:00.889) 0:00:02.929 ********** 2026-04-24 06:22:30.580963 | orchestrator | included: /ansible/roles/placement/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:22:30.580967 | orchestrator | 2026-04-24 06:22:30.580971 | orchestrator | TASK [service-ks-register : placement | Creating/deleting services] ************ 2026-04-24 06:22:30.580974 | orchestrator | Friday 24 April 2026 06:21:56 +0000 (0:00:01.476) 0:00:04.405 ********** 2026-04-24 06:22:30.580978 | orchestrator | ok: [testbed-node-0] => (item=placement (placement)) 2026-04-24 06:22:30.580982 | orchestrator | 2026-04-24 06:22:30.580985 | orchestrator | TASK [service-ks-register : placement | Creating/deleting endpoints] *********** 2026-04-24 06:22:30.580989 | orchestrator | Friday 24 April 2026 06:22:01 +0000 (0:00:04.390) 0:00:08.795 ********** 2026-04-24 06:22:30.580993 | orchestrator | ok: [testbed-node-0] => (item=placement -> https://api-int.testbed.osism.xyz:8780 -> internal) 2026-04-24 06:22:30.581007 | orchestrator | ok: [testbed-node-0] => (item=placement -> https://api.testbed.osism.xyz:8780 -> public) 2026-04-24 06:22:30.581011 | orchestrator | 2026-04-24 06:22:30.581015 | orchestrator | TASK [service-ks-register : placement | Creating projects] ********************* 2026-04-24 06:22:30.581019 | orchestrator | Friday 24 April 2026 06:22:08 +0000 (0:00:07.613) 0:00:16.408 ********** 2026-04-24 06:22:30.581022 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 06:22:30.581027 | orchestrator | 2026-04-24 06:22:30.581030 | orchestrator | TASK [service-ks-register : placement | Creating users] ************************ 2026-04-24 06:22:30.581034 | orchestrator | Friday 24 April 2026 06:22:12 +0000 (0:00:03.536) 0:00:19.945 ********** 2026-04-24 06:22:30.581038 | orchestrator | changed: [testbed-node-0] => (item=placement -> service) 2026-04-24 06:22:30.581041 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 06:22:30.581045 | orchestrator | 2026-04-24 06:22:30.581049 | orchestrator | TASK [service-ks-register : placement | Creating roles] ************************ 2026-04-24 06:22:30.581052 | orchestrator | Friday 24 April 2026 06:22:17 +0000 (0:00:05.480) 0:00:25.425 ********** 2026-04-24 06:22:30.581056 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 06:22:30.581060 | orchestrator | 2026-04-24 06:22:30.581064 | orchestrator | TASK [service-ks-register : placement | Granting/revoking user roles] ********** 2026-04-24 06:22:30.581068 | orchestrator | Friday 24 April 2026 06:22:21 +0000 (0:00:03.337) 0:00:28.763 ********** 2026-04-24 06:22:30.581071 | orchestrator | ok: [testbed-node-0] => (item=placement -> service -> admin) 2026-04-24 06:22:30.581075 | orchestrator | 2026-04-24 06:22:30.581079 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-24 06:22:30.581082 | orchestrator | Friday 24 April 2026 06:22:25 +0000 (0:00:04.624) 0:00:33.388 ********** 2026-04-24 06:22:30.581086 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:22:30.581090 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:22:30.581094 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:22:30.581097 | orchestrator | 2026-04-24 06:22:30.581101 | orchestrator | TASK [placement : Ensuring config directories exist] *************************** 2026-04-24 06:22:30.581105 | orchestrator | Friday 24 April 2026 06:22:26 +0000 (0:00:00.706) 0:00:34.094 ********** 2026-04-24 06:22:30.581123 | orchestrator | ok: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:30.581133 | orchestrator | ok: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:30.581139 | orchestrator | ok: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:30.581143 | orchestrator | 2026-04-24 06:22:30.581147 | orchestrator | TASK [placement : Check if policies shall be overwritten] ********************** 2026-04-24 06:22:30.581150 | orchestrator | Friday 24 April 2026 06:22:27 +0000 (0:00:01.240) 0:00:35.334 ********** 2026-04-24 06:22:30.581154 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:22:30.581158 | orchestrator | 2026-04-24 06:22:30.581162 | orchestrator | TASK [placement : Set placement policy file] *********************************** 2026-04-24 06:22:30.581165 | orchestrator | Friday 24 April 2026 06:22:27 +0000 (0:00:00.124) 0:00:35.459 ********** 2026-04-24 06:22:30.581169 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:22:30.581173 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:22:30.581177 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:22:30.581180 | orchestrator | 2026-04-24 06:22:30.581184 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-24 06:22:30.581188 | orchestrator | Friday 24 April 2026 06:22:28 +0000 (0:00:00.317) 0:00:35.777 ********** 2026-04-24 06:22:30.581192 | orchestrator | included: /ansible/roles/placement/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:22:30.581198 | orchestrator | 2026-04-24 06:22:30.581202 | orchestrator | TASK [service-cert-copy : placement | Copying over extra CA certificates] ****** 2026-04-24 06:22:30.581206 | orchestrator | Friday 24 April 2026 06:22:29 +0000 (0:00:01.105) 0:00:36.882 ********** 2026-04-24 06:22:30.581212 | orchestrator | ok: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:32.042847 | orchestrator | ok: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:32.042955 | orchestrator | ok: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:32.042973 | orchestrator | 2026-04-24 06:22:32.042988 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS certificate] *** 2026-04-24 06:22:32.043000 | orchestrator | Friday 24 April 2026 06:22:30 +0000 (0:00:01.351) 0:00:38.234 ********** 2026-04-24 06:22:32.043014 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:32.043049 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:22:32.043081 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:32.043093 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:22:32.043105 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:32.043116 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:22:32.043127 | orchestrator | 2026-04-24 06:22:32.043138 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS key] *** 2026-04-24 06:22:32.043154 | orchestrator | Friday 24 April 2026 06:22:31 +0000 (0:00:00.902) 0:00:39.137 ********** 2026-04-24 06:22:32.043166 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:32.043205 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:22:32.043218 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:32.043229 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:22:32.043250 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:41.613283 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:22:41.613370 | orchestrator | 2026-04-24 06:22:41.613383 | orchestrator | TASK [placement : Copying over config.json files for services] ***************** 2026-04-24 06:22:41.613394 | orchestrator | Friday 24 April 2026 06:22:32 +0000 (0:00:00.744) 0:00:39.881 ********** 2026-04-24 06:22:41.613417 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:41.613444 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:41.613453 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:41.613461 | orchestrator | 2026-04-24 06:22:41.613469 | orchestrator | TASK [placement : Copying over placement.conf] ********************************* 2026-04-24 06:22:41.613477 | orchestrator | Friday 24 April 2026 06:22:33 +0000 (0:00:01.488) 0:00:41.370 ********** 2026-04-24 06:22:41.613498 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:41.613511 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:41.613527 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:41.613535 | orchestrator | 2026-04-24 06:22:41.613542 | orchestrator | TASK [placement : Copying over placement-api wsgi configuration] *************** 2026-04-24 06:22:41.613550 | orchestrator | Friday 24 April 2026 06:22:36 +0000 (0:00:02.616) 0:00:43.987 ********** 2026-04-24 06:22:41.613589 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-24 06:22:41.613599 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:22:41.613607 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-24 06:22:41.613614 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:22:41.613621 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-24 06:22:41.613630 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:22:41.613635 | orchestrator | 2026-04-24 06:22:41.613640 | orchestrator | TASK [Configure uWSGI for Placement] ******************************************* 2026-04-24 06:22:41.613644 | orchestrator | Friday 24 April 2026 06:22:36 +0000 (0:00:00.512) 0:00:44.499 ********** 2026-04-24 06:22:41.613649 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:22:41.613654 | orchestrator | 2026-04-24 06:22:41.613659 | orchestrator | TASK [service-uwsgi-config : Copying over placement-api uWSGI config] ********** 2026-04-24 06:22:41.613663 | orchestrator | Friday 24 April 2026 06:22:38 +0000 (0:00:01.195) 0:00:45.694 ********** 2026-04-24 06:22:41.613668 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:22:41.613672 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:22:41.613677 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:22:41.613681 | orchestrator | 2026-04-24 06:22:41.613686 | orchestrator | TASK [placement : Copying over migrate-db.rc.j2 configuration] ***************** 2026-04-24 06:22:41.613691 | orchestrator | Friday 24 April 2026 06:22:40 +0000 (0:00:02.052) 0:00:47.747 ********** 2026-04-24 06:22:41.613695 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:22:41.613700 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:22:41.613705 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:22:41.613709 | orchestrator | 2026-04-24 06:22:41.613718 | orchestrator | TASK [placement : Copying over existing policy file] *************************** 2026-04-24 06:22:44.971057 | orchestrator | Friday 24 April 2026 06:22:41 +0000 (0:00:01.400) 0:00:49.148 ********** 2026-04-24 06:22:44.971184 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:44.971230 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:22:44.971246 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:44.971258 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:22:44.971270 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:22:44.971281 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:22:44.971292 | orchestrator | 2026-04-24 06:22:44.971304 | orchestrator | TASK [service-check-containers : placement | Check containers] ***************** 2026-04-24 06:22:44.971315 | orchestrator | Friday 24 April 2026 06:22:42 +0000 (0:00:01.281) 0:00:50.429 ********** 2026-04-24 06:22:44.971345 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:44.971371 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:44.971385 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:22:44.971397 | orchestrator | 2026-04-24 06:22:44.971409 | orchestrator | TASK [service-check-containers : placement | Notify handlers to restart containers] *** 2026-04-24 06:22:44.971422 | orchestrator | Friday 24 April 2026 06:22:44 +0000 (0:00:01.489) 0:00:51.918 ********** 2026-04-24 06:22:44.971433 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 06:22:44.971444 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:22:44.971455 | orchestrator | } 2026-04-24 06:22:44.971466 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 06:22:44.971477 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:22:44.971488 | orchestrator | } 2026-04-24 06:22:44.971499 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 06:22:44.971509 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:22:44.971520 | orchestrator | } 2026-04-24 06:22:44.971531 | orchestrator | 2026-04-24 06:22:44.971542 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:22:44.971553 | orchestrator | Friday 24 April 2026 06:22:44 +0000 (0:00:00.364) 0:00:52.283 ********** 2026-04-24 06:22:44.971602 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:23:29.918420 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:23:29.918591 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:23:29.918614 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:23:29.918627 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:23:29.918640 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:23:29.918651 | orchestrator | 2026-04-24 06:23:29.918662 | orchestrator | TASK [placement : Creating placement databases] ******************************** 2026-04-24 06:23:29.918675 | orchestrator | Friday 24 April 2026 06:22:46 +0000 (0:00:01.310) 0:00:53.594 ********** 2026-04-24 06:23:29.918686 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:23:29.918698 | orchestrator | 2026-04-24 06:23:29.918709 | orchestrator | TASK [placement : Creating placement databases user and setting permissions] *** 2026-04-24 06:23:29.918720 | orchestrator | Friday 24 April 2026 06:22:48 +0000 (0:00:02.176) 0:00:55.771 ********** 2026-04-24 06:23:29.918730 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:23:29.918741 | orchestrator | 2026-04-24 06:23:29.918752 | orchestrator | TASK [placement : Running placement bootstrap container] *********************** 2026-04-24 06:23:29.918763 | orchestrator | Friday 24 April 2026 06:22:50 +0000 (0:00:02.692) 0:00:58.463 ********** 2026-04-24 06:23:29.918796 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:23:29.918808 | orchestrator | 2026-04-24 06:23:29.918818 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-24 06:23:29.918829 | orchestrator | Friday 24 April 2026 06:23:05 +0000 (0:00:14.735) 0:01:13.199 ********** 2026-04-24 06:23:29.918840 | orchestrator | 2026-04-24 06:23:29.918851 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-24 06:23:29.918861 | orchestrator | Friday 24 April 2026 06:23:05 +0000 (0:00:00.076) 0:01:13.275 ********** 2026-04-24 06:23:29.918872 | orchestrator | 2026-04-24 06:23:29.918883 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-24 06:23:29.918894 | orchestrator | Friday 24 April 2026 06:23:05 +0000 (0:00:00.073) 0:01:13.348 ********** 2026-04-24 06:23:29.918904 | orchestrator | 2026-04-24 06:23:29.918915 | orchestrator | RUNNING HANDLER [placement : Restart placement-api container] ****************** 2026-04-24 06:23:29.918926 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 06:23:29.918937 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 06:23:29.918961 | orchestrator | Friday 24 April 2026 06:23:05 +0000 (0:00:00.080) 0:01:13.428 ********** 2026-04-24 06:23:29.918974 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:23:29.918986 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:23:29.918999 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:23:29.919012 | orchestrator | 2026-04-24 06:23:29.919024 | orchestrator | TASK [placement : Perform Placement online data migration] ********************* 2026-04-24 06:23:29.919037 | orchestrator | Friday 24 April 2026 06:23:17 +0000 (0:00:11.691) 0:01:25.120 ********** 2026-04-24 06:23:29.919050 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:23:29.919063 | orchestrator | 2026-04-24 06:23:29.919092 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:23:29.919106 | orchestrator | testbed-node-0 : ok=24  changed=9  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-24 06:23:29.919120 | orchestrator | testbed-node-1 : ok=14  changed=6  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 06:23:29.919133 | orchestrator | testbed-node-2 : ok=14  changed=6  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 06:23:29.919145 | orchestrator | 2026-04-24 06:23:29.919158 | orchestrator | 2026-04-24 06:23:29.919176 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:23:29.919190 | orchestrator | Friday 24 April 2026 06:23:29 +0000 (0:00:11.984) 0:01:37.105 ********** 2026-04-24 06:23:29.919203 | orchestrator | =============================================================================== 2026-04-24 06:23:29.919215 | orchestrator | placement : Running placement bootstrap container ---------------------- 14.74s 2026-04-24 06:23:29.919228 | orchestrator | placement : Perform Placement online data migration -------------------- 11.98s 2026-04-24 06:23:29.919240 | orchestrator | placement : Restart placement-api container ---------------------------- 11.69s 2026-04-24 06:23:29.919251 | orchestrator | service-ks-register : placement | Creating/deleting endpoints ----------- 7.61s 2026-04-24 06:23:29.919263 | orchestrator | service-ks-register : placement | Creating users ------------------------ 5.48s 2026-04-24 06:23:29.919276 | orchestrator | service-ks-register : placement | Granting/revoking user roles ---------- 4.62s 2026-04-24 06:23:29.919290 | orchestrator | service-ks-register : placement | Creating/deleting services ------------ 4.39s 2026-04-24 06:23:29.919302 | orchestrator | service-ks-register : placement | Creating projects --------------------- 3.54s 2026-04-24 06:23:29.919314 | orchestrator | service-ks-register : placement | Creating roles ------------------------ 3.34s 2026-04-24 06:23:29.919325 | orchestrator | placement : Creating placement databases user and setting permissions --- 2.69s 2026-04-24 06:23:29.919343 | orchestrator | placement : Copying over placement.conf --------------------------------- 2.62s 2026-04-24 06:23:29.919354 | orchestrator | placement : Creating placement databases -------------------------------- 2.18s 2026-04-24 06:23:29.919365 | orchestrator | service-uwsgi-config : Copying over placement-api uWSGI config ---------- 2.05s 2026-04-24 06:23:29.919376 | orchestrator | service-check-containers : placement | Check containers ----------------- 1.49s 2026-04-24 06:23:29.919386 | orchestrator | placement : Copying over config.json files for services ----------------- 1.49s 2026-04-24 06:23:29.919397 | orchestrator | placement : include_tasks ----------------------------------------------- 1.48s 2026-04-24 06:23:29.919407 | orchestrator | placement : Copying over migrate-db.rc.j2 configuration ----------------- 1.40s 2026-04-24 06:23:29.919418 | orchestrator | service-cert-copy : placement | Copying over extra CA certificates ------ 1.35s 2026-04-24 06:23:29.919429 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.31s 2026-04-24 06:23:29.919439 | orchestrator | placement : Copying over existing policy file --------------------------- 1.28s 2026-04-24 06:23:30.134683 | orchestrator | + osism apply -a upgrade neutron 2026-04-24 06:23:31.502968 | orchestrator | 2026-04-24 06:23:31 | INFO  | Prepare task for execution of neutron. 2026-04-24 06:23:31.569852 | orchestrator | 2026-04-24 06:23:31 | INFO  | Task 7e02c13a-dd63-4b7e-99e7-02a62a8295b0 (neutron) was prepared for execution. 2026-04-24 06:23:31.569945 | orchestrator | 2026-04-24 06:23:31 | INFO  | It takes a moment until task 7e02c13a-dd63-4b7e-99e7-02a62a8295b0 (neutron) has been started and output is visible here. 2026-04-24 06:23:55.613495 | orchestrator | 2026-04-24 06:23:55.613658 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:23:55.613678 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 06:23:55.613691 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 06:23:55.613713 | orchestrator | 2026-04-24 06:23:55.613724 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:23:55.613735 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 06:23:55.613746 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 06:23:55.613767 | orchestrator | Friday 24 April 2026 06:23:36 +0000 (0:00:01.357) 0:00:01.357 ********** 2026-04-24 06:23:55.613777 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:23:55.613789 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:23:55.613800 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:23:55.613810 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:23:55.613821 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:23:55.613831 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:23:55.613842 | orchestrator | 2026-04-24 06:23:55.613853 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:23:55.613863 | orchestrator | Friday 24 April 2026 06:23:37 +0000 (0:00:01.539) 0:00:02.897 ********** 2026-04-24 06:23:55.613874 | orchestrator | ok: [testbed-node-0] => (item=enable_neutron_True) 2026-04-24 06:23:55.613885 | orchestrator | ok: [testbed-node-1] => (item=enable_neutron_True) 2026-04-24 06:23:55.613896 | orchestrator | ok: [testbed-node-2] => (item=enable_neutron_True) 2026-04-24 06:23:55.613907 | orchestrator | ok: [testbed-node-3] => (item=enable_neutron_True) 2026-04-24 06:23:55.613917 | orchestrator | ok: [testbed-node-4] => (item=enable_neutron_True) 2026-04-24 06:23:55.613927 | orchestrator | ok: [testbed-node-5] => (item=enable_neutron_True) 2026-04-24 06:23:55.613938 | orchestrator | 2026-04-24 06:23:55.613949 | orchestrator | PLAY [Apply role neutron] ****************************************************** 2026-04-24 06:23:55.613959 | orchestrator | 2026-04-24 06:23:55.613970 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 06:23:55.614007 | orchestrator | Friday 24 April 2026 06:23:39 +0000 (0:00:01.235) 0:00:04.132 ********** 2026-04-24 06:23:55.614095 | orchestrator | included: /ansible/roles/neutron/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:23:55.614110 | orchestrator | 2026-04-24 06:23:55.614123 | orchestrator | TASK [neutron : Get container facts] ******************************************* 2026-04-24 06:23:55.614136 | orchestrator | Friday 24 April 2026 06:23:41 +0000 (0:00:02.259) 0:00:06.392 ********** 2026-04-24 06:23:55.614149 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:23:55.614161 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:23:55.614174 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:23:55.614186 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:23:55.614199 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:23:55.614210 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:23:55.614220 | orchestrator | 2026-04-24 06:23:55.614231 | orchestrator | TASK [neutron : Get container volume facts] ************************************ 2026-04-24 06:23:55.614242 | orchestrator | Friday 24 April 2026 06:23:43 +0000 (0:00:01.975) 0:00:08.367 ********** 2026-04-24 06:23:55.614252 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:23:55.614263 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:23:55.614274 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:23:55.614284 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:23:55.614295 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:23:55.614306 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:23:55.614317 | orchestrator | 2026-04-24 06:23:55.614328 | orchestrator | TASK [neutron : Check for ML2/OVN presence] ************************************ 2026-04-24 06:23:55.614338 | orchestrator | Friday 24 April 2026 06:23:44 +0000 (0:00:01.198) 0:00:09.566 ********** 2026-04-24 06:23:55.614349 | orchestrator | ok: [testbed-node-0] => { 2026-04-24 06:23:55.614360 | orchestrator |  "changed": false, 2026-04-24 06:23:55.614371 | orchestrator |  "msg": "All assertions passed" 2026-04-24 06:23:55.614382 | orchestrator | } 2026-04-24 06:23:55.614393 | orchestrator | ok: [testbed-node-1] => { 2026-04-24 06:23:55.614404 | orchestrator |  "changed": false, 2026-04-24 06:23:55.614414 | orchestrator |  "msg": "All assertions passed" 2026-04-24 06:23:55.614425 | orchestrator | } 2026-04-24 06:23:55.614436 | orchestrator | ok: [testbed-node-2] => { 2026-04-24 06:23:55.614446 | orchestrator |  "changed": false, 2026-04-24 06:23:55.614457 | orchestrator |  "msg": "All assertions passed" 2026-04-24 06:23:55.614468 | orchestrator | } 2026-04-24 06:23:55.614479 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 06:23:55.614489 | orchestrator |  "changed": false, 2026-04-24 06:23:55.614500 | orchestrator |  "msg": "All assertions passed" 2026-04-24 06:23:55.614550 | orchestrator | } 2026-04-24 06:23:55.614562 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 06:23:55.614573 | orchestrator |  "changed": false, 2026-04-24 06:23:55.614584 | orchestrator |  "msg": "All assertions passed" 2026-04-24 06:23:55.614595 | orchestrator | } 2026-04-24 06:23:55.614605 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 06:23:55.614616 | orchestrator |  "changed": false, 2026-04-24 06:23:55.614626 | orchestrator |  "msg": "All assertions passed" 2026-04-24 06:23:55.614637 | orchestrator | } 2026-04-24 06:23:55.614648 | orchestrator | 2026-04-24 06:23:55.614658 | orchestrator | TASK [neutron : Check for ML2/OVS presence] ************************************ 2026-04-24 06:23:55.614669 | orchestrator | Friday 24 April 2026 06:23:45 +0000 (0:00:00.642) 0:00:10.208 ********** 2026-04-24 06:23:55.614681 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:23:55.614691 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:23:55.614702 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:23:55.614713 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:23:55.614723 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:23:55.614734 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:23:55.614745 | orchestrator | 2026-04-24 06:23:55.614755 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 06:23:55.614777 | orchestrator | Friday 24 April 2026 06:23:46 +0000 (0:00:00.954) 0:00:11.163 ********** 2026-04-24 06:23:55.614806 | orchestrator | included: /ansible/roles/neutron/tasks/rolling_upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:23:55.614819 | orchestrator | 2026-04-24 06:23:55.614830 | orchestrator | TASK [Load and persist kernel modules] ***************************************** 2026-04-24 06:23:55.614841 | orchestrator | Friday 24 April 2026 06:23:47 +0000 (0:00:01.523) 0:00:12.687 ********** 2026-04-24 06:23:55.614851 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:23:55.614862 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:23:55.614872 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:23:55.614883 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:23:55.614894 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:23:55.614904 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:23:55.614915 | orchestrator | 2026-04-24 06:23:55.614926 | orchestrator | TASK [neutron : Check IPv6 support] ******************************************** 2026-04-24 06:23:55.614936 | orchestrator | Friday 24 April 2026 06:23:49 +0000 (0:00:02.233) 0:00:14.920 ********** 2026-04-24 06:23:55.614947 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:23:55.614958 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:23:55.614969 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:23:55.614979 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:23:55.614990 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:23:55.615001 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:23:55.615011 | orchestrator | 2026-04-24 06:23:55.615022 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-24 06:23:55.615033 | orchestrator | Friday 24 April 2026 06:23:50 +0000 (0:00:01.007) 0:00:15.927 ********** 2026-04-24 06:23:55.615043 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:23:55.615054 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:23:55.615065 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:23:55.615075 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:23:55.615086 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:23:55.615096 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:23:55.615107 | orchestrator | 2026-04-24 06:23:55.615118 | orchestrator | TASK [neutron : Ensuring config directories exist] ***************************** 2026-04-24 06:23:55.615128 | orchestrator | Friday 24 April 2026 06:23:53 +0000 (0:00:02.557) 0:00:18.485 ********** 2026-04-24 06:23:55.615152 | orchestrator | ok: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:23:55.615170 | orchestrator | ok: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:23:55.615200 | orchestrator | ok: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:02.092627 | orchestrator | ok: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:02.092759 | orchestrator | ok: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:02.092777 | orchestrator | ok: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:02.092790 | orchestrator | 2026-04-24 06:24:02.092804 | orchestrator | TASK [neutron : Check if extra ml2 plugins exists] ***************************** 2026-04-24 06:24:02.092841 | orchestrator | Friday 24 April 2026 06:23:56 +0000 (0:00:02.683) 0:00:21.169 ********** 2026-04-24 06:24:02.092854 | orchestrator | [WARNING]: Skipped 2026-04-24 06:24:02.092866 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' path 2026-04-24 06:24:02.092878 | orchestrator | due to this access issue: 2026-04-24 06:24:02.092891 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' is not 2026-04-24 06:24:02.092902 | orchestrator | a directory 2026-04-24 06:24:02.092913 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 06:24:02.092924 | orchestrator | 2026-04-24 06:24:02.092935 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 06:24:02.092946 | orchestrator | Friday 24 April 2026 06:23:57 +0000 (0:00:01.248) 0:00:22.417 ********** 2026-04-24 06:24:02.092957 | orchestrator | included: /ansible/roles/neutron/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:24:02.092970 | orchestrator | 2026-04-24 06:24:02.092981 | orchestrator | TASK [service-cert-copy : neutron | Copying over extra CA certificates] ******** 2026-04-24 06:24:02.092992 | orchestrator | Friday 24 April 2026 06:23:59 +0000 (0:00:02.014) 0:00:24.432 ********** 2026-04-24 06:24:02.093022 | orchestrator | ok: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:02.093037 | orchestrator | ok: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:02.093056 | orchestrator | ok: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:02.093077 | orchestrator | ok: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:02.093089 | orchestrator | ok: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:02.093110 | orchestrator | ok: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:05.988834 | orchestrator | 2026-04-24 06:24:05.988939 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS certificate] *** 2026-04-24 06:24:05.988957 | orchestrator | Friday 24 April 2026 06:24:02 +0000 (0:00:02.805) 0:00:27.238 ********** 2026-04-24 06:24:05.988993 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:05.989010 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:05.989054 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:05.989066 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:05.989078 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:05.989090 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:05.989121 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:05.989134 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:05.989145 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:05.989156 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:05.989173 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:05.989193 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:05.989204 | orchestrator | 2026-04-24 06:24:05.989216 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS key] ***** 2026-04-24 06:24:05.989227 | orchestrator | Friday 24 April 2026 06:24:04 +0000 (0:00:02.295) 0:00:29.533 ********** 2026-04-24 06:24:05.989239 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:05.989250 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:05.989262 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:05.989274 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:05.989294 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:12.458359 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:12.458463 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:12.458477 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:12.458486 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:12.458494 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:12.458537 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:12.458545 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:12.458553 | orchestrator | 2026-04-24 06:24:12.458562 | orchestrator | TASK [neutron : Creating TLS backend PEM File] ********************************* 2026-04-24 06:24:12.458570 | orchestrator | Friday 24 April 2026 06:24:07 +0000 (0:00:02.626) 0:00:32.159 ********** 2026-04-24 06:24:12.458578 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:12.458585 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:12.458592 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:12.458599 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:12.458606 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:12.458614 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:12.458621 | orchestrator | 2026-04-24 06:24:12.458628 | orchestrator | TASK [neutron : Check if policies shall be overwritten] ************************ 2026-04-24 06:24:12.458636 | orchestrator | Friday 24 April 2026 06:24:09 +0000 (0:00:02.277) 0:00:34.437 ********** 2026-04-24 06:24:12.458643 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:12.458650 | orchestrator | 2026-04-24 06:24:12.458657 | orchestrator | TASK [neutron : Set neutron policy file] *************************************** 2026-04-24 06:24:12.458665 | orchestrator | Friday 24 April 2026 06:24:09 +0000 (0:00:00.146) 0:00:34.583 ********** 2026-04-24 06:24:12.458693 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:12.458700 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:12.458707 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:12.458715 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:12.458722 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:12.458729 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:12.458736 | orchestrator | 2026-04-24 06:24:12.458744 | orchestrator | TASK [neutron : Copying over existing policy file] ***************************** 2026-04-24 06:24:12.458751 | orchestrator | Friday 24 April 2026 06:24:10 +0000 (0:00:00.943) 0:00:35.527 ********** 2026-04-24 06:24:12.458779 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:12.458789 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:12.458797 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:12.458805 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:12.458813 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:12.458821 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:12.458828 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:12.458843 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:12.458861 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:21.021951 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:21.022086 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:21.022135 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:21.022149 | orchestrator | 2026-04-24 06:24:21.022162 | orchestrator | TASK [neutron : Copying over config.json files for services] ******************* 2026-04-24 06:24:21.022174 | orchestrator | Friday 24 April 2026 06:24:12 +0000 (0:00:02.506) 0:00:38.033 ********** 2026-04-24 06:24:21.022188 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:21.022203 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:21.022263 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:21.022295 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:21.022309 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:21.022320 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:21.022339 | orchestrator | 2026-04-24 06:24:21.022351 | orchestrator | TASK [neutron : Copying over neutron.conf] ************************************* 2026-04-24 06:24:21.022361 | orchestrator | Friday 24 April 2026 06:24:16 +0000 (0:00:03.385) 0:00:41.419 ********** 2026-04-24 06:24:21.022373 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:21.022397 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:23.546933 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:23.547037 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:23.547111 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:23.547137 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:24:23.547150 | orchestrator | 2026-04-24 06:24:23.547163 | orchestrator | TASK [neutron : Copying over neutron_vpnaas.conf] ****************************** 2026-04-24 06:24:23.547187 | orchestrator | Friday 24 April 2026 06:24:22 +0000 (0:00:05.716) 0:00:47.136 ********** 2026-04-24 06:24:23.547218 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:23.547231 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:23.547244 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:23.547263 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:23.547275 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:23.547286 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:23.547298 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:23.547309 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:23.547334 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:36.602728 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:36.602841 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:36.602871 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:36.602926 | orchestrator | 2026-04-24 06:24:36.602948 | orchestrator | TASK [neutron : Copying over ssh key] ****************************************** 2026-04-24 06:24:36.602969 | orchestrator | Friday 24 April 2026 06:24:23 +0000 (0:00:01.569) 0:00:48.706 ********** 2026-04-24 06:24:36.602987 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:36.603005 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:36.603021 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:36.603039 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:24:36.603057 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:24:36.603075 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:24:36.603093 | orchestrator | 2026-04-24 06:24:36.603111 | orchestrator | TASK [neutron : Copying over ml2_conf.ini] ************************************* 2026-04-24 06:24:36.603129 | orchestrator | Friday 24 April 2026 06:24:26 +0000 (0:00:02.459) 0:00:51.165 ********** 2026-04-24 06:24:36.603147 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:36.603166 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:36.603183 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:36.603201 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:36.603239 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:36.603258 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:36.603307 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:36.603347 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:36.603371 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:24:36.603392 | orchestrator | 2026-04-24 06:24:36.603411 | orchestrator | TASK [neutron : Copying over openvswitch_agent.ini] **************************** 2026-04-24 06:24:36.603429 | orchestrator | Friday 24 April 2026 06:24:29 +0000 (0:00:03.549) 0:00:54.714 ********** 2026-04-24 06:24:36.603448 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:36.603467 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:36.603511 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:36.603533 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:36.603551 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:36.603567 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:36.603585 | orchestrator | 2026-04-24 06:24:36.603601 | orchestrator | TASK [neutron : Copying over sriov_agent.ini] ********************************** 2026-04-24 06:24:36.603627 | orchestrator | Friday 24 April 2026 06:24:32 +0000 (0:00:02.408) 0:00:57.123 ********** 2026-04-24 06:24:36.603646 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:36.603664 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:36.603682 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:36.603701 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:36.603720 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:36.603737 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:36.603755 | orchestrator | 2026-04-24 06:24:36.603773 | orchestrator | TASK [neutron : Copying over mlnx_agent.ini] *********************************** 2026-04-24 06:24:36.603792 | orchestrator | Friday 24 April 2026 06:24:34 +0000 (0:00:02.219) 0:00:59.343 ********** 2026-04-24 06:24:36.603824 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:36.603841 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:36.603861 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:36.603878 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:36.603897 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:36.603917 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:36.603936 | orchestrator | 2026-04-24 06:24:36.603955 | orchestrator | TASK [neutron : Copying over eswitchd.conf] ************************************ 2026-04-24 06:24:36.603985 | orchestrator | Friday 24 April 2026 06:24:36 +0000 (0:00:02.312) 0:01:01.655 ********** 2026-04-24 06:24:46.862740 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:46.862844 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:46.862858 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:46.862870 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:46.862881 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:46.862891 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:46.862902 | orchestrator | 2026-04-24 06:24:46.862914 | orchestrator | TASK [neutron : Copying over dhcp_agent.ini] *********************************** 2026-04-24 06:24:46.862926 | orchestrator | Friday 24 April 2026 06:24:38 +0000 (0:00:02.085) 0:01:03.741 ********** 2026-04-24 06:24:46.862937 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:46.862948 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:46.862958 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:46.862969 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:46.863062 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:46.863077 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:46.863088 | orchestrator | 2026-04-24 06:24:46.863099 | orchestrator | TASK [neutron : Copying over dnsmasq.conf] ************************************* 2026-04-24 06:24:46.863110 | orchestrator | Friday 24 April 2026 06:24:41 +0000 (0:00:02.388) 0:01:06.129 ********** 2026-04-24 06:24:46.863121 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 06:24:46.863133 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:46.863143 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 06:24:46.863154 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:46.863165 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 06:24:46.863175 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:46.863186 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 06:24:46.863196 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:46.863207 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 06:24:46.863218 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:46.863228 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-24 06:24:46.863239 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:46.863249 | orchestrator | 2026-04-24 06:24:46.863260 | orchestrator | TASK [neutron : Copying over l3_agent.ini] ************************************* 2026-04-24 06:24:46.863271 | orchestrator | Friday 24 April 2026 06:24:43 +0000 (0:00:02.329) 0:01:08.459 ********** 2026-04-24 06:24:46.863292 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:46.863336 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:24:46.863365 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:46.863379 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:24:46.863411 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:46.863426 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:24:46.863438 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:46.863451 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:24:46.863465 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:24:46.863518 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:24:46.863531 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:24:46.863550 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:24:46.863563 | orchestrator | 2026-04-24 06:24:46.863575 | orchestrator | TASK [neutron : Copying over fwaas_driver.ini] ********************************* 2026-04-24 06:24:46.863587 | orchestrator | Friday 24 April 2026 06:24:45 +0000 (0:00:02.421) 0:01:10.880 ********** 2026-04-24 06:24:46.863607 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:25:10.370873 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.370969 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:25:10.370983 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.370992 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:25:10.371019 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371042 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:25:10.371055 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371066 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:25:10.371076 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371107 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:25:10.371119 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371131 | orchestrator | 2026-04-24 06:25:10.371143 | orchestrator | TASK [neutron : Copying over metadata_agent.ini] ******************************* 2026-04-24 06:25:10.371155 | orchestrator | Friday 24 April 2026 06:24:48 +0000 (0:00:02.247) 0:01:13.128 ********** 2026-04-24 06:25:10.371167 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371178 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371190 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371201 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371212 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371223 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371234 | orchestrator | 2026-04-24 06:25:10.371241 | orchestrator | TASK [neutron : Copying over neutron_ovn_metadata_agent.ini] ******************* 2026-04-24 06:25:10.371255 | orchestrator | Friday 24 April 2026 06:24:50 +0000 (0:00:02.108) 0:01:15.236 ********** 2026-04-24 06:25:10.371262 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371269 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371275 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371282 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:25:10.371288 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:25:10.371294 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:25:10.371301 | orchestrator | 2026-04-24 06:25:10.371307 | orchestrator | TASK [neutron : Copying over metering_agent.ini] ******************************* 2026-04-24 06:25:10.371314 | orchestrator | Friday 24 April 2026 06:24:54 +0000 (0:00:04.505) 0:01:19.742 ********** 2026-04-24 06:25:10.371321 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371327 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371333 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371340 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371347 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371353 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371360 | orchestrator | 2026-04-24 06:25:10.371366 | orchestrator | TASK [neutron : Copying over ironic_neutron_agent.ini] ************************* 2026-04-24 06:25:10.371373 | orchestrator | Friday 24 April 2026 06:24:56 +0000 (0:00:02.192) 0:01:21.934 ********** 2026-04-24 06:25:10.371379 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371386 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371392 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371398 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371405 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371411 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371418 | orchestrator | 2026-04-24 06:25:10.371425 | orchestrator | TASK [neutron : Copying over bgp_dragent.ini] ********************************** 2026-04-24 06:25:10.371433 | orchestrator | Friday 24 April 2026 06:24:59 +0000 (0:00:02.371) 0:01:24.306 ********** 2026-04-24 06:25:10.371441 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371449 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371456 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371463 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371471 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371504 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371512 | orchestrator | 2026-04-24 06:25:10.371520 | orchestrator | TASK [neutron : Copying over ovn_agent.ini] ************************************ 2026-04-24 06:25:10.371528 | orchestrator | Friday 24 April 2026 06:25:01 +0000 (0:00:02.281) 0:01:26.588 ********** 2026-04-24 06:25:10.371536 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371543 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371551 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371559 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371566 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371574 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371582 | orchestrator | 2026-04-24 06:25:10.371595 | orchestrator | TASK [neutron : Copying over nsx.ini] ****************************************** 2026-04-24 06:25:10.371603 | orchestrator | Friday 24 April 2026 06:25:03 +0000 (0:00:02.375) 0:01:28.963 ********** 2026-04-24 06:25:10.371611 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371618 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371624 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371631 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371638 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371649 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371660 | orchestrator | 2026-04-24 06:25:10.371671 | orchestrator | TASK [neutron : Copy neutron-l3-agent-wrapper script] ************************** 2026-04-24 06:25:10.371682 | orchestrator | Friday 24 April 2026 06:25:06 +0000 (0:00:02.107) 0:01:31.071 ********** 2026-04-24 06:25:10.371692 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371710 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371721 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371732 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371742 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371753 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371763 | orchestrator | 2026-04-24 06:25:10.371773 | orchestrator | TASK [neutron : Copying over extra ml2 plugins] ******************************** 2026-04-24 06:25:10.371784 | orchestrator | Friday 24 April 2026 06:25:08 +0000 (0:00:02.206) 0:01:33.278 ********** 2026-04-24 06:25:10.371795 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:10.371806 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:10.371816 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:10.371826 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:10.371836 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:10.371848 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:10.371858 | orchestrator | 2026-04-24 06:25:10.371881 | orchestrator | TASK [neutron : Copying over neutron-tls-proxy.cfg] **************************** 2026-04-24 06:25:18.136971 | orchestrator | Friday 24 April 2026 06:25:10 +0000 (0:00:02.145) 0:01:35.423 ********** 2026-04-24 06:25:18.137065 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 06:25:18.137078 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:18.137087 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 06:25:18.137096 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:18.137104 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 06:25:18.137112 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:18.137120 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 06:25:18.137128 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:18.137135 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 06:25:18.137143 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:18.137151 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-24 06:25:18.137159 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:18.137167 | orchestrator | 2026-04-24 06:25:18.137176 | orchestrator | TASK [neutron : Copying over neutron_taas.conf] ******************************** 2026-04-24 06:25:18.137184 | orchestrator | Friday 24 April 2026 06:25:12 +0000 (0:00:02.368) 0:01:37.791 ********** 2026-04-24 06:25:18.137196 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:25:18.137207 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:18.137230 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:25:18.137261 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:25:18.137297 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:25:18.137307 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:18.137316 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:25:18.137325 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:18.137333 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:25:18.137341 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:25:18.137350 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:25:18.137364 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:25:18.137372 | orchestrator | 2026-04-24 06:25:18.137380 | orchestrator | TASK [service-check-containers : neutron | Check containers] ******************* 2026-04-24 06:25:18.137388 | orchestrator | Friday 24 April 2026 06:25:15 +0000 (0:00:02.896) 0:01:40.688 ********** 2026-04-24 06:25:18.137401 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:25:18.137418 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:25:21.463999 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:25:21.464104 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:25:21.464167 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:25:21.464181 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-24 06:25:21.464193 | orchestrator | 2026-04-24 06:25:21.464206 | orchestrator | TASK [service-check-containers : neutron | Notify handlers to restart containers] *** 2026-04-24 06:25:21.464218 | orchestrator | Friday 24 April 2026 06:25:18 +0000 (0:00:03.280) 0:01:43.969 ********** 2026-04-24 06:25:21.464230 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 06:25:21.464242 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:25:21.464253 | orchestrator | } 2026-04-24 06:25:21.464264 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 06:25:21.464275 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:25:21.464285 | orchestrator | } 2026-04-24 06:25:21.464296 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 06:25:21.464306 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:25:21.464317 | orchestrator | } 2026-04-24 06:25:21.464327 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 06:25:21.464338 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:25:21.464348 | orchestrator | } 2026-04-24 06:25:21.464359 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 06:25:21.464369 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:25:21.464380 | orchestrator | } 2026-04-24 06:25:21.464391 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 06:25:21.464420 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:25:21.464431 | orchestrator | } 2026-04-24 06:25:21.464443 | orchestrator | 2026-04-24 06:25:21.464454 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:25:21.464465 | orchestrator | Friday 24 April 2026 06:25:19 +0000 (0:00:01.000) 0:01:44.969 ********** 2026-04-24 06:25:21.464521 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:25:21.464546 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:25:21.464565 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:25:21.464579 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:25:21.464592 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:25:21.464605 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:25:21.464629 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:28:07.994146 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:28:07.994329 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:28:07.994378 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:28:07.994392 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-24 06:28:07.994404 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:28:07.994415 | orchestrator | 2026-04-24 06:28:07.994427 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 06:28:07.994440 | orchestrator | Friday 24 April 2026 06:25:22 +0000 (0:00:02.922) 0:01:47.891 ********** 2026-04-24 06:28:07.994451 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:28:07.994462 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:28:07.994494 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:28:07.994505 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:28:07.994516 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:28:07.994540 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:28:07.994551 | orchestrator | 2026-04-24 06:28:07.994562 | orchestrator | TASK [neutron : Running Neutron database expand container] ********************* 2026-04-24 06:28:07.994573 | orchestrator | Friday 24 April 2026 06:25:23 +0000 (0:00:00.644) 0:01:48.535 ********** 2026-04-24 06:28:07.994584 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:28:07.994595 | orchestrator | 2026-04-24 06:28:07.994605 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.994619 | orchestrator | Friday 24 April 2026 06:26:01 +0000 (0:00:38.012) 0:02:26.548 ********** 2026-04-24 06:28:07.994632 | orchestrator | 2026-04-24 06:28:07.994645 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.994657 | orchestrator | Friday 24 April 2026 06:26:01 +0000 (0:00:00.074) 0:02:26.622 ********** 2026-04-24 06:28:07.994670 | orchestrator | 2026-04-24 06:28:07.994682 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.994695 | orchestrator | Friday 24 April 2026 06:26:01 +0000 (0:00:00.074) 0:02:26.696 ********** 2026-04-24 06:28:07.994708 | orchestrator | 2026-04-24 06:28:07.994720 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.994733 | orchestrator | Friday 24 April 2026 06:26:01 +0000 (0:00:00.262) 0:02:26.958 ********** 2026-04-24 06:28:07.994746 | orchestrator | 2026-04-24 06:28:07.994757 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.994768 | orchestrator | Friday 24 April 2026 06:26:01 +0000 (0:00:00.071) 0:02:27.030 ********** 2026-04-24 06:28:07.994779 | orchestrator | 2026-04-24 06:28:07.994789 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.994800 | orchestrator | Friday 24 April 2026 06:26:02 +0000 (0:00:00.075) 0:02:27.105 ********** 2026-04-24 06:28:07.994819 | orchestrator | 2026-04-24 06:28:07.994830 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-server container] ******************* 2026-04-24 06:28:07.994841 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 06:28:07.994854 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 06:28:07.994875 | orchestrator | Friday 24 April 2026 06:26:02 +0000 (0:00:00.074) 0:02:27.179 ********** 2026-04-24 06:28:07.994886 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:28:07.994897 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:28:07.994908 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:28:07.994919 | orchestrator | 2026-04-24 06:28:07.994929 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-ovn-metadata-agent container] ******* 2026-04-24 06:28:07.994940 | orchestrator | Friday 24 April 2026 06:26:40 +0000 (0:00:38.267) 0:03:05.447 ********** 2026-04-24 06:28:07.994951 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:28:07.994962 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:28:07.994972 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:28:07.994983 | orchestrator | 2026-04-24 06:28:07.995012 | orchestrator | TASK [neutron : Checking neutron pending contract scripts] ********************* 2026-04-24 06:28:07.995024 | orchestrator | Friday 24 April 2026 06:27:45 +0000 (0:01:05.085) 0:04:10.533 ********** 2026-04-24 06:28:07.995035 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:28:07.995046 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:28:07.995056 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:28:07.995067 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:28:07.995077 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:28:07.995088 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:28:07.995099 | orchestrator | 2026-04-24 06:28:07.995110 | orchestrator | TASK [neutron : Stopping all neutron-server for contract db] ******************* 2026-04-24 06:28:07.995121 | orchestrator | Friday 24 April 2026 06:27:46 +0000 (0:00:00.869) 0:04:11.402 ********** 2026-04-24 06:28:07.995131 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:28:07.995142 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:28:07.995153 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:28:07.995163 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:28:07.995174 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:28:07.995184 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:28:07.995195 | orchestrator | 2026-04-24 06:28:07.995205 | orchestrator | TASK [neutron : Running Neutron database contract container] ******************* 2026-04-24 06:28:07.995216 | orchestrator | Friday 24 April 2026 06:27:49 +0000 (0:00:03.250) 0:04:14.653 ********** 2026-04-24 06:28:07.995277 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:28:07.995288 | orchestrator | 2026-04-24 06:28:07.995300 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.995311 | orchestrator | Friday 24 April 2026 06:28:05 +0000 (0:00:15.508) 0:04:30.161 ********** 2026-04-24 06:28:07.995322 | orchestrator | 2026-04-24 06:28:07.995332 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.995343 | orchestrator | Friday 24 April 2026 06:28:05 +0000 (0:00:00.082) 0:04:30.244 ********** 2026-04-24 06:28:07.995354 | orchestrator | 2026-04-24 06:28:07.995365 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.995376 | orchestrator | Friday 24 April 2026 06:28:05 +0000 (0:00:00.078) 0:04:30.322 ********** 2026-04-24 06:28:07.995387 | orchestrator | 2026-04-24 06:28:07.995398 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.995408 | orchestrator | Friday 24 April 2026 06:28:05 +0000 (0:00:00.085) 0:04:30.408 ********** 2026-04-24 06:28:07.995419 | orchestrator | 2026-04-24 06:28:07.995430 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.995441 | orchestrator | Friday 24 April 2026 06:28:05 +0000 (0:00:00.074) 0:04:30.483 ********** 2026-04-24 06:28:07.995460 | orchestrator | 2026-04-24 06:28:07.995488 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-24 06:28:07.995499 | orchestrator | Friday 24 April 2026 06:28:05 +0000 (0:00:00.075) 0:04:30.558 ********** 2026-04-24 06:28:07.995510 | orchestrator | 2026-04-24 06:28:07.995520 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-24 06:28:07.995537 | orchestrator | Friday 24 April 2026 06:28:05 +0000 (0:00:00.072) 0:04:30.630 ********** 2026-04-24 06:28:07.995548 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:28:07.995559 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:28:07.995569 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:28:07.995580 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:28:07.995591 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:28:07.995602 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:28:07.995613 | orchestrator | 2026-04-24 06:28:07.995624 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:28:07.995636 | orchestrator | testbed-node-0 : ok=21  changed=8  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-24 06:28:07.995648 | orchestrator | testbed-node-1 : ok=18  changed=6  unreachable=0 failed=0 skipped=33  rescued=0 ignored=0 2026-04-24 06:28:07.995659 | orchestrator | testbed-node-2 : ok=18  changed=6  unreachable=0 failed=0 skipped=33  rescued=0 ignored=0 2026-04-24 06:28:07.995670 | orchestrator | testbed-node-3 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-24 06:28:07.995681 | orchestrator | testbed-node-4 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-24 06:28:07.995691 | orchestrator | testbed-node-5 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-24 06:28:07.995702 | orchestrator | 2026-04-24 06:28:07.995713 | orchestrator | 2026-04-24 06:28:07.995724 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:28:07.995735 | orchestrator | Friday 24 April 2026 06:28:07 +0000 (0:00:02.396) 0:04:33.026 ********** 2026-04-24 06:28:07.995745 | orchestrator | =============================================================================== 2026-04-24 06:28:07.995756 | orchestrator | neutron : Restart neutron-ovn-metadata-agent container ----------------- 65.09s 2026-04-24 06:28:07.995767 | orchestrator | neutron : Restart neutron-server container ----------------------------- 38.27s 2026-04-24 06:28:07.995778 | orchestrator | neutron : Running Neutron database expand container -------------------- 38.01s 2026-04-24 06:28:07.995788 | orchestrator | neutron : Running Neutron database contract container ------------------ 15.51s 2026-04-24 06:28:07.995799 | orchestrator | neutron : Copying over neutron.conf ------------------------------------- 5.72s 2026-04-24 06:28:07.995810 | orchestrator | neutron : Copying over neutron_ovn_metadata_agent.ini ------------------- 4.51s 2026-04-24 06:28:07.995829 | orchestrator | neutron : Copying over ml2_conf.ini ------------------------------------- 3.55s 2026-04-24 06:28:08.424956 | orchestrator | neutron : Copying over config.json files for services ------------------- 3.39s 2026-04-24 06:28:08.425057 | orchestrator | service-check-containers : neutron | Check containers ------------------- 3.28s 2026-04-24 06:28:08.425071 | orchestrator | neutron : Stopping all neutron-server for contract db ------------------- 3.25s 2026-04-24 06:28:08.425083 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.92s 2026-04-24 06:28:08.425094 | orchestrator | neutron : Copying over neutron_taas.conf -------------------------------- 2.90s 2026-04-24 06:28:08.425104 | orchestrator | service-cert-copy : neutron | Copying over extra CA certificates -------- 2.81s 2026-04-24 06:28:08.425115 | orchestrator | neutron : Ensuring config directories exist ----------------------------- 2.68s 2026-04-24 06:28:08.425158 | orchestrator | service-cert-copy : neutron | Copying over backend internal TLS key ----- 2.63s 2026-04-24 06:28:08.425169 | orchestrator | Setting sysctl values --------------------------------------------------- 2.56s 2026-04-24 06:28:08.425180 | orchestrator | neutron : Copying over existing policy file ----------------------------- 2.51s 2026-04-24 06:28:08.425191 | orchestrator | neutron : Copying over ssh key ------------------------------------------ 2.46s 2026-04-24 06:28:08.425202 | orchestrator | neutron : Copying over l3_agent.ini ------------------------------------- 2.42s 2026-04-24 06:28:08.425212 | orchestrator | neutron : Copying over openvswitch_agent.ini ---------------------------- 2.41s 2026-04-24 06:28:08.631940 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-24 06:28:08.632040 | orchestrator | + osism apply -a reconfigure nova 2026-04-24 06:28:09.952182 | orchestrator | 2026-04-24 06:28:09 | INFO  | Prepare task for execution of nova. 2026-04-24 06:28:10.023431 | orchestrator | 2026-04-24 06:28:10 | INFO  | Task f8af7171-6ba2-48f5-8b99-06ed2c2f043b (nova) was prepared for execution. 2026-04-24 06:28:10.023600 | orchestrator | 2026-04-24 06:28:10 | INFO  | It takes a moment until task f8af7171-6ba2-48f5-8b99-06ed2c2f043b (nova) has been started and output is visible here. 2026-04-24 06:30:13.236200 | orchestrator | 2026-04-24 06:30:13.236323 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:30:13.236347 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 06:30:13.236362 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 06:30:13.236378 | orchestrator | 2026-04-24 06:30:13.236386 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-24 06:30:13.236407 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 06:30:13.236415 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 06:30:13.236429 | orchestrator | Friday 24 April 2026 06:28:14 +0000 (0:00:01.255) 0:00:01.255 ********** 2026-04-24 06:30:13.236437 | orchestrator | changed: [testbed-manager] 2026-04-24 06:30:13.236444 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:30:13.236451 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:30:13.236534 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:30:13.236542 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:30:13.236550 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:30:13.236557 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:30:13.236564 | orchestrator | 2026-04-24 06:30:13.236571 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:30:13.236579 | orchestrator | Friday 24 April 2026 06:28:17 +0000 (0:00:02.265) 0:00:03.521 ********** 2026-04-24 06:30:13.236587 | orchestrator | changed: [testbed-manager] 2026-04-24 06:30:13.236594 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:30:13.236601 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:30:13.236608 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:30:13.236616 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:30:13.236623 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:30:13.236630 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:30:13.236637 | orchestrator | 2026-04-24 06:30:13.236644 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:30:13.236652 | orchestrator | Friday 24 April 2026 06:28:18 +0000 (0:00:00.898) 0:00:04.420 ********** 2026-04-24 06:30:13.236659 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-24 06:30:13.236666 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-24 06:30:13.236673 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-24 06:30:13.236681 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-24 06:30:13.236708 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-24 06:30:13.236716 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-24 06:30:13.236723 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-24 06:30:13.236730 | orchestrator | 2026-04-24 06:30:13.236737 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-24 06:30:13.236744 | orchestrator | 2026-04-24 06:30:13.236752 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-24 06:30:13.236761 | orchestrator | Friday 24 April 2026 06:28:19 +0000 (0:00:01.283) 0:00:05.703 ********** 2026-04-24 06:30:13.236769 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:30:13.236778 | orchestrator | 2026-04-24 06:30:13.236786 | orchestrator | TASK [nova : Creating Nova databases] ****************************************** 2026-04-24 06:30:13.236794 | orchestrator | Friday 24 April 2026 06:28:20 +0000 (0:00:01.020) 0:00:06.724 ********** 2026-04-24 06:30:13.236803 | orchestrator | ok: [testbed-node-0] => (item=nova_cell0) 2026-04-24 06:30:13.236812 | orchestrator | ok: [testbed-node-0] => (item=nova_api) 2026-04-24 06:30:13.236820 | orchestrator | 2026-04-24 06:30:13.236828 | orchestrator | TASK [nova : Creating Nova databases user and setting permissions] ************* 2026-04-24 06:30:13.236836 | orchestrator | Friday 24 April 2026 06:28:24 +0000 (0:00:04.656) 0:00:11.381 ********** 2026-04-24 06:30:13.236844 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 06:30:13.236853 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 06:30:13.236861 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.236869 | orchestrator | 2026-04-24 06:30:13.236877 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-24 06:30:13.236886 | orchestrator | Friday 24 April 2026 06:28:29 +0000 (0:00:04.771) 0:00:16.152 ********** 2026-04-24 06:30:13.236894 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.236902 | orchestrator | 2026-04-24 06:30:13.236910 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-24 06:30:13.236918 | orchestrator | Friday 24 April 2026 06:28:30 +0000 (0:00:00.682) 0:00:16.835 ********** 2026-04-24 06:30:13.236926 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.236934 | orchestrator | 2026-04-24 06:30:13.236942 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-24 06:30:13.236950 | orchestrator | Friday 24 April 2026 06:28:31 +0000 (0:00:01.176) 0:00:18.011 ********** 2026-04-24 06:30:13.236959 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:30:13.236967 | orchestrator | 2026-04-24 06:30:13.236975 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 06:30:13.236984 | orchestrator | Friday 24 April 2026 06:28:34 +0000 (0:00:02.919) 0:00:20.931 ********** 2026-04-24 06:30:13.236992 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:30:13.237000 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237008 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237016 | orchestrator | 2026-04-24 06:30:13.237024 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-24 06:30:13.237032 | orchestrator | Friday 24 April 2026 06:28:35 +0000 (0:00:00.756) 0:00:21.687 ********** 2026-04-24 06:30:13.237041 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.237049 | orchestrator | 2026-04-24 06:30:13.237057 | orchestrator | TASK [nova : Create cell0 mappings] ******************************************** 2026-04-24 06:30:13.237082 | orchestrator | Friday 24 April 2026 06:29:11 +0000 (0:00:36.339) 0:00:58.026 ********** 2026-04-24 06:30:13.237091 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.237099 | orchestrator | 2026-04-24 06:30:13.237107 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-24 06:30:13.237115 | orchestrator | Friday 24 April 2026 06:29:27 +0000 (0:00:15.727) 0:01:13.753 ********** 2026-04-24 06:30:13.237123 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.237132 | orchestrator | 2026-04-24 06:30:13.237140 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-24 06:30:13.237154 | orchestrator | Friday 24 April 2026 06:29:42 +0000 (0:00:15.033) 0:01:28.787 ********** 2026-04-24 06:30:13.237163 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.237171 | orchestrator | 2026-04-24 06:30:13.237184 | orchestrator | TASK [nova : Update cell0 mappings] ******************************************** 2026-04-24 06:30:13.237191 | orchestrator | Friday 24 April 2026 06:29:43 +0000 (0:00:01.318) 0:01:30.105 ********** 2026-04-24 06:30:13.237198 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:30:13.237205 | orchestrator | 2026-04-24 06:30:13.237212 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 06:30:13.237219 | orchestrator | Friday 24 April 2026 06:29:44 +0000 (0:00:00.650) 0:01:30.756 ********** 2026-04-24 06:30:13.237226 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:30:13.237234 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237241 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237248 | orchestrator | 2026-04-24 06:30:13.237255 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-24 06:30:13.237262 | orchestrator | Friday 24 April 2026 06:29:44 +0000 (0:00:00.583) 0:01:31.339 ********** 2026-04-24 06:30:13.237269 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:30:13.237276 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237283 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237290 | orchestrator | 2026-04-24 06:30:13.237297 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-24 06:30:13.237305 | orchestrator | 2026-04-24 06:30:13.237312 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-24 06:30:13.237319 | orchestrator | Friday 24 April 2026 06:29:45 +0000 (0:00:00.951) 0:01:32.290 ********** 2026-04-24 06:30:13.237326 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:30:13.237333 | orchestrator | 2026-04-24 06:30:13.237340 | orchestrator | TASK [nova-cell : Creating Nova cell database] ********************************* 2026-04-24 06:30:13.237347 | orchestrator | Friday 24 April 2026 06:29:46 +0000 (0:00:01.033) 0:01:33.324 ********** 2026-04-24 06:30:13.237354 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237361 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237368 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.237375 | orchestrator | 2026-04-24 06:30:13.237382 | orchestrator | TASK [nova-cell : Creating Nova cell database user and setting permissions] **** 2026-04-24 06:30:13.237390 | orchestrator | Friday 24 April 2026 06:29:49 +0000 (0:00:02.213) 0:01:35.537 ********** 2026-04-24 06:30:13.237397 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237404 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237411 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.237418 | orchestrator | 2026-04-24 06:30:13.237425 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-24 06:30:13.237432 | orchestrator | Friday 24 April 2026 06:29:51 +0000 (0:00:02.740) 0:01:38.277 ********** 2026-04-24 06:30:13.237439 | orchestrator | skipping: [testbed-node-1] => (item=openstack)  2026-04-24 06:30:13.237447 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237465 | orchestrator | skipping: [testbed-node-2] => (item=openstack)  2026-04-24 06:30:13.237473 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237480 | orchestrator | ok: [testbed-node-0] => (item=openstack) 2026-04-24 06:30:13.237487 | orchestrator | 2026-04-24 06:30:13.237495 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-24 06:30:13.237502 | orchestrator | Friday 24 April 2026 06:29:56 +0000 (0:00:04.696) 0:01:42.974 ********** 2026-04-24 06:30:13.237509 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-24 06:30:13.237516 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237523 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-24 06:30:13.237530 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237537 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-24 06:30:13.237550 | orchestrator | ok: [testbed-node-0 -> {{ service_rabbitmq_delegate_host }}] 2026-04-24 06:30:13.237557 | orchestrator | 2026-04-24 06:30:13.237564 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-24 06:30:13.237571 | orchestrator | Friday 24 April 2026 06:30:11 +0000 (0:00:14.507) 0:01:57.481 ********** 2026-04-24 06:30:13.237582 | orchestrator | skipping: [testbed-node-0] => (item=openstack)  2026-04-24 06:30:13.237594 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:30:13.237606 | orchestrator | skipping: [testbed-node-1] => (item=openstack)  2026-04-24 06:30:13.237617 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237630 | orchestrator | skipping: [testbed-node-2] => (item=openstack)  2026-04-24 06:30:13.237642 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237654 | orchestrator | 2026-04-24 06:30:13.237666 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-24 06:30:13.237674 | orchestrator | Friday 24 April 2026 06:30:11 +0000 (0:00:00.493) 0:01:57.974 ********** 2026-04-24 06:30:13.237682 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-24 06:30:13.237688 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:30:13.237695 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-24 06:30:13.237703 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237710 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-24 06:30:13.237717 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:30:13.237724 | orchestrator | 2026-04-24 06:30:13.237731 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-24 06:30:13.237738 | orchestrator | Friday 24 April 2026 06:30:12 +0000 (0:00:01.103) 0:01:59.078 ********** 2026-04-24 06:30:13.237745 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:30:13.237752 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:30:13.237765 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.095930 | orchestrator | 2026-04-24 06:31:33.096022 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-24 06:31:33.096033 | orchestrator | Friday 24 April 2026 06:30:13 +0000 (0:00:00.640) 0:01:59.718 ********** 2026-04-24 06:31:33.096040 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:33.096048 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.096054 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:31:33.096061 | orchestrator | 2026-04-24 06:31:33.096068 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-24 06:31:33.096075 | orchestrator | Friday 24 April 2026 06:30:14 +0000 (0:00:01.098) 0:02:00.816 ********** 2026-04-24 06:31:33.096094 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:33.096100 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.096107 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:31:33.096113 | orchestrator | 2026-04-24 06:31:33.096119 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-24 06:31:33.096126 | orchestrator | Friday 24 April 2026 06:30:17 +0000 (0:00:02.851) 0:02:03.668 ********** 2026-04-24 06:31:33.096132 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:33.096138 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.096144 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:31:33.096151 | orchestrator | 2026-04-24 06:31:33.096157 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-24 06:31:33.096163 | orchestrator | Friday 24 April 2026 06:30:28 +0000 (0:00:11.507) 0:02:15.176 ********** 2026-04-24 06:31:33.096169 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.096175 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:33.096181 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:31:33.096188 | orchestrator | 2026-04-24 06:31:33.096195 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-24 06:31:33.096201 | orchestrator | Friday 24 April 2026 06:30:42 +0000 (0:00:13.586) 0:02:28.763 ********** 2026-04-24 06:31:33.096207 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:31:33.096231 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:33.096238 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.096244 | orchestrator | 2026-04-24 06:31:33.096250 | orchestrator | TASK [nova-cell : Create cell] ************************************************* 2026-04-24 06:31:33.096257 | orchestrator | Friday 24 April 2026 06:30:43 +0000 (0:00:01.463) 0:02:30.227 ********** 2026-04-24 06:31:33.096263 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:31:33.096269 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:33.096275 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.096281 | orchestrator | 2026-04-24 06:31:33.096287 | orchestrator | TASK [nova-cell : Update cell] ************************************************* 2026-04-24 06:31:33.096294 | orchestrator | Friday 24 April 2026 06:30:44 +0000 (0:00:01.072) 0:02:31.300 ********** 2026-04-24 06:31:33.096300 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:33.096306 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.096312 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:31:33.096318 | orchestrator | 2026-04-24 06:31:33.096324 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-24 06:31:33.096330 | orchestrator | Friday 24 April 2026 06:30:58 +0000 (0:00:13.653) 0:02:44.953 ********** 2026-04-24 06:31:33.096337 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:31:33.096343 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:33.096349 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:33.096355 | orchestrator | 2026-04-24 06:31:33.096361 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-24 06:31:33.096367 | orchestrator | 2026-04-24 06:31:33.096374 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 06:31:33.096380 | orchestrator | Friday 24 April 2026 06:30:59 +0000 (0:00:00.791) 0:02:45.745 ********** 2026-04-24 06:31:33.096387 | orchestrator | included: /ansible/roles/nova/tasks/reconfigure.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:31:33.096394 | orchestrator | 2026-04-24 06:31:33.096400 | orchestrator | TASK [service-ks-register : nova | Creating/deleting services] ***************** 2026-04-24 06:31:33.096407 | orchestrator | Friday 24 April 2026 06:31:00 +0000 (0:00:01.285) 0:02:47.030 ********** 2026-04-24 06:31:33.096413 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy (compute_legacy))  2026-04-24 06:31:33.096419 | orchestrator | ok: [testbed-node-0] => (item=nova (compute)) 2026-04-24 06:31:33.096426 | orchestrator | 2026-04-24 06:31:33.096432 | orchestrator | TASK [service-ks-register : nova | Creating/deleting endpoints] **************** 2026-04-24 06:31:33.096499 | orchestrator | Friday 24 April 2026 06:31:04 +0000 (0:00:03.400) 0:02:50.431 ********** 2026-04-24 06:31:33.096507 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api-int.testbed.osism.xyz:8774/v2/%(tenant_id)s -> internal)  2026-04-24 06:31:33.096516 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api.testbed.osism.xyz:8774/v2/%(tenant_id)s -> public)  2026-04-24 06:31:33.096523 | orchestrator | ok: [testbed-node-0] => (item=nova -> https://api-int.testbed.osism.xyz:8774/v2.1 -> internal) 2026-04-24 06:31:33.096531 | orchestrator | ok: [testbed-node-0] => (item=nova -> https://api.testbed.osism.xyz:8774/v2.1 -> public) 2026-04-24 06:31:33.096538 | orchestrator | 2026-04-24 06:31:33.096545 | orchestrator | TASK [service-ks-register : nova | Creating projects] ************************** 2026-04-24 06:31:33.096552 | orchestrator | Friday 24 April 2026 06:31:10 +0000 (0:00:06.591) 0:02:57.022 ********** 2026-04-24 06:31:33.096560 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-24 06:31:33.096567 | orchestrator | 2026-04-24 06:31:33.096574 | orchestrator | TASK [service-ks-register : nova | Creating users] ***************************** 2026-04-24 06:31:33.096581 | orchestrator | Friday 24 April 2026 06:31:13 +0000 (0:00:03.355) 0:03:00.378 ********** 2026-04-24 06:31:33.096589 | orchestrator | changed: [testbed-node-0] => (item=nova -> service) 2026-04-24 06:31:33.096596 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-24 06:31:33.096603 | orchestrator | 2026-04-24 06:31:33.096617 | orchestrator | TASK [service-ks-register : nova | Creating roles] ***************************** 2026-04-24 06:31:33.096638 | orchestrator | Friday 24 April 2026 06:31:19 +0000 (0:00:05.118) 0:03:05.496 ********** 2026-04-24 06:31:33.096645 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-24 06:31:33.096653 | orchestrator | 2026-04-24 06:31:33.096660 | orchestrator | TASK [service-ks-register : nova | Granting/revoking user roles] *************** 2026-04-24 06:31:33.096667 | orchestrator | Friday 24 April 2026 06:31:22 +0000 (0:00:03.649) 0:03:09.145 ********** 2026-04-24 06:31:33.096674 | orchestrator | ok: [testbed-node-0] => (item=nova -> service -> admin) 2026-04-24 06:31:33.096682 | orchestrator | ok: [testbed-node-0] => (item=nova -> service -> service) 2026-04-24 06:31:33.096689 | orchestrator | 2026-04-24 06:31:33.096701 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-24 06:31:33.096708 | orchestrator | Friday 24 April 2026 06:31:31 +0000 (0:00:08.515) 0:03:17.662 ********** 2026-04-24 06:31:33.096720 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:33.096731 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:33.096740 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:33.096760 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:39.117987 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:39.118128 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:39.118141 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:39.118169 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:39.118197 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:39.118206 | orchestrator | 2026-04-24 06:31:39.118214 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-24 06:31:39.118222 | orchestrator | Friday 24 April 2026 06:31:34 +0000 (0:00:02.801) 0:03:20.463 ********** 2026-04-24 06:31:39.118229 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:31:39.118237 | orchestrator | 2026-04-24 06:31:39.118244 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-24 06:31:39.118251 | orchestrator | Friday 24 April 2026 06:31:34 +0000 (0:00:00.141) 0:03:20.604 ********** 2026-04-24 06:31:39.118257 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:31:39.118264 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:39.118270 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:39.118277 | orchestrator | 2026-04-24 06:31:39.118283 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-24 06:31:39.118290 | orchestrator | Friday 24 April 2026 06:31:34 +0000 (0:00:00.368) 0:03:20.972 ********** 2026-04-24 06:31:39.118297 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 06:31:39.118304 | orchestrator | 2026-04-24 06:31:39.118310 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-24 06:31:39.118316 | orchestrator | Friday 24 April 2026 06:31:35 +0000 (0:00:01.194) 0:03:22.167 ********** 2026-04-24 06:31:39.118323 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:31:39.118329 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:39.118336 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:39.118342 | orchestrator | 2026-04-24 06:31:39.118349 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 06:31:39.118355 | orchestrator | Friday 24 April 2026 06:31:36 +0000 (0:00:00.381) 0:03:22.549 ********** 2026-04-24 06:31:39.118363 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:31:39.118370 | orchestrator | 2026-04-24 06:31:39.118376 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-24 06:31:39.118383 | orchestrator | Friday 24 April 2026 06:31:37 +0000 (0:00:01.251) 0:03:23.801 ********** 2026-04-24 06:31:39.118390 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:39.118405 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:39.118425 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:41.844584 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:41.844697 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:41.844746 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:41.844776 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:41.844811 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:41.844823 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:41.844835 | orchestrator | 2026-04-24 06:31:41.844848 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-24 06:31:41.844860 | orchestrator | Friday 24 April 2026 06:31:40 +0000 (0:00:03.494) 0:03:27.296 ********** 2026-04-24 06:31:41.844873 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:41.844894 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:41.844912 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:31:41.844924 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:31:41.844948 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:43.086181 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:43.086297 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:31:43.086327 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:43.086352 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:43.086367 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:43.086401 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:31:43.086425 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:43.086491 | orchestrator | 2026-04-24 06:31:43.086510 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-24 06:31:43.086525 | orchestrator | Friday 24 April 2026 06:31:42 +0000 (0:00:01.418) 0:03:28.715 ********** 2026-04-24 06:31:43.086540 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:43.086555 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:43.086564 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:31:43.086573 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:31:43.086589 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:45.954782 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:45.954880 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:31:45.954894 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:31:45.954920 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:45.954930 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:45.954976 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:31:45.954986 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:31:45.954995 | orchestrator | 2026-04-24 06:31:45.955004 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-24 06:31:45.955013 | orchestrator | Friday 24 April 2026 06:31:43 +0000 (0:00:01.181) 0:03:29.897 ********** 2026-04-24 06:31:45.955021 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:45.955035 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:45.955045 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:45.955066 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:53.529575 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:53.529688 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:53.529703 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:53.529733 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:53.529742 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:53.529750 | orchestrator | 2026-04-24 06:31:53.529760 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-24 06:31:53.529808 | orchestrator | Friday 24 April 2026 06:31:47 +0000 (0:00:03.876) 0:03:33.774 ********** 2026-04-24 06:31:53.529820 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:53.529834 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:53.529851 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:53.529867 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:58.248013 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:58.248115 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:31:58.248151 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:58.248162 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:58.248171 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:31:58.248179 | orchestrator | 2026-04-24 06:31:58.248189 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-24 06:31:58.248212 | orchestrator | Friday 24 April 2026 06:31:57 +0000 (0:00:10.193) 0:03:43.967 ********** 2026-04-24 06:31:58.248222 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:58.248235 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:58.248251 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:31:58.248261 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:31:58.248270 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:31:58.248286 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:32:10.616343 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:32:10.616775 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:32:10.616807 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:32:10.616830 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:32:10.616851 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:32:10.616871 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:32:10.616890 | orchestrator | 2026-04-24 06:32:10.616909 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-24 06:32:10.616928 | orchestrator | Friday 24 April 2026 06:31:58 +0000 (0:00:00.838) 0:03:44.805 ********** 2026-04-24 06:32:10.616946 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:32:10.616959 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:32:10.616971 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:32:10.616983 | orchestrator | 2026-04-24 06:32:10.616993 | orchestrator | TASK [nova : Copying over nova-metadata-wsgi.conf] ***************************** 2026-04-24 06:32:10.617002 | orchestrator | Friday 24 April 2026 06:31:59 +0000 (0:00:00.790) 0:03:45.595 ********** 2026-04-24 06:32:10.617015 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:32:10.617031 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:32:10.617060 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:32:10.617077 | orchestrator | 2026-04-24 06:32:10.617094 | orchestrator | TASK [nova : Copying over vendordata file for nova services] ******************* 2026-04-24 06:32:10.617136 | orchestrator | Friday 24 April 2026 06:32:00 +0000 (0:00:01.401) 0:03:46.997 ********** 2026-04-24 06:32:10.617148 | orchestrator | skipping: [testbed-node-0] => (item=nova-metadata)  2026-04-24 06:32:10.617158 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-24 06:32:10.617168 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:32:10.617189 | orchestrator | skipping: [testbed-node-1] => (item=nova-metadata)  2026-04-24 06:32:10.617206 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-24 06:32:10.617223 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:32:10.617275 | orchestrator | skipping: [testbed-node-2] => (item=nova-metadata)  2026-04-24 06:32:10.617293 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-24 06:32:10.617308 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:32:10.617328 | orchestrator | 2026-04-24 06:32:10.617352 | orchestrator | TASK [Configure uWSGI for Nova] ************************************************ 2026-04-24 06:32:10.617367 | orchestrator | Friday 24 April 2026 06:32:01 +0000 (0:00:00.684) 0:03:47.682 ********** 2026-04-24 06:32:10.617383 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-api', 'port': '8774', 'workers': '2'}) 2026-04-24 06:32:10.617403 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-metadata', 'port': '8775', 'workers': '2'}) 2026-04-24 06:32:10.617417 | orchestrator | 2026-04-24 06:32:10.617459 | orchestrator | TASK [service-uwsgi-config : Copying over nova-api uWSGI config] *************** 2026-04-24 06:32:10.617476 | orchestrator | Friday 24 April 2026 06:32:03 +0000 (0:00:02.218) 0:03:49.901 ********** 2026-04-24 06:32:10.617491 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:32:10.617508 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:32:10.617524 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:32:10.617541 | orchestrator | 2026-04-24 06:32:10.617558 | orchestrator | TASK [service-uwsgi-config : Copying over nova-metadata uWSGI config] ********** 2026-04-24 06:32:10.617568 | orchestrator | Friday 24 April 2026 06:32:06 +0000 (0:00:02.732) 0:03:52.633 ********** 2026-04-24 06:32:10.617577 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:32:10.617587 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:32:10.617597 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:32:10.617606 | orchestrator | 2026-04-24 06:32:10.617615 | orchestrator | TASK [service-check-containers : nova | Check containers] ********************** 2026-04-24 06:32:10.617626 | orchestrator | Friday 24 April 2026 06:32:08 +0000 (0:00:02.558) 0:03:55.191 ********** 2026-04-24 06:32:10.617638 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:32:10.617650 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:32:10.617693 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:32:13.133120 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:32:13.133199 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:32:13.133229 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:32:13.133248 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:32:13.133269 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:32:13.133275 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:32:13.133281 | orchestrator | 2026-04-24 06:32:13.133287 | orchestrator | TASK [service-check-containers : nova | Notify handlers to restart containers] *** 2026-04-24 06:32:13.133293 | orchestrator | Friday 24 April 2026 06:32:12 +0000 (0:00:03.397) 0:03:58.589 ********** 2026-04-24 06:32:13.133300 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 06:32:13.133306 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:32:13.133311 | orchestrator | } 2026-04-24 06:32:13.133317 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 06:32:13.133322 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:32:13.133327 | orchestrator | } 2026-04-24 06:32:13.133332 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 06:32:13.133337 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:32:13.133342 | orchestrator | } 2026-04-24 06:32:13.133348 | orchestrator | 2026-04-24 06:32:13.133353 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:32:13.133363 | orchestrator | Friday 24 April 2026 06:32:12 +0000 (0:00:00.394) 0:03:58.983 ********** 2026-04-24 06:32:13.133369 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:32:13.133378 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:32:13.133388 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:33:43.154553 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:33:43.154713 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:33:43.154828 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:33:43.154860 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:33:43.154882 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:33:43.154924 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:33:43.154979 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:33:43.155016 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:33:43.155035 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:33:43.155055 | orchestrator | 2026-04-24 06:33:43.155074 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 06:33:43.155096 | orchestrator | Friday 24 April 2026 06:32:14 +0000 (0:00:01.567) 0:04:00.550 ********** 2026-04-24 06:33:43.155115 | orchestrator | 2026-04-24 06:33:43.155134 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 06:33:43.155152 | orchestrator | Friday 24 April 2026 06:32:14 +0000 (0:00:00.413) 0:04:00.964 ********** 2026-04-24 06:33:43.155171 | orchestrator | 2026-04-24 06:33:43.155189 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 06:33:43.155208 | orchestrator | Friday 24 April 2026 06:32:14 +0000 (0:00:00.166) 0:04:01.131 ********** 2026-04-24 06:33:43.155227 | orchestrator | 2026-04-24 06:33:43.155247 | orchestrator | RUNNING HANDLER [nova : Restart nova-scheduler container] ********************** 2026-04-24 06:33:43.155267 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 06:33:43.155287 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 06:33:43.155323 | orchestrator | Friday 24 April 2026 06:32:14 +0000 (0:00:00.165) 0:04:01.296 ********** 2026-04-24 06:33:43.155342 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:33:43.155361 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:33:43.155379 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:33:43.155399 | orchestrator | 2026-04-24 06:33:43.155506 | orchestrator | RUNNING HANDLER [nova : Restart nova-api container] **************************** 2026-04-24 06:33:43.155526 | orchestrator | Friday 24 April 2026 06:32:41 +0000 (0:00:26.535) 0:04:27.832 ********** 2026-04-24 06:33:43.155545 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:33:43.155562 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:33:43.155581 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:33:43.155600 | orchestrator | 2026-04-24 06:33:43.155617 | orchestrator | RUNNING HANDLER [nova : Restart nova-metadata container] *********************** 2026-04-24 06:33:43.155636 | orchestrator | Friday 24 April 2026 06:32:54 +0000 (0:00:13.457) 0:04:41.290 ********** 2026-04-24 06:33:43.155653 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:33:43.155672 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:33:43.155691 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:33:43.155709 | orchestrator | 2026-04-24 06:33:43.155727 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-24 06:33:43.155746 | orchestrator | 2026-04-24 06:33:43.155763 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 06:33:43.155795 | orchestrator | Friday 24 April 2026 06:33:05 +0000 (0:00:10.615) 0:04:51.905 ********** 2026-04-24 06:33:43.155814 | orchestrator | included: /ansible/roles/nova-cell/tasks/reconfigure.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:33:43.155835 | orchestrator | 2026-04-24 06:33:43.155853 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 06:33:43.155907 | orchestrator | Friday 24 April 2026 06:33:07 +0000 (0:00:02.126) 0:04:54.032 ********** 2026-04-24 06:33:43.155929 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:33:43.155947 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:33:43.155982 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:33:43.156003 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:33:43.156023 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:33:43.156044 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:33:43.156065 | orchestrator | 2026-04-24 06:33:43.156084 | orchestrator | TASK [nova-cell : Get new Libvirt version] ************************************* 2026-04-24 06:33:43.156105 | orchestrator | Friday 24 April 2026 06:33:08 +0000 (0:00:01.349) 0:04:55.382 ********** 2026-04-24 06:33:43.156145 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:34:22.034849 | orchestrator | 2026-04-24 06:34:22.034977 | orchestrator | TASK [nova-cell : Cache new Libvirt version] *********************************** 2026-04-24 06:34:22.035000 | orchestrator | Friday 24 April 2026 06:33:43 +0000 (0:00:34.267) 0:05:29.650 ********** 2026-04-24 06:34:22.035015 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:34:22.035029 | orchestrator | 2026-04-24 06:34:22.035042 | orchestrator | TASK [Get nova_libvirt image info] ********************************************* 2026-04-24 06:34:22.035056 | orchestrator | Friday 24 April 2026 06:33:44 +0000 (0:00:01.563) 0:05:31.213 ********** 2026-04-24 06:34:22.035070 | orchestrator | included: service-image-info for testbed-node-3 2026-04-24 06:34:22.035083 | orchestrator | 2026-04-24 06:34:22.035096 | orchestrator | TASK [service-image-info : community.docker.docker_image_info] ***************** 2026-04-24 06:34:22.035109 | orchestrator | Friday 24 April 2026 06:33:46 +0000 (0:00:01.259) 0:05:32.473 ********** 2026-04-24 06:34:22.035122 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:34:22.035136 | orchestrator | 2026-04-24 06:34:22.035150 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-24 06:34:22.035164 | orchestrator | Friday 24 April 2026 06:33:49 +0000 (0:00:03.567) 0:05:36.041 ********** 2026-04-24 06:34:22.035179 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:34:22.035192 | orchestrator | 2026-04-24 06:34:22.035206 | orchestrator | TASK [service-image-info : containers.podman.podman_image_info] **************** 2026-04-24 06:34:22.035220 | orchestrator | Friday 24 April 2026 06:33:51 +0000 (0:00:02.181) 0:05:38.222 ********** 2026-04-24 06:34:22.035234 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:34:22.035248 | orchestrator | 2026-04-24 06:34:22.035261 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-24 06:34:22.035274 | orchestrator | Friday 24 April 2026 06:33:53 +0000 (0:00:02.129) 0:05:40.351 ********** 2026-04-24 06:34:22.035287 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:34:22.035301 | orchestrator | 2026-04-24 06:34:22.035314 | orchestrator | TASK [nova-cell : Get container facts] ***************************************** 2026-04-24 06:34:22.035328 | orchestrator | Friday 24 April 2026 06:33:56 +0000 (0:00:02.475) 0:05:42.827 ********** 2026-04-24 06:34:22.035341 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:22.035355 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:22.035369 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:22.035383 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:34:22.035445 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:34:22.035460 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:34:22.035472 | orchestrator | 2026-04-24 06:34:22.035486 | orchestrator | TASK [nova-cell : Get current Libvirt version] ********************************* 2026-04-24 06:34:22.035502 | orchestrator | Friday 24 April 2026 06:34:00 +0000 (0:00:04.119) 0:05:46.947 ********** 2026-04-24 06:34:22.035531 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:22.035546 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:22.035570 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:22.035584 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:34:22.035598 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:34:22.035611 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:34:22.035624 | orchestrator | 2026-04-24 06:34:22.035633 | orchestrator | TASK [nova-cell : Check that the new Libvirt version is >= current] ************ 2026-04-24 06:34:22.035641 | orchestrator | Friday 24 April 2026 06:34:05 +0000 (0:00:04.840) 0:05:51.787 ********** 2026-04-24 06:34:22.035649 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:22.035658 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:22.035691 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:22.035700 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 06:34:22.035708 | orchestrator |  "changed": false, 2026-04-24 06:34:22.035716 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-24 06:34:22.035725 | orchestrator | } 2026-04-24 06:34:22.035733 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 06:34:22.035741 | orchestrator |  "changed": false, 2026-04-24 06:34:22.035749 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-24 06:34:22.035757 | orchestrator | } 2026-04-24 06:34:22.035765 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 06:34:22.035773 | orchestrator |  "changed": false, 2026-04-24 06:34:22.035781 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-24 06:34:22.035789 | orchestrator | } 2026-04-24 06:34:22.035797 | orchestrator | 2026-04-24 06:34:22.035807 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-24 06:34:22.035820 | orchestrator | Friday 24 April 2026 06:34:11 +0000 (0:00:06.546) 0:05:58.333 ********** 2026-04-24 06:34:22.035833 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:22.035845 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:22.035860 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:22.035878 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:34:22.035891 | orchestrator | 2026-04-24 06:34:22.035904 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-24 06:34:22.035938 | orchestrator | Friday 24 April 2026 06:34:13 +0000 (0:00:01.572) 0:05:59.906 ********** 2026-04-24 06:34:22.035957 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-24 06:34:22.035970 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-24 06:34:22.035984 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-24 06:34:22.035998 | orchestrator | 2026-04-24 06:34:22.036011 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-24 06:34:22.036023 | orchestrator | Friday 24 April 2026 06:34:14 +0000 (0:00:00.809) 0:06:00.716 ********** 2026-04-24 06:34:22.036033 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-24 06:34:22.036039 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-24 06:34:22.036046 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-24 06:34:22.036053 | orchestrator | 2026-04-24 06:34:22.036060 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-24 06:34:22.036066 | orchestrator | Friday 24 April 2026 06:34:15 +0000 (0:00:01.614) 0:06:02.330 ********** 2026-04-24 06:34:22.036073 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-24 06:34:22.036080 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:34:22.036104 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-24 06:34:22.036111 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:34:22.036117 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-24 06:34:22.036124 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:34:22.036131 | orchestrator | 2026-04-24 06:34:22.036137 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-24 06:34:22.036144 | orchestrator | Friday 24 April 2026 06:34:16 +0000 (0:00:00.636) 0:06:02.966 ********** 2026-04-24 06:34:22.036151 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 06:34:22.036158 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 06:34:22.036165 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 06:34:22.036172 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 06:34:22.036178 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 06:34:22.036185 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:22.036201 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 06:34:22.036208 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 06:34:22.036214 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:22.036221 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 06:34:22.036228 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 06:34:22.036234 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 06:34:22.036241 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 06:34:22.036248 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:22.036254 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 06:34:22.036261 | orchestrator | 2026-04-24 06:34:22.036268 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-24 06:34:22.036274 | orchestrator | Friday 24 April 2026 06:34:17 +0000 (0:00:01.137) 0:06:04.104 ********** 2026-04-24 06:34:22.036281 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:22.036287 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:22.036294 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:22.036301 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:34:22.036308 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:34:22.036314 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:34:22.036321 | orchestrator | 2026-04-24 06:34:22.036328 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-24 06:34:22.036335 | orchestrator | Friday 24 April 2026 06:34:18 +0000 (0:00:01.259) 0:06:05.363 ********** 2026-04-24 06:34:22.036341 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:22.036348 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:22.036355 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:22.036361 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:34:22.036368 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:34:22.036375 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:34:22.036381 | orchestrator | 2026-04-24 06:34:22.036388 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-24 06:34:22.036413 | orchestrator | Friday 24 April 2026 06:34:20 +0000 (0:00:01.666) 0:06:07.030 ********** 2026-04-24 06:34:22.036429 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:34:22.036445 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:34:22.036465 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:34:24.523957 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524048 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524060 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524083 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524092 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524118 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524142 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524150 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524157 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524169 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524177 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524192 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:24.524200 | orchestrator | 2026-04-24 06:34:24.524209 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 06:34:24.524218 | orchestrator | Friday 24 April 2026 06:34:23 +0000 (0:00:02.503) 0:06:09.533 ********** 2026-04-24 06:34:24.524232 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:34:28.270377 | orchestrator | 2026-04-24 06:34:28.270528 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-24 06:34:28.270548 | orchestrator | Friday 24 April 2026 06:34:24 +0000 (0:00:01.513) 0:06:11.047 ********** 2026-04-24 06:34:28.270566 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270592 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270621 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270648 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270658 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270680 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270688 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270695 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270706 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270720 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270728 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:28.270741 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:30.821929 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:30.822058 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:30.822088 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:34:30.822116 | orchestrator | 2026-04-24 06:34:30.822125 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-24 06:34:30.822133 | orchestrator | Friday 24 April 2026 06:34:28 +0000 (0:00:04.058) 0:06:15.105 ********** 2026-04-24 06:34:30.822143 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:34:30.822152 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:34:30.822173 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:34:30.822180 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:34:30.822187 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:34:30.822198 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:30.822210 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:34:30.822216 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:34:30.822223 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:34:30.822230 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:34:30.822241 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:34:32.523350 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:34:32.523503 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:34:32.523549 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:32.523577 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:34:32.523592 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:34:32.523605 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:34:32.523616 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:34:32.523628 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:34:32.523658 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:34:32.523679 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:32.523691 | orchestrator | 2026-04-24 06:34:32.523703 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-24 06:34:32.523715 | orchestrator | Friday 24 April 2026 06:34:31 +0000 (0:00:02.736) 0:06:17.842 ********** 2026-04-24 06:34:32.523732 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:34:32.523744 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:34:32.523756 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:34:32.523768 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:34:32.523786 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:34:39.155190 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:34:39.155317 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:34:39.155361 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:34:39.155381 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:34:39.155451 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:34:39.155467 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:34:39.155483 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:34:39.155498 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:34:39.155557 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:34:39.155568 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:39.155577 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:34:39.155591 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:34:39.155600 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:39.155609 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:34:39.155618 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:34:39.155627 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:39.155636 | orchestrator | 2026-04-24 06:34:39.155646 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 06:34:39.155656 | orchestrator | Friday 24 April 2026 06:34:34 +0000 (0:00:02.968) 0:06:20.811 ********** 2026-04-24 06:34:39.155665 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:34:39.155674 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:34:39.155682 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:34:39.155698 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:34:39.155707 | orchestrator | 2026-04-24 06:34:39.155716 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-24 06:34:39.155725 | orchestrator | Friday 24 April 2026 06:34:35 +0000 (0:00:01.476) 0:06:22.288 ********** 2026-04-24 06:34:39.155733 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 06:34:39.155742 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 06:34:39.155750 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 06:34:39.155759 | orchestrator | 2026-04-24 06:34:39.155768 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-24 06:34:39.155776 | orchestrator | Friday 24 April 2026 06:34:37 +0000 (0:00:01.426) 0:06:23.715 ********** 2026-04-24 06:34:39.155785 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 06:34:39.155793 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 06:34:39.155802 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 06:34:39.155811 | orchestrator | 2026-04-24 06:34:39.155819 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-24 06:34:39.155830 | orchestrator | Friday 24 April 2026 06:34:38 +0000 (0:00:01.238) 0:06:24.953 ********** 2026-04-24 06:34:39.155845 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:34:39.155860 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:34:39.155875 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:34:39.155890 | orchestrator | 2026-04-24 06:34:39.155906 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-24 06:34:39.155956 | orchestrator | Friday 24 April 2026 06:34:39 +0000 (0:00:00.586) 0:06:25.539 ********** 2026-04-24 06:35:06.212034 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:35:06.212147 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:35:06.212163 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:35:06.212176 | orchestrator | 2026-04-24 06:35:06.212189 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-24 06:35:06.212204 | orchestrator | Friday 24 April 2026 06:34:40 +0000 (0:00:01.102) 0:06:26.641 ********** 2026-04-24 06:35:06.212216 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-24 06:35:06.212229 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-24 06:35:06.212241 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-24 06:35:06.212253 | orchestrator | 2026-04-24 06:35:06.212266 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-24 06:35:06.212278 | orchestrator | Friday 24 April 2026 06:34:41 +0000 (0:00:01.314) 0:06:27.956 ********** 2026-04-24 06:35:06.212290 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-24 06:35:06.212302 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-24 06:35:06.212314 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-24 06:35:06.212326 | orchestrator | 2026-04-24 06:35:06.212355 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-24 06:35:06.212367 | orchestrator | Friday 24 April 2026 06:34:42 +0000 (0:00:01.235) 0:06:29.192 ********** 2026-04-24 06:35:06.212432 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-24 06:35:06.212446 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-24 06:35:06.212458 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-24 06:35:06.212470 | orchestrator | ok: [testbed-node-3] => (item=nova-libvirt) 2026-04-24 06:35:06.212482 | orchestrator | ok: [testbed-node-4] => (item=nova-libvirt) 2026-04-24 06:35:06.212494 | orchestrator | ok: [testbed-node-5] => (item=nova-libvirt) 2026-04-24 06:35:06.212506 | orchestrator | 2026-04-24 06:35:06.212516 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-24 06:35:06.212526 | orchestrator | Friday 24 April 2026 06:34:46 +0000 (0:00:04.135) 0:06:33.327 ********** 2026-04-24 06:35:06.212536 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:06.212571 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:06.212583 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:06.212593 | orchestrator | 2026-04-24 06:35:06.212604 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-24 06:35:06.212615 | orchestrator | Friday 24 April 2026 06:34:47 +0000 (0:00:00.599) 0:06:33.927 ********** 2026-04-24 06:35:06.212625 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:06.212636 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:06.212647 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:06.212657 | orchestrator | 2026-04-24 06:35:06.212668 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-24 06:35:06.212679 | orchestrator | Friday 24 April 2026 06:34:47 +0000 (0:00:00.331) 0:06:34.258 ********** 2026-04-24 06:35:06.212690 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:35:06.212700 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:35:06.212711 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:35:06.212723 | orchestrator | 2026-04-24 06:35:06.212734 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-24 06:35:06.212745 | orchestrator | Friday 24 April 2026 06:34:49 +0000 (0:00:01.413) 0:06:35.672 ********** 2026-04-24 06:35:06.212757 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-24 06:35:06.212769 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-24 06:35:06.212778 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-24 06:35:06.212790 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-24 06:35:06.212800 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-24 06:35:06.212811 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-24 06:35:06.212821 | orchestrator | 2026-04-24 06:35:06.212831 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-24 06:35:06.212841 | orchestrator | Friday 24 April 2026 06:34:53 +0000 (0:00:03.962) 0:06:39.635 ********** 2026-04-24 06:35:06.212853 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-24 06:35:06.212864 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-24 06:35:06.212875 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-24 06:35:06.212885 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-24 06:35:06.212895 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:35:06.212904 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-24 06:35:06.212914 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:35:06.212924 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-24 06:35:06.212934 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:35:06.212944 | orchestrator | 2026-04-24 06:35:06.212954 | orchestrator | TASK [nova-cell : Include tasks from qemu_wrapper.yml] ************************* 2026-04-24 06:35:06.212983 | orchestrator | Friday 24 April 2026 06:34:56 +0000 (0:00:03.727) 0:06:43.362 ********** 2026-04-24 06:35:06.212993 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:06.213003 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:06.213013 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:06.213023 | orchestrator | included: /ansible/roles/nova-cell/tasks/qemu_wrapper.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:35:06.213043 | orchestrator | 2026-04-24 06:35:06.213053 | orchestrator | TASK [nova-cell : Check qemu wrapper file] ************************************* 2026-04-24 06:35:06.213063 | orchestrator | Friday 24 April 2026 06:34:59 +0000 (0:00:02.735) 0:06:46.097 ********** 2026-04-24 06:35:06.213073 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 06:35:06.213083 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 06:35:06.213093 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 06:35:06.213103 | orchestrator | 2026-04-24 06:35:06.213113 | orchestrator | TASK [nova-cell : Copy qemu wrapper] ******************************************* 2026-04-24 06:35:06.213123 | orchestrator | Friday 24 April 2026 06:35:00 +0000 (0:00:01.207) 0:06:47.304 ********** 2026-04-24 06:35:06.213151 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:06.213162 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:06.213172 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:06.213182 | orchestrator | 2026-04-24 06:35:06.213192 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-24 06:35:06.213202 | orchestrator | Friday 24 April 2026 06:35:01 +0000 (0:00:00.335) 0:06:47.639 ********** 2026-04-24 06:35:06.213212 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:06.213221 | orchestrator | 2026-04-24 06:35:06.213231 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-24 06:35:06.213242 | orchestrator | Friday 24 April 2026 06:35:01 +0000 (0:00:00.147) 0:06:47.787 ********** 2026-04-24 06:35:06.213252 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:06.213263 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:06.213272 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:06.213282 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:06.213292 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:06.213302 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:06.213312 | orchestrator | 2026-04-24 06:35:06.213323 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-24 06:35:06.213333 | orchestrator | Friday 24 April 2026 06:35:02 +0000 (0:00:01.149) 0:06:48.936 ********** 2026-04-24 06:35:06.213343 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 06:35:06.213352 | orchestrator | 2026-04-24 06:35:06.213362 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-24 06:35:06.213392 | orchestrator | Friday 24 April 2026 06:35:03 +0000 (0:00:00.824) 0:06:49.760 ********** 2026-04-24 06:35:06.213404 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:06.213414 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:06.213425 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:06.213435 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:06.213445 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:06.213456 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:06.213467 | orchestrator | 2026-04-24 06:35:06.213478 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-24 06:35:06.213489 | orchestrator | Friday 24 April 2026 06:35:04 +0000 (0:00:00.654) 0:06:50.415 ********** 2026-04-24 06:35:06.213503 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:35:06.213525 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:35:06.213552 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856012 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856114 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856126 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856134 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856162 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856170 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856205 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856219 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856227 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856234 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856246 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856255 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:08.856263 | orchestrator | 2026-04-24 06:35:08.856270 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-24 06:35:08.856278 | orchestrator | Friday 24 April 2026 06:35:08 +0000 (0:00:04.128) 0:06:54.544 ********** 2026-04-24 06:35:08.856293 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:15.576489 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:15.576605 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:15.576645 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:15.576658 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:15.576682 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:15.576712 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:15.576726 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:15.576747 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:15.576759 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:15.576771 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:15.576787 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:15.576806 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:36.814262 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:36.814491 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:36.814512 | orchestrator | 2026-04-24 06:35:36.814525 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-24 06:35:36.814538 | orchestrator | Friday 24 April 2026 06:35:16 +0000 (0:00:07.993) 0:07:02.538 ********** 2026-04-24 06:35:36.814550 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:36.814562 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:36.814572 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:36.814583 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:36.814594 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:36.814605 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:36.814615 | orchestrator | 2026-04-24 06:35:36.814626 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-24 06:35:36.814637 | orchestrator | Friday 24 April 2026 06:35:17 +0000 (0:00:01.648) 0:07:04.186 ********** 2026-04-24 06:35:36.814649 | orchestrator | ok: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 06:35:36.814660 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 06:35:36.814671 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 06:35:36.814682 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 06:35:36.814693 | orchestrator | ok: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 06:35:36.814703 | orchestrator | ok: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 06:35:36.814714 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 06:35:36.814725 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:36.814736 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 06:35:36.814747 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:36.814758 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 06:35:36.814769 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:36.814780 | orchestrator | ok: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 06:35:36.814806 | orchestrator | ok: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 06:35:36.814819 | orchestrator | ok: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 06:35:36.814831 | orchestrator | 2026-04-24 06:35:36.814844 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-24 06:35:36.814857 | orchestrator | Friday 24 April 2026 06:35:22 +0000 (0:00:04.426) 0:07:08.613 ********** 2026-04-24 06:35:36.814870 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:36.814882 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:36.814894 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:36.814916 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:36.814929 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:36.814941 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:36.814954 | orchestrator | 2026-04-24 06:35:36.814966 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-24 06:35:36.814979 | orchestrator | Friday 24 April 2026 06:35:22 +0000 (0:00:00.721) 0:07:09.334 ********** 2026-04-24 06:35:36.814992 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 06:35:36.815005 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 06:35:36.815018 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 06:35:36.815031 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 06:35:36.815062 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 06:35:36.815076 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 06:35:36.815088 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 06:35:36.815100 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 06:35:36.815112 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 06:35:36.815125 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 06:35:36.815137 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:36.815150 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 06:35:36.815160 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:36.815171 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 06:35:36.815182 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:36.815192 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:35:36.815203 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:35:36.815213 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:35:36.815224 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:35:36.815235 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:35:36.815246 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:35:36.815257 | orchestrator | 2026-04-24 06:35:36.815267 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-24 06:35:36.815278 | orchestrator | Friday 24 April 2026 06:35:29 +0000 (0:00:06.125) 0:07:15.460 ********** 2026-04-24 06:35:36.815289 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 06:35:36.815300 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 06:35:36.815310 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 06:35:36.815321 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:35:36.815332 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:35:36.815350 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:35:36.815389 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 06:35:36.815401 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 06:35:36.815412 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 06:35:36.815423 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 06:35:36.815440 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 06:35:36.815451 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 06:35:36.815461 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:35:36.815472 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 06:35:36.815483 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:36.815494 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:35:36.815505 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 06:35:36.815515 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:36.815526 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 06:35:36.815537 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:36.815547 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:35:36.815558 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:35:36.815568 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:35:36.815579 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:35:36.815590 | orchestrator | ok: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:35:36.815600 | orchestrator | ok: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:35:36.815618 | orchestrator | ok: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:35:44.444513 | orchestrator | 2026-04-24 06:35:44.444598 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-24 06:35:44.444608 | orchestrator | Friday 24 April 2026 06:35:36 +0000 (0:00:07.827) 0:07:23.287 ********** 2026-04-24 06:35:44.444614 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:44.444622 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:44.444628 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:44.444633 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:44.444639 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:44.444645 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:44.444650 | orchestrator | 2026-04-24 06:35:44.444656 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-24 06:35:44.444661 | orchestrator | Friday 24 April 2026 06:35:37 +0000 (0:00:00.924) 0:07:24.212 ********** 2026-04-24 06:35:44.444667 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:44.444672 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:44.444678 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:44.444683 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:44.444688 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:44.444694 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:44.444699 | orchestrator | 2026-04-24 06:35:44.444704 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-24 06:35:44.444710 | orchestrator | Friday 24 April 2026 06:35:38 +0000 (0:00:00.663) 0:07:24.876 ********** 2026-04-24 06:35:44.444715 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:44.444738 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:44.444744 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:35:44.444750 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:44.444756 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:35:44.444761 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:35:44.444767 | orchestrator | 2026-04-24 06:35:44.444777 | orchestrator | TASK [nova-cell : Generating 'hostid' file for nova_compute] ******************* 2026-04-24 06:35:44.444786 | orchestrator | Friday 24 April 2026 06:35:40 +0000 (0:00:02.258) 0:07:27.134 ********** 2026-04-24 06:35:44.444796 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:44.444804 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:44.444812 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:35:44.444820 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:35:44.444829 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:35:44.444838 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:44.444847 | orchestrator | 2026-04-24 06:35:44.444855 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-24 06:35:44.444864 | orchestrator | Friday 24 April 2026 06:35:42 +0000 (0:00:02.112) 0:07:29.246 ********** 2026-04-24 06:35:44.444876 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:44.444902 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:44.444911 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:35:44.444930 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:44.444944 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:44.444950 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:35:44.444956 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:44.444962 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:44.444971 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:44.444977 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:44.444988 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:35:48.298834 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:48.298953 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:35:48.298973 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:35:48.299000 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:48.299022 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:35:48.299035 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:35:48.299048 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:48.299061 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:35:48.299074 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:35:48.299109 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:48.299122 | orchestrator | 2026-04-24 06:35:48.299135 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-24 06:35:48.299164 | orchestrator | Friday 24 April 2026 06:35:44 +0000 (0:00:02.083) 0:07:31.329 ********** 2026-04-24 06:35:48.299177 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-24 06:35:48.299189 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-24 06:35:48.299200 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:48.299212 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-24 06:35:48.299223 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-24 06:35:48.299234 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:48.299245 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-24 06:35:48.299257 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-24 06:35:48.299268 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:48.299280 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-24 06:35:48.299291 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-24 06:35:48.299303 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:35:48.299315 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-24 06:35:48.299326 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-24 06:35:48.299338 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:35:48.299350 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-24 06:35:48.299386 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-24 06:35:48.299398 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:35:48.299410 | orchestrator | 2026-04-24 06:35:48.299422 | orchestrator | TASK [service-check-containers : nova_cell | Check containers] ***************** 2026-04-24 06:35:48.299435 | orchestrator | Friday 24 April 2026 06:35:45 +0000 (0:00:00.873) 0:07:32.203 ********** 2026-04-24 06:35:48.299492 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:35:48.299511 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:35:48.299534 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:35:48.299556 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823233 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823307 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823316 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823334 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823411 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823418 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823436 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823441 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823448 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823457 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823462 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:35:50.823466 | orchestrator | 2026-04-24 06:35:50.823471 | orchestrator | TASK [service-check-containers : nova_cell | Notify handlers to restart containers] *** 2026-04-24 06:35:50.823476 | orchestrator | Friday 24 April 2026 06:35:49 +0000 (0:00:03.944) 0:07:36.148 ********** 2026-04-24 06:35:50.823481 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 06:35:50.823486 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:35:50.823490 | orchestrator | } 2026-04-24 06:35:50.823494 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 06:35:50.823498 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:35:50.823502 | orchestrator | } 2026-04-24 06:35:50.823505 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 06:35:50.823509 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:35:50.823513 | orchestrator | } 2026-04-24 06:35:50.823516 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 06:35:50.823521 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:35:50.823524 | orchestrator | } 2026-04-24 06:35:50.823528 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 06:35:50.823532 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:35:50.823535 | orchestrator | } 2026-04-24 06:35:50.823539 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 06:35:50.823543 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:35:50.823546 | orchestrator | } 2026-04-24 06:35:50.823550 | orchestrator | 2026-04-24 06:35:50.823558 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:35:52.024023 | orchestrator | Friday 24 April 2026 06:35:50 +0000 (0:00:01.056) 0:07:37.204 ********** 2026-04-24 06:35:52.024110 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:52.024125 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:52.024168 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:35:52.024178 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:35:52.024187 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:52.024195 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:52.024217 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:35:52.024226 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:35:52.024240 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:35:52.024267 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:35:52.024276 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:35:52.024294 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:35:52.024302 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:35:52.024317 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:39:05.504215 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:05.504330 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:39:05.504373 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:39:05.504387 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:05.504400 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:39:05.504411 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:39:05.504423 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:05.504435 | orchestrator | 2026-04-24 06:39:05.504447 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 06:39:05.504460 | orchestrator | Friday 24 April 2026 06:35:53 +0000 (0:00:02.330) 0:07:39.535 ********** 2026-04-24 06:39:05.504471 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:39:05.504481 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:39:05.504492 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:39:05.504503 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:05.504514 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:05.504525 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:05.504535 | orchestrator | 2026-04-24 06:39:05.504547 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:39:05.504557 | orchestrator | Friday 24 April 2026 06:35:53 +0000 (0:00:00.691) 0:07:40.226 ********** 2026-04-24 06:39:05.504568 | orchestrator | 2026-04-24 06:39:05.504579 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:39:05.504590 | orchestrator | Friday 24 April 2026 06:35:53 +0000 (0:00:00.160) 0:07:40.387 ********** 2026-04-24 06:39:05.504601 | orchestrator | 2026-04-24 06:39:05.504611 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:39:05.504622 | orchestrator | Friday 24 April 2026 06:35:54 +0000 (0:00:00.393) 0:07:40.781 ********** 2026-04-24 06:39:05.504649 | orchestrator | 2026-04-24 06:39:05.504672 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:39:05.504683 | orchestrator | Friday 24 April 2026 06:35:54 +0000 (0:00:00.168) 0:07:40.950 ********** 2026-04-24 06:39:05.504693 | orchestrator | 2026-04-24 06:39:05.504707 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:39:05.504719 | orchestrator | Friday 24 April 2026 06:35:54 +0000 (0:00:00.185) 0:07:41.135 ********** 2026-04-24 06:39:05.504733 | orchestrator | 2026-04-24 06:39:05.504745 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:39:05.504766 | orchestrator | Friday 24 April 2026 06:35:54 +0000 (0:00:00.191) 0:07:41.327 ********** 2026-04-24 06:39:05.504779 | orchestrator | 2026-04-24 06:39:05.504791 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-conductor container] ***************** 2026-04-24 06:39:05.504821 | orchestrator | Friday 24 April 2026 06:35:55 +0000 (0:00:00.178) 0:07:41.505 ********** 2026-04-24 06:39:05.504835 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:39:05.504848 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:39:05.504860 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:39:05.504874 | orchestrator | 2026-04-24 06:39:05.504887 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-novncproxy container] **************** 2026-04-24 06:39:05.504900 | orchestrator | Friday 24 April 2026 06:36:10 +0000 (0:00:14.984) 0:07:56.489 ********** 2026-04-24 06:39:05.504914 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:39:05.504926 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:39:05.504939 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:39:05.504952 | orchestrator | 2026-04-24 06:39:05.504965 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-ssh container] *********************** 2026-04-24 06:39:05.504978 | orchestrator | Friday 24 April 2026 06:36:32 +0000 (0:00:22.414) 0:08:18.904 ********** 2026-04-24 06:39:05.504991 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:39:05.505004 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:39:05.505018 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:39:05.505031 | orchestrator | 2026-04-24 06:39:05.505044 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-libvirt container] ******************* 2026-04-24 06:39:05.505057 | orchestrator | Friday 24 April 2026 06:36:58 +0000 (0:00:26.148) 0:08:45.052 ********** 2026-04-24 06:39:05.505068 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:39:05.505079 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:39:05.505090 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:39:05.505100 | orchestrator | 2026-04-24 06:39:05.505111 | orchestrator | RUNNING HANDLER [nova-cell : Checking libvirt container is ready] ************** 2026-04-24 06:39:05.505122 | orchestrator | Friday 24 April 2026 06:37:42 +0000 (0:00:43.497) 0:09:28.550 ********** 2026-04-24 06:39:05.505174 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:39:05.505186 | orchestrator | FAILED - RETRYING: [testbed-node-4]: Checking libvirt container is ready (10 retries left). 2026-04-24 06:39:05.505198 | orchestrator | FAILED - RETRYING: [testbed-node-5]: Checking libvirt container is ready (10 retries left). 2026-04-24 06:39:05.505209 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:39:05.505220 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:39:05.505230 | orchestrator | 2026-04-24 06:39:05.505241 | orchestrator | RUNNING HANDLER [nova-cell : Create libvirt SASL user] ************************* 2026-04-24 06:39:05.505252 | orchestrator | Friday 24 April 2026 06:37:48 +0000 (0:00:06.437) 0:09:34.987 ********** 2026-04-24 06:39:05.505263 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:39:05.505274 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:39:05.505284 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:39:05.505295 | orchestrator | 2026-04-24 06:39:05.505306 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-compute container] ******************* 2026-04-24 06:39:05.505317 | orchestrator | Friday 24 April 2026 06:37:49 +0000 (0:00:00.826) 0:09:35.814 ********** 2026-04-24 06:39:05.505328 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:39:05.505339 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:39:05.505349 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:39:05.505360 | orchestrator | 2026-04-24 06:39:05.505371 | orchestrator | RUNNING HANDLER [nova-cell : Wait for nova-compute services to update service versions] *** 2026-04-24 06:39:05.505384 | orchestrator | Friday 24 April 2026 06:38:24 +0000 (0:00:34.872) 0:10:10.686 ********** 2026-04-24 06:39:05.505394 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:39:05.505405 | orchestrator | 2026-04-24 06:39:05.505416 | orchestrator | TASK [nova-cell : Waiting for nova-compute services to register themselves] **** 2026-04-24 06:39:05.505427 | orchestrator | Friday 24 April 2026 06:38:24 +0000 (0:00:00.539) 0:10:11.226 ********** 2026-04-24 06:39:05.505445 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:39:05.505456 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:39:05.505466 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:05.505477 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:05.505488 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:05.505499 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 06:39:05.505510 | orchestrator | 2026-04-24 06:39:05.505521 | orchestrator | TASK [nova-cell : Fail if nova-compute service failed to register] ************* 2026-04-24 06:39:05.505532 | orchestrator | Friday 24 April 2026 06:38:34 +0000 (0:00:09.366) 0:10:20.593 ********** 2026-04-24 06:39:05.505543 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:39:05.505553 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:39:05.505564 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:39:05.505575 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:05.505586 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:05.505596 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:05.505607 | orchestrator | 2026-04-24 06:39:05.505618 | orchestrator | TASK [nova-cell : Include discover_computes.yml] ******************************* 2026-04-24 06:39:05.505628 | orchestrator | Friday 24 April 2026 06:38:44 +0000 (0:00:10.622) 0:10:31.215 ********** 2026-04-24 06:39:05.505639 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:39:05.505650 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:39:05.505661 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:05.505671 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:05.505682 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:05.505693 | orchestrator | included: /ansible/roles/nova-cell/tasks/discover_computes.yml for testbed-node-5 2026-04-24 06:39:05.505704 | orchestrator | 2026-04-24 06:39:05.505714 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-24 06:39:05.505725 | orchestrator | Friday 24 April 2026 06:38:49 +0000 (0:00:05.148) 0:10:36.364 ********** 2026-04-24 06:39:05.505736 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 06:39:05.505747 | orchestrator | 2026-04-24 06:39:05.505757 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-24 06:39:05.505768 | orchestrator | Friday 24 April 2026 06:39:03 +0000 (0:00:13.487) 0:10:49.851 ********** 2026-04-24 06:39:05.505779 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 06:39:05.505790 | orchestrator | 2026-04-24 06:39:05.505800 | orchestrator | TASK [nova-cell : Fail if cell settings not found] ***************************** 2026-04-24 06:39:05.505819 | orchestrator | Friday 24 April 2026 06:39:05 +0000 (0:00:02.032) 0:10:51.884 ********** 2026-04-24 06:39:28.759174 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:39:28.759300 | orchestrator | 2026-04-24 06:39:28.759319 | orchestrator | TASK [nova-cell : Discover nova hosts] ***************************************** 2026-04-24 06:39:28.759335 | orchestrator | Friday 24 April 2026 06:39:07 +0000 (0:00:01.606) 0:10:53.491 ********** 2026-04-24 06:39:28.759347 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-24 06:39:28.759360 | orchestrator | 2026-04-24 06:39:28.759372 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-24 06:39:28.759384 | orchestrator | 2026-04-24 06:39:28.759396 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-24 06:39:28.759410 | orchestrator | Friday 24 April 2026 06:39:19 +0000 (0:00:12.737) 0:11:06.228 ********** 2026-04-24 06:39:28.759425 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:39:28.759438 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:39:28.759451 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:39:28.759464 | orchestrator | 2026-04-24 06:39:28.759478 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-24 06:39:28.759492 | orchestrator | 2026-04-24 06:39:28.759506 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-24 06:39:28.759549 | orchestrator | Friday 24 April 2026 06:39:21 +0000 (0:00:01.460) 0:11:07.689 ********** 2026-04-24 06:39:28.759565 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:28.759579 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:28.759594 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:28.759609 | orchestrator | 2026-04-24 06:39:28.759623 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-24 06:39:28.759638 | orchestrator | 2026-04-24 06:39:28.759652 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-24 06:39:28.759666 | orchestrator | Friday 24 April 2026 06:39:22 +0000 (0:00:01.158) 0:11:08.847 ********** 2026-04-24 06:39:28.759680 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-24 06:39:28.759696 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-24 06:39:28.759710 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-24 06:39:28.759725 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-24 06:39:28.759738 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-24 06:39:28.759750 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-24 06:39:28.759763 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:39:28.759776 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-24 06:39:28.759789 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-24 06:39:28.759801 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-24 06:39:28.759814 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-24 06:39:28.759827 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-24 06:39:28.759840 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-24 06:39:28.759852 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:39:28.759865 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-24 06:39:28.759878 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-24 06:39:28.759891 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-24 06:39:28.759903 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-24 06:39:28.759917 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-24 06:39:28.759930 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-24 06:39:28.759944 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:39:28.759957 | orchestrator | skipping: [testbed-node-0] => (item=nova-conductor)  2026-04-24 06:39:28.759971 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-24 06:39:28.759985 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-24 06:39:28.759999 | orchestrator | skipping: [testbed-node-0] => (item=nova-novncproxy)  2026-04-24 06:39:28.760014 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-24 06:39:28.760028 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-24 06:39:28.760041 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:28.760056 | orchestrator | skipping: [testbed-node-1] => (item=nova-conductor)  2026-04-24 06:39:28.760072 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-24 06:39:28.760087 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-24 06:39:28.760157 | orchestrator | skipping: [testbed-node-1] => (item=nova-novncproxy)  2026-04-24 06:39:28.760175 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-24 06:39:28.760189 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-24 06:39:28.760202 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:28.760216 | orchestrator | skipping: [testbed-node-2] => (item=nova-conductor)  2026-04-24 06:39:28.760230 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-24 06:39:28.760244 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-24 06:39:28.760272 | orchestrator | skipping: [testbed-node-2] => (item=nova-novncproxy)  2026-04-24 06:39:28.760287 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-24 06:39:28.760300 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-24 06:39:28.760312 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:28.760325 | orchestrator | 2026-04-24 06:39:28.760337 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-24 06:39:28.760349 | orchestrator | 2026-04-24 06:39:28.760361 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-24 06:39:28.760374 | orchestrator | Friday 24 April 2026 06:39:24 +0000 (0:00:01.904) 0:11:10.751 ********** 2026-04-24 06:39:28.760409 | orchestrator | skipping: [testbed-node-0] => (item=nova-scheduler)  2026-04-24 06:39:28.760424 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-24 06:39:28.760439 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:28.760453 | orchestrator | skipping: [testbed-node-1] => (item=nova-scheduler)  2026-04-24 06:39:28.760466 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-24 06:39:28.760480 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:28.760494 | orchestrator | skipping: [testbed-node-2] => (item=nova-scheduler)  2026-04-24 06:39:28.760508 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-24 06:39:28.760523 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:28.760537 | orchestrator | 2026-04-24 06:39:28.760550 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-24 06:39:28.760563 | orchestrator | 2026-04-24 06:39:28.760577 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-24 06:39:28.760592 | orchestrator | Friday 24 April 2026 06:39:25 +0000 (0:00:01.218) 0:11:11.969 ********** 2026-04-24 06:39:28.760606 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:28.760620 | orchestrator | 2026-04-24 06:39:28.760635 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-24 06:39:28.760649 | orchestrator | 2026-04-24 06:39:28.760663 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-24 06:39:28.760677 | orchestrator | Friday 24 April 2026 06:39:26 +0000 (0:00:01.388) 0:11:13.358 ********** 2026-04-24 06:39:28.760690 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:39:28.760703 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:39:28.760717 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:39:28.760731 | orchestrator | 2026-04-24 06:39:28.760745 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:39:28.760760 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 06:39:28.760778 | orchestrator | testbed-node-0 : ok=58  changed=25  unreachable=0 failed=0 skipped=53  rescued=0 ignored=0 2026-04-24 06:39:28.760793 | orchestrator | testbed-node-1 : ok=31  changed=21  unreachable=0 failed=0 skipped=61  rescued=0 ignored=0 2026-04-24 06:39:28.760807 | orchestrator | testbed-node-2 : ok=31  changed=21  unreachable=0 failed=0 skipped=61  rescued=0 ignored=0 2026-04-24 06:39:28.760821 | orchestrator | testbed-node-3 : ok=49  changed=15  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-24 06:39:28.760834 | orchestrator | testbed-node-4 : ok=43  changed=14  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-24 06:39:28.760849 | orchestrator | testbed-node-5 : ok=48  changed=14  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-24 06:39:28.760863 | orchestrator | 2026-04-24 06:39:28.760890 | orchestrator | 2026-04-24 06:39:28.760905 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:39:28.760919 | orchestrator | Friday 24 April 2026 06:39:28 +0000 (0:00:01.769) 0:11:15.127 ********** 2026-04-24 06:39:28.760933 | orchestrator | =============================================================================== 2026-04-24 06:39:28.760946 | orchestrator | nova-cell : Restart nova-libvirt container ----------------------------- 43.50s 2026-04-24 06:39:28.760960 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 36.34s 2026-04-24 06:39:28.760973 | orchestrator | nova-cell : Restart nova-compute container ----------------------------- 34.87s 2026-04-24 06:39:28.760986 | orchestrator | nova-cell : Get new Libvirt version ------------------------------------ 34.27s 2026-04-24 06:39:28.761000 | orchestrator | nova : Restart nova-scheduler container -------------------------------- 26.54s 2026-04-24 06:39:28.761014 | orchestrator | nova-cell : Restart nova-ssh container --------------------------------- 26.15s 2026-04-24 06:39:28.761029 | orchestrator | nova-cell : Restart nova-novncproxy container -------------------------- 22.41s 2026-04-24 06:39:28.761043 | orchestrator | nova : Create cell0 mappings ------------------------------------------- 15.73s 2026-04-24 06:39:28.761057 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 15.03s 2026-04-24 06:39:28.761071 | orchestrator | nova-cell : Restart nova-conductor container --------------------------- 14.98s 2026-04-24 06:39:28.761083 | orchestrator | service-rabbitmq : nova | Ensure RabbitMQ users exist ------------------ 14.51s 2026-04-24 06:39:28.761096 | orchestrator | nova-cell : Update cell ------------------------------------------------ 13.65s 2026-04-24 06:39:28.761132 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 13.59s 2026-04-24 06:39:28.761144 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 13.49s 2026-04-24 06:39:28.761158 | orchestrator | nova : Restart nova-api container -------------------------------------- 13.46s 2026-04-24 06:39:28.761170 | orchestrator | nova-cell : Discover nova hosts ---------------------------------------- 12.74s 2026-04-24 06:39:28.761183 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 11.51s 2026-04-24 06:39:28.761196 | orchestrator | nova-cell : Fail if nova-compute service failed to register ------------ 10.62s 2026-04-24 06:39:28.761209 | orchestrator | nova : Restart nova-metadata container --------------------------------- 10.62s 2026-04-24 06:39:28.761235 | orchestrator | nova : Copying over nova.conf ------------------------------------------ 10.19s 2026-04-24 06:39:29.460789 | orchestrator | + osism apply nova-update-cell-mappings 2026-04-24 06:39:40.825262 | orchestrator | 2026-04-24 06:39:40 | INFO  | Prepare task for execution of nova-update-cell-mappings. 2026-04-24 06:39:40.905737 | orchestrator | 2026-04-24 06:39:40 | INFO  | Task 745f3329-2258-4c8c-8f19-3a30b899fa75 (nova-update-cell-mappings) was prepared for execution. 2026-04-24 06:39:40.905811 | orchestrator | 2026-04-24 06:39:40 | INFO  | It takes a moment until task 745f3329-2258-4c8c-8f19-3a30b899fa75 (nova-update-cell-mappings) has been started and output is visible here. 2026-04-24 06:40:13.723210 | orchestrator | 2026-04-24 06:40:13.723327 | orchestrator | PLAY [Update Nova cell mappings] *********************************************** 2026-04-24 06:40:13.723343 | orchestrator | 2026-04-24 06:40:13.723354 | orchestrator | TASK [Get list of Nova cells] ************************************************** 2026-04-24 06:40:13.723365 | orchestrator | Friday 24 April 2026 06:39:46 +0000 (0:00:01.632) 0:00:01.632 ********** 2026-04-24 06:40:13.723376 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:40:13.723387 | orchestrator | 2026-04-24 06:40:13.723397 | orchestrator | TASK [Parse cell information] ************************************************** 2026-04-24 06:40:13.723407 | orchestrator | Friday 24 April 2026 06:40:01 +0000 (0:00:15.306) 0:00:16.938 ********** 2026-04-24 06:40:13.723417 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:40:13.723426 | orchestrator | 2026-04-24 06:40:13.723436 | orchestrator | TASK [Display cells to update] ************************************************* 2026-04-24 06:40:13.723446 | orchestrator | Friday 24 April 2026 06:40:02 +0000 (0:00:01.172) 0:00:18.110 ********** 2026-04-24 06:40:13.723482 | orchestrator | ok: [testbed-node-0] => { 2026-04-24 06:40:13.723493 | orchestrator |  "msg": "Cells to update: [{'name': '', 'uuid': '7332f8df-8ff3-42ff-8b9c-b14559bebb2b'}]" 2026-04-24 06:40:13.723505 | orchestrator | } 2026-04-24 06:40:13.723515 | orchestrator | 2026-04-24 06:40:13.723524 | orchestrator | TASK [Use specified cell UUID if provided] ************************************* 2026-04-24 06:40:13.723534 | orchestrator | Friday 24 April 2026 06:40:03 +0000 (0:00:01.124) 0:00:19.235 ********** 2026-04-24 06:40:13.723544 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:40:13.723553 | orchestrator | 2026-04-24 06:40:13.723563 | orchestrator | TASK [Abort if multiple cells found without specific UUID and abort_on_multiple is enabled] *** 2026-04-24 06:40:13.723573 | orchestrator | Friday 24 April 2026 06:40:05 +0000 (0:00:01.179) 0:00:20.415 ********** 2026-04-24 06:40:13.723583 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:40:13.723593 | orchestrator | 2026-04-24 06:40:13.723603 | orchestrator | TASK [Update Nova cell mappings] *********************************************** 2026-04-24 06:40:13.723612 | orchestrator | Friday 24 April 2026 06:40:06 +0000 (0:00:01.135) 0:00:21.550 ********** 2026-04-24 06:40:13.723622 | orchestrator | changed: [testbed-node-0] => (item=7332f8df-8ff3-42ff-8b9c-b14559bebb2b) 2026-04-24 06:40:13.723632 | orchestrator | 2026-04-24 06:40:13.723642 | orchestrator | TASK [Display update results] ************************************************** 2026-04-24 06:40:13.723651 | orchestrator | Friday 24 April 2026 06:40:11 +0000 (0:00:05.638) 0:00:27.188 ********** 2026-04-24 06:40:13.723660 | orchestrator | ok: [testbed-node-0] => (item=7332f8df-8ff3-42ff-8b9c-b14559bebb2b) => { 2026-04-24 06:40:13.723670 | orchestrator |  "msg": "Cell 7332f8df-8ff3-42ff-8b9c-b14559bebb2b updated successfully" 2026-04-24 06:40:13.723680 | orchestrator | } 2026-04-24 06:40:13.723692 | orchestrator | 2026-04-24 06:40:13.723702 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:40:13.723715 | orchestrator | testbed-node-0 : ok=5  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 06:40:13.723726 | orchestrator | 2026-04-24 06:40:13.723737 | orchestrator | 2026-04-24 06:40:13.723748 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:40:13.723760 | orchestrator | Friday 24 April 2026 06:40:13 +0000 (0:00:01.550) 0:00:28.738 ********** 2026-04-24 06:40:13.723771 | orchestrator | =============================================================================== 2026-04-24 06:40:13.723782 | orchestrator | Get list of Nova cells ------------------------------------------------- 15.31s 2026-04-24 06:40:13.723793 | orchestrator | Update Nova cell mappings ----------------------------------------------- 5.64s 2026-04-24 06:40:13.723808 | orchestrator | Display update results -------------------------------------------------- 1.55s 2026-04-24 06:40:13.723826 | orchestrator | Use specified cell UUID if provided ------------------------------------- 1.18s 2026-04-24 06:40:13.723838 | orchestrator | Parse cell information -------------------------------------------------- 1.17s 2026-04-24 06:40:13.723850 | orchestrator | Abort if multiple cells found without specific UUID and abort_on_multiple is enabled --- 1.14s 2026-04-24 06:40:13.723861 | orchestrator | Display cells to update ------------------------------------------------- 1.12s 2026-04-24 06:40:13.924349 | orchestrator | + osism apply -a upgrade nova 2026-04-24 06:40:15.316676 | orchestrator | 2026-04-24 06:40:15 | INFO  | Prepare task for execution of nova. 2026-04-24 06:40:15.397029 | orchestrator | 2026-04-24 06:40:15 | INFO  | Task 7e2e98de-ad05-4efe-9ce2-9eacc9335c38 (nova) was prepared for execution. 2026-04-24 06:40:15.397162 | orchestrator | 2026-04-24 06:40:15 | INFO  | It takes a moment until task 7e2e98de-ad05-4efe-9ce2-9eacc9335c38 (nova) has been started and output is visible here. 2026-04-24 06:41:33.392615 | orchestrator | 2026-04-24 06:41:33.392721 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:41:33.392738 | orchestrator | 2026-04-24 06:41:33.392749 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-24 06:41:33.392783 | orchestrator | Friday 24 April 2026 06:40:21 +0000 (0:00:02.388) 0:00:02.388 ********** 2026-04-24 06:41:33.392794 | orchestrator | changed: [testbed-manager] 2026-04-24 06:41:33.392805 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:41:33.392815 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:41:33.392824 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:41:33.392852 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:41:33.392862 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:41:33.392882 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:41:33.392893 | orchestrator | 2026-04-24 06:41:33.392902 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:41:33.392912 | orchestrator | Friday 24 April 2026 06:40:25 +0000 (0:00:04.071) 0:00:06.459 ********** 2026-04-24 06:41:33.392921 | orchestrator | changed: [testbed-manager] 2026-04-24 06:41:33.392931 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:41:33.392940 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:41:33.392950 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:41:33.392959 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:41:33.392969 | orchestrator | changed: [testbed-node-4] 2026-04-24 06:41:33.392978 | orchestrator | changed: [testbed-node-5] 2026-04-24 06:41:33.392987 | orchestrator | 2026-04-24 06:41:33.393033 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:41:33.393044 | orchestrator | Friday 24 April 2026 06:40:27 +0000 (0:00:02.391) 0:00:08.850 ********** 2026-04-24 06:41:33.393053 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-24 06:41:33.393063 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-24 06:41:33.393073 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-24 06:41:33.393082 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-24 06:41:33.393092 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-24 06:41:33.393101 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-24 06:41:33.393111 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-24 06:41:33.393120 | orchestrator | 2026-04-24 06:41:33.393129 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-24 06:41:33.393139 | orchestrator | 2026-04-24 06:41:33.393148 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-24 06:41:33.393159 | orchestrator | Friday 24 April 2026 06:40:32 +0000 (0:00:04.489) 0:00:13.339 ********** 2026-04-24 06:41:33.393170 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:41:33.393181 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:33.393192 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:33.393203 | orchestrator | 2026-04-24 06:41:33.393214 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-24 06:41:33.393225 | orchestrator | Friday 24 April 2026 06:40:34 +0000 (0:00:02.639) 0:00:15.979 ********** 2026-04-24 06:41:33.393236 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:41:33.393248 | orchestrator | 2026-04-24 06:41:33.393258 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-24 06:41:33.393270 | orchestrator | Friday 24 April 2026 06:40:37 +0000 (0:00:02.843) 0:00:18.823 ********** 2026-04-24 06:41:33.393281 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:41:33.393295 | orchestrator | 2026-04-24 06:41:33.393312 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-24 06:41:33.393326 | orchestrator | Friday 24 April 2026 06:40:39 +0000 (0:00:02.080) 0:00:20.903 ********** 2026-04-24 06:41:33.393337 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:41:33.393348 | orchestrator | 2026-04-24 06:41:33.393358 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-24 06:41:33.393370 | orchestrator | Friday 24 April 2026 06:40:42 +0000 (0:00:02.167) 0:00:23.071 ********** 2026-04-24 06:41:33.393389 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:41:33.393399 | orchestrator | 2026-04-24 06:41:33.393408 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-24 06:41:33.393418 | orchestrator | Friday 24 April 2026 06:40:46 +0000 (0:00:04.066) 0:00:27.137 ********** 2026-04-24 06:41:33.393427 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:41:33.393437 | orchestrator | 2026-04-24 06:41:33.393446 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-24 06:41:33.393456 | orchestrator | 2026-04-24 06:41:33.393465 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-24 06:41:33.393474 | orchestrator | Friday 24 April 2026 06:41:05 +0000 (0:00:19.626) 0:00:46.763 ********** 2026-04-24 06:41:33.393484 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:41:33.393498 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:33.393508 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:33.393517 | orchestrator | 2026-04-24 06:41:33.393527 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-24 06:41:33.393536 | orchestrator | Friday 24 April 2026 06:41:07 +0000 (0:00:01.390) 0:00:48.154 ********** 2026-04-24 06:41:33.393547 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:41:33.393564 | orchestrator | 2026-04-24 06:41:33.393574 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-24 06:41:33.393584 | orchestrator | Friday 24 April 2026 06:41:08 +0000 (0:00:01.674) 0:00:49.828 ********** 2026-04-24 06:41:33.393594 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:33.393603 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:33.393613 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:41:33.393623 | orchestrator | 2026-04-24 06:41:33.393632 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-24 06:41:33.393642 | orchestrator | Friday 24 April 2026 06:41:10 +0000 (0:00:01.527) 0:00:51.355 ********** 2026-04-24 06:41:33.393652 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:33.393661 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:33.393671 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:41:33.393680 | orchestrator | 2026-04-24 06:41:33.393707 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-24 06:41:33.393717 | orchestrator | Friday 24 April 2026 06:41:12 +0000 (0:00:01.989) 0:00:53.345 ********** 2026-04-24 06:41:33.393727 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:33.393737 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:33.393746 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:41:33.393756 | orchestrator | 2026-04-24 06:41:33.393766 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-24 06:41:33.393775 | orchestrator | Friday 24 April 2026 06:41:16 +0000 (0:00:03.971) 0:00:57.317 ********** 2026-04-24 06:41:33.393789 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:33.393804 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:33.393814 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:41:33.393824 | orchestrator | 2026-04-24 06:41:33.393834 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-24 06:41:33.393843 | orchestrator | 2026-04-24 06:41:33.393853 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 06:41:33.393863 | orchestrator | Friday 24 April 2026 06:41:30 +0000 (0:00:13.855) 0:01:11.173 ********** 2026-04-24 06:41:33.393872 | orchestrator | included: /ansible/roles/nova/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:41:33.393883 | orchestrator | 2026-04-24 06:41:33.393892 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-24 06:41:33.393902 | orchestrator | Friday 24 April 2026 06:41:32 +0000 (0:00:02.004) 0:01:13.177 ********** 2026-04-24 06:41:33.393916 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:33.393939 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:33.393958 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:45.315968 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:45.316216 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:41:45.316241 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:45.316254 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:45.316286 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:41:45.316300 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:41:45.316319 | orchestrator | 2026-04-24 06:41:45.316332 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-24 06:41:45.316344 | orchestrator | Friday 24 April 2026 06:41:35 +0000 (0:00:03.241) 0:01:16.419 ********** 2026-04-24 06:41:45.316355 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:41:45.316368 | orchestrator | 2026-04-24 06:41:45.316379 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-24 06:41:45.316390 | orchestrator | Friday 24 April 2026 06:41:36 +0000 (0:00:01.211) 0:01:17.630 ********** 2026-04-24 06:41:45.316401 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:41:45.316418 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:45.316436 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:45.316454 | orchestrator | 2026-04-24 06:41:45.316471 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-24 06:41:45.316489 | orchestrator | Friday 24 April 2026 06:41:38 +0000 (0:00:01.722) 0:01:19.352 ********** 2026-04-24 06:41:45.316505 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 06:41:45.316522 | orchestrator | 2026-04-24 06:41:45.316539 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-24 06:41:45.316557 | orchestrator | Friday 24 April 2026 06:41:40 +0000 (0:00:02.260) 0:01:21.613 ********** 2026-04-24 06:41:45.316574 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:41:45.316591 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:45.316609 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:45.316626 | orchestrator | 2026-04-24 06:41:45.316645 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-24 06:41:45.316664 | orchestrator | Friday 24 April 2026 06:41:42 +0000 (0:00:01.439) 0:01:23.052 ********** 2026-04-24 06:41:45.316683 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:41:45.316701 | orchestrator | 2026-04-24 06:41:45.316712 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-24 06:41:45.316723 | orchestrator | Friday 24 April 2026 06:41:43 +0000 (0:00:01.914) 0:01:24.967 ********** 2026-04-24 06:41:45.316736 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:45.316760 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:48.998320 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:48.998413 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:48.998428 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:48.998452 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:48.998484 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:41:48.998494 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:41:48.998503 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:41:48.998512 | orchestrator | 2026-04-24 06:41:48.998521 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-24 06:41:48.998529 | orchestrator | Friday 24 April 2026 06:41:48 +0000 (0:00:04.512) 0:01:29.479 ********** 2026-04-24 06:41:48.998539 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:48.998555 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:50.899159 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:41:50.899228 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:41:50.899238 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:50.899244 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:50.899249 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:41:50.899272 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:50.899289 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:50.899294 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:50.899299 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:41:50.899303 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:50.899307 | orchestrator | 2026-04-24 06:41:50.899312 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-24 06:41:50.899317 | orchestrator | Friday 24 April 2026 06:41:50 +0000 (0:00:01.904) 0:01:31.383 ********** 2026-04-24 06:41:50.899322 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:50.899339 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:54.456290 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:41:54.456366 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:41:54.456375 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:54.456381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:54.456404 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:41:54.456408 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:41:54.456424 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:54.456430 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:41:54.456434 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:41:54.456442 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:41:54.456446 | orchestrator | 2026-04-24 06:41:54.456450 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-24 06:41:54.456455 | orchestrator | Friday 24 April 2026 06:41:52 +0000 (0:00:02.465) 0:01:33.849 ********** 2026-04-24 06:41:54.456459 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:41:54.456467 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:00.777111 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:00.777190 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:00.777213 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:00.777230 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:00.777237 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:00.777243 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:00.777248 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:00.777256 | orchestrator | 2026-04-24 06:42:00.777260 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-24 06:42:00.777266 | orchestrator | Friday 24 April 2026 06:41:57 +0000 (0:00:04.502) 0:01:38.351 ********** 2026-04-24 06:42:00.777270 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:00.777279 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:08.044280 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:08.044427 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:08.044448 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:08.044480 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:08.044496 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:08.044509 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:08.044529 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:08.044542 | orchestrator | 2026-04-24 06:42:08.044556 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-24 06:42:08.044568 | orchestrator | Friday 24 April 2026 06:42:07 +0000 (0:00:10.246) 0:01:48.598 ********** 2026-04-24 06:42:08.044581 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:08.044602 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:20.316759 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:42:20.316874 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:42:20.316887 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:20.316893 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:20.316899 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:42:20.316904 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:42:20.316921 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:20.316932 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:20.316938 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:42:20.316943 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:42:20.316948 | orchestrator | 2026-04-24 06:42:20.316954 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-24 06:42:20.316960 | orchestrator | Friday 24 April 2026 06:42:09 +0000 (0:00:02.030) 0:01:50.629 ********** 2026-04-24 06:42:20.317006 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:42:20.317012 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:42:20.317017 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:42:20.317022 | orchestrator | 2026-04-24 06:42:20.317027 | orchestrator | TASK [nova : Copying over nova-metadata-wsgi.conf] ***************************** 2026-04-24 06:42:20.317032 | orchestrator | Friday 24 April 2026 06:42:11 +0000 (0:00:02.078) 0:01:52.707 ********** 2026-04-24 06:42:20.317037 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:42:20.317042 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:42:20.317047 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:42:20.317051 | orchestrator | 2026-04-24 06:42:20.317056 | orchestrator | TASK [nova : Copying over vendordata file for nova services] ******************* 2026-04-24 06:42:20.317061 | orchestrator | Friday 24 April 2026 06:42:13 +0000 (0:00:01.738) 0:01:54.446 ********** 2026-04-24 06:42:20.317067 | orchestrator | skipping: [testbed-node-0] => (item=nova-metadata)  2026-04-24 06:42:20.317072 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-24 06:42:20.317077 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:42:20.317082 | orchestrator | skipping: [testbed-node-1] => (item=nova-metadata)  2026-04-24 06:42:20.317086 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-24 06:42:20.317091 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:42:20.317096 | orchestrator | skipping: [testbed-node-2] => (item=nova-metadata)  2026-04-24 06:42:20.317101 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-24 06:42:20.317106 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:42:20.317110 | orchestrator | 2026-04-24 06:42:20.317115 | orchestrator | TASK [Configure uWSGI for Nova] ************************************************ 2026-04-24 06:42:20.317120 | orchestrator | Friday 24 April 2026 06:42:14 +0000 (0:00:01.417) 0:01:55.863 ********** 2026-04-24 06:42:20.317130 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-api', 'port': '8774', 'workers': '2'}) 2026-04-24 06:42:20.317137 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-metadata', 'port': '8775', 'workers': '2'}) 2026-04-24 06:42:20.317142 | orchestrator | 2026-04-24 06:42:20.317147 | orchestrator | TASK [service-uwsgi-config : Copying over nova-api uWSGI config] *************** 2026-04-24 06:42:20.317152 | orchestrator | Friday 24 April 2026 06:42:17 +0000 (0:00:03.116) 0:01:58.980 ********** 2026-04-24 06:42:20.317157 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:42:20.317162 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:42:20.317166 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:42:20.317171 | orchestrator | 2026-04-24 06:42:47.103646 | orchestrator | TASK [service-uwsgi-config : Copying over nova-metadata uWSGI config] ********** 2026-04-24 06:42:47.103782 | orchestrator | Friday 24 April 2026 06:42:21 +0000 (0:00:03.140) 0:02:02.120 ********** 2026-04-24 06:42:47.103800 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:42:47.103813 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:42:47.103825 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:42:47.103836 | orchestrator | 2026-04-24 06:42:47.103848 | orchestrator | TASK [nova : Run Nova upgrade checks] ****************************************** 2026-04-24 06:42:47.103859 | orchestrator | Friday 24 April 2026 06:42:24 +0000 (0:00:03.708) 0:02:05.829 ********** 2026-04-24 06:42:47.103870 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:42:47.103882 | orchestrator | 2026-04-24 06:42:47.103906 | orchestrator | TASK [nova : Upgrade status check result] ************************************** 2026-04-24 06:42:47.103917 | orchestrator | Friday 24 April 2026 06:42:44 +0000 (0:00:19.815) 0:02:25.645 ********** 2026-04-24 06:42:47.103928 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:42:47.103939 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:42:47.103996 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:42:47.104011 | orchestrator | 2026-04-24 06:42:47.104030 | orchestrator | TASK [nova : Stopping top level nova services] ********************************* 2026-04-24 06:42:47.104062 | orchestrator | Friday 24 April 2026 06:42:46 +0000 (0:00:01.503) 0:02:27.149 ********** 2026-04-24 06:42:47.104089 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:47.104115 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:47.104173 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:42:47.104205 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:42:47.104253 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:47.104277 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:47.104295 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:42:47.104313 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:42:47.104332 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:47.104379 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:52.470246 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:42:52.470351 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:42:52.470366 | orchestrator | 2026-04-24 06:42:52.470376 | orchestrator | TASK [service-check-containers : nova | Check containers] ********************** 2026-04-24 06:42:52.470387 | orchestrator | Friday 24 April 2026 06:42:48 +0000 (0:00:02.438) 0:02:29.587 ********** 2026-04-24 06:42:52.470399 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:52.470434 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:52.470446 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:52.470474 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:52.470488 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:52.470514 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:42:52.470531 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:52.470575 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:56.225544 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:42:56.225667 | orchestrator | 2026-04-24 06:42:56.225686 | orchestrator | TASK [service-check-containers : nova | Notify handlers to restart containers] *** 2026-04-24 06:42:56.225699 | orchestrator | Friday 24 April 2026 06:42:53 +0000 (0:00:05.099) 0:02:34.687 ********** 2026-04-24 06:42:56.225712 | orchestrator | ok: [testbed-node-0] => { 2026-04-24 06:42:56.225724 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:42:56.225736 | orchestrator | } 2026-04-24 06:42:56.225787 | orchestrator | ok: [testbed-node-1] => { 2026-04-24 06:42:56.225801 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:42:56.225812 | orchestrator | } 2026-04-24 06:42:56.225823 | orchestrator | ok: [testbed-node-2] => { 2026-04-24 06:42:56.225834 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:42:56.225870 | orchestrator | } 2026-04-24 06:42:56.225881 | orchestrator | 2026-04-24 06:42:56.225892 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:42:56.225903 | orchestrator | Friday 24 April 2026 06:42:55 +0000 (0:00:01.536) 0:02:36.224 ********** 2026-04-24 06:42:56.225918 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:56.225933 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:56.225989 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:42:56.226003 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:42:56.226086 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:56.226116 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:56.226131 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:42:56.226143 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:42:56.226164 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:42:56.226187 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:43:39.741904 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:43:39.742064 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:39.742073 | orchestrator | 2026-04-24 06:43:39.742078 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 06:43:39.742090 | orchestrator | Friday 24 April 2026 06:42:57 +0000 (0:00:02.381) 0:02:38.606 ********** 2026-04-24 06:43:39.742094 | orchestrator | 2026-04-24 06:43:39.742098 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 06:43:39.742102 | orchestrator | Friday 24 April 2026 06:42:58 +0000 (0:00:00.564) 0:02:39.170 ********** 2026-04-24 06:43:39.742105 | orchestrator | 2026-04-24 06:43:39.742109 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-24 06:43:39.742113 | orchestrator | Friday 24 April 2026 06:42:58 +0000 (0:00:00.568) 0:02:39.738 ********** 2026-04-24 06:43:39.742117 | orchestrator | 2026-04-24 06:43:39.742121 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-24 06:43:39.742124 | orchestrator | 2026-04-24 06:43:39.742128 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 06:43:39.742132 | orchestrator | Friday 24 April 2026 06:43:00 +0000 (0:00:01.718) 0:02:41.457 ********** 2026-04-24 06:43:39.742137 | orchestrator | included: /ansible/roles/nova-cell/tasks/upgrade.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:43:39.742142 | orchestrator | 2026-04-24 06:43:39.742152 | orchestrator | TASK [nova-cell : Get new Libvirt version] ************************************* 2026-04-24 06:43:39.742156 | orchestrator | Friday 24 April 2026 06:43:03 +0000 (0:00:02.645) 0:02:44.102 ********** 2026-04-24 06:43:39.742160 | orchestrator | changed: [testbed-node-3] 2026-04-24 06:43:39.742164 | orchestrator | 2026-04-24 06:43:39.742167 | orchestrator | TASK [nova-cell : Cache new Libvirt version] *********************************** 2026-04-24 06:43:39.742171 | orchestrator | Friday 24 April 2026 06:43:07 +0000 (0:00:04.486) 0:02:48.589 ********** 2026-04-24 06:43:39.742175 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:43:39.742179 | orchestrator | 2026-04-24 06:43:39.742183 | orchestrator | TASK [Get nova_libvirt image info] ********************************************* 2026-04-24 06:43:39.742187 | orchestrator | Friday 24 April 2026 06:43:09 +0000 (0:00:02.411) 0:02:51.000 ********** 2026-04-24 06:43:39.742191 | orchestrator | included: service-image-info for testbed-node-3 2026-04-24 06:43:39.742194 | orchestrator | 2026-04-24 06:43:39.742198 | orchestrator | TASK [service-image-info : community.docker.docker_image_info] ***************** 2026-04-24 06:43:39.742202 | orchestrator | Friday 24 April 2026 06:43:12 +0000 (0:00:02.106) 0:02:53.106 ********** 2026-04-24 06:43:39.742206 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:43:39.742209 | orchestrator | 2026-04-24 06:43:39.742213 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-24 06:43:39.742217 | orchestrator | Friday 24 April 2026 06:43:16 +0000 (0:00:04.437) 0:02:57.544 ********** 2026-04-24 06:43:39.742221 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:43:39.742224 | orchestrator | 2026-04-24 06:43:39.742228 | orchestrator | TASK [service-image-info : containers.podman.podman_image_info] **************** 2026-04-24 06:43:39.742232 | orchestrator | Friday 24 April 2026 06:43:19 +0000 (0:00:03.021) 0:03:00.566 ********** 2026-04-24 06:43:39.742236 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:43:39.742256 | orchestrator | 2026-04-24 06:43:39.742275 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-24 06:43:39.742280 | orchestrator | Friday 24 April 2026 06:43:22 +0000 (0:00:03.036) 0:03:03.602 ********** 2026-04-24 06:43:39.742283 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:43:39.742287 | orchestrator | 2026-04-24 06:43:39.742291 | orchestrator | TASK [nova-cell : Get container facts] ***************************************** 2026-04-24 06:43:39.742295 | orchestrator | Friday 24 April 2026 06:43:25 +0000 (0:00:03.154) 0:03:06.757 ********** 2026-04-24 06:43:39.742298 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:43:39.742302 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:43:39.742306 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:43:39.742310 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:43:39.742314 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:43:39.742317 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:39.742321 | orchestrator | 2026-04-24 06:43:39.742325 | orchestrator | TASK [nova-cell : Get current Libvirt version] ********************************* 2026-04-24 06:43:39.742328 | orchestrator | Friday 24 April 2026 06:43:30 +0000 (0:00:05.095) 0:03:11.852 ********** 2026-04-24 06:43:39.742332 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:43:39.742336 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:43:39.742340 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:39.742343 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:43:39.742347 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:43:39.742350 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:43:39.742354 | orchestrator | 2026-04-24 06:43:39.742358 | orchestrator | TASK [nova-cell : Check that the new Libvirt version is >= current] ************ 2026-04-24 06:43:39.742362 | orchestrator | Friday 24 April 2026 06:43:35 +0000 (0:00:04.814) 0:03:16.667 ********** 2026-04-24 06:43:39.742365 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:43:39.742369 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:43:39.742373 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:43:39.742376 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:43:39.742380 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:39.742393 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:43:39.742398 | orchestrator | 2026-04-24 06:43:39.742402 | orchestrator | TASK [nova-cell : Stopping nova cell services] ********************************* 2026-04-24 06:43:39.742407 | orchestrator | Friday 24 April 2026 06:43:38 +0000 (0:00:03.089) 0:03:19.756 ********** 2026-04-24 06:43:39.742418 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:43:39.742424 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:43:39.742430 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:43:39.743619 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:43:39.743648 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:43:39.743673 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:43:50.567091 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:43:50.567207 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:43:50.567229 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:43:50.567276 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:43:50.567309 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:43:50.567324 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:43:50.567339 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:43:50.567352 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:43:50.567365 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:43:50.567460 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:43:50.567472 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:43:50.567505 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:43:50.567513 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:43:50.567537 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:43:50.567546 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:50.567553 | orchestrator | 2026-04-24 06:43:50.567562 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-24 06:43:50.567571 | orchestrator | Friday 24 April 2026 06:43:42 +0000 (0:00:03.352) 0:03:23.110 ********** 2026-04-24 06:43:50.567578 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:43:50.567586 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:43:50.567593 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:50.567601 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:43:50.567610 | orchestrator | 2026-04-24 06:43:50.567618 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-24 06:43:50.567627 | orchestrator | Friday 24 April 2026 06:43:44 +0000 (0:00:02.206) 0:03:25.316 ********** 2026-04-24 06:43:50.567636 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-24 06:43:50.567646 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-24 06:43:50.567654 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-24 06:43:50.567662 | orchestrator | 2026-04-24 06:43:50.567671 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-24 06:43:50.567679 | orchestrator | Friday 24 April 2026 06:43:46 +0000 (0:00:01.935) 0:03:27.252 ********** 2026-04-24 06:43:50.567688 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-24 06:43:50.567696 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-24 06:43:50.567704 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-24 06:43:50.567713 | orchestrator | 2026-04-24 06:43:50.567721 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-24 06:43:50.567729 | orchestrator | Friday 24 April 2026 06:43:48 +0000 (0:00:02.280) 0:03:29.533 ********** 2026-04-24 06:43:50.567738 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-24 06:43:50.567746 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:43:50.567755 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-24 06:43:50.567763 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:43:50.567771 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-24 06:43:50.567779 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:43:50.567788 | orchestrator | 2026-04-24 06:43:50.567797 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-24 06:43:50.567811 | orchestrator | Friday 24 April 2026 06:43:50 +0000 (0:00:01.535) 0:03:31.069 ********** 2026-04-24 06:43:50.567820 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 06:43:50.567829 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 06:43:50.567837 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:43:50.567852 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 06:43:59.311192 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 06:43:59.311320 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 06:43:59.311337 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 06:43:59.311349 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-24 06:43:59.311361 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:43:59.311373 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-24 06:43:59.311384 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-24 06:43:59.311395 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:59.311406 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 06:43:59.311417 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 06:43:59.311428 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-24 06:43:59.311438 | orchestrator | 2026-04-24 06:43:59.311450 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-24 06:43:59.311461 | orchestrator | Friday 24 April 2026 06:43:52 +0000 (0:00:02.148) 0:03:33.217 ********** 2026-04-24 06:43:59.311471 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:43:59.311482 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:43:59.311493 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:59.311504 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:43:59.311515 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:43:59.311526 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:43:59.311537 | orchestrator | 2026-04-24 06:43:59.311548 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-24 06:43:59.311558 | orchestrator | Friday 24 April 2026 06:43:54 +0000 (0:00:02.544) 0:03:35.762 ********** 2026-04-24 06:43:59.311569 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:43:59.311580 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:43:59.311591 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:43:59.311602 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:43:59.311612 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:43:59.311623 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:43:59.311634 | orchestrator | 2026-04-24 06:43:59.311645 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-24 06:43:59.311655 | orchestrator | Friday 24 April 2026 06:43:57 +0000 (0:00:02.508) 0:03:38.271 ********** 2026-04-24 06:43:59.311686 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:43:59.311726 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:43:59.311808 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:43:59.311824 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:43:59.311839 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:43:59.311858 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:43:59.311872 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:43:59.311893 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:43:59.311939 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277223 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277333 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277350 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277379 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277416 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277429 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277441 | orchestrator | 2026-04-24 06:44:06.277469 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 06:44:06.277483 | orchestrator | Friday 24 April 2026 06:44:01 +0000 (0:00:04.608) 0:03:42.879 ********** 2026-04-24 06:44:06.277495 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:44:06.277508 | orchestrator | 2026-04-24 06:44:06.277520 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-24 06:44:06.277532 | orchestrator | Friday 24 April 2026 06:44:04 +0000 (0:00:02.191) 0:03:45.071 ********** 2026-04-24 06:44:06.277544 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277563 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277584 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277596 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:44:06.277617 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:44:11.667679 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:44:11.667772 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:44:11.667803 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:44:11.667897 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:11.667975 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:11.667985 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:11.668009 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:11.668019 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:11.668063 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:44:11.668072 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:44:11.668080 | orchestrator | 2026-04-24 06:44:11.668089 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-24 06:44:11.668098 | orchestrator | Friday 24 April 2026 06:44:10 +0000 (0:00:06.557) 0:03:51.629 ********** 2026-04-24 06:44:11.668107 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:44:11.668141 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:44:12.681782 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:44:12.682093 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:44:12.682123 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:44:12.682145 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:44:12.682162 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:44:12.682179 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:44:12.682196 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:44:12.682274 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:44:12.682293 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:44:12.682322 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:44:12.682348 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:44:12.682368 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:44:12.682385 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:44:12.682404 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:44:12.682422 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:44:12.682450 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:44:15.921598 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:44:15.921704 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:44:15.921723 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:44:15.921736 | orchestrator | 2026-04-24 06:44:15.921748 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-24 06:44:15.921760 | orchestrator | Friday 24 April 2026 06:44:13 +0000 (0:00:03.335) 0:03:54.965 ********** 2026-04-24 06:44:15.921789 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:44:15.921802 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:44:15.921815 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:44:15.921847 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:44:15.921886 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:44:15.921900 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:44:15.921998 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:44:15.922012 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:44:15.922084 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:44:15.922096 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:44:15.922107 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:44:15.922128 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:44:15.922206 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:44:45.809000 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:44:45.810987 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:44:45.811062 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:44:45.811075 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:44:45.811085 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:44:45.811094 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:44:45.811102 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:44:45.811142 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:44:45.811151 | orchestrator | 2026-04-24 06:44:45.811162 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-24 06:44:45.811181 | orchestrator | Friday 24 April 2026 06:44:18 +0000 (0:00:04.211) 0:03:59.176 ********** 2026-04-24 06:44:45.811189 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:44:45.811197 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:44:45.811205 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:44:45.811214 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:44:45.811222 | orchestrator | 2026-04-24 06:44:45.811231 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-24 06:44:45.811239 | orchestrator | Friday 24 April 2026 06:44:20 +0000 (0:00:02.416) 0:04:01.593 ********** 2026-04-24 06:44:45.811247 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 06:44:45.811280 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 06:44:45.811288 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 06:44:45.811296 | orchestrator | 2026-04-24 06:44:45.811304 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-24 06:44:45.811312 | orchestrator | Friday 24 April 2026 06:44:22 +0000 (0:00:02.067) 0:04:03.661 ********** 2026-04-24 06:44:45.811320 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 06:44:45.811328 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 06:44:45.811336 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 06:44:45.811344 | orchestrator | 2026-04-24 06:44:45.811352 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-24 06:44:45.811360 | orchestrator | Friday 24 April 2026 06:44:24 +0000 (0:00:02.024) 0:04:05.685 ********** 2026-04-24 06:44:45.811369 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:44:45.811378 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:44:45.811386 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:44:45.811393 | orchestrator | 2026-04-24 06:44:45.811401 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-24 06:44:45.811409 | orchestrator | Friday 24 April 2026 06:44:26 +0000 (0:00:01.774) 0:04:07.459 ********** 2026-04-24 06:44:45.811417 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:44:45.811425 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:44:45.811433 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:44:45.811441 | orchestrator | 2026-04-24 06:44:45.811449 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-24 06:44:45.811461 | orchestrator | Friday 24 April 2026 06:44:28 +0000 (0:00:01.603) 0:04:09.063 ********** 2026-04-24 06:44:45.811470 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-24 06:44:45.811478 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-24 06:44:45.811486 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-24 06:44:45.811494 | orchestrator | 2026-04-24 06:44:45.811502 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-24 06:44:45.811509 | orchestrator | Friday 24 April 2026 06:44:30 +0000 (0:00:02.280) 0:04:11.344 ********** 2026-04-24 06:44:45.811517 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-24 06:44:45.811525 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-24 06:44:45.811533 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-24 06:44:45.811541 | orchestrator | 2026-04-24 06:44:45.811549 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-24 06:44:45.811557 | orchestrator | Friday 24 April 2026 06:44:32 +0000 (0:00:02.294) 0:04:13.638 ********** 2026-04-24 06:44:45.811565 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-24 06:44:45.811589 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-24 06:44:45.811597 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-24 06:44:45.811605 | orchestrator | ok: [testbed-node-3] => (item=nova-libvirt) 2026-04-24 06:44:45.811613 | orchestrator | ok: [testbed-node-4] => (item=nova-libvirt) 2026-04-24 06:44:45.811621 | orchestrator | ok: [testbed-node-5] => (item=nova-libvirt) 2026-04-24 06:44:45.811628 | orchestrator | 2026-04-24 06:44:45.811636 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-24 06:44:45.811645 | orchestrator | Friday 24 April 2026 06:44:37 +0000 (0:00:04.800) 0:04:18.439 ********** 2026-04-24 06:44:45.811653 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:44:45.811661 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:44:45.811669 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:44:45.811676 | orchestrator | 2026-04-24 06:44:45.811684 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-24 06:44:45.811692 | orchestrator | Friday 24 April 2026 06:44:38 +0000 (0:00:01.352) 0:04:19.792 ********** 2026-04-24 06:44:45.811700 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:44:45.811708 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:44:45.811716 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:44:45.811724 | orchestrator | 2026-04-24 06:44:45.811732 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-24 06:44:45.811740 | orchestrator | Friday 24 April 2026 06:44:40 +0000 (0:00:01.349) 0:04:21.141 ********** 2026-04-24 06:44:45.811748 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:44:45.811756 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:44:45.811763 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:44:45.811771 | orchestrator | 2026-04-24 06:44:45.811779 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-24 06:44:45.811787 | orchestrator | Friday 24 April 2026 06:44:42 +0000 (0:00:02.552) 0:04:23.694 ********** 2026-04-24 06:44:45.811805 | orchestrator | ok: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-24 06:44:45.811816 | orchestrator | ok: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-24 06:44:45.811824 | orchestrator | ok: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-24 06:44:45.811832 | orchestrator | ok: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-24 06:44:45.811840 | orchestrator | ok: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-24 06:44:45.811854 | orchestrator | ok: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-24 06:45:07.831209 | orchestrator | 2026-04-24 06:45:07.831320 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-24 06:45:07.831338 | orchestrator | Friday 24 April 2026 06:44:46 +0000 (0:00:04.294) 0:04:27.988 ********** 2026-04-24 06:45:07.831349 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-24 06:45:07.831360 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-24 06:45:07.831370 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-24 06:45:07.831380 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-24 06:45:07.831390 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:45:07.831400 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-24 06:45:07.831435 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:45:07.831445 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-24 06:45:07.831455 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:45:07.831465 | orchestrator | 2026-04-24 06:45:07.831475 | orchestrator | TASK [nova-cell : Include tasks from qemu_wrapper.yml] ************************* 2026-04-24 06:45:07.831485 | orchestrator | Friday 24 April 2026 06:44:51 +0000 (0:00:04.332) 0:04:32.321 ********** 2026-04-24 06:45:07.831495 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:07.831504 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:07.831514 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:07.831537 | orchestrator | included: /ansible/roles/nova-cell/tasks/qemu_wrapper.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 06:45:07.831548 | orchestrator | 2026-04-24 06:45:07.831557 | orchestrator | TASK [nova-cell : Check qemu wrapper file] ************************************* 2026-04-24 06:45:07.831567 | orchestrator | Friday 24 April 2026 06:44:54 +0000 (0:00:03.396) 0:04:35.717 ********** 2026-04-24 06:45:07.831576 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 06:45:07.831586 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 06:45:07.831596 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 06:45:07.831605 | orchestrator | 2026-04-24 06:45:07.831615 | orchestrator | TASK [nova-cell : Copy qemu wrapper] ******************************************* 2026-04-24 06:45:07.831625 | orchestrator | Friday 24 April 2026 06:44:56 +0000 (0:00:02.017) 0:04:37.735 ********** 2026-04-24 06:45:07.831634 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:45:07.831644 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:45:07.831654 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:45:07.831663 | orchestrator | 2026-04-24 06:45:07.831673 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-24 06:45:07.831682 | orchestrator | Friday 24 April 2026 06:44:58 +0000 (0:00:01.574) 0:04:39.310 ********** 2026-04-24 06:45:07.831692 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:45:07.831702 | orchestrator | 2026-04-24 06:45:07.831711 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-24 06:45:07.831721 | orchestrator | Friday 24 April 2026 06:44:59 +0000 (0:00:01.238) 0:04:40.549 ********** 2026-04-24 06:45:07.831732 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:45:07.831744 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:45:07.831755 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:45:07.831766 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:07.831778 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:07.831789 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:07.831801 | orchestrator | 2026-04-24 06:45:07.831812 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-24 06:45:07.831823 | orchestrator | Friday 24 April 2026 06:45:01 +0000 (0:00:01.919) 0:04:42.469 ********** 2026-04-24 06:45:07.831835 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 06:45:07.831846 | orchestrator | 2026-04-24 06:45:07.831858 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-24 06:45:07.831869 | orchestrator | Friday 24 April 2026 06:45:03 +0000 (0:00:01.781) 0:04:44.250 ********** 2026-04-24 06:45:07.831901 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:45:07.831913 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:45:07.831924 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:45:07.831936 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:07.831947 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:07.831959 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:07.831970 | orchestrator | 2026-04-24 06:45:07.831982 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-24 06:45:07.831997 | orchestrator | Friday 24 April 2026 06:45:05 +0000 (0:00:02.030) 0:04:46.281 ********** 2026-04-24 06:45:07.832020 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:45:07.832146 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:45:07.832169 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:45:07.832180 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:45:07.832191 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:45:07.832202 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:45:07.832234 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:45:07.832264 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:45:13.181835 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:13.181981 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:13.182001 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:13.182103 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:13.182138 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:13.182161 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:45:13.182192 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:13.182199 | orchestrator | 2026-04-24 06:45:13.182207 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-24 06:45:13.182215 | orchestrator | Friday 24 April 2026 06:45:11 +0000 (0:00:06.559) 0:04:52.840 ********** 2026-04-24 06:45:13.182222 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:45:13.182230 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:45:13.182243 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:45:13.182250 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:45:13.182276 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:45:28.285181 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:45:28.285280 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285381 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285399 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285413 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285463 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285479 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285488 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285503 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285512 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:45:28.285519 | orchestrator | 2026-04-24 06:45:28.285528 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-24 06:45:28.285537 | orchestrator | Friday 24 April 2026 06:45:21 +0000 (0:00:09.962) 0:05:02.803 ********** 2026-04-24 06:45:28.285544 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:45:28.285555 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:45:28.285567 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:45:28.285585 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:28.285596 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:28.285608 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:28.285620 | orchestrator | 2026-04-24 06:45:28.285631 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-24 06:45:28.285643 | orchestrator | Friday 24 April 2026 06:45:24 +0000 (0:00:03.090) 0:05:05.894 ********** 2026-04-24 06:45:28.285653 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 06:45:28.285665 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 06:45:28.285676 | orchestrator | ok: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 06:45:28.285687 | orchestrator | ok: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 06:45:28.285699 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 06:45:28.285711 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:28.285723 | orchestrator | ok: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-24 06:45:28.285742 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 06:45:28.285753 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:28.285765 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-24 06:45:28.285787 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-24 06:45:58.567498 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:58.567629 | orchestrator | ok: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 06:45:58.567637 | orchestrator | ok: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 06:45:58.567676 | orchestrator | ok: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-24 06:45:58.567683 | orchestrator | 2026-04-24 06:45:58.567691 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-24 06:45:58.567698 | orchestrator | Friday 24 April 2026 06:45:29 +0000 (0:00:04.842) 0:05:10.737 ********** 2026-04-24 06:45:58.567705 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:45:58.567714 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:45:58.567719 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:45:58.567725 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:58.567732 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:58.567739 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:58.567746 | orchestrator | 2026-04-24 06:45:58.567753 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-24 06:45:58.567759 | orchestrator | Friday 24 April 2026 06:45:31 +0000 (0:00:02.198) 0:05:12.935 ********** 2026-04-24 06:45:58.567765 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 06:45:58.567774 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 06:45:58.567785 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 06:45:58.567798 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 06:45:58.567809 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-24 06:45:58.567820 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 06:45:58.567832 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 06:45:58.567842 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 06:45:58.567899 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:58.567912 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 06:45:58.567923 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:58.567936 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:45:58.567947 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:45:58.567958 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:45:58.567968 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-24 06:45:58.567977 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-24 06:45:58.567987 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-24 06:45:58.567997 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:58.568006 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:45:58.568020 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:45:58.568032 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-24 06:45:58.568045 | orchestrator | 2026-04-24 06:45:58.568061 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-24 06:45:58.568073 | orchestrator | Friday 24 April 2026 06:45:38 +0000 (0:00:06.530) 0:05:19.465 ********** 2026-04-24 06:45:58.568105 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 06:45:58.568119 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 06:45:58.568133 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:45:58.568146 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 06:45:58.568158 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:45:58.568193 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 06:45:58.568207 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-24 06:45:58.568220 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 06:45:58.568233 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 06:45:58.568275 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:45:58.568289 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:45:58.568301 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 06:45:58.568314 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:58.568327 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 06:45:58.568339 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:58.568351 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-24 06:45:58.568364 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-24 06:45:58.568376 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:45:58.568386 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:45:58.568397 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-24 06:45:58.568406 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-24 06:45:58.568412 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-24 06:45:58.568419 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-24 06:45:58.568425 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:58.568431 | orchestrator | ok: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:45:58.568438 | orchestrator | ok: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:45:58.568444 | orchestrator | ok: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-24 06:45:58.568452 | orchestrator | 2026-04-24 06:45:58.568461 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-24 06:45:58.568468 | orchestrator | Friday 24 April 2026 06:45:47 +0000 (0:00:08.714) 0:05:28.180 ********** 2026-04-24 06:45:58.568477 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:45:58.568485 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:45:58.568494 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:45:58.568502 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:58.568511 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:58.568519 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:58.568526 | orchestrator | 2026-04-24 06:45:58.568535 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-24 06:45:58.568544 | orchestrator | Friday 24 April 2026 06:45:48 +0000 (0:00:01.772) 0:05:29.952 ********** 2026-04-24 06:45:58.568555 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:45:58.568564 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:45:58.568587 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:45:58.568595 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:58.568604 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:58.568612 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:58.568621 | orchestrator | 2026-04-24 06:45:58.568630 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-24 06:45:58.568638 | orchestrator | Friday 24 April 2026 06:45:51 +0000 (0:00:02.089) 0:05:32.042 ********** 2026-04-24 06:45:58.568647 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:58.568655 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:58.568664 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:45:58.568674 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:45:58.568684 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:45:58.568692 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:58.568700 | orchestrator | 2026-04-24 06:45:58.568709 | orchestrator | TASK [nova-cell : Generating 'hostid' file for nova_compute] ******************* 2026-04-24 06:45:58.568716 | orchestrator | Friday 24 April 2026 06:45:54 +0000 (0:00:03.166) 0:05:35.209 ********** 2026-04-24 06:45:58.568722 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:45:58.568727 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:45:58.568733 | orchestrator | ok: [testbed-node-5] 2026-04-24 06:45:58.568738 | orchestrator | ok: [testbed-node-4] 2026-04-24 06:45:58.568744 | orchestrator | ok: [testbed-node-3] 2026-04-24 06:45:58.568749 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:45:58.568755 | orchestrator | 2026-04-24 06:45:58.568761 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-24 06:45:58.568766 | orchestrator | Friday 24 April 2026 06:45:57 +0000 (0:00:03.545) 0:05:38.754 ********** 2026-04-24 06:45:58.568786 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:45:58.568812 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:46:00.494208 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:46:00.494333 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:46:00.494346 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:46:00.494354 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:46:00.494361 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:46:00.494367 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:46:00.494386 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:46:00.494411 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:46:00.494424 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:46:00.494430 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:46:00.494437 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:46:00.494443 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:46:00.494450 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:46:00.494460 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:46:00.494466 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:46:00.494472 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:46:00.494482 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:46:07.519544 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:46:07.519669 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:46:07.519692 | orchestrator | 2026-04-24 06:46:07.519710 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-24 06:46:07.519728 | orchestrator | Friday 24 April 2026 06:46:01 +0000 (0:00:04.014) 0:05:42.769 ********** 2026-04-24 06:46:07.519744 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-24 06:46:07.519760 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-24 06:46:07.519775 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:46:07.519791 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-24 06:46:07.519807 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-24 06:46:07.519822 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:46:07.519838 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-24 06:46:07.519914 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-24 06:46:07.519931 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:46:07.519947 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-24 06:46:07.519963 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-24 06:46:07.519979 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:46:07.519995 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-24 06:46:07.520012 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-24 06:46:07.520028 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:46:07.520043 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-24 06:46:07.520060 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-24 06:46:07.520077 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:46:07.520094 | orchestrator | 2026-04-24 06:46:07.520111 | orchestrator | TASK [service-check-containers : nova_cell | Check containers] ***************** 2026-04-24 06:46:07.520128 | orchestrator | Friday 24 April 2026 06:46:04 +0000 (0:00:02.502) 0:05:45.271 ********** 2026-04-24 06:46:07.520167 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:46:07.520188 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:46:07.520347 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-24 06:46:07.520370 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:46:07.520389 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:46:07.520407 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:46:07.520430 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:46:07.520457 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-24 06:46:07.520483 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:46:15.568267 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:46:15.568377 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:46:15.568394 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-24 06:46:15.568421 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:46:15.568457 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-24 06:46:15.568470 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 06:46:15.568482 | orchestrator | 2026-04-24 06:46:15.568512 | orchestrator | TASK [service-check-containers : nova_cell | Notify handlers to restart containers] *** 2026-04-24 06:46:15.568525 | orchestrator | Friday 24 April 2026 06:46:11 +0000 (0:00:07.402) 0:05:52.673 ********** 2026-04-24 06:46:15.568538 | orchestrator | ok: [testbed-node-3] => { 2026-04-24 06:46:15.568549 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:46:15.568560 | orchestrator | } 2026-04-24 06:46:15.568572 | orchestrator | ok: [testbed-node-4] => { 2026-04-24 06:46:15.568583 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:46:15.568594 | orchestrator | } 2026-04-24 06:46:15.568604 | orchestrator | ok: [testbed-node-5] => { 2026-04-24 06:46:15.568615 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:46:15.568626 | orchestrator | } 2026-04-24 06:46:15.568636 | orchestrator | ok: [testbed-node-0] => { 2026-04-24 06:46:15.568647 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:46:15.568658 | orchestrator | } 2026-04-24 06:46:15.568669 | orchestrator | ok: [testbed-node-1] => { 2026-04-24 06:46:15.568679 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:46:15.568690 | orchestrator | } 2026-04-24 06:46:15.568701 | orchestrator | ok: [testbed-node-2] => { 2026-04-24 06:46:15.568711 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:46:15.568722 | orchestrator | } 2026-04-24 06:46:15.568733 | orchestrator | 2026-04-24 06:46:15.568747 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:46:15.568766 | orchestrator | Friday 24 April 2026 06:46:13 +0000 (0:00:02.028) 0:05:54.703 ********** 2026-04-24 06:46:15.568787 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:46:15.568820 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:46:15.568875 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:46:15.568899 | orchestrator | skipping: [testbed-node-3] 2026-04-24 06:46:15.568931 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:46:19.568230 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:46:19.568334 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:46:19.568379 | orchestrator | skipping: [testbed-node-4] 2026-04-24 06:46:19.568394 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-24 06:46:19.568422 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-24 06:46:19.568434 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-24 06:46:19.568446 | orchestrator | skipping: [testbed-node-5] 2026-04-24 06:46:19.568523 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:46:19.568538 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:46:19.568550 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:46:19.568561 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:46:19.568582 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:46:19.568593 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:46:19.568610 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-24 06:46:19.568622 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-24 06:46:19.568633 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:46:19.568645 | orchestrator | 2026-04-24 06:46:19.568657 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:46:19.568670 | orchestrator | Friday 24 April 2026 06:46:17 +0000 (0:00:04.213) 0:05:58.917 ********** 2026-04-24 06:46:19.568681 | orchestrator | 2026-04-24 06:46:19.568692 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:46:19.568703 | orchestrator | Friday 24 April 2026 06:46:18 +0000 (0:00:00.525) 0:05:59.443 ********** 2026-04-24 06:46:19.568714 | orchestrator | 2026-04-24 06:46:19.568725 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:46:19.568736 | orchestrator | Friday 24 April 2026 06:46:19 +0000 (0:00:00.971) 0:06:00.414 ********** 2026-04-24 06:46:19.568746 | orchestrator | 2026-04-24 06:46:19.568766 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:48:13.061210 | orchestrator | Friday 24 April 2026 06:46:19 +0000 (0:00:00.553) 0:06:00.968 ********** 2026-04-24 06:48:13.061318 | orchestrator | 2026-04-24 06:48:13.061332 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:48:13.061342 | orchestrator | Friday 24 April 2026 06:46:20 +0000 (0:00:00.530) 0:06:01.498 ********** 2026-04-24 06:48:13.061352 | orchestrator | 2026-04-24 06:48:13.061361 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-24 06:48:13.061370 | orchestrator | Friday 24 April 2026 06:46:21 +0000 (0:00:00.554) 0:06:02.053 ********** 2026-04-24 06:48:13.061405 | orchestrator | 2026-04-24 06:48:13.061415 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-24 06:48:13.061425 | orchestrator | 2026-04-24 06:48:13.061434 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-24 06:48:13.061443 | orchestrator | Friday 24 April 2026 06:46:23 +0000 (0:00:02.092) 0:06:04.146 ********** 2026-04-24 06:48:13.061453 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:13.061463 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:13.061473 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:48:13.061482 | orchestrator | 2026-04-24 06:48:13.061491 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-24 06:48:13.061501 | orchestrator | 2026-04-24 06:48:13.061510 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-24 06:48:13.061519 | orchestrator | Friday 24 April 2026 06:46:25 +0000 (0:00:02.062) 0:06:06.209 ********** 2026-04-24 06:48:13.061529 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:13.061538 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:13.061548 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:48:13.061557 | orchestrator | 2026-04-24 06:48:13.061566 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-24 06:48:13.061576 | orchestrator | 2026-04-24 06:48:13.061585 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-24 06:48:13.061595 | orchestrator | Friday 24 April 2026 06:46:27 +0000 (0:00:02.549) 0:06:08.759 ********** 2026-04-24 06:48:13.061604 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-24 06:48:13.061614 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-24 06:48:13.061623 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-24 06:48:13.061633 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-24 06:48:13.061642 | orchestrator | changed: [testbed-node-1] => (item=nova-conductor) 2026-04-24 06:48:13.061652 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-24 06:48:13.061661 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-24 06:48:13.061670 | orchestrator | changed: [testbed-node-0] => (item=nova-conductor) 2026-04-24 06:48:13.061679 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-24 06:48:13.061689 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-24 06:48:13.061698 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-24 06:48:13.061707 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-24 06:48:13.061716 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-24 06:48:13.061726 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-24 06:48:13.061750 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-24 06:48:13.061761 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-24 06:48:13.061800 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-24 06:48:13.061811 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-24 06:48:13.061820 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-24 06:48:13.061830 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-24 06:48:13.061841 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-24 06:48:13.061851 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-24 06:48:13.061861 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-24 06:48:13.061871 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-24 06:48:13.061881 | orchestrator | changed: [testbed-node-1] => (item=nova-novncproxy) 2026-04-24 06:48:13.061891 | orchestrator | changed: [testbed-node-0] => (item=nova-novncproxy) 2026-04-24 06:48:13.061901 | orchestrator | changed: [testbed-node-2] => (item=nova-conductor) 2026-04-24 06:48:13.061922 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-24 06:48:13.061932 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-24 06:48:13.061942 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-24 06:48:13.061952 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-24 06:48:13.061962 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-24 06:48:13.061973 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-24 06:48:13.061982 | orchestrator | changed: [testbed-node-2] => (item=nova-novncproxy) 2026-04-24 06:48:13.061993 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-24 06:48:13.062003 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-24 06:48:13.062114 | orchestrator | 2026-04-24 06:48:13.062128 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-24 06:48:13.062138 | orchestrator | 2026-04-24 06:48:13.062148 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-24 06:48:13.062157 | orchestrator | Friday 24 April 2026 06:47:16 +0000 (0:00:48.915) 0:06:57.674 ********** 2026-04-24 06:48:13.062166 | orchestrator | changed: [testbed-node-0] => (item=nova-scheduler) 2026-04-24 06:48:13.062191 | orchestrator | changed: [testbed-node-1] => (item=nova-scheduler) 2026-04-24 06:48:13.062201 | orchestrator | changed: [testbed-node-2] => (item=nova-scheduler) 2026-04-24 06:48:13.062209 | orchestrator | changed: [testbed-node-1] => (item=nova-api) 2026-04-24 06:48:13.062218 | orchestrator | changed: [testbed-node-0] => (item=nova-api) 2026-04-24 06:48:13.062227 | orchestrator | changed: [testbed-node-2] => (item=nova-api) 2026-04-24 06:48:13.062235 | orchestrator | 2026-04-24 06:48:13.062244 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-24 06:48:13.062253 | orchestrator | 2026-04-24 06:48:13.062261 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-24 06:48:13.062270 | orchestrator | Friday 24 April 2026 06:47:37 +0000 (0:00:21.051) 0:07:18.727 ********** 2026-04-24 06:48:13.062279 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:48:13.062288 | orchestrator | 2026-04-24 06:48:13.062296 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-24 06:48:13.062305 | orchestrator | 2026-04-24 06:48:13.062313 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-24 06:48:13.062322 | orchestrator | Friday 24 April 2026 06:47:57 +0000 (0:00:19.338) 0:07:38.065 ********** 2026-04-24 06:48:13.062331 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:13.062339 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:48:13.062348 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:48:13.062356 | orchestrator | 2026-04-24 06:48:13.062365 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:48:13.062374 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 06:48:13.062385 | orchestrator | testbed-node-0 : ok=39  changed=8  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-24 06:48:13.062394 | orchestrator | testbed-node-1 : ok=27  changed=5  unreachable=0 failed=0 skipped=46  rescued=0 ignored=0 2026-04-24 06:48:13.062402 | orchestrator | testbed-node-2 : ok=27  changed=5  unreachable=0 failed=0 skipped=46  rescued=0 ignored=0 2026-04-24 06:48:13.062411 | orchestrator | testbed-node-3 : ok=43  changed=5  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-24 06:48:13.062420 | orchestrator | testbed-node-4 : ok=37  changed=4  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-24 06:48:13.062436 | orchestrator | testbed-node-5 : ok=37  changed=4  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-24 06:48:13.062444 | orchestrator | 2026-04-24 06:48:13.062453 | orchestrator | 2026-04-24 06:48:13.062462 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:48:13.062470 | orchestrator | Friday 24 April 2026 06:48:12 +0000 (0:00:15.527) 0:07:53.592 ********** 2026-04-24 06:48:13.062479 | orchestrator | =============================================================================== 2026-04-24 06:48:13.062493 | orchestrator | nova-cell : Reload nova cell services to remove RPC version cap -------- 48.92s 2026-04-24 06:48:13.062502 | orchestrator | nova : Reload nova API services to remove RPC version pin -------------- 21.05s 2026-04-24 06:48:13.062510 | orchestrator | nova : Run Nova upgrade checks ----------------------------------------- 19.82s 2026-04-24 06:48:13.062519 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 19.63s 2026-04-24 06:48:13.062527 | orchestrator | nova : Run Nova API online database migrations ------------------------- 19.34s 2026-04-24 06:48:13.062536 | orchestrator | nova-cell : Run Nova cell online database migrations ------------------- 15.53s 2026-04-24 06:48:13.062545 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 13.86s 2026-04-24 06:48:13.062553 | orchestrator | nova : Copying over nova.conf ------------------------------------------ 10.25s 2026-04-24 06:48:13.062562 | orchestrator | nova-cell : Copying over nova.conf -------------------------------------- 9.96s 2026-04-24 06:48:13.062570 | orchestrator | nova-cell : Copying files for nova-ssh ---------------------------------- 8.71s 2026-04-24 06:48:13.062579 | orchestrator | service-check-containers : nova_cell | Check containers ----------------- 7.40s 2026-04-24 06:48:13.062587 | orchestrator | nova-cell : Copying over config.json files for services ----------------- 6.56s 2026-04-24 06:48:13.062596 | orchestrator | service-cert-copy : nova | Copying over extra CA certificates ----------- 6.56s 2026-04-24 06:48:13.062604 | orchestrator | nova-cell : Copying over libvirt SASL configuration --------------------- 6.53s 2026-04-24 06:48:13.062613 | orchestrator | nova-cell : Flush handlers ---------------------------------------------- 5.23s 2026-04-24 06:48:13.062621 | orchestrator | service-check-containers : nova | Check containers ---------------------- 5.10s 2026-04-24 06:48:13.062630 | orchestrator | nova-cell : Get container facts ----------------------------------------- 5.10s 2026-04-24 06:48:13.062638 | orchestrator | nova-cell : Copying over libvirt configuration -------------------------- 4.84s 2026-04-24 06:48:13.062647 | orchestrator | nova-cell : Get current Libvirt version --------------------------------- 4.81s 2026-04-24 06:48:13.062656 | orchestrator | nova-cell : Copy over ceph.conf ----------------------------------------- 4.80s 2026-04-24 06:48:13.332343 | orchestrator | + osism apply -a upgrade horizon 2026-04-24 06:48:14.723603 | orchestrator | 2026-04-24 06:48:14 | INFO  | Prepare task for execution of horizon. 2026-04-24 06:48:14.797123 | orchestrator | 2026-04-24 06:48:14 | INFO  | Task 98243ad7-4435-4221-a6ab-63d032e950f5 (horizon) was prepared for execution. 2026-04-24 06:48:14.797239 | orchestrator | 2026-04-24 06:48:14 | INFO  | It takes a moment until task 98243ad7-4435-4221-a6ab-63d032e950f5 (horizon) has been started and output is visible here. 2026-04-24 06:48:30.159808 | orchestrator | 2026-04-24 06:48:30.159957 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:48:30.159989 | orchestrator | 2026-04-24 06:48:30.160009 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:48:30.160027 | orchestrator | Friday 24 April 2026 06:48:20 +0000 (0:00:02.031) 0:00:02.031 ********** 2026-04-24 06:48:30.160046 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:48:30.160068 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:48:30.160086 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:48:30.160106 | orchestrator | 2026-04-24 06:48:30.160124 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:48:30.160179 | orchestrator | Friday 24 April 2026 06:48:22 +0000 (0:00:01.768) 0:00:03.799 ********** 2026-04-24 06:48:30.160199 | orchestrator | ok: [testbed-node-0] => (item=enable_horizon_True) 2026-04-24 06:48:30.160218 | orchestrator | ok: [testbed-node-1] => (item=enable_horizon_True) 2026-04-24 06:48:30.160236 | orchestrator | ok: [testbed-node-2] => (item=enable_horizon_True) 2026-04-24 06:48:30.160255 | orchestrator | 2026-04-24 06:48:30.160275 | orchestrator | PLAY [Apply role horizon] ****************************************************** 2026-04-24 06:48:30.160295 | orchestrator | 2026-04-24 06:48:30.160315 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 06:48:30.160333 | orchestrator | Friday 24 April 2026 06:48:23 +0000 (0:00:01.805) 0:00:05.605 ********** 2026-04-24 06:48:30.160352 | orchestrator | included: /ansible/roles/horizon/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:48:30.160372 | orchestrator | 2026-04-24 06:48:30.160390 | orchestrator | TASK [horizon : Ensuring config directories exist] ***************************** 2026-04-24 06:48:30.160408 | orchestrator | Friday 24 April 2026 06:48:27 +0000 (0:00:03.299) 0:00:08.904 ********** 2026-04-24 06:48:30.160457 | orchestrator | ok: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:48:30.160559 | orchestrator | ok: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:48:30.160614 | orchestrator | ok: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:48:30.160638 | orchestrator | 2026-04-24 06:48:30.160657 | orchestrator | TASK [horizon : Set empty custom policy] *************************************** 2026-04-24 06:48:30.160676 | orchestrator | Friday 24 April 2026 06:48:29 +0000 (0:00:02.435) 0:00:11.340 ********** 2026-04-24 06:48:30.160704 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:48:30.160723 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:48:30.160743 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:48:30.160792 | orchestrator | 2026-04-24 06:48:30.160825 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 06:48:58.227907 | orchestrator | Friday 24 April 2026 06:48:31 +0000 (0:00:01.493) 0:00:12.834 ********** 2026-04-24 06:48:58.228046 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-24 06:48:58.228072 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-24 06:48:58.228090 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'ironic', 'enabled': False})  2026-04-24 06:48:58.228106 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'masakari', 'enabled': False})  2026-04-24 06:48:58.228123 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'mistral', 'enabled': False})  2026-04-24 06:48:58.228140 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'tacker', 'enabled': False})  2026-04-24 06:48:58.228157 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'trove', 'enabled': False})  2026-04-24 06:48:58.228174 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'watcher', 'enabled': False})  2026-04-24 06:48:58.228191 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-24 06:48:58.228208 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-24 06:48:58.228223 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'ironic', 'enabled': False})  2026-04-24 06:48:58.228239 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'masakari', 'enabled': False})  2026-04-24 06:48:58.228249 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'mistral', 'enabled': False})  2026-04-24 06:48:58.228259 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'tacker', 'enabled': False})  2026-04-24 06:48:58.228269 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'trove', 'enabled': False})  2026-04-24 06:48:58.228278 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'watcher', 'enabled': False})  2026-04-24 06:48:58.228288 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-24 06:48:58.228297 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-24 06:48:58.228307 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'ironic', 'enabled': False})  2026-04-24 06:48:58.228316 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'masakari', 'enabled': False})  2026-04-24 06:48:58.228326 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'mistral', 'enabled': False})  2026-04-24 06:48:58.228335 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'tacker', 'enabled': False})  2026-04-24 06:48:58.228361 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'trove', 'enabled': False})  2026-04-24 06:48:58.228371 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'watcher', 'enabled': False})  2026-04-24 06:48:58.228382 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'ceilometer', 'enabled': 'yes'}) 2026-04-24 06:48:58.228396 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'cinder', 'enabled': 'yes'}) 2026-04-24 06:48:58.228407 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'designate', 'enabled': True}) 2026-04-24 06:48:58.228418 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'glance', 'enabled': True}) 2026-04-24 06:48:58.228430 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'keystone', 'enabled': True}) 2026-04-24 06:48:58.228468 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'magnum', 'enabled': True}) 2026-04-24 06:48:58.228480 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'manila', 'enabled': True}) 2026-04-24 06:48:58.228492 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'neutron', 'enabled': True}) 2026-04-24 06:48:58.228504 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova', 'enabled': True}) 2026-04-24 06:48:58.228517 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'octavia', 'enabled': True}) 2026-04-24 06:48:58.228528 | orchestrator | 2026-04-24 06:48:58.228541 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:48:58.228559 | orchestrator | Friday 24 April 2026 06:48:33 +0000 (0:00:02.354) 0:00:15.188 ********** 2026-04-24 06:48:58.228575 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:48:58.228594 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:48:58.228612 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:48:58.228628 | orchestrator | 2026-04-24 06:48:58.228661 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:48:58.228674 | orchestrator | Friday 24 April 2026 06:48:35 +0000 (0:00:01.458) 0:00:16.647 ********** 2026-04-24 06:48:58.228685 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.228697 | orchestrator | 2026-04-24 06:48:58.228709 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:48:58.228720 | orchestrator | Friday 24 April 2026 06:48:36 +0000 (0:00:01.152) 0:00:17.800 ********** 2026-04-24 06:48:58.228731 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.228773 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:58.228790 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:48:58.228836 | orchestrator | 2026-04-24 06:48:58.228847 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:48:58.228857 | orchestrator | Friday 24 April 2026 06:48:37 +0000 (0:00:01.473) 0:00:19.273 ********** 2026-04-24 06:48:58.228866 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:48:58.228876 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:48:58.228885 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:48:58.228895 | orchestrator | 2026-04-24 06:48:58.228904 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:48:58.228914 | orchestrator | Friday 24 April 2026 06:48:39 +0000 (0:00:01.744) 0:00:21.018 ********** 2026-04-24 06:48:58.228923 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.228932 | orchestrator | 2026-04-24 06:48:58.228942 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:48:58.228952 | orchestrator | Friday 24 April 2026 06:48:40 +0000 (0:00:01.196) 0:00:22.215 ********** 2026-04-24 06:48:58.228962 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.228972 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:58.228981 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:48:58.228991 | orchestrator | 2026-04-24 06:48:58.229000 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:48:58.229010 | orchestrator | Friday 24 April 2026 06:48:42 +0000 (0:00:01.487) 0:00:23.703 ********** 2026-04-24 06:48:58.229020 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:48:58.229029 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:48:58.229039 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:48:58.229048 | orchestrator | 2026-04-24 06:48:58.229058 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:48:58.229067 | orchestrator | Friday 24 April 2026 06:48:43 +0000 (0:00:01.433) 0:00:25.137 ********** 2026-04-24 06:48:58.229086 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.229096 | orchestrator | 2026-04-24 06:48:58.229105 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:48:58.229115 | orchestrator | Friday 24 April 2026 06:48:44 +0000 (0:00:01.172) 0:00:26.309 ********** 2026-04-24 06:48:58.229124 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.229134 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:58.229143 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:48:58.229153 | orchestrator | 2026-04-24 06:48:58.229162 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:48:58.229178 | orchestrator | Friday 24 April 2026 06:48:46 +0000 (0:00:01.834) 0:00:28.144 ********** 2026-04-24 06:48:58.229188 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:48:58.229198 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:48:58.229208 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:48:58.229217 | orchestrator | 2026-04-24 06:48:58.229227 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:48:58.229236 | orchestrator | Friday 24 April 2026 06:48:47 +0000 (0:00:01.438) 0:00:29.582 ********** 2026-04-24 06:48:58.229245 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.229255 | orchestrator | 2026-04-24 06:48:58.229265 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:48:58.229274 | orchestrator | Friday 24 April 2026 06:48:49 +0000 (0:00:01.156) 0:00:30.739 ********** 2026-04-24 06:48:58.229284 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.229293 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:58.229303 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:48:58.229312 | orchestrator | 2026-04-24 06:48:58.229322 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:48:58.229331 | orchestrator | Friday 24 April 2026 06:48:50 +0000 (0:00:01.405) 0:00:32.144 ********** 2026-04-24 06:48:58.229341 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:48:58.229350 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:48:58.229360 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:48:58.229376 | orchestrator | 2026-04-24 06:48:58.229398 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:48:58.229422 | orchestrator | Friday 24 April 2026 06:48:52 +0000 (0:00:01.728) 0:00:33.873 ********** 2026-04-24 06:48:58.229438 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.229454 | orchestrator | 2026-04-24 06:48:58.229470 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:48:58.229486 | orchestrator | Friday 24 April 2026 06:48:53 +0000 (0:00:01.186) 0:00:35.059 ********** 2026-04-24 06:48:58.229502 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.229519 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:58.229535 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:48:58.229552 | orchestrator | 2026-04-24 06:48:58.229569 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:48:58.229585 | orchestrator | Friday 24 April 2026 06:48:54 +0000 (0:00:01.465) 0:00:36.525 ********** 2026-04-24 06:48:58.229603 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:48:58.229620 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:48:58.229637 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:48:58.229654 | orchestrator | 2026-04-24 06:48:58.229671 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:48:58.229688 | orchestrator | Friday 24 April 2026 06:48:56 +0000 (0:00:01.565) 0:00:38.091 ********** 2026-04-24 06:48:58.229704 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.229721 | orchestrator | 2026-04-24 06:48:58.229763 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:48:58.229780 | orchestrator | Friday 24 April 2026 06:48:57 +0000 (0:00:01.168) 0:00:39.259 ********** 2026-04-24 06:48:58.229796 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:48:58.229812 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:48:58.229841 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:34.916338 | orchestrator | 2026-04-24 06:49:34.916423 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:49:34.916435 | orchestrator | Friday 24 April 2026 06:48:59 +0000 (0:00:01.773) 0:00:41.032 ********** 2026-04-24 06:49:34.916444 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:49:34.916452 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:49:34.916460 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:49:34.916468 | orchestrator | 2026-04-24 06:49:34.916477 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:49:34.916484 | orchestrator | Friday 24 April 2026 06:49:00 +0000 (0:00:01.596) 0:00:42.629 ********** 2026-04-24 06:49:34.916492 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.916501 | orchestrator | 2026-04-24 06:49:34.916509 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:49:34.916517 | orchestrator | Friday 24 April 2026 06:49:02 +0000 (0:00:01.206) 0:00:43.835 ********** 2026-04-24 06:49:34.916524 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.916532 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:49:34.916540 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:34.916548 | orchestrator | 2026-04-24 06:49:34.916556 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:49:34.916564 | orchestrator | Friday 24 April 2026 06:49:03 +0000 (0:00:01.471) 0:00:45.307 ********** 2026-04-24 06:49:34.916572 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:49:34.916580 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:49:34.916588 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:49:34.916596 | orchestrator | 2026-04-24 06:49:34.916604 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:49:34.916612 | orchestrator | Friday 24 April 2026 06:49:05 +0000 (0:00:01.436) 0:00:46.744 ********** 2026-04-24 06:49:34.916620 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.916628 | orchestrator | 2026-04-24 06:49:34.916635 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:49:34.916643 | orchestrator | Friday 24 April 2026 06:49:06 +0000 (0:00:01.206) 0:00:47.951 ********** 2026-04-24 06:49:34.916651 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.916659 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:49:34.916667 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:34.916679 | orchestrator | 2026-04-24 06:49:34.916694 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:49:34.916757 | orchestrator | Friday 24 April 2026 06:49:07 +0000 (0:00:01.390) 0:00:49.341 ********** 2026-04-24 06:49:34.916775 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:49:34.916789 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:49:34.916802 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:49:34.916816 | orchestrator | 2026-04-24 06:49:34.916824 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:49:34.916832 | orchestrator | Friday 24 April 2026 06:49:09 +0000 (0:00:01.510) 0:00:50.852 ********** 2026-04-24 06:49:34.916840 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.916848 | orchestrator | 2026-04-24 06:49:34.916867 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:49:34.916875 | orchestrator | Friday 24 April 2026 06:49:10 +0000 (0:00:01.190) 0:00:52.042 ********** 2026-04-24 06:49:34.916883 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.916891 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:49:34.916899 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:34.916907 | orchestrator | 2026-04-24 06:49:34.916916 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-24 06:49:34.916925 | orchestrator | Friday 24 April 2026 06:49:11 +0000 (0:00:01.418) 0:00:53.461 ********** 2026-04-24 06:49:34.916933 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:49:34.916943 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:49:34.916952 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:49:34.916979 | orchestrator | 2026-04-24 06:49:34.916989 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-24 06:49:34.917000 | orchestrator | Friday 24 April 2026 06:49:13 +0000 (0:00:01.505) 0:00:54.966 ********** 2026-04-24 06:49:34.917010 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.917019 | orchestrator | 2026-04-24 06:49:34.917029 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-24 06:49:34.917039 | orchestrator | Friday 24 April 2026 06:49:14 +0000 (0:00:01.160) 0:00:56.127 ********** 2026-04-24 06:49:34.917049 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.917059 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:49:34.917069 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:34.917080 | orchestrator | 2026-04-24 06:49:34.917090 | orchestrator | TASK [horizon : Copying over config.json files for services] ******************* 2026-04-24 06:49:34.917098 | orchestrator | Friday 24 April 2026 06:49:16 +0000 (0:00:01.515) 0:00:57.643 ********** 2026-04-24 06:49:34.917107 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:49:34.917115 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:49:34.917124 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:49:34.917132 | orchestrator | 2026-04-24 06:49:34.917141 | orchestrator | TASK [horizon : Copying over horizon.conf] ************************************* 2026-04-24 06:49:34.917149 | orchestrator | Friday 24 April 2026 06:49:19 +0000 (0:00:03.184) 0:01:00.828 ********** 2026-04-24 06:49:34.917158 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-24 06:49:34.917167 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-24 06:49:34.917176 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-24 06:49:34.917184 | orchestrator | 2026-04-24 06:49:34.917193 | orchestrator | TASK [horizon : Copying over kolla-settings.py] ******************************** 2026-04-24 06:49:34.917201 | orchestrator | Friday 24 April 2026 06:49:22 +0000 (0:00:03.138) 0:01:03.967 ********** 2026-04-24 06:49:34.917210 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-24 06:49:34.917219 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-24 06:49:34.917243 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-24 06:49:34.917252 | orchestrator | 2026-04-24 06:49:34.917261 | orchestrator | TASK [horizon : Copying over custom-settings.py] ******************************* 2026-04-24 06:49:34.917270 | orchestrator | Friday 24 April 2026 06:49:25 +0000 (0:00:03.119) 0:01:07.087 ********** 2026-04-24 06:49:34.917278 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-24 06:49:34.917287 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-24 06:49:34.917296 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-24 06:49:34.917304 | orchestrator | 2026-04-24 06:49:34.917313 | orchestrator | TASK [horizon : Copying over existing policy file] ***************************** 2026-04-24 06:49:34.917321 | orchestrator | Friday 24 April 2026 06:49:28 +0000 (0:00:02.712) 0:01:09.799 ********** 2026-04-24 06:49:34.917330 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.917339 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:49:34.917347 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:34.917356 | orchestrator | 2026-04-24 06:49:34.917364 | orchestrator | TASK [horizon : Copying over custom themes] ************************************ 2026-04-24 06:49:34.917373 | orchestrator | Friday 24 April 2026 06:49:29 +0000 (0:00:01.545) 0:01:11.345 ********** 2026-04-24 06:49:34.917381 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:34.917390 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:49:34.917398 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:34.917419 | orchestrator | 2026-04-24 06:49:34.917428 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 06:49:34.917451 | orchestrator | Friday 24 April 2026 06:49:31 +0000 (0:00:01.646) 0:01:12.991 ********** 2026-04-24 06:49:34.917461 | orchestrator | included: /ansible/roles/horizon/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:49:34.917469 | orchestrator | 2026-04-24 06:49:34.917478 | orchestrator | TASK [service-cert-copy : horizon | Copying over extra CA certificates] ******** 2026-04-24 06:49:34.917486 | orchestrator | Friday 24 April 2026 06:49:33 +0000 (0:00:02.050) 0:01:15.042 ********** 2026-04-24 06:49:34.917505 | orchestrator | ok: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:49:34.917527 | orchestrator | ok: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:49:36.927379 | orchestrator | ok: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:49:36.927487 | orchestrator | 2026-04-24 06:49:36.927522 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS certificate] *** 2026-04-24 06:49:36.927542 | orchestrator | Friday 24 April 2026 06:49:36 +0000 (0:00:02.846) 0:01:17.889 ********** 2026-04-24 06:49:36.927598 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:49:36.927652 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:36.927675 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:49:36.927693 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:49:36.927842 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:49:42.581305 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:42.581410 | orchestrator | 2026-04-24 06:49:42.581426 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS key] ***** 2026-04-24 06:49:42.581440 | orchestrator | Friday 24 April 2026 06:49:38 +0000 (0:00:01.905) 0:01:19.794 ********** 2026-04-24 06:49:42.581456 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:49:42.581498 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:42.581548 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:49:42.581563 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:49:42.581575 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:49:42.581596 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:49:42.581607 | orchestrator | 2026-04-24 06:49:42.581618 | orchestrator | TASK [service-check-containers : horizon | Check containers] ******************* 2026-04-24 06:49:42.581629 | orchestrator | Friday 24 April 2026 06:49:40 +0000 (0:00:02.489) 0:01:22.285 ********** 2026-04-24 06:49:42.581655 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:49:45.943888 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:49:45.944043 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-24 06:49:45.944075 | orchestrator | 2026-04-24 06:49:45.944089 | orchestrator | TASK [service-check-containers : horizon | Notify handlers to restart containers] *** 2026-04-24 06:49:45.944102 | orchestrator | Friday 24 April 2026 06:49:43 +0000 (0:00:03.170) 0:01:25.455 ********** 2026-04-24 06:49:45.944115 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 06:49:45.944126 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:49:45.944138 | orchestrator | } 2026-04-24 06:49:45.944149 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 06:49:45.944160 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:49:45.944171 | orchestrator | } 2026-04-24 06:49:45.944181 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 06:49:45.944192 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:49:45.944202 | orchestrator | } 2026-04-24 06:49:45.944213 | orchestrator | 2026-04-24 06:49:45.944224 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:49:45.944235 | orchestrator | Friday 24 April 2026 06:49:45 +0000 (0:00:01.593) 0:01:27.049 ********** 2026-04-24 06:49:45.944255 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:49:45.944268 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:49:45.944290 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:51:05.354089 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:51:05.354169 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-24 06:51:05.354197 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:51:05.354205 | orchestrator | 2026-04-24 06:51:05.354213 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 06:51:05.354220 | orchestrator | Friday 24 April 2026 06:49:47 +0000 (0:00:02.538) 0:01:29.588 ********** 2026-04-24 06:51:05.354226 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:51:05.354231 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:51:05.354237 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:51:05.354243 | orchestrator | 2026-04-24 06:51:05.354249 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-24 06:51:05.354255 | orchestrator | Friday 24 April 2026 06:49:49 +0000 (0:00:01.638) 0:01:31.226 ********** 2026-04-24 06:51:05.354261 | orchestrator | included: /ansible/roles/horizon/tasks/bootstrap_service.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:51:05.354267 | orchestrator | 2026-04-24 06:51:05.354273 | orchestrator | TASK [horizon : Running Horizon bootstrap container] *************************** 2026-04-24 06:51:05.354279 | orchestrator | Friday 24 April 2026 06:49:51 +0000 (0:00:01.859) 0:01:33.085 ********** 2026-04-24 06:51:05.354286 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:51:05.354292 | orchestrator | 2026-04-24 06:51:05.354299 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-24 06:51:05.354305 | orchestrator | Friday 24 April 2026 06:50:27 +0000 (0:00:36.496) 0:02:09.582 ********** 2026-04-24 06:51:05.354311 | orchestrator | 2026-04-24 06:51:05.354317 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-24 06:51:05.354323 | orchestrator | Friday 24 April 2026 06:50:28 +0000 (0:00:00.780) 0:02:10.362 ********** 2026-04-24 06:51:05.354329 | orchestrator | 2026-04-24 06:51:05.354334 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-24 06:51:05.354341 | orchestrator | Friday 24 April 2026 06:50:29 +0000 (0:00:00.565) 0:02:10.928 ********** 2026-04-24 06:51:05.354347 | orchestrator | 2026-04-24 06:51:05.354353 | orchestrator | RUNNING HANDLER [horizon : Restart horizon container] ************************** 2026-04-24 06:51:05.354359 | orchestrator | Friday 24 April 2026 06:50:30 +0000 (0:00:00.914) 0:02:11.843 ********** 2026-04-24 06:51:05.354365 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:51:05.354371 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:51:05.354377 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:51:05.354383 | orchestrator | 2026-04-24 06:51:05.354390 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:51:05.354397 | orchestrator | testbed-node-0 : ok=36  changed=6  unreachable=0 failed=0 skipped=26  rescued=0 ignored=0 2026-04-24 06:51:05.354416 | orchestrator | testbed-node-1 : ok=35  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-24 06:51:05.354423 | orchestrator | testbed-node-2 : ok=35  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-24 06:51:05.354430 | orchestrator | 2026-04-24 06:51:05.354437 | orchestrator | 2026-04-24 06:51:05.354443 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:51:05.354450 | orchestrator | Friday 24 April 2026 06:51:04 +0000 (0:00:34.664) 0:02:46.507 ********** 2026-04-24 06:51:05.354461 | orchestrator | =============================================================================== 2026-04-24 06:51:05.354468 | orchestrator | horizon : Running Horizon bootstrap container -------------------------- 36.50s 2026-04-24 06:51:05.354474 | orchestrator | horizon : Restart horizon container ------------------------------------ 34.66s 2026-04-24 06:51:05.354481 | orchestrator | horizon : include_tasks ------------------------------------------------- 3.30s 2026-04-24 06:51:05.354488 | orchestrator | horizon : Copying over config.json files for services ------------------- 3.18s 2026-04-24 06:51:05.354495 | orchestrator | service-check-containers : horizon | Check containers ------------------- 3.17s 2026-04-24 06:51:05.354508 | orchestrator | horizon : Copying over horizon.conf ------------------------------------- 3.14s 2026-04-24 06:51:05.354514 | orchestrator | horizon : Copying over kolla-settings.py -------------------------------- 3.12s 2026-04-24 06:51:05.354520 | orchestrator | service-cert-copy : horizon | Copying over extra CA certificates -------- 2.85s 2026-04-24 06:51:05.354527 | orchestrator | horizon : Copying over custom-settings.py ------------------------------- 2.71s 2026-04-24 06:51:05.354533 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.54s 2026-04-24 06:51:05.354538 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS key ----- 2.49s 2026-04-24 06:51:05.354544 | orchestrator | horizon : Ensuring config directories exist ----------------------------- 2.44s 2026-04-24 06:51:05.354550 | orchestrator | horizon : include_tasks ------------------------------------------------- 2.35s 2026-04-24 06:51:05.354556 | orchestrator | horizon : Flush handlers ------------------------------------------------ 2.26s 2026-04-24 06:51:05.354562 | orchestrator | horizon : include_tasks ------------------------------------------------- 2.05s 2026-04-24 06:51:05.354567 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS certificate --- 1.91s 2026-04-24 06:51:05.354574 | orchestrator | horizon : include_tasks ------------------------------------------------- 1.86s 2026-04-24 06:51:05.354580 | orchestrator | horizon : Update custom policy file name -------------------------------- 1.84s 2026-04-24 06:51:05.354586 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.81s 2026-04-24 06:51:05.354593 | orchestrator | horizon : Update custom policy file name -------------------------------- 1.77s 2026-04-24 06:51:05.601967 | orchestrator | + osism apply -a upgrade skyline 2026-04-24 06:51:06.992712 | orchestrator | 2026-04-24 06:51:06 | INFO  | Prepare task for execution of skyline. 2026-04-24 06:51:07.070973 | orchestrator | 2026-04-24 06:51:07 | INFO  | Task c4190486-372b-4dc6-9820-54d6cdd8d9b1 (skyline) was prepared for execution. 2026-04-24 06:51:07.071019 | orchestrator | 2026-04-24 06:51:07 | INFO  | It takes a moment until task c4190486-372b-4dc6-9820-54d6cdd8d9b1 (skyline) has been started and output is visible here. 2026-04-24 06:51:28.641282 | orchestrator | 2026-04-24 06:51:28.641404 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:51:28.641426 | orchestrator | 2026-04-24 06:51:28.641441 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:51:28.641455 | orchestrator | Friday 24 April 2026 06:51:12 +0000 (0:00:01.877) 0:00:01.877 ********** 2026-04-24 06:51:28.641469 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:51:28.641484 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:51:28.641498 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:51:28.641512 | orchestrator | 2026-04-24 06:51:28.641528 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:51:28.641542 | orchestrator | Friday 24 April 2026 06:51:14 +0000 (0:00:01.919) 0:00:03.797 ********** 2026-04-24 06:51:28.641557 | orchestrator | ok: [testbed-node-0] => (item=enable_skyline_True) 2026-04-24 06:51:28.641571 | orchestrator | ok: [testbed-node-1] => (item=enable_skyline_True) 2026-04-24 06:51:28.641585 | orchestrator | ok: [testbed-node-2] => (item=enable_skyline_True) 2026-04-24 06:51:28.641599 | orchestrator | 2026-04-24 06:51:28.641614 | orchestrator | PLAY [Apply role skyline] ****************************************************** 2026-04-24 06:51:28.641628 | orchestrator | 2026-04-24 06:51:28.641701 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-24 06:51:28.641717 | orchestrator | Friday 24 April 2026 06:51:17 +0000 (0:00:02.736) 0:00:06.533 ********** 2026-04-24 06:51:28.641732 | orchestrator | included: /ansible/roles/skyline/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:51:28.641748 | orchestrator | 2026-04-24 06:51:28.641762 | orchestrator | TASK [skyline : Ensuring config directories exist] ***************************** 2026-04-24 06:51:28.641776 | orchestrator | Friday 24 April 2026 06:51:21 +0000 (0:00:03.926) 0:00:10.459 ********** 2026-04-24 06:51:28.641845 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:28.641871 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:28.641918 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:28.641940 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:28.641978 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:28.641996 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:28.642013 | orchestrator | 2026-04-24 06:51:28.642091 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-24 06:51:28.642107 | orchestrator | Friday 24 April 2026 06:51:24 +0000 (0:00:03.385) 0:00:13.845 ********** 2026-04-24 06:51:28.642121 | orchestrator | included: /ansible/roles/skyline/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:51:28.642138 | orchestrator | 2026-04-24 06:51:28.642154 | orchestrator | TASK [service-cert-copy : skyline | Copying over extra CA certificates] ******** 2026-04-24 06:51:28.642171 | orchestrator | Friday 24 April 2026 06:51:27 +0000 (0:00:02.242) 0:00:16.088 ********** 2026-04-24 06:51:28.642204 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:31.536153 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:31.536369 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:31.536459 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:31.536511 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:31.536549 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:31.536572 | orchestrator | 2026-04-24 06:51:31.536592 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS certificate] *** 2026-04-24 06:51:31.536621 | orchestrator | Friday 24 April 2026 06:51:30 +0000 (0:00:03.764) 0:00:19.853 ********** 2026-04-24 06:51:31.536670 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:51:31.536693 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:51:31.536714 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:51:31.536750 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:51:33.397453 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:51:33.397583 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:51:33.397613 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:51:33.397635 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:51:33.397731 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:51:33.397750 | orchestrator | 2026-04-24 06:51:33.397768 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS key] ***** 2026-04-24 06:51:33.397819 | orchestrator | Friday 24 April 2026 06:51:32 +0000 (0:00:01.777) 0:00:21.630 ********** 2026-04-24 06:51:33.397869 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:51:33.397905 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:51:33.397926 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:51:33.397949 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:51:33.397973 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:51:33.398009 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:51:33.398232 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:51:43.716400 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:51:43.717293 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:51:43.717331 | orchestrator | 2026-04-24 06:51:43.717343 | orchestrator | TASK [skyline : Copying over skyline.yaml files for services] ****************** 2026-04-24 06:51:43.717354 | orchestrator | Friday 24 April 2026 06:51:34 +0000 (0:00:01.987) 0:00:23.618 ********** 2026-04-24 06:51:43.717366 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:43.717399 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:43.717423 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:43.717430 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:43.717436 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:43.717446 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:43.717452 | orchestrator | 2026-04-24 06:51:43.717457 | orchestrator | TASK [skyline : Copying over gunicorn.py files for services] ******************* 2026-04-24 06:51:43.717462 | orchestrator | Friday 24 April 2026 06:51:38 +0000 (0:00:04.053) 0:00:27.671 ********** 2026-04-24 06:51:43.717467 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-24 06:51:43.717474 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-24 06:51:43.717479 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-24 06:51:43.717484 | orchestrator | 2026-04-24 06:51:43.717489 | orchestrator | TASK [skyline : Copying over nginx.conf files for services] ******************** 2026-04-24 06:51:43.717494 | orchestrator | Friday 24 April 2026 06:51:41 +0000 (0:00:02.912) 0:00:30.584 ********** 2026-04-24 06:51:43.717502 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-24 06:51:52.899127 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-24 06:51:52.899192 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-24 06:51:52.899202 | orchestrator | 2026-04-24 06:51:52.899209 | orchestrator | TASK [skyline : Copying over config.json files for services] ******************* 2026-04-24 06:51:52.899216 | orchestrator | Friday 24 April 2026 06:51:45 +0000 (0:00:03.487) 0:00:34.071 ********** 2026-04-24 06:51:52.899231 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:52.899241 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:52.899265 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:52.899287 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:52.899295 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:52.899303 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:52.899314 | orchestrator | 2026-04-24 06:51:52.899321 | orchestrator | TASK [skyline : Copying over custom logos] ************************************* 2026-04-24 06:51:52.899328 | orchestrator | Friday 24 April 2026 06:51:49 +0000 (0:00:04.331) 0:00:38.403 ********** 2026-04-24 06:51:52.899335 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:51:52.899343 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:51:52.899350 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:51:52.899355 | orchestrator | 2026-04-24 06:51:52.899382 | orchestrator | TASK [service-check-containers : skyline | Check containers] ******************* 2026-04-24 06:51:52.899390 | orchestrator | Friday 24 April 2026 06:51:51 +0000 (0:00:02.014) 0:00:40.418 ********** 2026-04-24 06:51:52.899397 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:52.899413 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:57.236500 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-24 06:51:57.236691 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:57.236713 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:57.236756 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-24 06:51:57.236766 | orchestrator | 2026-04-24 06:51:57.236780 | orchestrator | TASK [service-check-containers : skyline | Notify handlers to restart containers] *** 2026-04-24 06:51:57.236788 | orchestrator | Friday 24 April 2026 06:51:55 +0000 (0:00:03.648) 0:00:44.066 ********** 2026-04-24 06:51:57.236795 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 06:51:57.236801 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:51:57.236808 | orchestrator | } 2026-04-24 06:51:57.236814 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 06:51:57.236819 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:51:57.236825 | orchestrator | } 2026-04-24 06:51:57.236830 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 06:51:57.236855 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:51:57.236862 | orchestrator | } 2026-04-24 06:51:57.236868 | orchestrator | 2026-04-24 06:51:57.236874 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:51:57.236880 | orchestrator | Friday 24 April 2026 06:51:56 +0000 (0:00:01.445) 0:00:45.512 ********** 2026-04-24 06:51:57.236887 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:51:57.236894 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:51:57.236901 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:51:57.236913 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:51:57.236937 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:52:38.160121 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:52:38.160242 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-24 06:52:38.160264 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-24 06:52:38.160278 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:52:38.160291 | orchestrator | 2026-04-24 06:52:38.160304 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-24 06:52:38.160317 | orchestrator | Friday 24 April 2026 06:51:59 +0000 (0:00:02.540) 0:00:48.052 ********** 2026-04-24 06:52:38.160328 | orchestrator | 2026-04-24 06:52:38.160339 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-24 06:52:38.160350 | orchestrator | Friday 24 April 2026 06:51:59 +0000 (0:00:00.490) 0:00:48.543 ********** 2026-04-24 06:52:38.160386 | orchestrator | 2026-04-24 06:52:38.160398 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-24 06:52:38.160424 | orchestrator | Friday 24 April 2026 06:52:00 +0000 (0:00:00.493) 0:00:49.036 ********** 2026-04-24 06:52:38.160436 | orchestrator | 2026-04-24 06:52:38.160447 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-apiserver container] **************** 2026-04-24 06:52:38.160457 | orchestrator | Friday 24 April 2026 06:52:01 +0000 (0:00:00.929) 0:00:49.965 ********** 2026-04-24 06:52:38.160468 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:52:38.160479 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:52:38.160490 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:52:38.160500 | orchestrator | 2026-04-24 06:52:38.160511 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-console container] ****************** 2026-04-24 06:52:38.160522 | orchestrator | Friday 24 April 2026 06:52:19 +0000 (0:00:18.588) 0:01:08.554 ********** 2026-04-24 06:52:38.160533 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:52:38.160544 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:52:38.160554 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:52:38.160567 | orchestrator | 2026-04-24 06:52:38.160585 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:52:38.160628 | orchestrator | testbed-node-0 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 06:52:38.160642 | orchestrator | testbed-node-1 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 06:52:38.160654 | orchestrator | testbed-node-2 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 06:52:38.160667 | orchestrator | 2026-04-24 06:52:38.160679 | orchestrator | 2026-04-24 06:52:38.160692 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:52:38.160705 | orchestrator | Friday 24 April 2026 06:52:37 +0000 (0:00:17.899) 0:01:26.454 ********** 2026-04-24 06:52:38.160717 | orchestrator | =============================================================================== 2026-04-24 06:52:38.160748 | orchestrator | skyline : Restart skyline-apiserver container -------------------------- 18.59s 2026-04-24 06:52:38.160762 | orchestrator | skyline : Restart skyline-console container ---------------------------- 17.90s 2026-04-24 06:52:38.160774 | orchestrator | skyline : Copying over config.json files for services ------------------- 4.33s 2026-04-24 06:52:38.160787 | orchestrator | skyline : Copying over skyline.yaml files for services ------------------ 4.05s 2026-04-24 06:52:38.160799 | orchestrator | skyline : include_tasks ------------------------------------------------- 3.93s 2026-04-24 06:52:38.160812 | orchestrator | service-cert-copy : skyline | Copying over extra CA certificates -------- 3.76s 2026-04-24 06:52:38.160824 | orchestrator | service-check-containers : skyline | Check containers ------------------- 3.65s 2026-04-24 06:52:38.160837 | orchestrator | skyline : Copying over nginx.conf files for services -------------------- 3.49s 2026-04-24 06:52:38.160850 | orchestrator | skyline : Ensuring config directories exist ----------------------------- 3.39s 2026-04-24 06:52:38.160862 | orchestrator | skyline : Copying over gunicorn.py files for services ------------------- 2.91s 2026-04-24 06:52:38.160874 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.74s 2026-04-24 06:52:38.160887 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.54s 2026-04-24 06:52:38.160899 | orchestrator | skyline : include_tasks ------------------------------------------------- 2.24s 2026-04-24 06:52:38.160912 | orchestrator | skyline : Copying over custom logos ------------------------------------- 2.01s 2026-04-24 06:52:38.160924 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS key ----- 1.99s 2026-04-24 06:52:38.160937 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.92s 2026-04-24 06:52:38.160949 | orchestrator | skyline : Flush handlers ------------------------------------------------ 1.91s 2026-04-24 06:52:38.160970 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS certificate --- 1.78s 2026-04-24 06:52:38.161008 | orchestrator | service-check-containers : skyline | Notify handlers to restart containers --- 1.45s 2026-04-24 06:52:38.457231 | orchestrator | + osism apply -a upgrade glance 2026-04-24 06:52:40.040450 | orchestrator | 2026-04-24 06:52:40 | INFO  | Prepare task for execution of glance. 2026-04-24 06:52:40.167209 | orchestrator | 2026-04-24 06:52:40 | INFO  | Task 1024b0d8-55f5-44c6-a91c-40cee78b60a6 (glance) was prepared for execution. 2026-04-24 06:52:40.167326 | orchestrator | 2026-04-24 06:52:40 | INFO  | It takes a moment until task 1024b0d8-55f5-44c6-a91c-40cee78b60a6 (glance) has been started and output is visible here. 2026-04-24 06:53:35.540027 | orchestrator | 2026-04-24 06:53:35.540106 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:53:35.540114 | orchestrator | 2026-04-24 06:53:35.540119 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:53:35.540123 | orchestrator | Friday 24 April 2026 06:52:46 +0000 (0:00:01.870) 0:00:01.870 ********** 2026-04-24 06:53:35.540128 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:53:35.540134 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:53:35.540138 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:53:35.540141 | orchestrator | 2026-04-24 06:53:35.540145 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:53:35.540149 | orchestrator | Friday 24 April 2026 06:52:48 +0000 (0:00:02.014) 0:00:03.884 ********** 2026-04-24 06:53:35.540153 | orchestrator | ok: [testbed-node-0] => (item=enable_glance_True) 2026-04-24 06:53:35.540158 | orchestrator | ok: [testbed-node-1] => (item=enable_glance_True) 2026-04-24 06:53:35.540162 | orchestrator | ok: [testbed-node-2] => (item=enable_glance_True) 2026-04-24 06:53:35.540166 | orchestrator | 2026-04-24 06:53:35.540182 | orchestrator | PLAY [Apply role glance] ******************************************************* 2026-04-24 06:53:35.540186 | orchestrator | 2026-04-24 06:53:35.540189 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:53:35.540193 | orchestrator | Friday 24 April 2026 06:52:50 +0000 (0:00:01.978) 0:00:05.863 ********** 2026-04-24 06:53:35.540198 | orchestrator | included: /ansible/roles/glance/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:53:35.540203 | orchestrator | 2026-04-24 06:53:35.540207 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:53:35.540210 | orchestrator | Friday 24 April 2026 06:52:53 +0000 (0:00:03.388) 0:00:09.252 ********** 2026-04-24 06:53:35.540214 | orchestrator | included: /ansible/roles/glance/tasks/rolling_upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:53:35.540218 | orchestrator | 2026-04-24 06:53:35.540222 | orchestrator | TASK [glance : Start Glance upgrade] ******************************************* 2026-04-24 06:53:35.540226 | orchestrator | Friday 24 April 2026 06:52:57 +0000 (0:00:03.478) 0:00:12.730 ********** 2026-04-24 06:53:35.540230 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:53:35.540234 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:53:35.540238 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:53:35.540242 | orchestrator | 2026-04-24 06:53:35.540246 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:53:35.540250 | orchestrator | Friday 24 April 2026 06:52:59 +0000 (0:00:01.917) 0:00:14.648 ********** 2026-04-24 06:53:35.540254 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:53:35.540259 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:53:35.540263 | orchestrator | included: /ansible/roles/glance/tasks/config.yml for testbed-node-0 2026-04-24 06:53:35.540266 | orchestrator | 2026-04-24 06:53:35.540270 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-24 06:53:35.540274 | orchestrator | Friday 24 April 2026 06:53:01 +0000 (0:00:02.267) 0:00:16.915 ********** 2026-04-24 06:53:35.540281 | orchestrator | ok: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:53:35.540302 | orchestrator | 2026-04-24 06:53:35.540307 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:53:35.540310 | orchestrator | Friday 24 April 2026 06:53:07 +0000 (0:00:05.963) 0:00:22.879 ********** 2026-04-24 06:53:35.540314 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-0 2026-04-24 06:53:35.540318 | orchestrator | 2026-04-24 06:53:35.540332 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-24 06:53:35.540336 | orchestrator | Friday 24 April 2026 06:53:09 +0000 (0:00:01.627) 0:00:24.507 ********** 2026-04-24 06:53:35.540340 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:53:35.540343 | orchestrator | 2026-04-24 06:53:35.540347 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-24 06:53:35.540351 | orchestrator | Friday 24 April 2026 06:53:14 +0000 (0:00:05.282) 0:00:29.790 ********** 2026-04-24 06:53:35.540355 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-24 06:53:35.540360 | orchestrator | 2026-04-24 06:53:35.540364 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-24 06:53:35.540367 | orchestrator | Friday 24 April 2026 06:53:17 +0000 (0:00:03.161) 0:00:32.952 ********** 2026-04-24 06:53:35.540374 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-24 06:53:35.540378 | orchestrator | 2026-04-24 06:53:35.540382 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-24 06:53:35.540386 | orchestrator | Friday 24 April 2026 06:53:19 +0000 (0:00:02.294) 0:00:35.246 ********** 2026-04-24 06:53:35.540389 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:53:35.540393 | orchestrator | 2026-04-24 06:53:35.540397 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-24 06:53:35.540401 | orchestrator | Friday 24 April 2026 06:53:21 +0000 (0:00:01.737) 0:00:36.984 ********** 2026-04-24 06:53:35.540404 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:53:35.540408 | orchestrator | 2026-04-24 06:53:35.540412 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-24 06:53:35.540415 | orchestrator | Friday 24 April 2026 06:53:22 +0000 (0:00:01.379) 0:00:38.363 ********** 2026-04-24 06:53:35.540419 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:53:35.540426 | orchestrator | 2026-04-24 06:53:35.540430 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:53:35.540434 | orchestrator | Friday 24 April 2026 06:53:24 +0000 (0:00:01.347) 0:00:39.711 ********** 2026-04-24 06:53:35.540437 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-0 2026-04-24 06:53:35.540441 | orchestrator | 2026-04-24 06:53:35.540445 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-24 06:53:35.540449 | orchestrator | Friday 24 April 2026 06:53:25 +0000 (0:00:01.716) 0:00:41.427 ********** 2026-04-24 06:53:35.540453 | orchestrator | ok: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:53:35.540457 | orchestrator | 2026-04-24 06:53:35.540461 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-24 06:53:35.540465 | orchestrator | Friday 24 April 2026 06:53:31 +0000 (0:00:05.936) 0:00:47.363 ********** 2026-04-24 06:53:35.540476 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:55:44.517006 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517076 | orchestrator | 2026-04-24 06:55:44.517085 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-24 06:55:44.517093 | orchestrator | Friday 24 April 2026 06:53:36 +0000 (0:00:04.808) 0:00:52.172 ********** 2026-04-24 06:55:44.517102 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:55:44.517112 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517118 | orchestrator | 2026-04-24 06:55:44.517125 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-24 06:55:44.517132 | orchestrator | Friday 24 April 2026 06:53:41 +0000 (0:00:04.610) 0:00:56.783 ********** 2026-04-24 06:55:44.517138 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517145 | orchestrator | 2026-04-24 06:55:44.517151 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-24 06:55:44.517158 | orchestrator | Friday 24 April 2026 06:53:46 +0000 (0:00:05.160) 0:01:01.943 ********** 2026-04-24 06:55:44.517185 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:55:44.517207 | orchestrator | 2026-04-24 06:55:44.517214 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-24 06:55:44.517220 | orchestrator | Friday 24 April 2026 06:53:52 +0000 (0:00:06.058) 0:01:08.001 ********** 2026-04-24 06:55:44.517227 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:55:44.517233 | orchestrator | 2026-04-24 06:55:44.517240 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-24 06:55:44.517246 | orchestrator | Friday 24 April 2026 06:53:59 +0000 (0:00:07.143) 0:01:15.145 ********** 2026-04-24 06:55:44.517253 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517259 | orchestrator | 2026-04-24 06:55:44.517266 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-24 06:55:44.517272 | orchestrator | Friday 24 April 2026 06:54:04 +0000 (0:00:04.350) 0:01:19.495 ********** 2026-04-24 06:55:44.517279 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517285 | orchestrator | 2026-04-24 06:55:44.517292 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-24 06:55:44.517298 | orchestrator | Friday 24 April 2026 06:54:08 +0000 (0:00:04.597) 0:01:24.093 ********** 2026-04-24 06:55:44.517304 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517311 | orchestrator | 2026-04-24 06:55:44.517317 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-24 06:55:44.517324 | orchestrator | Friday 24 April 2026 06:54:13 +0000 (0:00:04.653) 0:01:28.746 ********** 2026-04-24 06:55:44.517330 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517337 | orchestrator | 2026-04-24 06:55:44.517343 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-24 06:55:44.517350 | orchestrator | Friday 24 April 2026 06:54:14 +0000 (0:00:01.208) 0:01:29.955 ********** 2026-04-24 06:55:44.517356 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-24 06:55:44.517363 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517369 | orchestrator | 2026-04-24 06:55:44.517390 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-24 06:55:44.517398 | orchestrator | Friday 24 April 2026 06:54:19 +0000 (0:00:05.207) 0:01:35.162 ********** 2026-04-24 06:55:44.517404 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517410 | orchestrator | 2026-04-24 06:55:44.517417 | orchestrator | TASK [glance : Generating 'hostid' file for glance_api] ************************ 2026-04-24 06:55:44.517423 | orchestrator | Friday 24 April 2026 06:54:24 +0000 (0:00:05.007) 0:01:40.169 ********** 2026-04-24 06:55:44.517430 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517436 | orchestrator | 2026-04-24 06:55:44.517443 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:55:44.517449 | orchestrator | Friday 24 April 2026 06:54:29 +0000 (0:00:05.017) 0:01:45.187 ********** 2026-04-24 06:55:44.517456 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:55:44.517462 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:55:44.517469 | orchestrator | included: /ansible/roles/glance/tasks/stop_service.yml for testbed-node-0 2026-04-24 06:55:44.517476 | orchestrator | 2026-04-24 06:55:44.517482 | orchestrator | TASK [glance : Stop glance service] ******************************************** 2026-04-24 06:55:44.517494 | orchestrator | Friday 24 April 2026 06:54:31 +0000 (0:00:02.140) 0:01:47.328 ********** 2026-04-24 06:55:44.517500 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:55:44.517506 | orchestrator | 2026-04-24 06:55:44.517513 | orchestrator | TASK [glance : Enable log_bin_trust_function_creators function] **************** 2026-04-24 06:55:44.517519 | orchestrator | Friday 24 April 2026 06:54:46 +0000 (0:00:14.689) 0:02:02.017 ********** 2026-04-24 06:55:44.517526 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:55:44.517532 | orchestrator | 2026-04-24 06:55:44.517539 | orchestrator | TASK [glance : Running Glance database expand container] *********************** 2026-04-24 06:55:44.517545 | orchestrator | Friday 24 April 2026 06:54:50 +0000 (0:00:03.631) 0:02:05.649 ********** 2026-04-24 06:55:44.517552 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:55:44.517558 | orchestrator | 2026-04-24 06:55:44.517565 | orchestrator | TASK [glance : Running Glance database migrate container] ********************** 2026-04-24 06:55:44.517571 | orchestrator | Friday 24 April 2026 06:55:19 +0000 (0:00:29.339) 0:02:34.988 ********** 2026-04-24 06:55:44.517577 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:55:44.517584 | orchestrator | 2026-04-24 06:55:44.517591 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:55:44.517598 | orchestrator | Friday 24 April 2026 06:55:38 +0000 (0:00:19.170) 0:02:54.158 ********** 2026-04-24 06:55:44.517605 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:55:44.517612 | orchestrator | included: /ansible/roles/glance/tasks/config.yml for testbed-node-1, testbed-node-2 2026-04-24 06:55:44.517620 | orchestrator | 2026-04-24 06:55:44.517627 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-24 06:55:44.517634 | orchestrator | Friday 24 April 2026 06:55:40 +0000 (0:00:01.743) 0:02:55.902 ********** 2026-04-24 06:55:44.517654 | orchestrator | ok: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:56:15.200194 | orchestrator | ok: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:56:15.200434 | orchestrator | 2026-04-24 06:56:15.200454 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:56:15.200462 | orchestrator | Friday 24 April 2026 06:55:45 +0000 (0:00:05.451) 0:03:01.353 ********** 2026-04-24 06:56:15.200468 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-1, testbed-node-2 2026-04-24 06:56:15.200542 | orchestrator | 2026-04-24 06:56:15.200548 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-24 06:56:15.200553 | orchestrator | Friday 24 April 2026 06:55:47 +0000 (0:00:01.306) 0:03:02.660 ********** 2026-04-24 06:56:15.200559 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:56:15.200566 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:56:15.200572 | orchestrator | 2026-04-24 06:56:15.200577 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-24 06:56:15.200584 | orchestrator | Friday 24 April 2026 06:55:53 +0000 (0:00:06.395) 0:03:09.056 ********** 2026-04-24 06:56:15.200607 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-24 06:56:15.200615 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-24 06:56:15.200620 | orchestrator | 2026-04-24 06:56:15.200626 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-24 06:56:15.200632 | orchestrator | Friday 24 April 2026 06:55:56 +0000 (0:00:02.859) 0:03:11.916 ********** 2026-04-24 06:56:15.200638 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-24 06:56:15.200644 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-24 06:56:15.200650 | orchestrator | 2026-04-24 06:56:15.200656 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-24 06:56:15.200661 | orchestrator | Friday 24 April 2026 06:55:59 +0000 (0:00:02.902) 0:03:14.818 ********** 2026-04-24 06:56:15.200666 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:56:15.200672 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:56:15.200678 | orchestrator | 2026-04-24 06:56:15.200684 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-24 06:56:15.200690 | orchestrator | Friday 24 April 2026 06:56:01 +0000 (0:00:02.270) 0:03:17.088 ********** 2026-04-24 06:56:15.200697 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:56:15.200704 | orchestrator | 2026-04-24 06:56:15.200710 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-24 06:56:15.200715 | orchestrator | Friday 24 April 2026 06:56:03 +0000 (0:00:01.365) 0:03:18.453 ********** 2026-04-24 06:56:15.200734 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:56:15.200740 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:56:15.200747 | orchestrator | 2026-04-24 06:56:15.200753 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:56:15.200759 | orchestrator | Friday 24 April 2026 06:56:04 +0000 (0:00:01.251) 0:03:19.705 ********** 2026-04-24 06:56:15.200766 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-1, testbed-node-2 2026-04-24 06:56:15.200772 | orchestrator | 2026-04-24 06:56:15.200801 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-24 06:56:15.200808 | orchestrator | Friday 24 April 2026 06:56:05 +0000 (0:00:01.367) 0:03:21.073 ********** 2026-04-24 06:56:15.200818 | orchestrator | ok: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:56:15.200832 | orchestrator | ok: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:56:15.200844 | orchestrator | 2026-04-24 06:56:15.200851 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-24 06:56:15.200858 | orchestrator | Friday 24 April 2026 06:56:11 +0000 (0:00:05.397) 0:03:26.471 ********** 2026-04-24 06:56:15.200873 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:56:30.114496 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:56:30.114567 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:56:30.114588 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:56:30.114594 | orchestrator | 2026-04-24 06:56:30.114599 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-24 06:56:30.114606 | orchestrator | Friday 24 April 2026 06:56:17 +0000 (0:00:06.161) 0:03:32.632 ********** 2026-04-24 06:56:30.114612 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:56:30.114617 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:56:30.114634 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:56:30.114640 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:56:30.114649 | orchestrator | 2026-04-24 06:56:30.114654 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-24 06:56:30.114659 | orchestrator | Friday 24 April 2026 06:56:21 +0000 (0:00:04.323) 0:03:36.956 ********** 2026-04-24 06:56:30.114664 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:56:30.114669 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:56:30.114674 | orchestrator | 2026-04-24 06:56:30.114679 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-24 06:56:30.114684 | orchestrator | Friday 24 April 2026 06:56:26 +0000 (0:00:04.530) 0:03:41.486 ********** 2026-04-24 06:56:30.114689 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:56:30.114702 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:57:25.236778 | orchestrator | 2026-04-24 06:57:25.236899 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-24 06:57:25.236919 | orchestrator | Friday 24 April 2026 06:56:31 +0000 (0:00:05.189) 0:03:46.675 ********** 2026-04-24 06:57:25.236932 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:57:25.236944 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:57:25.236956 | orchestrator | 2026-04-24 06:57:25.236968 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-24 06:57:25.236977 | orchestrator | Friday 24 April 2026 06:56:38 +0000 (0:00:07.313) 0:03:53.989 ********** 2026-04-24 06:57:25.236984 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:57:25.236990 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:57:25.236997 | orchestrator | 2026-04-24 06:57:25.237004 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-24 06:57:25.237011 | orchestrator | Friday 24 April 2026 06:56:43 +0000 (0:00:04.944) 0:03:58.934 ********** 2026-04-24 06:57:25.237018 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:57:25.237025 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:57:25.237032 | orchestrator | 2026-04-24 06:57:25.237038 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-24 06:57:25.237045 | orchestrator | Friday 24 April 2026 06:56:48 +0000 (0:00:05.213) 0:04:04.148 ********** 2026-04-24 06:57:25.237051 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:57:25.237058 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:57:25.237065 | orchestrator | 2026-04-24 06:57:25.237071 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-24 06:57:25.237078 | orchestrator | Friday 24 April 2026 06:56:54 +0000 (0:00:05.493) 0:04:09.641 ********** 2026-04-24 06:57:25.237084 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:57:25.237091 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:57:25.237098 | orchestrator | 2026-04-24 06:57:25.237105 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-24 06:57:25.237111 | orchestrator | Friday 24 April 2026 06:56:55 +0000 (0:00:01.455) 0:04:11.097 ********** 2026-04-24 06:57:25.237118 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-24 06:57:25.237126 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:57:25.237132 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-24 06:57:25.237139 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:57:25.237146 | orchestrator | 2026-04-24 06:57:25.237152 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-24 06:57:25.237159 | orchestrator | Friday 24 April 2026 06:57:01 +0000 (0:00:05.713) 0:04:16.810 ********** 2026-04-24 06:57:25.237165 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:57:25.237172 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:57:25.237179 | orchestrator | 2026-04-24 06:57:25.237185 | orchestrator | TASK [glance : Generating 'hostid' file for glance_api] ************************ 2026-04-24 06:57:25.237290 | orchestrator | Friday 24 April 2026 06:57:06 +0000 (0:00:05.617) 0:04:22.427 ********** 2026-04-24 06:57:25.237298 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:57:25.237305 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:57:25.237313 | orchestrator | 2026-04-24 06:57:25.237321 | orchestrator | TASK [service-check-containers : glance | Check containers] ******************** 2026-04-24 06:57:25.237330 | orchestrator | Friday 24 April 2026 06:57:13 +0000 (0:00:06.418) 0:04:28.846 ********** 2026-04-24 06:57:25.237358 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:57:25.237429 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:57:25.237445 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-24 06:57:25.237466 | orchestrator | 2026-04-24 06:57:25.237478 | orchestrator | TASK [service-check-containers : glance | Notify handlers to restart containers] *** 2026-04-24 06:57:25.237491 | orchestrator | Friday 24 April 2026 06:57:19 +0000 (0:00:06.227) 0:04:35.074 ********** 2026-04-24 06:57:25.237503 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 06:57:25.237515 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:57:25.237527 | orchestrator | } 2026-04-24 06:57:25.237539 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 06:57:25.237550 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:57:25.237563 | orchestrator | } 2026-04-24 06:57:25.237576 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 06:57:25.237584 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 06:57:25.237592 | orchestrator | } 2026-04-24 06:57:25.237599 | orchestrator | 2026-04-24 06:57:25.237607 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 06:57:25.237615 | orchestrator | Friday 24 April 2026 06:57:21 +0000 (0:00:01.534) 0:04:36.608 ********** 2026-04-24 06:57:25.237632 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:58:44.377343 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:58:44.377503 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:58:44.377523 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:58:44.377549 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-24 06:58:44.377560 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:58:44.377570 | orchestrator | 2026-04-24 06:58:44.377580 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-24 06:58:44.377591 | orchestrator | Friday 24 April 2026 06:57:27 +0000 (0:00:05.911) 0:04:42.520 ********** 2026-04-24 06:58:44.377600 | orchestrator | 2026-04-24 06:58:44.377609 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-24 06:58:44.377619 | orchestrator | Friday 24 April 2026 06:57:27 +0000 (0:00:00.496) 0:04:43.016 ********** 2026-04-24 06:58:44.377628 | orchestrator | 2026-04-24 06:58:44.377636 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-24 06:58:44.377665 | orchestrator | Friday 24 April 2026 06:57:28 +0000 (0:00:00.479) 0:04:43.496 ********** 2026-04-24 06:58:44.377686 | orchestrator | 2026-04-24 06:58:44.377702 | orchestrator | RUNNING HANDLER [glance : Restart glance-api container] ************************ 2026-04-24 06:58:44.377712 | orchestrator | Friday 24 April 2026 06:57:28 +0000 (0:00:00.907) 0:04:44.403 ********** 2026-04-24 06:58:44.377722 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:58:44.377730 | orchestrator | changed: [testbed-node-1] 2026-04-24 06:58:44.377739 | orchestrator | changed: [testbed-node-2] 2026-04-24 06:58:44.377749 | orchestrator | 2026-04-24 06:58:44.377757 | orchestrator | TASK [glance : Running Glance database contract container] ********************* 2026-04-24 06:58:44.377766 | orchestrator | Friday 24 April 2026 06:58:18 +0000 (0:00:49.512) 0:05:33.915 ********** 2026-04-24 06:58:44.377775 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:58:44.377784 | orchestrator | 2026-04-24 06:58:44.377793 | orchestrator | TASK [glance : Disable log_bin_trust_function_creators function] *************** 2026-04-24 06:58:44.377802 | orchestrator | Friday 24 April 2026 06:58:36 +0000 (0:00:18.465) 0:05:52.381 ********** 2026-04-24 06:58:44.377812 | orchestrator | changed: [testbed-node-0] 2026-04-24 06:58:44.377822 | orchestrator | 2026-04-24 06:58:44.377832 | orchestrator | TASK [glance : Finish Glance upgrade] ****************************************** 2026-04-24 06:58:44.377843 | orchestrator | Friday 24 April 2026 06:58:40 +0000 (0:00:03.118) 0:05:55.500 ********** 2026-04-24 06:58:44.377853 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:58:44.377863 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:58:44.377872 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:58:44.377881 | orchestrator | 2026-04-24 06:58:44.377887 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-24 06:58:44.377893 | orchestrator | Friday 24 April 2026 06:58:41 +0000 (0:00:01.694) 0:05:57.194 ********** 2026-04-24 06:58:44.377902 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:58:44.377915 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:58:44.377927 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:58:44.377935 | orchestrator | 2026-04-24 06:58:44.377945 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 06:58:44.377956 | orchestrator | testbed-node-0 : ok=27  changed=11  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-24 06:58:44.377967 | orchestrator | testbed-node-1 : ok=20  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-24 06:58:44.377976 | orchestrator | testbed-node-2 : ok=20  changed=5  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-24 06:58:44.377984 | orchestrator | 2026-04-24 06:58:44.377994 | orchestrator | 2026-04-24 06:58:44.378003 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 06:58:44.378012 | orchestrator | Friday 24 April 2026 06:58:43 +0000 (0:00:01.983) 0:05:59.178 ********** 2026-04-24 06:58:44.378098 | orchestrator | =============================================================================== 2026-04-24 06:58:44.378112 | orchestrator | glance : Restart glance-api container ---------------------------------- 49.51s 2026-04-24 06:58:44.378124 | orchestrator | glance : Running Glance database expand container ---------------------- 29.34s 2026-04-24 06:58:44.378139 | orchestrator | glance : Running Glance database migrate container --------------------- 19.17s 2026-04-24 06:58:44.378147 | orchestrator | glance : Running Glance database contract container -------------------- 18.47s 2026-04-24 06:58:44.378156 | orchestrator | glance : Stop glance service ------------------------------------------- 14.69s 2026-04-24 06:58:44.378165 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 7.31s 2026-04-24 06:58:44.378174 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 7.14s 2026-04-24 06:58:44.378182 | orchestrator | glance : Generating 'hostid' file for glance_api ------------------------ 6.42s 2026-04-24 06:58:44.378191 | orchestrator | glance : Ensuring glance service ceph config subdir exists -------------- 6.40s 2026-04-24 06:58:44.378216 | orchestrator | service-check-containers : glance | Check containers -------------------- 6.23s 2026-04-24 06:58:44.378225 | orchestrator | service-cert-copy : glance | Copying over backend internal TLS certificate --- 6.16s 2026-04-24 06:58:44.378236 | orchestrator | glance : Copying over config.json files for services -------------------- 6.06s 2026-04-24 06:58:44.378244 | orchestrator | glance : Ensuring config directories exist ------------------------------ 5.96s 2026-04-24 06:58:44.378253 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 5.94s 2026-04-24 06:58:44.378262 | orchestrator | service-check-containers : Include tasks -------------------------------- 5.91s 2026-04-24 06:58:44.378270 | orchestrator | glance : Copying over glance-haproxy-tls.cfg ---------------------------- 5.71s 2026-04-24 06:58:44.378279 | orchestrator | glance : Generating 'hostnqn' file for glance_api ----------------------- 5.62s 2026-04-24 06:58:44.378288 | orchestrator | glance : Copying over property-protections-rules.conf ------------------- 5.49s 2026-04-24 06:58:44.378296 | orchestrator | glance : Ensuring config directories exist ------------------------------ 5.45s 2026-04-24 06:58:44.378305 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 5.40s 2026-04-24 06:58:44.744549 | orchestrator | + osism apply -a upgrade cinder 2026-04-24 06:58:46.340618 | orchestrator | 2026-04-24 06:58:46 | INFO  | Prepare task for execution of cinder. 2026-04-24 06:58:46.416773 | orchestrator | 2026-04-24 06:58:46 | INFO  | Task 38d1b91a-edc5-4c7b-8dd2-04d2f5028e24 (cinder) was prepared for execution. 2026-04-24 06:58:46.416864 | orchestrator | 2026-04-24 06:58:46 | INFO  | It takes a moment until task 38d1b91a-edc5-4c7b-8dd2-04d2f5028e24 (cinder) has been started and output is visible here. 2026-04-24 06:59:14.842984 | orchestrator | 2026-04-24 06:59:14.843145 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 06:59:14.843171 | orchestrator | 2026-04-24 06:59:14.843192 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 06:59:14.843210 | orchestrator | Friday 24 April 2026 06:58:53 +0000 (0:00:02.389) 0:00:02.390 ********** 2026-04-24 06:59:14.843228 | orchestrator | ok: [testbed-node-0] 2026-04-24 06:59:14.843245 | orchestrator | ok: [testbed-node-1] 2026-04-24 06:59:14.843256 | orchestrator | ok: [testbed-node-2] 2026-04-24 06:59:14.843265 | orchestrator | 2026-04-24 06:59:14.843275 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 06:59:14.843284 | orchestrator | Friday 24 April 2026 06:58:55 +0000 (0:00:02.556) 0:00:04.946 ********** 2026-04-24 06:59:14.843294 | orchestrator | ok: [testbed-node-0] => (item=enable_cinder_True) 2026-04-24 06:59:14.843304 | orchestrator | ok: [testbed-node-1] => (item=enable_cinder_True) 2026-04-24 06:59:14.843313 | orchestrator | ok: [testbed-node-2] => (item=enable_cinder_True) 2026-04-24 06:59:14.843323 | orchestrator | 2026-04-24 06:59:14.843332 | orchestrator | PLAY [Apply role cinder] ******************************************************* 2026-04-24 06:59:14.843342 | orchestrator | 2026-04-24 06:59:14.843351 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 06:59:14.843360 | orchestrator | Friday 24 April 2026 06:58:58 +0000 (0:00:02.663) 0:00:07.610 ********** 2026-04-24 06:59:14.843370 | orchestrator | included: /ansible/roles/cinder/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 06:59:14.843381 | orchestrator | 2026-04-24 06:59:14.843390 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 06:59:14.843400 | orchestrator | Friday 24 April 2026 06:59:02 +0000 (0:00:04.329) 0:00:11.940 ********** 2026-04-24 06:59:14.843409 | orchestrator | skipping: [testbed-node-1] 2026-04-24 06:59:14.843419 | orchestrator | skipping: [testbed-node-2] 2026-04-24 06:59:14.843429 | orchestrator | included: /ansible/roles/cinder/tasks/config.yml for testbed-node-0 2026-04-24 06:59:14.843438 | orchestrator | 2026-04-24 06:59:14.843448 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-24 06:59:14.843457 | orchestrator | Friday 24 April 2026 06:59:04 +0000 (0:00:02.303) 0:00:14.243 ********** 2026-04-24 06:59:14.843507 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:59:14.843524 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:59:14.843537 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 06:59:14.843568 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 06:59:14.843580 | orchestrator | 2026-04-24 06:59:14.843591 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 06:59:14.843602 | orchestrator | Friday 24 April 2026 06:59:08 +0000 (0:00:03.879) 0:00:18.122 ********** 2026-04-24 06:59:14.843613 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:59:14.843625 | orchestrator | 2026-04-24 06:59:14.843636 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 06:59:14.843647 | orchestrator | Friday 24 April 2026 06:59:10 +0000 (0:00:01.233) 0:00:19.356 ********** 2026-04-24 06:59:14.843657 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0 2026-04-24 06:59:14.843668 | orchestrator | 2026-04-24 06:59:14.843679 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-24 06:59:14.843690 | orchestrator | Friday 24 April 2026 06:59:11 +0000 (0:00:01.613) 0:00:20.969 ********** 2026-04-24 06:59:14.843706 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-24 06:59:14.843718 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-24 06:59:14.843729 | orchestrator | 2026-04-24 06:59:14.843740 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-24 06:59:14.843751 | orchestrator | Friday 24 April 2026 06:59:14 +0000 (0:00:02.722) 0:00:23.692 ********** 2026-04-24 06:59:14.843768 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-24 06:59:14.843782 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-24 06:59:14.843803 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-24 06:59:37.018413 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-24 06:59:37.018505 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-24 06:59:37.018530 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-24 06:59:37.018540 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-24 06:59:37.018563 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-24 06:59:37.018574 | orchestrator | 2026-04-24 06:59:37.018584 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-24 06:59:37.018593 | orchestrator | Friday 24 April 2026 06:59:21 +0000 (0:00:06.630) 0:00:30.322 ********** 2026-04-24 06:59:37.018609 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-24 06:59:37.018618 | orchestrator | 2026-04-24 06:59:37.018626 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-24 06:59:37.018634 | orchestrator | Friday 24 April 2026 06:59:23 +0000 (0:00:02.620) 0:00:32.943 ********** 2026-04-24 06:59:37.018643 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-24 06:59:37.018652 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-24 06:59:37.018661 | orchestrator | 2026-04-24 06:59:37.018670 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-24 06:59:37.018677 | orchestrator | Friday 24 April 2026 06:59:27 +0000 (0:00:04.000) 0:00:36.943 ********** 2026-04-24 06:59:37.018686 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-24 06:59:37.018695 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-24 06:59:37.018702 | orchestrator | 2026-04-24 06:59:37.018710 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-24 06:59:37.018718 | orchestrator | Friday 24 April 2026 06:59:29 +0000 (0:00:02.112) 0:00:39.056 ********** 2026-04-24 06:59:37.018726 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:59:37.018734 | orchestrator | 2026-04-24 06:59:37.018742 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-24 06:59:37.018750 | orchestrator | Friday 24 April 2026 06:59:31 +0000 (0:00:01.366) 0:00:40.423 ********** 2026-04-24 06:59:37.018758 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:59:37.018766 | orchestrator | 2026-04-24 06:59:37.018774 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 06:59:37.018787 | orchestrator | Friday 24 April 2026 06:59:32 +0000 (0:00:01.303) 0:00:41.726 ********** 2026-04-24 06:59:37.018796 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0 2026-04-24 06:59:37.018804 | orchestrator | 2026-04-24 06:59:37.018812 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-24 06:59:37.018821 | orchestrator | Friday 24 April 2026 06:59:34 +0000 (0:00:01.788) 0:00:43.514 ********** 2026-04-24 06:59:37.018831 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 06:59:37.018842 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 06:59:37.018865 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 06:59:44.586651 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 06:59:44.586703 | orchestrator | 2026-04-24 06:59:44.586715 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-24 06:59:44.586726 | orchestrator | Friday 24 April 2026 06:59:39 +0000 (0:00:04.858) 0:00:48.372 ********** 2026-04-24 06:59:44.586755 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:59:44.586767 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:59:44.586777 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 06:59:44.586810 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 06:59:44.586819 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:59:44.586828 | orchestrator | 2026-04-24 06:59:44.586848 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-24 06:59:44.586855 | orchestrator | Friday 24 April 2026 06:59:40 +0000 (0:00:01.869) 0:00:50.242 ********** 2026-04-24 06:59:44.586861 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 06:59:44.586871 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 06:59:44.586877 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 06:59:44.586882 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 06:59:44.586893 | orchestrator | skipping: [testbed-node-0] 2026-04-24 06:59:44.586898 | orchestrator | 2026-04-24 06:59:44.586904 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-24 06:59:44.586909 | orchestrator | Friday 24 April 2026 06:59:42 +0000 (0:00:01.882) 0:00:52.125 ********** 2026-04-24 06:59:44.586940 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:00:18.513531 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:00:18.513610 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:00:18.513622 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:00:18.513644 | orchestrator | 2026-04-24 07:00:18.513652 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-24 07:00:18.513659 | orchestrator | Friday 24 April 2026 06:59:48 +0000 (0:00:05.907) 0:00:58.033 ********** 2026-04-24 07:00:18.513666 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-24 07:00:18.513673 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:00:18.513680 | orchestrator | 2026-04-24 07:00:18.513686 | orchestrator | TASK [Configure uWSGI for Cinder] ********************************************** 2026-04-24 07:00:18.513692 | orchestrator | Friday 24 April 2026 06:59:50 +0000 (0:00:01.678) 0:00:59.711 ********** 2026-04-24 07:00:18.513699 | orchestrator | included: service-uwsgi-config for testbed-node-0 2026-04-24 07:00:18.513705 | orchestrator | 2026-04-24 07:00:18.513711 | orchestrator | TASK [service-uwsgi-config : Copying over cinder-api uWSGI config] ************* 2026-04-24 07:00:18.513718 | orchestrator | Friday 24 April 2026 06:59:52 +0000 (0:00:02.285) 0:01:01.997 ********** 2026-04-24 07:00:18.513724 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:00:18.513730 | orchestrator | 2026-04-24 07:00:18.513736 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-24 07:00:18.513743 | orchestrator | Friday 24 April 2026 06:59:55 +0000 (0:00:03.118) 0:01:05.116 ********** 2026-04-24 07:00:18.513751 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:00:18.513772 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:00:18.513783 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:00:18.513790 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:00:18.513802 | orchestrator | 2026-04-24 07:00:18.513809 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-24 07:00:18.513816 | orchestrator | Friday 24 April 2026 07:00:11 +0000 (0:00:15.712) 0:01:20.828 ********** 2026-04-24 07:00:18.513822 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:00:18.513877 | orchestrator | 2026-04-24 07:00:18.513885 | orchestrator | TASK [cinder : Generating 'hostid' file for cinder_volume] ********************* 2026-04-24 07:00:18.513892 | orchestrator | Friday 24 April 2026 07:00:14 +0000 (0:00:02.558) 0:01:23.386 ********** 2026-04-24 07:00:18.513898 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:00:18.513905 | orchestrator | 2026-04-24 07:00:18.513911 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-24 07:00:18.513918 | orchestrator | Friday 24 April 2026 07:00:17 +0000 (0:00:03.464) 0:01:26.850 ********** 2026-04-24 07:00:18.513926 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:00:18.513941 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:01:04.816451 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:01:04.816568 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:01:04.816598 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:01:04.816605 | orchestrator | 2026-04-24 07:01:04.816622 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-24 07:01:04.816631 | orchestrator | Friday 24 April 2026 07:00:19 +0000 (0:00:02.398) 0:01:29.249 ********** 2026-04-24 07:01:04.816637 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:01:04.816643 | orchestrator | 2026-04-24 07:01:04.816649 | orchestrator | TASK [cinder : Running Cinder bootstrap container] ***************************** 2026-04-24 07:01:04.816655 | orchestrator | Friday 24 April 2026 07:00:21 +0000 (0:00:01.651) 0:01:30.901 ********** 2026-04-24 07:01:04.816661 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:01:04.816666 | orchestrator | 2026-04-24 07:01:04.816672 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-24 07:01:04.816678 | orchestrator | Friday 24 April 2026 07:01:02 +0000 (0:00:41.230) 0:02:12.131 ********** 2026-04-24 07:01:04.816687 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:01:04.816754 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:01:04.816763 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:04.816784 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:01:04.816792 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:04.816798 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:04.816805 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:04.816819 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:13.810268 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:13.810336 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:13.810346 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:13.810354 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:13.810362 | orchestrator | 2026-04-24 07:01:13.810369 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 07:01:13.810378 | orchestrator | Friday 24 April 2026 07:01:06 +0000 (0:00:03.851) 0:02:15.983 ********** 2026-04-24 07:01:13.810385 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:01:13.810391 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:01:13.810398 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:01:13.810404 | orchestrator | 2026-04-24 07:01:13.810411 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 07:01:13.810417 | orchestrator | Friday 24 April 2026 07:01:08 +0000 (0:00:01.771) 0:02:17.755 ********** 2026-04-24 07:01:13.810424 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:01:13.810430 | orchestrator | 2026-04-24 07:01:13.810437 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-24 07:01:13.810443 | orchestrator | Friday 24 April 2026 07:01:10 +0000 (0:00:01.588) 0:02:19.343 ********** 2026-04-24 07:01:13.810464 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-24 07:01:13.810472 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-24 07:01:13.810479 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-24 07:01:13.810485 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-24 07:01:13.810491 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-24 07:01:13.810497 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-24 07:01:13.810503 | orchestrator | 2026-04-24 07:01:13.810510 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-24 07:01:13.810516 | orchestrator | Friday 24 April 2026 07:01:13 +0000 (0:00:03.151) 0:02:22.495 ********** 2026-04-24 07:01:13.810540 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-24 07:01:13.810549 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-24 07:01:13.810557 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-24 07:01:13.810564 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-24 07:01:13.810583 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-24 07:01:15.328071 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-24 07:01:15.328134 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-24 07:01:15.328146 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-24 07:01:15.328183 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-24 07:01:15.328202 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-24 07:01:15.328210 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-24 07:01:15.328217 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-24 07:01:15.328229 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-24 07:01:15.328244 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-24 07:01:18.825021 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-24 07:01:18.826112 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-24 07:01:18.826178 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-24 07:01:18.826213 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-24 07:01:18.826259 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-24 07:01:18.826269 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-24 07:01:18.826275 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-24 07:01:18.826287 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-24 07:01:18.826294 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-24 07:01:18.826310 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-24 07:01:37.944895 | orchestrator | 2026-04-24 07:01:37.944997 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-24 07:01:37.945011 | orchestrator | Friday 24 April 2026 07:01:20 +0000 (0:00:06.905) 0:02:29.400 ********** 2026-04-24 07:01:37.945021 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-24 07:01:37.945031 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-24 07:01:37.945039 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-24 07:01:37.945048 | orchestrator | 2026-04-24 07:01:37.945056 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-24 07:01:37.945064 | orchestrator | Friday 24 April 2026 07:01:23 +0000 (0:00:03.222) 0:02:32.622 ********** 2026-04-24 07:01:37.945085 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-24 07:01:37.945094 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-24 07:01:37.945135 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-24 07:01:37.945145 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-24 07:01:37.945155 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-24 07:01:37.945163 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-24 07:01:37.945171 | orchestrator | 2026-04-24 07:01:37.945179 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-24 07:01:37.945186 | orchestrator | Friday 24 April 2026 07:01:27 +0000 (0:00:04.218) 0:02:36.841 ********** 2026-04-24 07:01:37.945195 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-24 07:01:37.945203 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-24 07:01:37.945211 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-24 07:01:37.945219 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-24 07:01:37.945227 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-24 07:01:37.945234 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-24 07:01:37.945242 | orchestrator | 2026-04-24 07:01:37.945250 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-24 07:01:37.945258 | orchestrator | Friday 24 April 2026 07:01:29 +0000 (0:00:02.273) 0:02:39.114 ********** 2026-04-24 07:01:37.945266 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:01:37.945274 | orchestrator | 2026-04-24 07:01:37.945282 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-24 07:01:37.945290 | orchestrator | Friday 24 April 2026 07:01:31 +0000 (0:00:01.383) 0:02:40.498 ********** 2026-04-24 07:01:37.945298 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:01:37.945306 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:01:37.945314 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:01:37.945322 | orchestrator | 2026-04-24 07:01:37.945329 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-24 07:01:37.945337 | orchestrator | Friday 24 April 2026 07:01:33 +0000 (0:00:01.914) 0:02:42.412 ********** 2026-04-24 07:01:37.945347 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:01:37.945355 | orchestrator | 2026-04-24 07:01:37.945362 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-24 07:01:37.945370 | orchestrator | Friday 24 April 2026 07:01:34 +0000 (0:00:01.653) 0:02:44.066 ********** 2026-04-24 07:01:37.945412 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:01:37.945426 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:01:37.945442 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:01:37.945453 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:37.945467 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:37.945476 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:37.945492 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:41.389819 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:41.389920 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:41.389935 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:41.389961 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:41.389971 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:01:41.390003 | orchestrator | 2026-04-24 07:01:41.390058 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-24 07:01:41.390070 | orchestrator | Friday 24 April 2026 07:01:40 +0000 (0:00:05.641) 0:02:49.707 ********** 2026-04-24 07:01:41.390098 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:01:41.390111 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:01:41.390121 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:01:41.390143 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:01:41.390152 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:01:41.390161 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:01:41.390186 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397715 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397796 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397805 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:01:43.397827 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:01:43.397852 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397858 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397877 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397882 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:01:43.397888 | orchestrator | 2026-04-24 07:01:43.397893 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-24 07:01:43.397899 | orchestrator | Friday 24 April 2026 07:01:42 +0000 (0:00:02.337) 0:02:52.045 ********** 2026-04-24 07:01:43.397904 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:01:43.397913 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397922 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397927 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:01:43.397932 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:01:43.397942 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:01:46.817346 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:01:46.817490 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:01:46.817541 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:01:46.817559 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:01:46.817579 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:01:46.817595 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:01:46.817730 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:01:46.817742 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:01:46.817761 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:01:46.817771 | orchestrator | 2026-04-24 07:01:46.817781 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-24 07:01:46.817798 | orchestrator | Friday 24 April 2026 07:01:44 +0000 (0:00:01.909) 0:02:53.954 ********** 2026-04-24 07:01:46.817808 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:01:46.817819 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:01:46.817838 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:02:02.565239 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565387 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565401 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565413 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565424 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565448 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565458 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565479 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565489 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:02.565500 | orchestrator | 2026-04-24 07:02:02.565510 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-24 07:02:02.565521 | orchestrator | Friday 24 April 2026 07:01:50 +0000 (0:00:06.074) 0:03:00.028 ********** 2026-04-24 07:02:02.565530 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-24 07:02:02.565540 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:02:02.565550 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-24 07:02:02.565559 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:02:02.565568 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-24 07:02:02.565577 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:02:02.565663 | orchestrator | 2026-04-24 07:02:02.565675 | orchestrator | TASK [Configure uWSGI for Cinder] ********************************************** 2026-04-24 07:02:02.565693 | orchestrator | Friday 24 April 2026 07:01:52 +0000 (0:00:02.034) 0:03:02.063 ********** 2026-04-24 07:02:02.565702 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:02:02.565713 | orchestrator | 2026-04-24 07:02:02.565722 | orchestrator | TASK [service-uwsgi-config : Copying over cinder-api uWSGI config] ************* 2026-04-24 07:02:02.565731 | orchestrator | Friday 24 April 2026 07:01:54 +0000 (0:00:02.086) 0:03:04.150 ********** 2026-04-24 07:02:02.565740 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:02:02.565752 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:02:02.565761 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:02:02.565771 | orchestrator | 2026-04-24 07:02:02.565780 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-24 07:02:02.565790 | orchestrator | Friday 24 April 2026 07:01:58 +0000 (0:00:03.580) 0:03:07.731 ********** 2026-04-24 07:02:02.565812 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:02:13.302865 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:02:13.302955 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:02:13.302971 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:13.302981 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:13.303013 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:13.303045 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:13.303056 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:13.303065 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:13.303075 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:13.303092 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:13.303108 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:21.627839 | orchestrator | 2026-04-24 07:02:21.627941 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-24 07:02:21.627957 | orchestrator | Friday 24 April 2026 07:02:14 +0000 (0:00:16.165) 0:03:23.896 ********** 2026-04-24 07:02:21.627966 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:02:21.627977 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:02:21.627985 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:02:21.627994 | orchestrator | 2026-04-24 07:02:21.628003 | orchestrator | TASK [cinder : Generating 'hostid' file for cinder_volume] ********************* 2026-04-24 07:02:21.628012 | orchestrator | Friday 24 April 2026 07:02:17 +0000 (0:00:03.093) 0:03:26.990 ********** 2026-04-24 07:02:21.628036 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:02:21.628045 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:02:21.628056 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:02:21.628064 | orchestrator | 2026-04-24 07:02:21.628073 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-24 07:02:21.628081 | orchestrator | Friday 24 April 2026 07:02:20 +0000 (0:00:03.117) 0:03:30.108 ********** 2026-04-24 07:02:21.628095 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:02:21.628109 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:02:21.628142 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:02:21.628151 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:02:21.628159 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:02:21.628189 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:02:21.628198 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:02:21.628206 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:02:21.628223 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:02:21.628232 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:02:21.628242 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:02:21.628256 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:02:28.286357 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:02:28.286468 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:02:28.286514 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:02:28.286528 | orchestrator | 2026-04-24 07:02:28.286592 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-24 07:02:28.286606 | orchestrator | Friday 24 April 2026 07:02:22 +0000 (0:00:02.007) 0:03:32.115 ********** 2026-04-24 07:02:28.286617 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:02:28.286658 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:02:28.286670 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:02:28.286681 | orchestrator | 2026-04-24 07:02:28.286692 | orchestrator | TASK [service-check-containers : cinder | Check containers] ******************** 2026-04-24 07:02:28.286703 | orchestrator | Friday 24 April 2026 07:02:24 +0000 (0:00:01.973) 0:03:34.088 ********** 2026-04-24 07:02:28.286717 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:02:28.286748 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:02:28.286781 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:02:28.286805 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:28.286818 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:28.286829 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:28.286841 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:28.286866 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:33.293375 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:33.293647 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:33.293688 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:33.293702 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:02:33.293724 | orchestrator | 2026-04-24 07:02:33.293745 | orchestrator | TASK [service-check-containers : cinder | Notify handlers to restart containers] *** 2026-04-24 07:02:33.293768 | orchestrator | Friday 24 April 2026 07:02:30 +0000 (0:00:05.793) 0:03:39.882 ********** 2026-04-24 07:02:33.293787 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:02:33.293799 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:02:33.293811 | orchestrator | } 2026-04-24 07:02:33.293822 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:02:33.293837 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:02:33.293849 | orchestrator | } 2026-04-24 07:02:33.293862 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:02:33.293879 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:02:33.293896 | orchestrator | } 2026-04-24 07:02:33.293921 | orchestrator | 2026-04-24 07:02:33.293944 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:02:33.293963 | orchestrator | Friday 24 April 2026 07:02:32 +0000 (0:00:01.805) 0:03:41.688 ********** 2026-04-24 07:02:33.294170 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:02:33.294227 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:02:33.294249 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:02:33.294272 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:02:33.294292 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:02:33.294315 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:02:33.294359 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:05:04.831346 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:05:04.831453 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:05:04.831466 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:05:04.831478 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:05:04.831487 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:05:04.831510 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-24 07:05:04.831555 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-24 07:05:04.831562 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:05:04.831569 | orchestrator | 2026-04-24 07:05:04.831576 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-24 07:05:04.831583 | orchestrator | Friday 24 April 2026 07:02:34 +0000 (0:00:02.407) 0:03:44.096 ********** 2026-04-24 07:05:04.831589 | orchestrator | 2026-04-24 07:05:04.831595 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-24 07:05:04.831601 | orchestrator | Friday 24 April 2026 07:02:35 +0000 (0:00:00.492) 0:03:44.588 ********** 2026-04-24 07:05:04.831607 | orchestrator | 2026-04-24 07:05:04.831613 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-24 07:05:04.831618 | orchestrator | Friday 24 April 2026 07:02:36 +0000 (0:00:00.739) 0:03:45.328 ********** 2026-04-24 07:05:04.831669 | orchestrator | 2026-04-24 07:05:04.831676 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-api container] ************************ 2026-04-24 07:05:04.831681 | orchestrator | Friday 24 April 2026 07:02:36 +0000 (0:00:00.876) 0:03:46.204 ********** 2026-04-24 07:05:04.831686 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:05:04.831692 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:05:04.831698 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:05:04.831703 | orchestrator | 2026-04-24 07:05:04.831709 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-scheduler container] ****************** 2026-04-24 07:05:04.831714 | orchestrator | Friday 24 April 2026 07:03:10 +0000 (0:00:33.462) 0:04:19.667 ********** 2026-04-24 07:05:04.831720 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:05:04.831726 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:05:04.831731 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:05:04.831737 | orchestrator | 2026-04-24 07:05:04.831743 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-volume container] ********************* 2026-04-24 07:05:04.831749 | orchestrator | Friday 24 April 2026 07:03:25 +0000 (0:00:14.784) 0:04:34.451 ********** 2026-04-24 07:05:04.831755 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:05:04.831761 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:05:04.831766 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:05:04.831772 | orchestrator | 2026-04-24 07:05:04.831777 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-backup container] ********************* 2026-04-24 07:05:04.831783 | orchestrator | Friday 24 April 2026 07:04:05 +0000 (0:00:40.823) 0:05:15.274 ********** 2026-04-24 07:05:04.831788 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:05:04.831794 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:05:04.831800 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:05:04.831806 | orchestrator | 2026-04-24 07:05:04.831811 | orchestrator | RUNNING HANDLER [cinder : Wait for cinder services to update service versions] *** 2026-04-24 07:05:04.831818 | orchestrator | Friday 24 April 2026 07:04:26 +0000 (0:00:20.802) 0:05:36.077 ********** 2026-04-24 07:05:04.831824 | orchestrator | Pausing for 30 seconds 2026-04-24 07:05:04.831841 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:05:04.831847 | orchestrator | 2026-04-24 07:05:04.831854 | orchestrator | TASK [cinder : Reload cinder services to remove RPC version pin] *************** 2026-04-24 07:05:04.831860 | orchestrator | Friday 24 April 2026 07:04:58 +0000 (0:00:31.767) 0:06:07.844 ********** 2026-04-24 07:05:04.831875 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:05:04.831891 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:05:45.777299 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:05:45.777381 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777406 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777412 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777427 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777444 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777448 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777453 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777461 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777468 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-24 07:05:45.777472 | orchestrator | 2026-04-24 07:05:45.777477 | orchestrator | TASK [cinder : Running Cinder online schema migration] ************************* 2026-04-24 07:05:45.777482 | orchestrator | Friday 24 April 2026 07:05:28 +0000 (0:00:29.816) 0:06:37.661 ********** 2026-04-24 07:05:45.777486 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:05:45.777491 | orchestrator | 2026-04-24 07:05:45.777495 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:05:45.777499 | orchestrator | testbed-node-0 : ok=44  changed=13  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 07:05:45.777504 | orchestrator | testbed-node-1 : ok=25  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 07:05:45.777507 | orchestrator | testbed-node-2 : ok=25  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 07:05:45.777511 | orchestrator | 2026-04-24 07:05:45.777515 | orchestrator | 2026-04-24 07:05:45.777519 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:05:45.777525 | orchestrator | Friday 24 April 2026 07:05:45 +0000 (0:00:17.397) 0:06:55.058 ********** 2026-04-24 07:05:46.532052 | orchestrator | =============================================================================== 2026-04-24 07:05:46.532120 | orchestrator | cinder : Running Cinder bootstrap container ---------------------------- 41.23s 2026-04-24 07:05:46.532126 | orchestrator | cinder : Restart cinder-volume container ------------------------------- 40.82s 2026-04-24 07:05:46.532130 | orchestrator | cinder : Restart cinder-api container ---------------------------------- 33.46s 2026-04-24 07:05:46.532135 | orchestrator | cinder : Wait for cinder services to update service versions ----------- 31.77s 2026-04-24 07:05:46.532139 | orchestrator | cinder : Reload cinder services to remove RPC version pin -------------- 29.82s 2026-04-24 07:05:46.532143 | orchestrator | cinder : Restart cinder-backup container ------------------------------- 20.80s 2026-04-24 07:05:46.532148 | orchestrator | cinder : Running Cinder online schema migration ------------------------ 17.40s 2026-04-24 07:05:46.532152 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 16.17s 2026-04-24 07:05:46.532176 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 15.71s 2026-04-24 07:05:46.532181 | orchestrator | cinder : Restart cinder-scheduler container ---------------------------- 14.78s 2026-04-24 07:05:46.532185 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 6.91s 2026-04-24 07:05:46.532188 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 6.63s 2026-04-24 07:05:46.532192 | orchestrator | cinder : Copying over config.json files for services -------------------- 6.07s 2026-04-24 07:05:46.532196 | orchestrator | cinder : Copying over config.json files for services -------------------- 5.91s 2026-04-24 07:05:46.532200 | orchestrator | service-check-containers : cinder | Check containers -------------------- 5.79s 2026-04-24 07:05:46.532204 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 5.64s 2026-04-24 07:05:46.532208 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 4.86s 2026-04-24 07:05:46.532211 | orchestrator | cinder : include_tasks -------------------------------------------------- 4.33s 2026-04-24 07:05:46.532215 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 4.22s 2026-04-24 07:05:46.532219 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 4.00s 2026-04-24 07:05:46.907836 | orchestrator | + osism apply -a upgrade barbican 2026-04-24 07:05:48.668161 | orchestrator | 2026-04-24 07:05:48 | INFO  | Prepare task for execution of barbican. 2026-04-24 07:05:48.745432 | orchestrator | 2026-04-24 07:05:48 | INFO  | Task af1cd9c8-5964-4a4c-b07c-212b5435790e (barbican) was prepared for execution. 2026-04-24 07:05:48.745517 | orchestrator | 2026-04-24 07:05:48 | INFO  | It takes a moment until task af1cd9c8-5964-4a4c-b07c-212b5435790e (barbican) has been started and output is visible here. 2026-04-24 07:06:06.346299 | orchestrator | 2026-04-24 07:06:06.346382 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:06:06.346391 | orchestrator | 2026-04-24 07:06:06.346397 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:06:06.346403 | orchestrator | Friday 24 April 2026 07:05:55 +0000 (0:00:02.058) 0:00:02.058 ********** 2026-04-24 07:06:06.346408 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:06:06.346413 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:06:06.346418 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:06:06.346423 | orchestrator | 2026-04-24 07:06:06.346428 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:06:06.346432 | orchestrator | Friday 24 April 2026 07:05:57 +0000 (0:00:02.098) 0:00:04.156 ********** 2026-04-24 07:06:06.346437 | orchestrator | ok: [testbed-node-0] => (item=enable_barbican_True) 2026-04-24 07:06:06.346443 | orchestrator | ok: [testbed-node-1] => (item=enable_barbican_True) 2026-04-24 07:06:06.346448 | orchestrator | ok: [testbed-node-2] => (item=enable_barbican_True) 2026-04-24 07:06:06.346452 | orchestrator | 2026-04-24 07:06:06.346457 | orchestrator | PLAY [Apply role barbican] ***************************************************** 2026-04-24 07:06:06.346462 | orchestrator | 2026-04-24 07:06:06.346478 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-24 07:06:06.346483 | orchestrator | Friday 24 April 2026 07:06:00 +0000 (0:00:02.500) 0:00:06.657 ********** 2026-04-24 07:06:06.346489 | orchestrator | included: /ansible/roles/barbican/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:06:06.346494 | orchestrator | 2026-04-24 07:06:06.346498 | orchestrator | TASK [barbican : Ensuring config directories exist] **************************** 2026-04-24 07:06:06.346503 | orchestrator | Friday 24 April 2026 07:06:04 +0000 (0:00:04.245) 0:00:10.902 ********** 2026-04-24 07:06:06.346511 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:06.346543 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:06.346562 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:06.346572 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:06.346578 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:06.346587 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:06.346593 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:06.346599 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:06.346607 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:18.304654 | orchestrator | 2026-04-24 07:06:18.304792 | orchestrator | TASK [barbican : Ensuring vassals config directories exist] ******************** 2026-04-24 07:06:18.304804 | orchestrator | Friday 24 April 2026 07:06:07 +0000 (0:00:03.312) 0:00:14.215 ********** 2026-04-24 07:06:18.304809 | orchestrator | ok: [testbed-node-0] => (item=barbican-api/vassals) 2026-04-24 07:06:18.304814 | orchestrator | ok: [testbed-node-1] => (item=barbican-api/vassals) 2026-04-24 07:06:18.304818 | orchestrator | ok: [testbed-node-2] => (item=barbican-api/vassals) 2026-04-24 07:06:18.304823 | orchestrator | 2026-04-24 07:06:18.304827 | orchestrator | TASK [barbican : Check if policies shall be overwritten] *********************** 2026-04-24 07:06:18.304831 | orchestrator | Friday 24 April 2026 07:06:09 +0000 (0:00:02.191) 0:00:16.406 ********** 2026-04-24 07:06:18.304835 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:06:18.304840 | orchestrator | 2026-04-24 07:06:18.304844 | orchestrator | TASK [barbican : Set barbican policy file] ************************************* 2026-04-24 07:06:18.304848 | orchestrator | Friday 24 April 2026 07:06:11 +0000 (0:00:01.344) 0:00:17.751 ********** 2026-04-24 07:06:18.304851 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:06:18.304884 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:06:18.304888 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:06:18.304892 | orchestrator | 2026-04-24 07:06:18.304896 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-24 07:06:18.304899 | orchestrator | Friday 24 April 2026 07:06:13 +0000 (0:00:01.953) 0:00:19.705 ********** 2026-04-24 07:06:18.304904 | orchestrator | included: /ansible/roles/barbican/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:06:18.304908 | orchestrator | 2026-04-24 07:06:18.304912 | orchestrator | TASK [service-cert-copy : barbican | Copying over extra CA certificates] ******* 2026-04-24 07:06:18.304916 | orchestrator | Friday 24 April 2026 07:06:15 +0000 (0:00:02.117) 0:00:21.822 ********** 2026-04-24 07:06:18.304923 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:18.304929 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:18.304947 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:18.304958 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:18.304971 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:18.304978 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:18.304984 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:18.304991 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:18.305006 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:22.325011 | orchestrator | 2026-04-24 07:06:22.325103 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS certificate] *** 2026-04-24 07:06:22.325132 | orchestrator | Friday 24 April 2026 07:06:19 +0000 (0:00:04.355) 0:00:26.178 ********** 2026-04-24 07:06:22.325153 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:22.325161 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:22.325166 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:22.325171 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:06:22.325176 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:22.325193 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:22.325205 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:22.325209 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:06:22.325213 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:22.325217 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:22.325221 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:22.325225 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:06:22.325229 | orchestrator | 2026-04-24 07:06:22.325233 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS key] **** 2026-04-24 07:06:22.325238 | orchestrator | Friday 24 April 2026 07:06:21 +0000 (0:00:02.327) 0:00:28.505 ********** 2026-04-24 07:06:22.325245 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:25.616144 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:25.616238 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:25.616250 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:06:25.616260 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:25.616268 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:25.616295 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:25.616302 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:06:25.616332 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:25.616340 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:25.616345 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:25.616352 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:06:25.616358 | orchestrator | 2026-04-24 07:06:25.616365 | orchestrator | TASK [barbican : Copying over config.json files for services] ****************** 2026-04-24 07:06:25.616374 | orchestrator | Friday 24 April 2026 07:06:23 +0000 (0:00:01.914) 0:00:30.420 ********** 2026-04-24 07:06:25.616380 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:25.616402 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:40.541772 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:40.541875 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:40.541888 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:40.541918 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:40.541924 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:40.541952 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:40.541958 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:40.541964 | orchestrator | 2026-04-24 07:06:40.541975 | orchestrator | TASK [barbican : Copying over barbican-api.ini] ******************************** 2026-04-24 07:06:40.541984 | orchestrator | Friday 24 April 2026 07:06:29 +0000 (0:00:05.524) 0:00:35.945 ********** 2026-04-24 07:06:40.541990 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:06:40.541998 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:06:40.542004 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:06:40.542010 | orchestrator | 2026-04-24 07:06:40.542063 | orchestrator | TASK [barbican : Checking whether barbican-api-paste.ini file exists] ********** 2026-04-24 07:06:40.542070 | orchestrator | Friday 24 April 2026 07:06:32 +0000 (0:00:02.774) 0:00:38.719 ********** 2026-04-24 07:06:40.542076 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:06:40.542084 | orchestrator | 2026-04-24 07:06:40.542090 | orchestrator | TASK [barbican : Copying over barbican-api-paste.ini] ************************** 2026-04-24 07:06:40.542096 | orchestrator | Friday 24 April 2026 07:06:34 +0000 (0:00:02.822) 0:00:41.542 ********** 2026-04-24 07:06:40.542104 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:06:40.542111 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:06:40.542117 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:06:40.542123 | orchestrator | 2026-04-24 07:06:40.542129 | orchestrator | TASK [barbican : Copying over barbican.conf] *********************************** 2026-04-24 07:06:40.542144 | orchestrator | Friday 24 April 2026 07:06:36 +0000 (0:00:01.997) 0:00:43.539 ********** 2026-04-24 07:06:40.542151 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:40.542158 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:40.542178 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:47.669588 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:47.670382 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:47.670427 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:47.670440 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:47.670465 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:47.670476 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:47.670486 | orchestrator | 2026-04-24 07:06:47.670498 | orchestrator | TASK [barbican : Copying over existing policy file] **************************** 2026-04-24 07:06:47.670531 | orchestrator | Friday 24 April 2026 07:06:46 +0000 (0:00:09.648) 0:00:53.188 ********** 2026-04-24 07:06:47.670544 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:47.670564 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:47.670575 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:47.670586 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:06:47.670602 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:47.670620 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:51.774827 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:51.774919 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:06:51.774930 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:51.774937 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:51.774943 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:51.774948 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:06:51.774952 | orchestrator | 2026-04-24 07:06:51.774982 | orchestrator | TASK [service-check-containers : barbican | Check containers] ****************** 2026-04-24 07:06:51.774989 | orchestrator | Friday 24 April 2026 07:06:49 +0000 (0:00:02.790) 0:00:55.979 ********** 2026-04-24 07:06:51.775006 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:51.775016 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:51.775021 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:06:51.775026 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:51.775034 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:51.775046 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:56.561160 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:56.561250 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:56.561262 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:06:56.561268 | orchestrator | 2026-04-24 07:06:56.561276 | orchestrator | TASK [service-check-containers : barbican | Notify handlers to restart containers] *** 2026-04-24 07:06:56.561285 | orchestrator | Friday 24 April 2026 07:06:53 +0000 (0:00:04.551) 0:01:00.530 ********** 2026-04-24 07:06:56.561293 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:06:56.561301 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:06:56.561308 | orchestrator | } 2026-04-24 07:06:56.561315 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:06:56.561321 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:06:56.561328 | orchestrator | } 2026-04-24 07:06:56.561334 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:06:56.561340 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:06:56.561348 | orchestrator | } 2026-04-24 07:06:56.561352 | orchestrator | 2026-04-24 07:06:56.561356 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:06:56.561360 | orchestrator | Friday 24 April 2026 07:06:55 +0000 (0:00:01.665) 0:01:02.196 ********** 2026-04-24 07:06:56.561381 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:56.561426 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:56.561435 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:56.561441 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:06:56.561447 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:06:56.561454 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:06:56.561464 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:06:56.561478 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:06:56.561491 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:09:57.703524 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:09:57.703655 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:09:57.703673 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:09:57.703682 | orchestrator | 2026-04-24 07:09:57.703690 | orchestrator | TASK [barbican : Running barbican bootstrap container] ************************* 2026-04-24 07:09:57.703698 | orchestrator | Friday 24 April 2026 07:06:58 +0000 (0:00:02.866) 0:01:05.062 ********** 2026-04-24 07:09:57.703714 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:09:57.703720 | orchestrator | 2026-04-24 07:09:57.703734 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-24 07:09:57.703740 | orchestrator | Friday 24 April 2026 07:07:13 +0000 (0:00:15.336) 0:01:20.399 ********** 2026-04-24 07:09:57.703746 | orchestrator | 2026-04-24 07:09:57.703752 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-24 07:09:57.703759 | orchestrator | Friday 24 April 2026 07:07:14 +0000 (0:00:00.534) 0:01:20.933 ********** 2026-04-24 07:09:57.703765 | orchestrator | 2026-04-24 07:09:57.703771 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-24 07:09:57.703778 | orchestrator | Friday 24 April 2026 07:07:14 +0000 (0:00:00.482) 0:01:21.415 ********** 2026-04-24 07:09:57.703784 | orchestrator | 2026-04-24 07:09:57.703790 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-api container] ******************** 2026-04-24 07:09:57.703823 | orchestrator | Friday 24 April 2026 07:07:15 +0000 (0:00:00.917) 0:01:22.333 ********** 2026-04-24 07:09:57.703830 | orchestrator | 2026-04-24 07:09:57.703836 | orchestrator | STILL ALIVE [task 'barbican : Restart barbican-api container' is running] ****** 2026-04-24 07:09:57.703842 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:09:57.703848 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:09:57.703854 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:09:57.703862 | orchestrator | 2026-04-24 07:09:57.703867 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-keystone-listener container] ****** 2026-04-24 07:09:57.703871 | orchestrator | Friday 24 April 2026 07:09:29 +0000 (0:02:14.226) 0:03:36.559 ********** 2026-04-24 07:09:57.703948 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:09:57.703965 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:09:57.703969 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:09:57.703973 | orchestrator | 2026-04-24 07:09:57.704003 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-worker container] ***************** 2026-04-24 07:09:57.704007 | orchestrator | Friday 24 April 2026 07:09:43 +0000 (0:00:13.335) 0:03:49.894 ********** 2026-04-24 07:09:57.704011 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:09:57.704015 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:09:57.704019 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:09:57.704022 | orchestrator | 2026-04-24 07:09:57.704026 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:09:57.704031 | orchestrator | testbed-node-0 : ok=17  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 07:09:57.704037 | orchestrator | testbed-node-1 : ok=15  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:09:57.704041 | orchestrator | testbed-node-2 : ok=15  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:09:57.704045 | orchestrator | 2026-04-24 07:09:57.704049 | orchestrator | 2026-04-24 07:09:57.704052 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:09:57.704058 | orchestrator | Friday 24 April 2026 07:09:57 +0000 (0:00:13.806) 0:04:03.700 ********** 2026-04-24 07:09:57.704065 | orchestrator | =============================================================================== 2026-04-24 07:09:57.704071 | orchestrator | barbican : Restart barbican-api container ----------------------------- 134.23s 2026-04-24 07:09:57.704079 | orchestrator | barbican : Running barbican bootstrap container ------------------------ 15.34s 2026-04-24 07:09:57.704132 | orchestrator | barbican : Restart barbican-worker container --------------------------- 13.81s 2026-04-24 07:09:57.704140 | orchestrator | barbican : Restart barbican-keystone-listener container ---------------- 13.34s 2026-04-24 07:09:57.704166 | orchestrator | barbican : Copying over barbican.conf ----------------------------------- 9.65s 2026-04-24 07:09:57.704172 | orchestrator | barbican : Copying over config.json files for services ------------------ 5.52s 2026-04-24 07:09:57.704176 | orchestrator | service-check-containers : barbican | Check containers ------------------ 4.55s 2026-04-24 07:09:57.704181 | orchestrator | service-cert-copy : barbican | Copying over extra CA certificates ------- 4.36s 2026-04-24 07:09:57.704185 | orchestrator | barbican : include_tasks ------------------------------------------------ 4.24s 2026-04-24 07:09:57.704192 | orchestrator | barbican : Ensuring config directories exist ---------------------------- 3.31s 2026-04-24 07:09:57.704199 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.87s 2026-04-24 07:09:57.704205 | orchestrator | barbican : Checking whether barbican-api-paste.ini file exists ---------- 2.82s 2026-04-24 07:09:57.704211 | orchestrator | barbican : Copying over existing policy file ---------------------------- 2.79s 2026-04-24 07:09:57.704218 | orchestrator | barbican : Copying over barbican-api.ini -------------------------------- 2.77s 2026-04-24 07:09:57.704225 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.50s 2026-04-24 07:09:57.704243 | orchestrator | service-cert-copy : barbican | Copying over backend internal TLS certificate --- 2.33s 2026-04-24 07:09:57.704250 | orchestrator | barbican : Ensuring vassals config directories exist -------------------- 2.19s 2026-04-24 07:09:57.704257 | orchestrator | barbican : include_tasks ------------------------------------------------ 2.12s 2026-04-24 07:09:57.704263 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.10s 2026-04-24 07:09:57.704267 | orchestrator | barbican : Copying over barbican-api-paste.ini -------------------------- 2.00s 2026-04-24 07:09:58.091628 | orchestrator | + osism apply -a upgrade designate 2026-04-24 07:09:59.875326 | orchestrator | 2026-04-24 07:09:59 | INFO  | Prepare task for execution of designate. 2026-04-24 07:09:59.947723 | orchestrator | 2026-04-24 07:09:59 | INFO  | Task ba7577fe-e02b-4c89-a312-4915a1296f7e (designate) was prepared for execution. 2026-04-24 07:09:59.947783 | orchestrator | 2026-04-24 07:09:59 | INFO  | It takes a moment until task ba7577fe-e02b-4c89-a312-4915a1296f7e (designate) has been started and output is visible here. 2026-04-24 07:10:17.190478 | orchestrator | 2026-04-24 07:10:17.190540 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:10:17.190550 | orchestrator | 2026-04-24 07:10:17.190557 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:10:17.190563 | orchestrator | Friday 24 April 2026 07:10:06 +0000 (0:00:02.183) 0:00:02.183 ********** 2026-04-24 07:10:17.190569 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:10:17.190576 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:10:17.190583 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:10:17.190589 | orchestrator | 2026-04-24 07:10:17.190595 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:10:17.190602 | orchestrator | Friday 24 April 2026 07:10:08 +0000 (0:00:02.072) 0:00:04.255 ********** 2026-04-24 07:10:17.190608 | orchestrator | ok: [testbed-node-0] => (item=enable_designate_True) 2026-04-24 07:10:17.190615 | orchestrator | ok: [testbed-node-1] => (item=enable_designate_True) 2026-04-24 07:10:17.190622 | orchestrator | ok: [testbed-node-2] => (item=enable_designate_True) 2026-04-24 07:10:17.190628 | orchestrator | 2026-04-24 07:10:17.190634 | orchestrator | PLAY [Apply role designate] **************************************************** 2026-04-24 07:10:17.190640 | orchestrator | 2026-04-24 07:10:17.190646 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-24 07:10:17.190662 | orchestrator | Friday 24 April 2026 07:10:11 +0000 (0:00:03.522) 0:00:07.777 ********** 2026-04-24 07:10:17.190669 | orchestrator | included: /ansible/roles/designate/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:10:17.190675 | orchestrator | 2026-04-24 07:10:17.190681 | orchestrator | TASK [designate : Ensuring config directories exist] *************************** 2026-04-24 07:10:17.190688 | orchestrator | Friday 24 April 2026 07:10:14 +0000 (0:00:02.494) 0:00:10.272 ********** 2026-04-24 07:10:17.190696 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:17.190706 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:17.190742 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:17.190763 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:17.190774 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:17.190781 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:17.190789 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:17.190801 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:17.190808 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:17.190818 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573684 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573739 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573745 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573761 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573765 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573770 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573783 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573790 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:26.573794 | orchestrator | 2026-04-24 07:10:26.573798 | orchestrator | TASK [designate : Check if policies shall be overwritten] ********************** 2026-04-24 07:10:26.573804 | orchestrator | Friday 24 April 2026 07:10:19 +0000 (0:00:05.432) 0:00:15.704 ********** 2026-04-24 07:10:26.573808 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:10:26.573815 | orchestrator | 2026-04-24 07:10:26.573819 | orchestrator | TASK [designate : Set designate policy file] *********************************** 2026-04-24 07:10:26.573823 | orchestrator | Friday 24 April 2026 07:10:20 +0000 (0:00:01.325) 0:00:17.029 ********** 2026-04-24 07:10:26.573826 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:10:26.573830 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:10:26.573834 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:10:26.573837 | orchestrator | 2026-04-24 07:10:26.573841 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-24 07:10:26.573845 | orchestrator | Friday 24 April 2026 07:10:22 +0000 (0:00:01.744) 0:00:18.773 ********** 2026-04-24 07:10:26.573849 | orchestrator | included: /ansible/roles/designate/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:10:26.573853 | orchestrator | 2026-04-24 07:10:26.573857 | orchestrator | TASK [service-cert-copy : designate | Copying over extra CA certificates] ****** 2026-04-24 07:10:26.573860 | orchestrator | Friday 24 April 2026 07:10:24 +0000 (0:00:02.205) 0:00:20.979 ********** 2026-04-24 07:10:26.573865 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:26.573885 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:26.573897 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:30.580297 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580365 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580374 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580383 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580390 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580406 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580439 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580448 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580455 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580463 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580470 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580477 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:30.580490 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:33.715750 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:33.715826 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:33.715837 | orchestrator | 2026-04-24 07:10:33.715844 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS certificate] *** 2026-04-24 07:10:33.715851 | orchestrator | Friday 24 April 2026 07:10:32 +0000 (0:00:07.550) 0:00:28.530 ********** 2026-04-24 07:10:33.715858 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:10:33.715893 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:10:33.715910 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:10:33.715942 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:10:33.715950 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:10:33.715956 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:10:33.715963 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:10:33.715970 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:10:33.715990 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.320898 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:10:36.320953 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.320962 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.320968 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:10:36.320975 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.320980 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.321008 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.321025 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.321030 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:10:36.321035 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.321041 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.321046 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:10:36.321051 | orchestrator | 2026-04-24 07:10:36.321057 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS key] *** 2026-04-24 07:10:36.321063 | orchestrator | Friday 24 April 2026 07:10:35 +0000 (0:00:02.942) 0:00:31.473 ********** 2026-04-24 07:10:36.321069 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:10:36.321089 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:10:36.321099 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:10:36.860339 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860405 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:10:36.860414 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860436 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860452 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:10:36.860470 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860477 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860483 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:10:36.860488 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:10:36.860495 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860505 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860513 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860518 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:10:36.860527 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:10:41.740732 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:10:41.740781 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:10:41.740788 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:10:41.740805 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:10:41.740812 | orchestrator | 2026-04-24 07:10:41.740817 | orchestrator | TASK [designate : Copying over config.json files for services] ***************** 2026-04-24 07:10:41.740823 | orchestrator | Friday 24 April 2026 07:10:38 +0000 (0:00:03.081) 0:00:34.555 ********** 2026-04-24 07:10:41.740836 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:41.740844 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:41.740859 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:41.740913 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:41.740924 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:41.740933 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:10:41.740938 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:41.740943 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:41.740953 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665776 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665844 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665850 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665881 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665887 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665891 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665902 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665910 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665914 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:10:48.665919 | orchestrator | 2026-04-24 07:10:48.665923 | orchestrator | TASK [designate : Copying over designate.conf] ********************************* 2026-04-24 07:10:48.665928 | orchestrator | Friday 24 April 2026 07:10:45 +0000 (0:00:07.160) 0:00:41.716 ********** 2026-04-24 07:10:48.665934 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:48.665941 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:10:48.665949 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:11:00.741790 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741842 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741854 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741882 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741887 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741901 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741912 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741916 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741922 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741926 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741929 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741935 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:00.741941 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:13.279401 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:13.279472 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:13.279482 | orchestrator | 2026-04-24 07:11:13.279501 | orchestrator | TASK [designate : Copying over pools.yaml] ************************************* 2026-04-24 07:11:13.279509 | orchestrator | Friday 24 April 2026 07:11:02 +0000 (0:00:17.102) 0:00:58.818 ********** 2026-04-24 07:11:13.279513 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-24 07:11:13.279517 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-24 07:11:13.279521 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-24 07:11:13.279525 | orchestrator | 2026-04-24 07:11:13.279528 | orchestrator | TASK [designate : Copying over named.conf] ************************************* 2026-04-24 07:11:13.279532 | orchestrator | Friday 24 April 2026 07:11:07 +0000 (0:00:05.025) 0:01:03.844 ********** 2026-04-24 07:11:13.279536 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-24 07:11:13.279540 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-24 07:11:13.279544 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-24 07:11:13.279547 | orchestrator | 2026-04-24 07:11:13.279551 | orchestrator | TASK [designate : Copying over rndc.conf] ************************************** 2026-04-24 07:11:13.279555 | orchestrator | Friday 24 April 2026 07:11:11 +0000 (0:00:03.947) 0:01:07.792 ********** 2026-04-24 07:11:13.279572 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:13.279586 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:13.279591 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:13.279598 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:13.279603 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:13.279611 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:13.279615 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:13.279622 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:16.648393 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:16.648451 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:16.648458 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:16.648474 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:16.648479 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:16.648483 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:16.648495 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:16.648501 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:16.648506 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:16.648512 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:16.648517 | orchestrator | 2026-04-24 07:11:16.648525 | orchestrator | TASK [designate : Copying over rndc.key] *************************************** 2026-04-24 07:11:16.648533 | orchestrator | Friday 24 April 2026 07:11:15 +0000 (0:00:04.060) 0:01:11.852 ********** 2026-04-24 07:11:16.648541 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:16.648552 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:17.540979 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:17.541040 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:17.541046 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:17.541050 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:17.541053 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:17.541064 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:17.541068 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:17.541074 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:17.541095 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:17.541099 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:17.541102 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:17.541106 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:17.541112 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:22.118270 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:22.118319 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:22.118324 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:22.118328 | orchestrator | 2026-04-24 07:11:22.118332 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-24 07:11:22.118336 | orchestrator | Friday 24 April 2026 07:11:19 +0000 (0:00:03.928) 0:01:15.781 ********** 2026-04-24 07:11:22.118339 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:11:22.118349 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:11:22.118353 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:11:22.118360 | orchestrator | 2026-04-24 07:11:22.118364 | orchestrator | TASK [designate : Copying over existing policy file] *************************** 2026-04-24 07:11:22.118367 | orchestrator | Friday 24 April 2026 07:11:21 +0000 (0:00:01.814) 0:01:17.595 ********** 2026-04-24 07:11:22.118371 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:22.118376 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:11:22.118405 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:22.118409 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:22.118412 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:22.118415 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:11:22.118419 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:11:22.118422 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:22.118428 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:11:25.654539 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:25.654592 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:25.654600 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:25.654606 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:11:25.654612 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:11:25.654619 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:25.654651 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:11:25.654659 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:25.654664 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:25.654669 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:25.654675 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:11:25.654680 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:11:25.654685 | orchestrator | 2026-04-24 07:11:25.654691 | orchestrator | TASK [service-check-containers : designate | Check containers] ***************** 2026-04-24 07:11:25.654697 | orchestrator | Friday 24 April 2026 07:11:23 +0000 (0:00:02.321) 0:01:19.917 ********** 2026-04-24 07:11:25.654703 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:11:25.654719 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:11:29.205534 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:11:29.205592 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205600 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205618 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205630 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205644 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205649 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205654 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205659 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205667 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205675 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205680 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:29.205688 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:34.619186 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:34.619281 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:34.619318 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:11:34.619326 | orchestrator | 2026-04-24 07:11:34.619333 | orchestrator | TASK [service-check-containers : designate | Notify handlers to restart containers] *** 2026-04-24 07:11:34.619342 | orchestrator | Friday 24 April 2026 07:11:31 +0000 (0:00:07.890) 0:01:27.808 ********** 2026-04-24 07:11:34.619350 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:11:34.619357 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:11:34.619365 | orchestrator | } 2026-04-24 07:11:34.619371 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:11:34.619378 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:11:34.619384 | orchestrator | } 2026-04-24 07:11:34.619391 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:11:34.619397 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:11:34.619403 | orchestrator | } 2026-04-24 07:11:34.619408 | orchestrator | 2026-04-24 07:11:34.619413 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:11:34.619416 | orchestrator | Friday 24 April 2026 07:11:33 +0000 (0:00:01.903) 0:01:29.711 ********** 2026-04-24 07:11:34.619434 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:34.619453 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:11:34.619459 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:11:34.619469 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:11:34.619473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:11:34.619481 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:11:34.619485 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:11:34.619493 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416255 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:12:26.416318 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416340 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416346 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416359 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416365 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:12:26.416371 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:12:26.416387 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-24 07:12:26.416399 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416404 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416410 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416418 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:12:26.416424 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:12:26.416429 | orchestrator | 2026-04-24 07:12:26.416435 | orchestrator | TASK [designate : Running Designate bootstrap container] *********************** 2026-04-24 07:12:26.416441 | orchestrator | Friday 24 April 2026 07:11:36 +0000 (0:00:03.027) 0:01:32.738 ********** 2026-04-24 07:12:26.416446 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:12:26.416452 | orchestrator | 2026-04-24 07:12:26.416457 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-24 07:12:26.416463 | orchestrator | Friday 24 April 2026 07:11:53 +0000 (0:00:16.743) 0:01:49.482 ********** 2026-04-24 07:12:26.416505 | orchestrator | 2026-04-24 07:12:26.416511 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-24 07:12:26.416516 | orchestrator | Friday 24 April 2026 07:11:53 +0000 (0:00:00.634) 0:01:50.116 ********** 2026-04-24 07:12:26.416521 | orchestrator | 2026-04-24 07:12:26.416526 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-24 07:12:26.416531 | orchestrator | Friday 24 April 2026 07:11:54 +0000 (0:00:00.489) 0:01:50.606 ********** 2026-04-24 07:12:26.416537 | orchestrator | 2026-04-24 07:12:26.416541 | orchestrator | RUNNING HANDLER [designate : Restart designate-backend-bind9 container] ******** 2026-04-24 07:12:26.416551 | orchestrator | Friday 24 April 2026 07:11:55 +0000 (0:00:00.915) 0:01:51.522 ********** 2026-04-24 07:12:26.416556 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:12:26.416561 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:12:26.416566 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:12:26.416571 | orchestrator | 2026-04-24 07:12:26.416576 | orchestrator | RUNNING HANDLER [designate : Restart designate-api container] ****************** 2026-04-24 07:12:26.416581 | orchestrator | Friday 24 April 2026 07:12:11 +0000 (0:00:16.116) 0:02:07.639 ********** 2026-04-24 07:12:26.416586 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:12:26.416592 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:12:26.416597 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:12:26.416602 | orchestrator | 2026-04-24 07:12:26.416607 | orchestrator | RUNNING HANDLER [designate : Restart designate-central container] ************** 2026-04-24 07:12:26.416616 | orchestrator | Friday 24 April 2026 07:12:26 +0000 (0:00:14.887) 0:02:22.527 ********** 2026-04-24 07:14:19.701621 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:14:19.701701 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:14:19.701707 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:14:19.701712 | orchestrator | 2026-04-24 07:14:19.701717 | orchestrator | RUNNING HANDLER [designate : Restart designate-producer container] ************* 2026-04-24 07:14:19.701722 | orchestrator | Friday 24 April 2026 07:12:40 +0000 (0:00:13.873) 0:02:36.401 ********** 2026-04-24 07:14:19.701727 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:14:19.701730 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:14:19.701734 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:14:19.701741 | orchestrator | 2026-04-24 07:14:19.701748 | orchestrator | RUNNING HANDLER [designate : Restart designate-mdns container] ***************** 2026-04-24 07:14:19.701756 | orchestrator | Friday 24 April 2026 07:13:40 +0000 (0:00:59.803) 0:03:36.204 ********** 2026-04-24 07:14:19.701765 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:14:19.701772 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:14:19.701778 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:14:19.701784 | orchestrator | 2026-04-24 07:14:19.701790 | orchestrator | RUNNING HANDLER [designate : Restart designate-worker container] *************** 2026-04-24 07:14:19.701796 | orchestrator | Friday 24 April 2026 07:13:54 +0000 (0:00:14.228) 0:03:50.433 ********** 2026-04-24 07:14:19.701803 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:14:19.701809 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:14:19.701816 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:14:19.701821 | orchestrator | 2026-04-24 07:14:19.701828 | orchestrator | TASK [designate : Non-destructive DNS pools update] **************************** 2026-04-24 07:14:19.701835 | orchestrator | Friday 24 April 2026 07:14:09 +0000 (0:00:14.869) 0:04:05.303 ********** 2026-04-24 07:14:19.701841 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:14:19.701847 | orchestrator | 2026-04-24 07:14:19.701881 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:14:19.701896 | orchestrator | testbed-node-0 : ok=22  changed=12  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-24 07:14:19.701906 | orchestrator | testbed-node-1 : ok=20  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:14:19.701910 | orchestrator | testbed-node-2 : ok=20  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:14:19.701914 | orchestrator | 2026-04-24 07:14:19.701918 | orchestrator | 2026-04-24 07:14:19.701922 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:14:19.701926 | orchestrator | Friday 24 April 2026 07:14:19 +0000 (0:00:10.084) 0:04:15.388 ********** 2026-04-24 07:14:19.701930 | orchestrator | =============================================================================== 2026-04-24 07:14:19.702080 | orchestrator | designate : Restart designate-producer container ----------------------- 59.80s 2026-04-24 07:14:19.702117 | orchestrator | designate : Copying over designate.conf -------------------------------- 17.10s 2026-04-24 07:14:19.702125 | orchestrator | designate : Running Designate bootstrap container ---------------------- 16.74s 2026-04-24 07:14:19.702132 | orchestrator | designate : Restart designate-backend-bind9 container ------------------ 16.12s 2026-04-24 07:14:19.702138 | orchestrator | designate : Restart designate-api container ---------------------------- 14.89s 2026-04-24 07:14:19.702144 | orchestrator | designate : Restart designate-worker container ------------------------- 14.87s 2026-04-24 07:14:19.702163 | orchestrator | designate : Restart designate-mdns container --------------------------- 14.23s 2026-04-24 07:14:19.702170 | orchestrator | designate : Restart designate-central container ------------------------ 13.87s 2026-04-24 07:14:19.702173 | orchestrator | designate : Non-destructive DNS pools update --------------------------- 10.08s 2026-04-24 07:14:19.702177 | orchestrator | service-check-containers : designate | Check containers ----------------- 7.89s 2026-04-24 07:14:19.702181 | orchestrator | service-cert-copy : designate | Copying over extra CA certificates ------ 7.55s 2026-04-24 07:14:19.702185 | orchestrator | designate : Copying over config.json files for services ----------------- 7.16s 2026-04-24 07:14:19.702199 | orchestrator | designate : Ensuring config directories exist --------------------------- 5.43s 2026-04-24 07:14:19.702204 | orchestrator | designate : Copying over pools.yaml ------------------------------------- 5.03s 2026-04-24 07:14:19.702215 | orchestrator | designate : Copying over rndc.conf -------------------------------------- 4.06s 2026-04-24 07:14:19.702220 | orchestrator | designate : Copying over named.conf ------------------------------------- 3.95s 2026-04-24 07:14:19.702224 | orchestrator | designate : Copying over rndc.key --------------------------------------- 3.93s 2026-04-24 07:14:19.702228 | orchestrator | Group hosts based on enabled services ----------------------------------- 3.52s 2026-04-24 07:14:19.702233 | orchestrator | service-cert-copy : designate | Copying over backend internal TLS key --- 3.08s 2026-04-24 07:14:19.702237 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.03s 2026-04-24 07:14:19.996171 | orchestrator | + osism apply -a upgrade ceilometer 2026-04-24 07:14:21.629072 | orchestrator | 2026-04-24 07:14:21 | INFO  | Prepare task for execution of ceilometer. 2026-04-24 07:14:21.698866 | orchestrator | 2026-04-24 07:14:21 | INFO  | Task 4b551109-cde5-4c6e-968a-36ecd8372063 (ceilometer) was prepared for execution. 2026-04-24 07:14:21.698927 | orchestrator | 2026-04-24 07:14:21 | INFO  | It takes a moment until task 4b551109-cde5-4c6e-968a-36ecd8372063 (ceilometer) has been started and output is visible here. 2026-04-24 07:14:47.864159 | orchestrator | 2026-04-24 07:14:47.864240 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:14:47.864249 | orchestrator | 2026-04-24 07:14:47.864253 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:14:47.864258 | orchestrator | Friday 24 April 2026 07:14:27 +0000 (0:00:02.066) 0:00:02.066 ********** 2026-04-24 07:14:47.864262 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:14:47.864267 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:14:47.864271 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:14:47.864275 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:14:47.864279 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:14:47.864282 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:14:47.864286 | orchestrator | 2026-04-24 07:14:47.864290 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:14:47.864294 | orchestrator | Friday 24 April 2026 07:14:31 +0000 (0:00:03.173) 0:00:05.239 ********** 2026-04-24 07:14:47.864299 | orchestrator | ok: [testbed-node-0] => (item=enable_ceilometer_True) 2026-04-24 07:14:47.864303 | orchestrator | ok: [testbed-node-1] => (item=enable_ceilometer_True) 2026-04-24 07:14:47.864307 | orchestrator | ok: [testbed-node-2] => (item=enable_ceilometer_True) 2026-04-24 07:14:47.864311 | orchestrator | ok: [testbed-node-3] => (item=enable_ceilometer_True) 2026-04-24 07:14:47.864315 | orchestrator | ok: [testbed-node-4] => (item=enable_ceilometer_True) 2026-04-24 07:14:47.864336 | orchestrator | ok: [testbed-node-5] => (item=enable_ceilometer_True) 2026-04-24 07:14:47.864340 | orchestrator | 2026-04-24 07:14:47.864344 | orchestrator | PLAY [Apply role ceilometer] *************************************************** 2026-04-24 07:14:47.864348 | orchestrator | 2026-04-24 07:14:47.864352 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-24 07:14:47.864356 | orchestrator | Friday 24 April 2026 07:14:33 +0000 (0:00:02.844) 0:00:08.084 ********** 2026-04-24 07:14:47.864360 | orchestrator | included: /ansible/roles/ceilometer/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 07:14:47.864366 | orchestrator | 2026-04-24 07:14:47.864370 | orchestrator | TASK [ceilometer : Ensuring config directories exist] ************************** 2026-04-24 07:14:47.864374 | orchestrator | Friday 24 April 2026 07:14:40 +0000 (0:00:06.214) 0:00:14.298 ********** 2026-04-24 07:14:47.864380 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:14:47.864399 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:14:47.864403 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:14:47.864418 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:14:47.864425 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:14:47.864433 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:14:47.864438 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:14:47.864444 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:14:47.864448 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:14:47.864452 | orchestrator | 2026-04-24 07:14:47.864456 | orchestrator | TASK [ceilometer : Check if the folder for custom meter definitions exist] ***** 2026-04-24 07:14:47.864460 | orchestrator | Friday 24 April 2026 07:14:44 +0000 (0:00:04.041) 0:00:18.339 ********** 2026-04-24 07:14:47.864464 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 07:14:47.864468 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:14:47.864472 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 07:14:47.864476 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 07:14:47.864479 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 07:14:47.864483 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 07:14:47.864487 | orchestrator | 2026-04-24 07:14:47.864493 | orchestrator | TASK [ceilometer : Set variable that indicates if we have a folder for custom meter YAML files] *** 2026-04-24 07:14:47.864501 | orchestrator | Friday 24 April 2026 07:14:47 +0000 (0:00:03.473) 0:00:21.813 ********** 2026-04-24 07:14:47.864511 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:14:47.864526 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:14:57.502465 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:14:57.502532 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:14:57.502542 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:14:57.502549 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:14:57.502555 | orchestrator | 2026-04-24 07:14:57.502563 | orchestrator | TASK [ceilometer : Find all *.yaml files in custom meter definitions folder (if the folder exist)] *** 2026-04-24 07:14:57.502571 | orchestrator | Friday 24 April 2026 07:14:49 +0000 (0:00:02.111) 0:00:23.925 ********** 2026-04-24 07:14:57.502577 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:14:57.502581 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:14:57.502585 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:14:57.502589 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:14:57.502593 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:14:57.502597 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:14:57.502600 | orchestrator | 2026-04-24 07:14:57.502605 | orchestrator | TASK [ceilometer : Set the variable that control the copy of custom meter definitions] *** 2026-04-24 07:14:57.502613 | orchestrator | Friday 24 April 2026 07:14:52 +0000 (0:00:02.816) 0:00:26.742 ********** 2026-04-24 07:14:57.502619 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:14:57.502626 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:14:57.502632 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:14:57.502639 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:14:57.502645 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:14:57.502651 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:14:57.502657 | orchestrator | 2026-04-24 07:14:57.502664 | orchestrator | TASK [ceilometer : Create default folder for custom meter definitions] ********* 2026-04-24 07:14:57.502670 | orchestrator | Friday 24 April 2026 07:14:54 +0000 (0:00:02.162) 0:00:28.904 ********** 2026-04-24 07:14:57.502679 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:14:57.502685 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:14:57.502690 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:14:57.502706 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:14:57.502725 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:14:57.502763 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:14:57.502770 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:14:57.502777 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:14:57.502783 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:14:57.502790 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:14:57.502796 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:14:57.502803 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:14:57.502809 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:14:57.502818 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:14:57.502830 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:14:57.502836 | orchestrator | 2026-04-24 07:14:57.502842 | orchestrator | TASK [ceilometer : Copying custom meter definitions to Ceilometer] ************* 2026-04-24 07:14:57.502849 | orchestrator | Friday 24 April 2026 07:14:57 +0000 (0:00:02.557) 0:00:31.462 ********** 2026-04-24 07:14:57.502855 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:14:57.502865 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:14.830451 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:14.830545 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:14.830559 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:14.830582 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:14.830612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:14.830619 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:14.830625 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:14.830631 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:14.830638 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:14.830659 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:14.830663 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:14.830667 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:14.830672 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:14.830678 | orchestrator | 2026-04-24 07:15:14.830686 | orchestrator | TASK [ceilometer : Check if the folder ["/opt/configuration/environments/kolla/files/overlays/ceilometer/pollsters.d"] for dynamic pollsters definitions exist] *** 2026-04-24 07:15:14.830695 | orchestrator | Friday 24 April 2026 07:14:59 +0000 (0:00:02.387) 0:00:33.849 ********** 2026-04-24 07:15:14.830702 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:15:14.830709 | orchestrator | 2026-04-24 07:15:14.830716 | orchestrator | TASK [ceilometer : Set the variable that control the copy of dynamic pollsters definitions] *** 2026-04-24 07:15:14.830723 | orchestrator | Friday 24 April 2026 07:15:01 +0000 (0:00:02.051) 0:00:35.901 ********** 2026-04-24 07:15:14.830730 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:15:14.830737 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:15:14.830742 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:15:14.830752 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:15:14.830756 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:15:14.830759 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:15:14.830763 | orchestrator | 2026-04-24 07:15:14.830767 | orchestrator | TASK [ceilometer : Clean default folder for dynamic pollsters definitions] ***** 2026-04-24 07:15:14.830771 | orchestrator | Friday 24 April 2026 07:15:03 +0000 (0:00:02.185) 0:00:38.087 ********** 2026-04-24 07:15:14.830774 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:15:14.830778 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:15:14.830782 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:15:14.830785 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:15:14.830789 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:15:14.830793 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:15:14.830796 | orchestrator | 2026-04-24 07:15:14.830800 | orchestrator | TASK [ceilometer : Create default folder for dynamic pollsters definitions] **** 2026-04-24 07:15:14.830808 | orchestrator | Friday 24 April 2026 07:15:06 +0000 (0:00:02.768) 0:00:40.856 ********** 2026-04-24 07:15:14.830812 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:14.830816 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:14.830820 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:14.830824 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:14.830827 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:14.830831 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:14.830835 | orchestrator | 2026-04-24 07:15:14.830839 | orchestrator | TASK [ceilometer : Copying dynamic pollsters definitions] ********************** 2026-04-24 07:15:14.830842 | orchestrator | Friday 24 April 2026 07:15:08 +0000 (0:00:02.080) 0:00:42.936 ********** 2026-04-24 07:15:14.830846 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:14.830850 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:14.830854 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:14.830857 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:14.830861 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:14.830865 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:14.830868 | orchestrator | 2026-04-24 07:15:14.830872 | orchestrator | TASK [ceilometer : Check if custom polling.yaml exists] ************************ 2026-04-24 07:15:14.830876 | orchestrator | Friday 24 April 2026 07:15:11 +0000 (0:00:02.466) 0:00:45.402 ********** 2026-04-24 07:15:14.830879 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:15:14.830883 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 07:15:14.830887 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 07:15:14.830891 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 07:15:14.830895 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 07:15:14.830900 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 07:15:14.830906 | orchestrator | 2026-04-24 07:15:14.830911 | orchestrator | TASK [ceilometer : Copying over polling.yaml] ********************************** 2026-04-24 07:15:14.830917 | orchestrator | Friday 24 April 2026 07:15:14 +0000 (0:00:03.312) 0:00:48.715 ********** 2026-04-24 07:15:14.831008 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:14.831025 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:22.908205 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:22.908290 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:22.908304 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:22.908327 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:22.908332 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:22.908336 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:22.908341 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:22.908345 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:22.908349 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:22.908363 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:22.908386 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:22.908390 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:22.908394 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:22.908398 | orchestrator | 2026-04-24 07:15:22.908403 | orchestrator | TASK [ceilometer : Set ceilometer polling file's path] ************************* 2026-04-24 07:15:22.908408 | orchestrator | Friday 24 April 2026 07:15:16 +0000 (0:00:02.421) 0:00:51.136 ********** 2026-04-24 07:15:22.908412 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:22.908415 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:22.908419 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:22.908423 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:22.908426 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:22.908430 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:22.908434 | orchestrator | 2026-04-24 07:15:22.908438 | orchestrator | TASK [ceilometer : Check custom gnocchi_resources.yaml exists] ***************** 2026-04-24 07:15:22.908442 | orchestrator | Friday 24 April 2026 07:15:19 +0000 (0:00:02.240) 0:00:53.377 ********** 2026-04-24 07:15:22.908445 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:15:22.908453 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 07:15:22.908457 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 07:15:22.908460 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 07:15:22.908467 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 07:15:22.908473 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 07:15:22.908482 | orchestrator | 2026-04-24 07:15:22.908489 | orchestrator | TASK [ceilometer : Copying over gnocchi_resources.yaml] ************************ 2026-04-24 07:15:22.908495 | orchestrator | Friday 24 April 2026 07:15:22 +0000 (0:00:03.316) 0:00:56.694 ********** 2026-04-24 07:15:22.908501 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:22.908507 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:22.908520 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:22.908533 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:35.844303 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:35.844408 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:35.844435 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:35.844442 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:35.844448 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:35.844454 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:35.844460 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:35.844482 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:35.844489 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:35.844494 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:35.844500 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:35.844505 | orchestrator | 2026-04-24 07:15:35.844511 | orchestrator | TASK [ceilometer : Set ceilometer gnocchi_resources file's path] *************** 2026-04-24 07:15:35.844518 | orchestrator | Friday 24 April 2026 07:15:25 +0000 (0:00:02.815) 0:00:59.510 ********** 2026-04-24 07:15:35.844524 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:35.844529 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:35.844534 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:35.844540 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:35.844545 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:35.844553 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:35.844562 | orchestrator | 2026-04-24 07:15:35.844608 | orchestrator | TASK [ceilometer : Check if policies shall be overwritten] ********************* 2026-04-24 07:15:35.844619 | orchestrator | Friday 24 April 2026 07:15:27 +0000 (0:00:01.993) 0:01:01.503 ********** 2026-04-24 07:15:35.844627 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:35.844636 | orchestrator | 2026-04-24 07:15:35.844644 | orchestrator | TASK [ceilometer : Set ceilometer policy file] ********************************* 2026-04-24 07:15:35.844652 | orchestrator | Friday 24 April 2026 07:15:28 +0000 (0:00:01.306) 0:01:02.810 ********** 2026-04-24 07:15:35.844660 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:35.844669 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:35.844677 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:35.844685 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:35.844694 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:35.844702 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:35.844710 | orchestrator | 2026-04-24 07:15:35.844718 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-24 07:15:35.844727 | orchestrator | Friday 24 April 2026 07:15:31 +0000 (0:00:02.559) 0:01:05.369 ********** 2026-04-24 07:15:35.844736 | orchestrator | included: /ansible/roles/ceilometer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 07:15:35.844746 | orchestrator | 2026-04-24 07:15:35.844754 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over extra CA certificates] ***** 2026-04-24 07:15:35.844763 | orchestrator | Friday 24 April 2026 07:15:33 +0000 (0:00:02.848) 0:01:08.218 ********** 2026-04-24 07:15:35.844779 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:35.844799 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:35.844808 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:35.844818 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:35.844836 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:39.069004 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:39.069107 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:39.069136 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:39.069145 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:39.069153 | orchestrator | 2026-04-24 07:15:39.069161 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS certificate] *** 2026-04-24 07:15:39.069171 | orchestrator | Friday 24 April 2026 07:15:37 +0000 (0:00:03.877) 0:01:12.096 ********** 2026-04-24 07:15:39.069181 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:39.069190 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:39.069210 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:39.069227 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:39.069234 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:39.069241 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:39.069250 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:39.069257 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:39.069264 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:39.069272 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:39.069279 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:39.069290 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:45.318767 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:45.318899 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:45.319073 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:45.319082 | orchestrator | 2026-04-24 07:15:45.319102 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS key] *** 2026-04-24 07:15:45.319132 | orchestrator | Friday 24 April 2026 07:15:40 +0000 (0:00:02.764) 0:01:14.861 ********** 2026-04-24 07:15:45.319137 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:45.319144 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:45.319148 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:45.319152 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:15:45.319156 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:45.319178 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:15:45.319193 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:45.319197 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:15:45.319201 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:15:45.319205 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:45.319209 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:15:45.319213 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:45.319217 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:15:45.319221 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:15:45.319224 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:15:45.319228 | orchestrator | 2026-04-24 07:15:45.319232 | orchestrator | TASK [ceilometer : Copying over config.json files for services] **************** 2026-04-24 07:15:45.319236 | orchestrator | Friday 24 April 2026 07:15:43 +0000 (0:00:03.062) 0:01:17.923 ********** 2026-04-24 07:15:45.319241 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:45.319256 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:51.589528 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:51.589623 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:51.589634 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:51.589643 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:51.589651 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:51.589679 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:51.589702 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:51.589707 | orchestrator | 2026-04-24 07:15:51.589712 | orchestrator | TASK [ceilometer : Copying over ceilometer.conf] ******************************* 2026-04-24 07:15:51.589717 | orchestrator | Friday 24 April 2026 07:15:47 +0000 (0:00:03.919) 0:01:21.843 ********** 2026-04-24 07:15:51.589721 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:51.589725 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:51.589729 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:15:51.589738 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:15:51.589745 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:12.389888 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:12.389998 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:12.390005 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:12.390010 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:12.390060 | orchestrator | 2026-04-24 07:16:12.390067 | orchestrator | TASK [ceilometer : Check custom event_definitions.yaml exists] ***************** 2026-04-24 07:16:12.390072 | orchestrator | Friday 24 April 2026 07:15:54 +0000 (0:00:07.282) 0:01:29.125 ********** 2026-04-24 07:16:12.390076 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:16:12.390081 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 07:16:12.390085 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 07:16:12.390089 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 07:16:12.390093 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 07:16:12.390096 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 07:16:12.390100 | orchestrator | 2026-04-24 07:16:12.390104 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml] ************************ 2026-04-24 07:16:12.390108 | orchestrator | Friday 24 April 2026 07:15:58 +0000 (0:00:03.556) 0:01:32.681 ********** 2026-04-24 07:16:12.390112 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:16:12.390116 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:16:12.390120 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:16:12.390123 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:16:12.390127 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:16:12.390131 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:16:12.390134 | orchestrator | 2026-04-24 07:16:12.390138 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml for notification service] *** 2026-04-24 07:16:12.390143 | orchestrator | Friday 24 April 2026 07:16:00 +0000 (0:00:02.025) 0:01:34.707 ********** 2026-04-24 07:16:12.390147 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:16:12.390151 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:16:12.390155 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:16:12.390159 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:16:12.390163 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:16:12.390167 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:16:12.390171 | orchestrator | 2026-04-24 07:16:12.390175 | orchestrator | TASK [ceilometer : Copying over event_pipeline.yaml] *************************** 2026-04-24 07:16:12.390178 | orchestrator | Friday 24 April 2026 07:16:03 +0000 (0:00:02.983) 0:01:37.691 ********** 2026-04-24 07:16:12.390182 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:16:12.390186 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:16:12.390190 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:16:12.390194 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:16:12.390207 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:16:12.390211 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:16:12.390215 | orchestrator | 2026-04-24 07:16:12.390219 | orchestrator | TASK [ceilometer : Check custom pipeline.yaml exists] ************************** 2026-04-24 07:16:12.390227 | orchestrator | Friday 24 April 2026 07:16:06 +0000 (0:00:02.790) 0:01:40.482 ********** 2026-04-24 07:16:12.390230 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:16:12.390234 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 07:16:12.390238 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 07:16:12.390242 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 07:16:12.390245 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 07:16:12.390249 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 07:16:12.390253 | orchestrator | 2026-04-24 07:16:12.390257 | orchestrator | TASK [ceilometer : Copying over custom pipeline.yaml file] ********************* 2026-04-24 07:16:12.390260 | orchestrator | Friday 24 April 2026 07:16:10 +0000 (0:00:03.942) 0:01:44.424 ********** 2026-04-24 07:16:12.390265 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:16:12.390274 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:16:12.390278 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:16:12.390285 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:12.390292 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:12.390305 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:15.211853 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:15.212037 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:15.212051 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:15.212058 | orchestrator | 2026-04-24 07:16:15.212065 | orchestrator | TASK [ceilometer : Copying over pipeline.yaml file] **************************** 2026-04-24 07:16:15.212074 | orchestrator | Friday 24 April 2026 07:16:13 +0000 (0:00:03.663) 0:01:48.088 ********** 2026-04-24 07:16:15.212081 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:16:15.212089 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:15.212108 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:16:15.212140 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:15.212148 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:16:15.212155 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:16:15.212161 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:15.212168 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:16:15.212174 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:15.212180 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:16:15.212187 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:16:15.212194 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:15.212200 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:16:15.212215 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:22.927264 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:16:22.927337 | orchestrator | 2026-04-24 07:16:22.927344 | orchestrator | TASK [ceilometer : Copying VMware vCenter CA file] ***************************** 2026-04-24 07:16:22.927350 | orchestrator | Friday 24 April 2026 07:16:16 +0000 (0:00:02.618) 0:01:50.707 ********** 2026-04-24 07:16:22.927354 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:16:22.927359 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:16:22.927363 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:16:22.927367 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:16:22.927371 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:16:22.927375 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:16:22.927379 | orchestrator | 2026-04-24 07:16:22.927383 | orchestrator | TASK [ceilometer : Copying over existing policy file] ************************** 2026-04-24 07:16:22.927396 | orchestrator | Friday 24 April 2026 07:16:18 +0000 (0:00:02.173) 0:01:52.881 ********** 2026-04-24 07:16:22.927402 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:16:22.927408 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:22.927413 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:16:22.927417 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:22.927439 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:16:22.927443 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:16:22.927458 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:16:22.927472 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:22.927476 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:16:22.927480 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:22.927485 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:16:22.927488 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:22.927492 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:16:22.927496 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:22.927500 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:16:22.927508 | orchestrator | 2026-04-24 07:16:22.927512 | orchestrator | TASK [service-check-containers : ceilometer | Check containers] **************** 2026-04-24 07:16:22.927516 | orchestrator | Friday 24 April 2026 07:16:21 +0000 (0:00:02.873) 0:01:55.755 ********** 2026-04-24 07:16:22.927521 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:16:22.927532 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:16:27.892817 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-24 07:16:27.892939 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:27.892949 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:27.892953 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:27.892979 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:27.892994 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:27.893009 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-24 07:16:27.893014 | orchestrator | 2026-04-24 07:16:27.893026 | orchestrator | TASK [service-check-containers : ceilometer | Notify handlers to restart containers] *** 2026-04-24 07:16:27.893031 | orchestrator | Friday 24 April 2026 07:16:25 +0000 (0:00:03.592) 0:01:59.348 ********** 2026-04-24 07:16:27.893037 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:16:27.893041 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:16:27.893045 | orchestrator | } 2026-04-24 07:16:27.893049 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:16:27.893053 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:16:27.893057 | orchestrator | } 2026-04-24 07:16:27.893061 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:16:27.893065 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:16:27.893068 | orchestrator | } 2026-04-24 07:16:27.893072 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 07:16:27.893076 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:16:27.893080 | orchestrator | } 2026-04-24 07:16:27.893084 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 07:16:27.893087 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:16:27.893091 | orchestrator | } 2026-04-24 07:16:27.893095 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 07:16:27.893099 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:16:27.893103 | orchestrator | } 2026-04-24 07:16:27.893107 | orchestrator | 2026-04-24 07:16:27.893111 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:16:27.893115 | orchestrator | Friday 24 April 2026 07:16:27 +0000 (0:00:02.103) 0:02:01.451 ********** 2026-04-24 07:16:27.893119 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:16:27.893128 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:27.893136 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:16:27.893140 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:16:27.893147 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:17:35.070246 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:17:35.070322 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-24 07:17:35.070334 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:17:35.070354 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:17:35.070360 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:17:35.070366 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:17:35.070372 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:17:35.070377 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:17:35.070392 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-24 07:17:35.070398 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:17:35.070404 | orchestrator | 2026-04-24 07:17:35.070410 | orchestrator | TASK [ceilometer : Running Ceilometer bootstrap container] ********************* 2026-04-24 07:17:35.070416 | orchestrator | Friday 24 April 2026 07:16:30 +0000 (0:00:03.400) 0:02:04.852 ********** 2026-04-24 07:17:35.070422 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:17:35.070427 | orchestrator | 2026-04-24 07:17:35.070433 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 07:17:35.070438 | orchestrator | Friday 24 April 2026 07:16:40 +0000 (0:00:10.105) 0:02:14.957 ********** 2026-04-24 07:17:35.070444 | orchestrator | 2026-04-24 07:17:35.070449 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 07:17:35.070469 | orchestrator | Friday 24 April 2026 07:16:41 +0000 (0:00:00.818) 0:02:15.776 ********** 2026-04-24 07:17:35.070479 | orchestrator | 2026-04-24 07:17:35.070486 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 07:17:35.070491 | orchestrator | Friday 24 April 2026 07:16:42 +0000 (0:00:00.478) 0:02:16.254 ********** 2026-04-24 07:17:35.070497 | orchestrator | 2026-04-24 07:17:35.070502 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 07:17:35.070508 | orchestrator | Friday 24 April 2026 07:16:42 +0000 (0:00:00.508) 0:02:16.763 ********** 2026-04-24 07:17:35.070513 | orchestrator | 2026-04-24 07:17:35.070518 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 07:17:35.070525 | orchestrator | Friday 24 April 2026 07:16:43 +0000 (0:00:00.497) 0:02:17.260 ********** 2026-04-24 07:17:35.070541 | orchestrator | 2026-04-24 07:17:35.070551 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-24 07:17:35.070558 | orchestrator | Friday 24 April 2026 07:16:43 +0000 (0:00:00.496) 0:02:17.757 ********** 2026-04-24 07:17:35.070564 | orchestrator | 2026-04-24 07:17:35.070569 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-notification container] ******* 2026-04-24 07:17:35.070574 | orchestrator | Friday 24 April 2026 07:16:44 +0000 (0:00:00.938) 0:02:18.695 ********** 2026-04-24 07:17:35.070580 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:17:35.070585 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:17:35.070591 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:17:35.070596 | orchestrator | 2026-04-24 07:17:35.070602 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-central container] ************ 2026-04-24 07:17:35.070607 | orchestrator | Friday 24 April 2026 07:17:02 +0000 (0:00:18.232) 0:02:36.927 ********** 2026-04-24 07:17:35.070612 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:17:35.070618 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:17:35.070623 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:17:35.070629 | orchestrator | 2026-04-24 07:17:35.070634 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-compute container] ************ 2026-04-24 07:17:35.070640 | orchestrator | Friday 24 April 2026 07:17:16 +0000 (0:00:13.469) 0:02:50.396 ********** 2026-04-24 07:17:35.070645 | orchestrator | changed: [testbed-node-5] 2026-04-24 07:17:35.070651 | orchestrator | changed: [testbed-node-4] 2026-04-24 07:17:35.070656 | orchestrator | changed: [testbed-node-3] 2026-04-24 07:17:35.070661 | orchestrator | 2026-04-24 07:17:35.070667 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:17:35.070673 | orchestrator | testbed-node-0 : ok=26  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-24 07:17:35.070680 | orchestrator | testbed-node-1 : ok=24  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 07:17:35.070685 | orchestrator | testbed-node-2 : ok=24  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 07:17:35.070691 | orchestrator | testbed-node-3 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-24 07:17:35.070696 | orchestrator | testbed-node-4 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-24 07:17:35.070702 | orchestrator | testbed-node-5 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-24 07:17:35.070707 | orchestrator | 2026-04-24 07:17:35.070712 | orchestrator | 2026-04-24 07:17:35.070718 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:17:35.070723 | orchestrator | Friday 24 April 2026 07:17:35 +0000 (0:00:18.881) 0:03:09.278 ********** 2026-04-24 07:17:35.070729 | orchestrator | =============================================================================== 2026-04-24 07:17:35.070734 | orchestrator | ceilometer : Restart ceilometer-compute container ---------------------- 18.88s 2026-04-24 07:17:35.070740 | orchestrator | ceilometer : Restart ceilometer-notification container ----------------- 18.23s 2026-04-24 07:17:35.070745 | orchestrator | ceilometer : Restart ceilometer-central container ---------------------- 13.47s 2026-04-24 07:17:35.070750 | orchestrator | ceilometer : Running Ceilometer bootstrap container -------------------- 10.11s 2026-04-24 07:17:35.070756 | orchestrator | ceilometer : Copying over ceilometer.conf ------------------------------- 7.28s 2026-04-24 07:17:35.070761 | orchestrator | ceilometer : include_tasks ---------------------------------------------- 6.21s 2026-04-24 07:17:35.070767 | orchestrator | ceilometer : Ensuring config directories exist -------------------------- 4.04s 2026-04-24 07:17:35.070775 | orchestrator | ceilometer : Check custom pipeline.yaml exists -------------------------- 3.94s 2026-04-24 07:17:35.070784 | orchestrator | ceilometer : Copying over config.json files for services ---------------- 3.92s 2026-04-24 07:17:35.070790 | orchestrator | service-cert-copy : ceilometer | Copying over extra CA certificates ----- 3.88s 2026-04-24 07:17:35.070795 | orchestrator | ceilometer : Flush handlers --------------------------------------------- 3.74s 2026-04-24 07:17:35.070800 | orchestrator | ceilometer : Copying over custom pipeline.yaml file --------------------- 3.66s 2026-04-24 07:17:35.070806 | orchestrator | service-check-containers : ceilometer | Check containers ---------------- 3.59s 2026-04-24 07:17:35.070925 | orchestrator | ceilometer : Check custom event_definitions.yaml exists ----------------- 3.56s 2026-04-24 07:17:35.070963 | orchestrator | ceilometer : Check if the folder for custom meter definitions exist ----- 3.47s 2026-04-24 07:17:35.070978 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.40s 2026-04-24 07:17:35.070997 | orchestrator | ceilometer : Check custom gnocchi_resources.yaml exists ----------------- 3.32s 2026-04-24 07:17:35.460905 | orchestrator | ceilometer : Check if custom polling.yaml exists ------------------------ 3.31s 2026-04-24 07:17:35.460967 | orchestrator | Group hosts based on Kolla action --------------------------------------- 3.17s 2026-04-24 07:17:35.460976 | orchestrator | service-cert-copy : ceilometer | Copying over backend internal TLS key --- 3.06s 2026-04-24 07:17:35.659188 | orchestrator | + osism apply -a upgrade aodh 2026-04-24 07:17:37.065569 | orchestrator | 2026-04-24 07:17:37 | INFO  | Prepare task for execution of aodh. 2026-04-24 07:17:37.153765 | orchestrator | 2026-04-24 07:17:37 | INFO  | Task 748b7bff-d936-42d0-9e07-feea2418f55b (aodh) was prepared for execution. 2026-04-24 07:17:37.153876 | orchestrator | 2026-04-24 07:17:37 | INFO  | It takes a moment until task 748b7bff-d936-42d0-9e07-feea2418f55b (aodh) has been started and output is visible here. 2026-04-24 07:17:52.898699 | orchestrator | 2026-04-24 07:17:52.898812 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:17:52.898823 | orchestrator | 2026-04-24 07:17:52.898830 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:17:52.898837 | orchestrator | Friday 24 April 2026 07:17:42 +0000 (0:00:01.715) 0:00:01.715 ********** 2026-04-24 07:17:52.898843 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:17:52.898851 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:17:52.898857 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:17:52.898863 | orchestrator | 2026-04-24 07:17:52.898869 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:17:52.898876 | orchestrator | Friday 24 April 2026 07:17:44 +0000 (0:00:01.997) 0:00:03.713 ********** 2026-04-24 07:17:52.898882 | orchestrator | ok: [testbed-node-0] => (item=enable_aodh_True) 2026-04-24 07:17:52.898889 | orchestrator | ok: [testbed-node-1] => (item=enable_aodh_True) 2026-04-24 07:17:52.898895 | orchestrator | ok: [testbed-node-2] => (item=enable_aodh_True) 2026-04-24 07:17:52.898901 | orchestrator | 2026-04-24 07:17:52.898907 | orchestrator | PLAY [Apply role aodh] ********************************************************* 2026-04-24 07:17:52.898913 | orchestrator | 2026-04-24 07:17:52.898919 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-24 07:17:52.898926 | orchestrator | Friday 24 April 2026 07:17:46 +0000 (0:00:01.861) 0:00:05.574 ********** 2026-04-24 07:17:52.898932 | orchestrator | included: /ansible/roles/aodh/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:17:52.898939 | orchestrator | 2026-04-24 07:17:52.898945 | orchestrator | TASK [aodh : Ensuring config directories exist] ******************************** 2026-04-24 07:17:52.898951 | orchestrator | Friday 24 April 2026 07:17:50 +0000 (0:00:03.793) 0:00:09.367 ********** 2026-04-24 07:17:52.898961 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:17:52.899009 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:17:52.899030 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:17:52.899037 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:17:52.899044 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:17:52.899050 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:17:52.899061 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:17:52.899071 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:17:52.899076 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:17:52.899087 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:17:58.174073 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:17:58.174150 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:17:58.174174 | orchestrator | 2026-04-24 07:17:58.174179 | orchestrator | TASK [aodh : Check if policies shall be overwritten] *************************** 2026-04-24 07:17:58.174184 | orchestrator | Friday 24 April 2026 07:17:54 +0000 (0:00:04.202) 0:00:13.570 ********** 2026-04-24 07:17:58.174188 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:17:58.174193 | orchestrator | 2026-04-24 07:17:58.174197 | orchestrator | TASK [aodh : Set aodh policy file] ********************************************* 2026-04-24 07:17:58.174201 | orchestrator | Friday 24 April 2026 07:17:55 +0000 (0:00:01.290) 0:00:14.860 ********** 2026-04-24 07:17:58.174205 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:17:58.174209 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:17:58.174212 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:17:58.174216 | orchestrator | 2026-04-24 07:17:58.174220 | orchestrator | TASK [aodh : Copying over existing policy file] ******************************** 2026-04-24 07:17:58.174224 | orchestrator | Friday 24 April 2026 07:17:57 +0000 (0:00:01.572) 0:00:16.433 ********** 2026-04-24 07:17:58.174238 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:17:58.174245 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:17:58.174250 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:17:58.174264 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:17:58.174272 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:17:58.174276 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:17:58.174281 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:17:58.174287 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:17:58.174291 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:17:58.174295 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:17:58.174303 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:05.055983 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:05.056077 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:18:05.056086 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:18:05.056091 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:18:05.056097 | orchestrator | 2026-04-24 07:18:05.056102 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-24 07:18:05.056107 | orchestrator | Friday 24 April 2026 07:17:59 +0000 (0:00:02.215) 0:00:18.648 ********** 2026-04-24 07:18:05.056124 | orchestrator | included: /ansible/roles/aodh/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:18:05.056130 | orchestrator | 2026-04-24 07:18:05.056134 | orchestrator | TASK [service-cert-copy : aodh | Copying over extra CA certificates] *********** 2026-04-24 07:18:05.056138 | orchestrator | Friday 24 April 2026 07:18:01 +0000 (0:00:02.124) 0:00:20.772 ********** 2026-04-24 07:18:05.056143 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:05.056161 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:05.056182 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:05.056186 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:05.056194 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:05.056199 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:05.056203 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:05.056214 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:09.031406 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:09.031490 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:09.031497 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:09.031514 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:09.031519 | orchestrator | 2026-04-24 07:18:09.031525 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS certificate] *** 2026-04-24 07:18:09.031531 | orchestrator | Friday 24 April 2026 07:18:07 +0000 (0:00:06.282) 0:00:27.055 ********** 2026-04-24 07:18:09.031536 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:09.031568 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:09.031574 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:09.031578 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:18:09.031585 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:09.031590 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:18:09.031594 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:18:09.031603 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:09.031612 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:18:11.391944 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:11.392013 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:18:11.392032 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:18:11.392037 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:18:11.392043 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:18:11.392065 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:18:11.392069 | orchestrator | 2026-04-24 07:18:11.392074 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS key] ******** 2026-04-24 07:18:11.392079 | orchestrator | Friday 24 April 2026 07:18:10 +0000 (0:00:02.662) 0:00:29.718 ********** 2026-04-24 07:18:11.392084 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:11.392101 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:11.392105 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:11.392113 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:11.392117 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:18:11.392125 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:11.392129 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:18:11.392137 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:18:16.370430 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:18:16.370536 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:16.370570 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:18:16.370578 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:18:16.370603 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:18:16.370612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:18:16.370620 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:18:16.370626 | orchestrator | 2026-04-24 07:18:16.370634 | orchestrator | TASK [aodh : Copying over config.json files for services] ********************** 2026-04-24 07:18:16.370643 | orchestrator | Friday 24 April 2026 07:18:12 +0000 (0:00:02.339) 0:00:32.058 ********** 2026-04-24 07:18:16.370651 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:16.370680 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:16.370693 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:16.370704 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:16.370710 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:16.370746 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:16.370752 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:16.370762 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744770 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744872 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744882 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744889 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744896 | orchestrator | 2026-04-24 07:18:25.744903 | orchestrator | TASK [aodh : Copying over aodh.conf] ******************************************* 2026-04-24 07:18:25.744910 | orchestrator | Friday 24 April 2026 07:18:18 +0000 (0:00:05.795) 0:00:37.854 ********** 2026-04-24 07:18:25.744917 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:25.744945 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:25.744957 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:25.744964 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744970 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744976 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744982 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:25.744994 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:35.690186 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:35.690281 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:35.690291 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:35.690300 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:35.690307 | orchestrator | 2026-04-24 07:18:35.690315 | orchestrator | TASK [aodh : Copying over wsgi-aodh files for services] ************************ 2026-04-24 07:18:35.690324 | orchestrator | Friday 24 April 2026 07:18:29 +0000 (0:00:10.851) 0:00:48.706 ********** 2026-04-24 07:18:35.690330 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:18:35.690339 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:18:35.690345 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:18:35.690352 | orchestrator | 2026-04-24 07:18:35.690358 | orchestrator | TASK [service-check-containers : aodh | Check containers] ********************** 2026-04-24 07:18:35.690365 | orchestrator | Friday 24 April 2026 07:18:32 +0000 (0:00:03.124) 0:00:51.831 ********** 2026-04-24 07:18:35.690372 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:35.690424 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:35.690433 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:18:35.690440 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:35.690448 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:35.690455 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-24 07:18:35.690476 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:40.600863 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:40.600963 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:40.600972 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:40.600976 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:40.600981 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-24 07:18:40.601004 | orchestrator | 2026-04-24 07:18:40.601009 | orchestrator | TASK [service-check-containers : aodh | Notify handlers to restart containers] *** 2026-04-24 07:18:40.601015 | orchestrator | Friday 24 April 2026 07:18:38 +0000 (0:00:05.573) 0:00:57.404 ********** 2026-04-24 07:18:40.601020 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:18:40.601025 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:18:40.601029 | orchestrator | } 2026-04-24 07:18:40.601033 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:18:40.601037 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:18:40.601041 | orchestrator | } 2026-04-24 07:18:40.601044 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:18:40.601048 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:18:40.601052 | orchestrator | } 2026-04-24 07:18:40.601055 | orchestrator | 2026-04-24 07:18:40.601059 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:18:40.601063 | orchestrator | Friday 24 April 2026 07:18:40 +0000 (0:00:01.842) 0:00:59.247 ********** 2026-04-24 07:18:40.601089 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:40.601097 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:40.601102 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:18:40.601106 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:18:40.601114 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:18:40.601118 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:18:40.601123 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:18:40.601133 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:20:04.177363 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:20:04.177471 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:20:04.177483 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:20:04.177510 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-24 07:20:04.177515 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-24 07:20:04.177520 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-24 07:20:04.177537 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:20:04.177546 | orchestrator | 2026-04-24 07:20:04.177556 | orchestrator | TASK [aodh : Running aodh bootstrap container] ********************************* 2026-04-24 07:20:04.177564 | orchestrator | Friday 24 April 2026 07:18:42 +0000 (0:00:02.312) 0:01:01.559 ********** 2026-04-24 07:20:04.177570 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:20:04.177576 | orchestrator | 2026-04-24 07:20:04.177632 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-24 07:20:04.177638 | orchestrator | Friday 24 April 2026 07:19:00 +0000 (0:00:17.873) 0:01:19.433 ********** 2026-04-24 07:20:04.177644 | orchestrator | 2026-04-24 07:20:04.177650 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-24 07:20:04.177656 | orchestrator | Friday 24 April 2026 07:19:00 +0000 (0:00:00.515) 0:01:19.949 ********** 2026-04-24 07:20:04.177662 | orchestrator | 2026-04-24 07:20:04.177683 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-24 07:20:04.177690 | orchestrator | Friday 24 April 2026 07:19:01 +0000 (0:00:00.500) 0:01:20.450 ********** 2026-04-24 07:20:04.177697 | orchestrator | 2026-04-24 07:20:04.177704 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-api container] **************************** 2026-04-24 07:20:04.177717 | orchestrator | Friday 24 April 2026 07:19:02 +0000 (0:00:01.182) 0:01:21.633 ********** 2026-04-24 07:20:04.177721 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:20:04.177730 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:20:04.177735 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:20:04.177739 | orchestrator | 2026-04-24 07:20:04.177743 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-evaluator container] ********************** 2026-04-24 07:20:04.177746 | orchestrator | Friday 24 April 2026 07:19:16 +0000 (0:00:14.001) 0:01:35.634 ********** 2026-04-24 07:20:04.177750 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:20:04.177754 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:20:04.177758 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:20:04.177768 | orchestrator | 2026-04-24 07:20:04.177772 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-listener container] *********************** 2026-04-24 07:20:04.177776 | orchestrator | Friday 24 April 2026 07:19:30 +0000 (0:00:13.873) 0:01:49.508 ********** 2026-04-24 07:20:04.177780 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:20:04.177784 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:20:04.177787 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:20:04.177791 | orchestrator | 2026-04-24 07:20:04.177795 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-notifier container] *********************** 2026-04-24 07:20:04.177799 | orchestrator | Friday 24 April 2026 07:19:44 +0000 (0:00:13.802) 0:02:03.310 ********** 2026-04-24 07:20:04.177802 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:20:04.177806 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:20:04.177810 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:20:04.177814 | orchestrator | 2026-04-24 07:20:04.177817 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:20:04.177822 | orchestrator | testbed-node-0 : ok=16  changed=9  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:20:04.177828 | orchestrator | testbed-node-1 : ok=15  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 07:20:04.177832 | orchestrator | testbed-node-2 : ok=15  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 07:20:04.177836 | orchestrator | 2026-04-24 07:20:04.177839 | orchestrator | 2026-04-24 07:20:04.177843 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:20:04.177847 | orchestrator | Friday 24 April 2026 07:20:03 +0000 (0:00:19.595) 0:02:22.905 ********** 2026-04-24 07:20:04.177850 | orchestrator | =============================================================================== 2026-04-24 07:20:04.177854 | orchestrator | aodh : Restart aodh-notifier container --------------------------------- 19.60s 2026-04-24 07:20:04.177858 | orchestrator | aodh : Running aodh bootstrap container -------------------------------- 17.87s 2026-04-24 07:20:04.177862 | orchestrator | aodh : Restart aodh-api container -------------------------------------- 14.00s 2026-04-24 07:20:04.177865 | orchestrator | aodh : Restart aodh-evaluator container -------------------------------- 13.87s 2026-04-24 07:20:04.177869 | orchestrator | aodh : Restart aodh-listener container --------------------------------- 13.80s 2026-04-24 07:20:04.177873 | orchestrator | aodh : Copying over aodh.conf ------------------------------------------ 10.85s 2026-04-24 07:20:04.177876 | orchestrator | service-cert-copy : aodh | Copying over extra CA certificates ----------- 6.28s 2026-04-24 07:20:04.177880 | orchestrator | aodh : Copying over config.json files for services ---------------------- 5.80s 2026-04-24 07:20:04.177884 | orchestrator | service-check-containers : aodh | Check containers ---------------------- 5.57s 2026-04-24 07:20:04.177888 | orchestrator | aodh : Ensuring config directories exist -------------------------------- 4.20s 2026-04-24 07:20:04.177891 | orchestrator | aodh : include_tasks ---------------------------------------------------- 3.79s 2026-04-24 07:20:04.177895 | orchestrator | aodh : Copying over wsgi-aodh files for services ------------------------ 3.12s 2026-04-24 07:20:04.177899 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS certificate --- 2.66s 2026-04-24 07:20:04.177905 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS key -------- 2.34s 2026-04-24 07:20:04.177909 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.31s 2026-04-24 07:20:04.177913 | orchestrator | aodh : Copying over existing policy file -------------------------------- 2.22s 2026-04-24 07:20:04.177918 | orchestrator | aodh : Flush handlers --------------------------------------------------- 2.20s 2026-04-24 07:20:04.177922 | orchestrator | aodh : include_tasks ---------------------------------------------------- 2.12s 2026-04-24 07:20:04.177932 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.00s 2026-04-24 07:20:04.177940 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.86s 2026-04-24 07:20:04.504813 | orchestrator | ++ semver 10.0.0 7.0.0 2026-04-24 07:20:04.547514 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 07:20:04.547614 | orchestrator | + osism apply -a bootstrap octavia 2026-04-24 07:20:06.311028 | orchestrator | 2026-04-24 07:20:06 | INFO  | Prepare task for execution of octavia. 2026-04-24 07:20:06.391871 | orchestrator | 2026-04-24 07:20:06 | INFO  | Task 17606a96-fe73-4ac5-be64-13b5b5cb0438 (octavia) was prepared for execution. 2026-04-24 07:20:06.391962 | orchestrator | 2026-04-24 07:20:06 | INFO  | It takes a moment until task 17606a96-fe73-4ac5-be64-13b5b5cb0438 (octavia) has been started and output is visible here. 2026-04-24 07:20:58.187312 | orchestrator | 2026-04-24 07:20:58.187370 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:20:58.187377 | orchestrator | 2026-04-24 07:20:58.187382 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:20:58.187386 | orchestrator | Friday 24 April 2026 07:20:12 +0000 (0:00:01.895) 0:00:01.896 ********** 2026-04-24 07:20:58.187390 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:20:58.187394 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:20:58.187399 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:20:58.187402 | orchestrator | 2026-04-24 07:20:58.187406 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:20:58.187411 | orchestrator | Friday 24 April 2026 07:20:14 +0000 (0:00:02.458) 0:00:04.354 ********** 2026-04-24 07:20:58.187415 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-24 07:20:58.187419 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-24 07:20:58.187423 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-24 07:20:58.187427 | orchestrator | 2026-04-24 07:20:58.187431 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-24 07:20:58.187435 | orchestrator | 2026-04-24 07:20:58.187438 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 07:20:58.187442 | orchestrator | Friday 24 April 2026 07:20:17 +0000 (0:00:02.197) 0:00:06.552 ********** 2026-04-24 07:20:58.187447 | orchestrator | included: /ansible/roles/octavia/tasks/bootstrap.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:20:58.187451 | orchestrator | 2026-04-24 07:20:58.187455 | orchestrator | TASK [octavia : Creating Octavia database] ************************************* 2026-04-24 07:20:58.187459 | orchestrator | Friday 24 April 2026 07:20:19 +0000 (0:00:02.514) 0:00:09.067 ********** 2026-04-24 07:20:58.187463 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:20:58.187467 | orchestrator | 2026-04-24 07:20:58.187471 | orchestrator | TASK [octavia : Creating Octavia persistence database] ************************* 2026-04-24 07:20:58.187475 | orchestrator | Friday 24 April 2026 07:20:23 +0000 (0:00:03.911) 0:00:12.978 ********** 2026-04-24 07:20:58.187478 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:20:58.187482 | orchestrator | 2026-04-24 07:20:58.187487 | orchestrator | TASK [octavia : Creating Octavia database user and setting permissions] ******** 2026-04-24 07:20:58.187491 | orchestrator | Friday 24 April 2026 07:20:26 +0000 (0:00:03.308) 0:00:16.287 ********** 2026-04-24 07:20:58.187495 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:20:58.187499 | orchestrator | 2026-04-24 07:20:58.187503 | orchestrator | TASK [octavia : Creating Octavia persistence database user and setting permissions] *** 2026-04-24 07:20:58.187507 | orchestrator | Friday 24 April 2026 07:20:30 +0000 (0:00:03.603) 0:00:19.890 ********** 2026-04-24 07:20:58.187511 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:20:58.187542 | orchestrator | 2026-04-24 07:20:58.187546 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-24 07:20:58.187550 | orchestrator | Friday 24 April 2026 07:20:34 +0000 (0:00:03.858) 0:00:23.749 ********** 2026-04-24 07:20:58.187554 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:20:58.187559 | orchestrator | 2026-04-24 07:20:58.187563 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:20:58.187582 | orchestrator | testbed-node-0 : ok=8  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 07:20:58.187587 | orchestrator | testbed-node-1 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 07:20:58.187592 | orchestrator | testbed-node-2 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 07:20:58.187599 | orchestrator | 2026-04-24 07:20:58.187605 | orchestrator | 2026-04-24 07:20:58.187612 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:20:58.187618 | orchestrator | Friday 24 April 2026 07:20:57 +0000 (0:00:23.484) 0:00:47.233 ********** 2026-04-24 07:20:58.187625 | orchestrator | =============================================================================== 2026-04-24 07:20:58.187631 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 23.48s 2026-04-24 07:20:58.187637 | orchestrator | octavia : Creating Octavia database ------------------------------------- 3.91s 2026-04-24 07:20:58.187644 | orchestrator | octavia : Creating Octavia persistence database user and setting permissions --- 3.86s 2026-04-24 07:20:58.187651 | orchestrator | octavia : Creating Octavia database user and setting permissions -------- 3.60s 2026-04-24 07:20:58.187658 | orchestrator | octavia : Creating Octavia persistence database ------------------------- 3.31s 2026-04-24 07:20:58.187665 | orchestrator | octavia : include_tasks ------------------------------------------------- 2.51s 2026-04-24 07:20:58.187672 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.46s 2026-04-24 07:20:58.187678 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.20s 2026-04-24 07:20:58.348849 | orchestrator | + osism apply -a upgrade octavia 2026-04-24 07:20:59.642404 | orchestrator | 2026-04-24 07:20:59 | INFO  | Prepare task for execution of octavia. 2026-04-24 07:20:59.703923 | orchestrator | 2026-04-24 07:20:59 | INFO  | Task 14814230-f0d7-462e-9ac5-78f7c15b6129 (octavia) was prepared for execution. 2026-04-24 07:20:59.703981 | orchestrator | 2026-04-24 07:20:59 | INFO  | It takes a moment until task 14814230-f0d7-462e-9ac5-78f7c15b6129 (octavia) has been started and output is visible here. 2026-04-24 07:21:42.754909 | orchestrator | 2026-04-24 07:21:42.754990 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:21:42.754997 | orchestrator | 2026-04-24 07:21:42.755001 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:21:42.755006 | orchestrator | Friday 24 April 2026 07:21:04 +0000 (0:00:01.612) 0:00:01.612 ********** 2026-04-24 07:21:42.755010 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:21:42.755015 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:21:42.755020 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:21:42.755035 | orchestrator | 2026-04-24 07:21:42.755042 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:21:42.755049 | orchestrator | Friday 24 April 2026 07:21:06 +0000 (0:00:02.445) 0:00:04.058 ********** 2026-04-24 07:21:42.755055 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-24 07:21:42.755062 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-24 07:21:42.755068 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-24 07:21:42.755074 | orchestrator | 2026-04-24 07:21:42.755088 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-24 07:21:42.755098 | orchestrator | 2026-04-24 07:21:42.755104 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 07:21:42.755110 | orchestrator | Friday 24 April 2026 07:21:09 +0000 (0:00:02.636) 0:00:06.695 ********** 2026-04-24 07:21:42.755118 | orchestrator | included: /ansible/roles/octavia/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:21:42.755126 | orchestrator | 2026-04-24 07:21:42.755135 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 07:21:42.755164 | orchestrator | Friday 24 April 2026 07:21:13 +0000 (0:00:04.177) 0:00:10.872 ********** 2026-04-24 07:21:42.755170 | orchestrator | included: /ansible/roles/octavia/tasks/get_resources_info.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:21:42.755176 | orchestrator | 2026-04-24 07:21:42.755182 | orchestrator | TASK [octavia : Get amphora flavor info] *************************************** 2026-04-24 07:21:42.755188 | orchestrator | Friday 24 April 2026 07:21:15 +0000 (0:00:02.077) 0:00:12.950 ********** 2026-04-24 07:21:42.755193 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:21:42.755199 | orchestrator | 2026-04-24 07:21:42.755204 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-24 07:21:42.755210 | orchestrator | Friday 24 April 2026 07:21:21 +0000 (0:00:05.698) 0:00:18.648 ********** 2026-04-24 07:21:42.755216 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:21:42.755222 | orchestrator | 2026-04-24 07:21:42.755228 | orchestrator | TASK [octavia : Get security groups for octavia] ******************************* 2026-04-24 07:21:42.755234 | orchestrator | Friday 24 April 2026 07:21:25 +0000 (0:00:04.464) 0:00:23.112 ********** 2026-04-24 07:21:42.755240 | orchestrator | ok: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-24 07:21:42.755247 | orchestrator | ok: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-24 07:21:42.755253 | orchestrator | 2026-04-24 07:21:42.755259 | orchestrator | TASK [octavia : Get loadbalancer management network] *************************** 2026-04-24 07:21:42.755265 | orchestrator | Friday 24 April 2026 07:21:34 +0000 (0:00:08.616) 0:00:31.729 ********** 2026-04-24 07:21:42.755271 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:21:42.755276 | orchestrator | 2026-04-24 07:21:42.755282 | orchestrator | TASK [octavia : Set octavia resources facts] *********************************** 2026-04-24 07:21:42.755288 | orchestrator | Friday 24 April 2026 07:21:39 +0000 (0:00:04.768) 0:00:36.498 ********** 2026-04-24 07:21:42.755293 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:21:42.755299 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:21:42.755305 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:21:42.755311 | orchestrator | 2026-04-24 07:21:42.755317 | orchestrator | TASK [octavia : Ensuring config directories exist] ***************************** 2026-04-24 07:21:42.755323 | orchestrator | Friday 24 April 2026 07:21:40 +0000 (0:00:01.613) 0:00:38.111 ********** 2026-04-24 07:21:42.755333 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:21:42.755373 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:21:42.755392 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:21:42.755397 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:21:42.755401 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:21:42.755405 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:21:42.755412 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:42.755422 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:48.207250 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:48.207342 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:48.207357 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:48.207365 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:48.207373 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:21:48.207395 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:21:48.207442 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:21:48.207470 | orchestrator | 2026-04-24 07:21:48.207477 | orchestrator | TASK [octavia : Check if policies shall be overwritten] ************************ 2026-04-24 07:21:48.207483 | orchestrator | Friday 24 April 2026 07:21:44 +0000 (0:00:04.040) 0:00:42.152 ********** 2026-04-24 07:21:48.207488 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:21:48.207493 | orchestrator | 2026-04-24 07:21:48.207498 | orchestrator | TASK [octavia : Set octavia policy file] *************************************** 2026-04-24 07:21:48.207503 | orchestrator | Friday 24 April 2026 07:21:46 +0000 (0:00:01.271) 0:00:43.424 ********** 2026-04-24 07:21:48.207507 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:21:48.207512 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:21:48.207516 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:21:48.207520 | orchestrator | 2026-04-24 07:21:48.207525 | orchestrator | TASK [octavia : Copying over existing policy file] ***************************** 2026-04-24 07:21:48.207530 | orchestrator | Friday 24 April 2026 07:21:47 +0000 (0:00:01.554) 0:00:44.979 ********** 2026-04-24 07:21:48.207535 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:21:48.207542 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:21:48.207548 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:21:48.207555 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:21:48.207569 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:21:53.337680 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:21:53.337794 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:21:53.337811 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:21:53.337819 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:21:53.337828 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:21:53.337899 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:21:53.337906 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:21:53.337924 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:21:53.337929 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:21:53.337933 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:21:53.337937 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:21:53.337941 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:21:53.337949 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:21:53.337953 | orchestrator | 2026-04-24 07:21:53.337958 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-24 07:21:53.337966 | orchestrator | Friday 24 April 2026 07:21:49 +0000 (0:00:02.013) 0:00:46.992 ********** 2026-04-24 07:21:53.337970 | orchestrator | included: /ansible/roles/octavia/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:21:53.337975 | orchestrator | 2026-04-24 07:21:53.337979 | orchestrator | TASK [service-cert-copy : octavia | Copying over extra CA certificates] ******** 2026-04-24 07:21:53.337982 | orchestrator | Friday 24 April 2026 07:21:51 +0000 (0:00:02.011) 0:00:49.004 ********** 2026-04-24 07:21:53.337991 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:21:56.798336 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:21:56.798411 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:21:56.798489 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:21:56.798511 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:21:56.798518 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:21:56.798534 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:56.798540 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:56.798545 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:56.798549 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:56.798559 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:56.798566 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:21:56.798570 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:21:56.798579 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:21:58.818925 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:21:58.819018 | orchestrator | 2026-04-24 07:21:58.819029 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS certificate] *** 2026-04-24 07:21:58.819037 | orchestrator | Friday 24 April 2026 07:21:58 +0000 (0:00:06.480) 0:00:55.485 ********** 2026-04-24 07:21:58.819046 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:21:58.819080 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:21:58.819101 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:21:58.819109 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:21:58.819132 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:21:58.819140 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:21:58.819162 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:21:58.819184 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:21:58.819196 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:21:58.819202 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:21:58.819209 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:21:58.819215 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:21:58.819228 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:22:00.736584 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:22:00.736659 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:22:00.736680 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:22:00.736686 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:22:00.736692 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:22:00.736700 | orchestrator | 2026-04-24 07:22:00.736707 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS key] ***** 2026-04-24 07:22:00.736715 | orchestrator | Friday 24 April 2026 07:22:00 +0000 (0:00:01.938) 0:00:57.423 ********** 2026-04-24 07:22:00.736722 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:22:00.736744 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:22:00.736770 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:22:00.736777 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:22:00.736788 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:22:00.736795 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:22:00.736801 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:22:00.736808 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:22:00.736823 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:22:04.804293 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:22:04.804371 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:22:04.804379 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:22:04.804399 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:22:04.804405 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:22:04.804411 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:22:04.804461 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:22:04.804467 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:22:04.804471 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:22:04.804475 | orchestrator | 2026-04-24 07:22:04.804480 | orchestrator | TASK [octavia : Copying over config.json files for services] ******************* 2026-04-24 07:22:04.804485 | orchestrator | Friday 24 April 2026 07:22:02 +0000 (0:00:02.031) 0:00:59.455 ********** 2026-04-24 07:22:04.804492 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:22:04.804498 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:22:04.804502 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:22:04.804514 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:22:16.752633 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:22:16.752731 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:22:16.752752 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752759 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752764 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752786 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752804 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752809 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752817 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752822 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752827 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:22:16.752837 | orchestrator | 2026-04-24 07:22:16.752842 | orchestrator | TASK [octavia : Copying over octavia-wsgi.conf] ******************************** 2026-04-24 07:22:16.752849 | orchestrator | Friday 24 April 2026 07:22:09 +0000 (0:00:06.931) 0:01:06.386 ********** 2026-04-24 07:22:16.752853 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-24 07:22:16.752859 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-24 07:22:16.752864 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-24 07:22:16.752868 | orchestrator | 2026-04-24 07:22:16.752873 | orchestrator | TASK [octavia : Copying over octavia.conf] ************************************* 2026-04-24 07:22:16.752877 | orchestrator | Friday 24 April 2026 07:22:12 +0000 (0:00:03.002) 0:01:09.389 ********** 2026-04-24 07:22:16.752885 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:22:32.909234 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:22:32.909350 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:22:32.909385 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:22:32.909510 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:22:32.909523 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:22:32.909549 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:32.909560 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:32.909575 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:32.909585 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:32.909603 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:32.909612 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:22:32.909621 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:22:32.909638 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:23:00.651073 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:23:00.651175 | orchestrator | 2026-04-24 07:23:00.651187 | orchestrator | TASK [octavia : Copying over Octavia SSH key] ********************************** 2026-04-24 07:23:00.651196 | orchestrator | Friday 24 April 2026 07:22:34 +0000 (0:00:22.480) 0:01:31.870 ********** 2026-04-24 07:23:00.651233 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:23:00.651241 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:23:00.651247 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:23:00.651253 | orchestrator | 2026-04-24 07:23:00.651258 | orchestrator | TASK [octavia : Copying certificate files for octavia-worker] ****************** 2026-04-24 07:23:00.651264 | orchestrator | Friday 24 April 2026 07:22:37 +0000 (0:00:03.057) 0:01:34.927 ********** 2026-04-24 07:23:00.651271 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651277 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651283 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651288 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651295 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651357 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651363 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651462 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651469 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651473 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651477 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651481 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651485 | orchestrator | 2026-04-24 07:23:00.651489 | orchestrator | TASK [octavia : Copying certificate files for octavia-housekeeping] ************ 2026-04-24 07:23:00.651493 | orchestrator | Friday 24 April 2026 07:22:44 +0000 (0:00:06.430) 0:01:41.358 ********** 2026-04-24 07:23:00.651496 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651501 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651504 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651508 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651512 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651515 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651519 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651523 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651527 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651530 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651534 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651538 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651541 | orchestrator | 2026-04-24 07:23:00.651545 | orchestrator | TASK [octavia : Copying certificate files for octavia-health-manager] ********** 2026-04-24 07:23:00.651549 | orchestrator | Friday 24 April 2026 07:22:50 +0000 (0:00:06.761) 0:01:48.119 ********** 2026-04-24 07:23:00.651552 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651556 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651560 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-24 07:23:00.651564 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651567 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651571 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-24 07:23:00.651575 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651579 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651582 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-24 07:23:00.651586 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651590 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651602 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-24 07:23:00.651606 | orchestrator | 2026-04-24 07:23:00.651611 | orchestrator | TASK [service-check-containers : octavia | Check containers] ******************* 2026-04-24 07:23:00.651615 | orchestrator | Friday 24 April 2026 07:22:57 +0000 (0:00:07.116) 0:01:55.236 ********** 2026-04-24 07:23:00.651646 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:23:00.651655 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:23:00.651661 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-24 07:23:00.651666 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:23:00.651672 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:23:00.651685 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-24 07:23:06.560911 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:23:06.560992 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:23:06.560999 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-24 07:23:06.561005 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:23:06.561010 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:23:06.561030 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-24 07:23:06.561079 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:23:06.561090 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:23:06.561097 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-24 07:23:06.561104 | orchestrator | 2026-04-24 07:23:06.561113 | orchestrator | TASK [service-check-containers : octavia | Notify handlers to restart containers] *** 2026-04-24 07:23:06.561123 | orchestrator | Friday 24 April 2026 07:23:04 +0000 (0:00:06.569) 0:02:01.805 ********** 2026-04-24 07:23:06.561131 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:23:06.561136 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:23:06.561141 | orchestrator | } 2026-04-24 07:23:06.561145 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:23:06.561156 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:23:06.561161 | orchestrator | } 2026-04-24 07:23:06.561170 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:23:06.561175 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:23:06.561179 | orchestrator | } 2026-04-24 07:23:06.561183 | orchestrator | 2026-04-24 07:23:06.561187 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:23:06.561191 | orchestrator | Friday 24 April 2026 07:23:06 +0000 (0:00:01.593) 0:02:03.399 ********** 2026-04-24 07:23:06.561196 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:23:06.561208 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:23:06.561223 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:23:06.824774 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:23:06.824843 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:23:06.824850 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:23:06.824856 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:23:06.824879 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:23:06.824885 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:23:06.824910 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:23:06.824915 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:23:06.824919 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:23:06.824923 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-24 07:23:06.824931 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-24 07:23:06.824935 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-24 07:23:06.824939 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-24 07:23:06.824949 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-24 07:24:42.440443 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:24:42.440550 | orchestrator | 2026-04-24 07:24:42.440560 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-24 07:24:42.440567 | orchestrator | Friday 24 April 2026 07:23:08 +0000 (0:00:02.643) 0:02:06.043 ********** 2026-04-24 07:24:42.440573 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:24:42.440578 | orchestrator | 2026-04-24 07:24:42.440583 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-24 07:24:42.440588 | orchestrator | Friday 24 April 2026 07:23:22 +0000 (0:00:14.097) 0:02:20.141 ********** 2026-04-24 07:24:42.440593 | orchestrator | 2026-04-24 07:24:42.440598 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-24 07:24:42.440603 | orchestrator | Friday 24 April 2026 07:23:23 +0000 (0:00:00.494) 0:02:20.635 ********** 2026-04-24 07:24:42.440608 | orchestrator | 2026-04-24 07:24:42.440613 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-24 07:24:42.440618 | orchestrator | Friday 24 April 2026 07:23:23 +0000 (0:00:00.520) 0:02:21.155 ********** 2026-04-24 07:24:42.440623 | orchestrator | 2026-04-24 07:24:42.440628 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-api container] ********************** 2026-04-24 07:24:42.440633 | orchestrator | Friday 24 April 2026 07:23:24 +0000 (0:00:00.972) 0:02:22.128 ********** 2026-04-24 07:24:42.440637 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:24:42.440659 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:24:42.440664 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:24:42.440669 | orchestrator | 2026-04-24 07:24:42.440674 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-driver-agent container] ************* 2026-04-24 07:24:42.440678 | orchestrator | Friday 24 April 2026 07:23:44 +0000 (0:00:19.487) 0:02:41.615 ********** 2026-04-24 07:24:42.440683 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:24:42.440688 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:24:42.440693 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:24:42.440698 | orchestrator | 2026-04-24 07:24:42.440702 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-health-manager container] *********** 2026-04-24 07:24:42.440710 | orchestrator | Friday 24 April 2026 07:23:59 +0000 (0:00:15.197) 0:02:56.812 ********** 2026-04-24 07:24:42.440718 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:24:42.440726 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:24:42.440733 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:24:42.440741 | orchestrator | 2026-04-24 07:24:42.440748 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-housekeeping container] ************* 2026-04-24 07:24:42.440756 | orchestrator | Friday 24 April 2026 07:24:13 +0000 (0:00:14.117) 0:03:10.930 ********** 2026-04-24 07:24:42.440764 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:24:42.440771 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:24:42.440779 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:24:42.440787 | orchestrator | 2026-04-24 07:24:42.440794 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-worker container] ******************* 2026-04-24 07:24:42.440803 | orchestrator | Friday 24 April 2026 07:24:27 +0000 (0:00:14.105) 0:03:25.035 ********** 2026-04-24 07:24:42.440809 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:24:42.440814 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:24:42.440819 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:24:42.440823 | orchestrator | 2026-04-24 07:24:42.440828 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:24:42.440834 | orchestrator | testbed-node-0 : ok=27  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:24:42.440841 | orchestrator | testbed-node-1 : ok=22  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 07:24:42.440845 | orchestrator | testbed-node-2 : ok=22  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 07:24:42.440850 | orchestrator | 2026-04-24 07:24:42.440855 | orchestrator | 2026-04-24 07:24:42.440860 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:24:42.440865 | orchestrator | Friday 24 April 2026 07:24:41 +0000 (0:00:14.186) 0:03:39.221 ********** 2026-04-24 07:24:42.440869 | orchestrator | =============================================================================== 2026-04-24 07:24:42.440874 | orchestrator | octavia : Copying over octavia.conf ------------------------------------ 22.48s 2026-04-24 07:24:42.440879 | orchestrator | octavia : Restart octavia-api container -------------------------------- 19.49s 2026-04-24 07:24:42.440884 | orchestrator | octavia : Restart octavia-driver-agent container ----------------------- 15.20s 2026-04-24 07:24:42.440888 | orchestrator | octavia : Restart octavia-worker container ----------------------------- 14.19s 2026-04-24 07:24:42.440893 | orchestrator | octavia : Restart octavia-health-manager container --------------------- 14.12s 2026-04-24 07:24:42.440898 | orchestrator | octavia : Restart octavia-housekeeping container ----------------------- 14.10s 2026-04-24 07:24:42.440903 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 14.10s 2026-04-24 07:24:42.440907 | orchestrator | octavia : Get security groups for octavia ------------------------------- 8.62s 2026-04-24 07:24:42.440912 | orchestrator | octavia : Copying certificate files for octavia-health-manager ---------- 7.12s 2026-04-24 07:24:42.440917 | orchestrator | octavia : Copying over config.json files for services ------------------- 6.93s 2026-04-24 07:24:42.440927 | orchestrator | octavia : Copying certificate files for octavia-housekeeping ------------ 6.76s 2026-04-24 07:24:42.440932 | orchestrator | service-check-containers : octavia | Check containers ------------------- 6.57s 2026-04-24 07:24:42.440936 | orchestrator | service-cert-copy : octavia | Copying over extra CA certificates -------- 6.48s 2026-04-24 07:24:42.440958 | orchestrator | octavia : Copying certificate files for octavia-worker ------------------ 6.43s 2026-04-24 07:24:42.440985 | orchestrator | octavia : Get amphora flavor info --------------------------------------- 5.70s 2026-04-24 07:24:42.440990 | orchestrator | octavia : Get loadbalancer management network --------------------------- 4.77s 2026-04-24 07:24:42.440996 | orchestrator | octavia : Get service project id ---------------------------------------- 4.46s 2026-04-24 07:24:42.441001 | orchestrator | octavia : include_tasks ------------------------------------------------- 4.18s 2026-04-24 07:24:42.441006 | orchestrator | octavia : Ensuring config directories exist ----------------------------- 4.04s 2026-04-24 07:24:42.441012 | orchestrator | octavia : Copying over Octavia SSH key ---------------------------------- 3.06s 2026-04-24 07:24:42.700510 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-24 07:24:42.700582 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/310-openstack-extended.sh 2026-04-24 07:24:44.240249 | orchestrator | 2026-04-24 07:24:44 | INFO  | Prepare task for execution of gnocchi. 2026-04-24 07:24:44.316081 | orchestrator | 2026-04-24 07:24:44 | INFO  | Task 84fda0d2-0001-4a90-ab9e-4e3ff6231a6c (gnocchi) was prepared for execution. 2026-04-24 07:24:44.316147 | orchestrator | 2026-04-24 07:24:44 | INFO  | It takes a moment until task 84fda0d2-0001-4a90-ab9e-4e3ff6231a6c (gnocchi) has been started and output is visible here. 2026-04-24 07:24:58.510435 | orchestrator | 2026-04-24 07:24:58.510542 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:24:58.510559 | orchestrator | 2026-04-24 07:24:58.510570 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:24:58.510581 | orchestrator | Friday 24 April 2026 07:24:50 +0000 (0:00:01.770) 0:00:01.770 ********** 2026-04-24 07:24:58.510592 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:24:58.510604 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:24:58.510613 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:24:58.510623 | orchestrator | 2026-04-24 07:24:58.510633 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:24:58.510642 | orchestrator | Friday 24 April 2026 07:24:52 +0000 (0:00:02.237) 0:00:04.007 ********** 2026-04-24 07:24:58.510652 | orchestrator | ok: [testbed-node-0] => (item=enable_gnocchi_False) 2026-04-24 07:24:58.510663 | orchestrator | ok: [testbed-node-1] => (item=enable_gnocchi_False) 2026-04-24 07:24:58.510673 | orchestrator | ok: [testbed-node-2] => (item=enable_gnocchi_False) 2026-04-24 07:24:58.510683 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: enable_gnocchi_True 2026-04-24 07:24:58.510695 | orchestrator | 2026-04-24 07:24:58.510704 | orchestrator | PLAY [Apply role gnocchi] ****************************************************** 2026-04-24 07:24:58.510714 | orchestrator | skipping: no hosts matched 2026-04-24 07:24:58.510725 | orchestrator | 2026-04-24 07:24:58.510734 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:24:58.510746 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 07:24:58.510757 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 07:24:58.510768 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-24 07:24:58.510779 | orchestrator | 2026-04-24 07:24:58.510791 | orchestrator | 2026-04-24 07:24:58.510801 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:24:58.510812 | orchestrator | Friday 24 April 2026 07:24:58 +0000 (0:00:05.836) 0:00:09.844 ********** 2026-04-24 07:24:58.510857 | orchestrator | =============================================================================== 2026-04-24 07:24:58.510869 | orchestrator | Group hosts based on enabled services ----------------------------------- 5.84s 2026-04-24 07:24:58.510879 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.24s 2026-04-24 07:25:00.304552 | orchestrator | 2026-04-24 07:25:00 | INFO  | Prepare task for execution of manila. 2026-04-24 07:25:00.399030 | orchestrator | 2026-04-24 07:25:00 | INFO  | Task ba9ec1ba-491b-40a4-a11f-22d519e6a5cb (manila) was prepared for execution. 2026-04-24 07:25:00.399110 | orchestrator | 2026-04-24 07:25:00 | INFO  | It takes a moment until task ba9ec1ba-491b-40a4-a11f-22d519e6a5cb (manila) has been started and output is visible here. 2026-04-24 07:25:17.505743 | orchestrator | 2026-04-24 07:25:17.505865 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:25:17.505884 | orchestrator | 2026-04-24 07:25:17.505898 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:25:17.505912 | orchestrator | Friday 24 April 2026 07:25:06 +0000 (0:00:02.095) 0:00:02.096 ********** 2026-04-24 07:25:17.505926 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:25:17.505940 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:25:17.505954 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:25:17.505967 | orchestrator | 2026-04-24 07:25:17.505980 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:25:17.505994 | orchestrator | Friday 24 April 2026 07:25:08 +0000 (0:00:02.114) 0:00:04.211 ********** 2026-04-24 07:25:17.506006 | orchestrator | ok: [testbed-node-0] => (item=enable_manila_True) 2026-04-24 07:25:17.506086 | orchestrator | ok: [testbed-node-1] => (item=enable_manila_True) 2026-04-24 07:25:17.506104 | orchestrator | ok: [testbed-node-2] => (item=enable_manila_True) 2026-04-24 07:25:17.506117 | orchestrator | 2026-04-24 07:25:17.506130 | orchestrator | PLAY [Apply role manila] ******************************************************* 2026-04-24 07:25:17.506143 | orchestrator | 2026-04-24 07:25:17.506176 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-24 07:25:17.506189 | orchestrator | Friday 24 April 2026 07:25:11 +0000 (0:00:03.158) 0:00:07.369 ********** 2026-04-24 07:25:17.506204 | orchestrator | included: /ansible/roles/manila/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:25:17.506218 | orchestrator | 2026-04-24 07:25:17.506294 | orchestrator | TASK [manila : Ensuring config directories exist] ****************************** 2026-04-24 07:25:17.506311 | orchestrator | Friday 24 April 2026 07:25:15 +0000 (0:00:03.441) 0:00:10.811 ********** 2026-04-24 07:25:17.506329 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:17.506352 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:17.506394 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:17.506431 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:17.506454 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:17.506470 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:17.506485 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:17.506513 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:17.506527 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:17.506550 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:36.963494 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:36.963586 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:36.963593 | orchestrator | 2026-04-24 07:25:36.963599 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-24 07:25:36.963604 | orchestrator | Friday 24 April 2026 07:25:18 +0000 (0:00:03.566) 0:00:14.377 ********** 2026-04-24 07:25:36.963609 | orchestrator | included: /ansible/roles/manila/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:25:36.963614 | orchestrator | 2026-04-24 07:25:36.963618 | orchestrator | TASK [manila : Ensuring manila service ceph config subdir exists] ************** 2026-04-24 07:25:36.963637 | orchestrator | Friday 24 April 2026 07:25:20 +0000 (0:00:02.078) 0:00:16.456 ********** 2026-04-24 07:25:36.963641 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:25:36.963646 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:25:36.963650 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:25:36.963655 | orchestrator | 2026-04-24 07:25:36.963706 | orchestrator | TASK [manila : Copy over multiple ceph configs for Manila] ********************* 2026-04-24 07:25:36.963712 | orchestrator | Friday 24 April 2026 07:25:23 +0000 (0:00:02.251) 0:00:18.707 ********** 2026-04-24 07:25:36.963717 | orchestrator | ok: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 07:25:36.963723 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 07:25:36.963728 | orchestrator | ok: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 07:25:36.963732 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 07:25:36.963736 | orchestrator | ok: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 07:25:36.963740 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 07:25:36.963744 | orchestrator | 2026-04-24 07:25:36.963748 | orchestrator | TASK [manila : Copy over ceph Manila keyrings] ********************************* 2026-04-24 07:25:36.963753 | orchestrator | Friday 24 April 2026 07:25:25 +0000 (0:00:02.622) 0:00:21.330 ********** 2026-04-24 07:25:36.963757 | orchestrator | ok: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 07:25:36.963761 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 07:25:36.963765 | orchestrator | ok: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 07:25:36.963769 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 07:25:36.963784 | orchestrator | ok: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-24 07:25:36.963788 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-24 07:25:36.963792 | orchestrator | 2026-04-24 07:25:36.963796 | orchestrator | TASK [manila : Ensuring config directory has correct owner and permission] ***** 2026-04-24 07:25:36.963804 | orchestrator | Friday 24 April 2026 07:25:28 +0000 (0:00:02.382) 0:00:23.713 ********** 2026-04-24 07:25:36.963808 | orchestrator | ok: [testbed-node-0] => (item=manila-share) 2026-04-24 07:25:36.963813 | orchestrator | ok: [testbed-node-1] => (item=manila-share) 2026-04-24 07:25:36.963817 | orchestrator | ok: [testbed-node-2] => (item=manila-share) 2026-04-24 07:25:36.963821 | orchestrator | 2026-04-24 07:25:36.963825 | orchestrator | TASK [manila : Check if policies shall be overwritten] ************************* 2026-04-24 07:25:36.963829 | orchestrator | Friday 24 April 2026 07:25:30 +0000 (0:00:02.171) 0:00:25.884 ********** 2026-04-24 07:25:36.963838 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:25:36.963843 | orchestrator | 2026-04-24 07:25:36.963847 | orchestrator | TASK [manila : Set manila policy file] ***************************************** 2026-04-24 07:25:36.963851 | orchestrator | Friday 24 April 2026 07:25:31 +0000 (0:00:01.309) 0:00:27.193 ********** 2026-04-24 07:25:36.963855 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:25:36.963859 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:25:36.963863 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:25:36.963867 | orchestrator | 2026-04-24 07:25:36.963871 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-24 07:25:36.963875 | orchestrator | Friday 24 April 2026 07:25:33 +0000 (0:00:01.498) 0:00:28.691 ********** 2026-04-24 07:25:36.963879 | orchestrator | included: /ansible/roles/manila/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:25:36.963883 | orchestrator | 2026-04-24 07:25:36.963887 | orchestrator | TASK [service-cert-copy : manila | Copying over extra CA certificates] ********* 2026-04-24 07:25:36.963891 | orchestrator | Friday 24 April 2026 07:25:35 +0000 (0:00:02.361) 0:00:31.052 ********** 2026-04-24 07:25:36.963896 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:36.963902 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:36.963911 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:41.285442 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285545 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285555 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285563 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285572 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285576 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285614 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285622 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285628 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:41.285634 | orchestrator | 2026-04-24 07:25:41.285642 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS certificate] *** 2026-04-24 07:25:41.285651 | orchestrator | Friday 24 April 2026 07:25:40 +0000 (0:00:05.165) 0:00:36.218 ********** 2026-04-24 07:25:41.285659 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:25:41.285667 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:25:41.285683 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758355 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758437 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758454 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:25:43.758468 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758477 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758510 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:25:43.758550 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758557 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:25:43.758562 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758568 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758574 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758579 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:25:43.758584 | orchestrator | 2026-04-24 07:25:43.758590 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS key] ****** 2026-04-24 07:25:43.758597 | orchestrator | Friday 24 April 2026 07:25:43 +0000 (0:00:02.495) 0:00:38.714 ********** 2026-04-24 07:25:43.758602 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:25:43.758616 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:25:43.758628 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:25:47.399154 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:25:47.399303 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:25:47.399319 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:25:47.399351 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:25:47.399359 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:25:47.399381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:25:47.399402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:25:47.399407 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:25:47.399411 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:25:47.399415 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:25:47.399419 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:25:47.399428 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:25:47.399432 | orchestrator | 2026-04-24 07:25:47.399437 | orchestrator | TASK [manila : Copying over config.json files for services] ******************** 2026-04-24 07:25:47.399442 | orchestrator | Friday 24 April 2026 07:25:45 +0000 (0:00:02.686) 0:00:41.400 ********** 2026-04-24 07:25:47.399450 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:47.399459 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:54.346372 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:54.346483 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346523 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346547 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346556 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346583 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346592 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346600 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346615 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346623 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:25:54.346631 | orchestrator | 2026-04-24 07:25:54.346640 | orchestrator | TASK [manila : Copying over manila.conf] *************************************** 2026-04-24 07:25:54.346654 | orchestrator | Friday 24 April 2026 07:25:51 +0000 (0:00:05.709) 0:00:47.110 ********** 2026-04-24 07:25:54.346662 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:25:54.346677 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:26:06.213854 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:26:06.213969 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:06.213989 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:26:06.213994 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:06.213998 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:26:06.214043 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:06.214066 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:26:06.214076 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:06.214083 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:06.214095 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:06.214102 | orchestrator | 2026-04-24 07:26:06.214110 | orchestrator | TASK [manila : Copying over manila-share.conf] ********************************* 2026-04-24 07:26:06.214118 | orchestrator | Friday 24 April 2026 07:26:00 +0000 (0:00:08.554) 0:00:55.664 ********** 2026-04-24 07:26:06.214126 | orchestrator | changed: [testbed-node-0] => (item=manila-share) 2026-04-24 07:26:06.214133 | orchestrator | changed: [testbed-node-1] => (item=manila-share) 2026-04-24 07:26:06.214140 | orchestrator | changed: [testbed-node-2] => (item=manila-share) 2026-04-24 07:26:06.214158 | orchestrator | 2026-04-24 07:26:06.214165 | orchestrator | TASK [manila : Copying over existing policy file] ****************************** 2026-04-24 07:26:06.214171 | orchestrator | Friday 24 April 2026 07:26:05 +0000 (0:00:05.457) 0:01:01.121 ********** 2026-04-24 07:26:06.214218 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:26:09.606376 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606452 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606459 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606464 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:26:09.606483 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:26:09.606488 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606518 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606523 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606527 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:26:09.606531 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:26:09.606537 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606541 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606545 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:26:09.606553 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:26:09.606557 | orchestrator | 2026-04-24 07:26:09.606562 | orchestrator | TASK [service-check-containers : manila | Check containers] ******************** 2026-04-24 07:26:09.606567 | orchestrator | Friday 24 April 2026 07:26:08 +0000 (0:00:02.647) 0:01:03.769 ********** 2026-04-24 07:26:09.606575 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:26:13.778962 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:26:13.779081 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:26:13.779095 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779124 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779130 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779151 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779159 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779170 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779326 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779347 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779354 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-24 07:26:13.779360 | orchestrator | 2026-04-24 07:26:13.779367 | orchestrator | TASK [service-check-containers : manila | Notify handlers to restart containers] *** 2026-04-24 07:26:13.779375 | orchestrator | Friday 24 April 2026 07:26:13 +0000 (0:00:05.286) 0:01:09.055 ********** 2026-04-24 07:26:13.779382 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:26:13.779389 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:26:13.779395 | orchestrator | } 2026-04-24 07:26:13.779401 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:26:13.779407 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:26:13.779413 | orchestrator | } 2026-04-24 07:26:13.779418 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:26:13.779432 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:26:16.050071 | orchestrator | } 2026-04-24 07:26:16.050167 | orchestrator | 2026-04-24 07:26:16.050231 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:26:16.050243 | orchestrator | Friday 24 April 2026 07:26:15 +0000 (0:00:01.581) 0:01:10.636 ********** 2026-04-24 07:26:16.050255 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:26:16.050283 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:26:16.050313 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:26:16.050322 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:26:16.050330 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:26:16.050356 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:26:16.050365 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:26:16.050377 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:26:16.050391 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:26:16.050399 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:26:16.050406 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:26:16.050414 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-24 07:26:16.050428 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-24 07:29:53.991192 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-24 07:29:53.991276 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:29:53.991285 | orchestrator | 2026-04-24 07:29:53.991290 | orchestrator | TASK [manila : Running Manila bootstrap container] ***************************** 2026-04-24 07:29:53.991312 | orchestrator | Friday 24 April 2026 07:26:17 +0000 (0:00:02.827) 0:01:13.464 ********** 2026-04-24 07:29:53.991317 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:29:53.991320 | orchestrator | 2026-04-24 07:29:53.991324 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-24 07:29:53.991338 | orchestrator | Friday 24 April 2026 07:26:38 +0000 (0:00:20.473) 0:01:33.937 ********** 2026-04-24 07:29:53.991342 | orchestrator | 2026-04-24 07:29:53.991346 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-24 07:29:53.991349 | orchestrator | Friday 24 April 2026 07:26:38 +0000 (0:00:00.468) 0:01:34.406 ********** 2026-04-24 07:29:53.991353 | orchestrator | 2026-04-24 07:29:53.991357 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-24 07:29:53.991361 | orchestrator | Friday 24 April 2026 07:26:39 +0000 (0:00:00.461) 0:01:34.868 ********** 2026-04-24 07:29:53.991364 | orchestrator | 2026-04-24 07:29:53.991368 | orchestrator | RUNNING HANDLER [manila : Restart manila-api container] ************************ 2026-04-24 07:29:53.991372 | orchestrator | Friday 24 April 2026 07:26:40 +0000 (0:00:00.895) 0:01:35.764 ********** 2026-04-24 07:29:53.991375 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:29:53.991379 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:29:53.991383 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:29:53.991387 | orchestrator | 2026-04-24 07:29:53.991390 | orchestrator | RUNNING HANDLER [manila : Restart manila-data container] *********************** 2026-04-24 07:29:53.991394 | orchestrator | Friday 24 April 2026 07:26:58 +0000 (0:00:18.078) 0:01:53.843 ********** 2026-04-24 07:29:53.991398 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:29:53.991402 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:29:53.991405 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:29:53.991409 | orchestrator | 2026-04-24 07:29:53.991413 | orchestrator | RUNNING HANDLER [manila : Restart manila-scheduler container] ****************** 2026-04-24 07:29:53.991416 | orchestrator | Friday 24 April 2026 07:27:17 +0000 (0:00:19.328) 0:02:13.171 ********** 2026-04-24 07:29:53.991420 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:29:53.991424 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:29:53.991427 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:29:53.991431 | orchestrator | 2026-04-24 07:29:53.991435 | orchestrator | RUNNING HANDLER [manila : Restart manila-share container] ********************** 2026-04-24 07:29:53.991439 | orchestrator | Friday 24 April 2026 07:27:30 +0000 (0:00:13.333) 0:02:26.505 ********** 2026-04-24 07:29:53.991442 | orchestrator | 2026-04-24 07:29:53.991446 | orchestrator | STILL ALIVE [task 'manila : Restart manila-share container' is running] ******** 2026-04-24 07:29:53.991450 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:29:53.991454 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:29:53.991457 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:29:53.991461 | orchestrator | 2026-04-24 07:29:53.991465 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:29:53.991470 | orchestrator | testbed-node-0 : ok=21  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:29:53.991475 | orchestrator | testbed-node-1 : ok=20  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 07:29:53.991479 | orchestrator | testbed-node-2 : ok=20  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 07:29:53.991485 | orchestrator | 2026-04-24 07:29:53.991491 | orchestrator | 2026-04-24 07:29:53.991497 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:29:53.991507 | orchestrator | Friday 24 April 2026 07:29:53 +0000 (0:02:22.452) 0:04:48.958 ********** 2026-04-24 07:29:53.991515 | orchestrator | =============================================================================== 2026-04-24 07:29:53.991521 | orchestrator | manila : Restart manila-share container ------------------------------- 142.45s 2026-04-24 07:29:53.991532 | orchestrator | manila : Running Manila bootstrap container ---------------------------- 20.47s 2026-04-24 07:29:53.991538 | orchestrator | manila : Restart manila-data container --------------------------------- 19.33s 2026-04-24 07:29:53.991544 | orchestrator | manila : Restart manila-api container ---------------------------------- 18.08s 2026-04-24 07:29:53.991550 | orchestrator | manila : Restart manila-scheduler container ---------------------------- 13.33s 2026-04-24 07:29:53.991556 | orchestrator | manila : Copying over manila.conf --------------------------------------- 8.55s 2026-04-24 07:29:53.991562 | orchestrator | manila : Copying over config.json files for services -------------------- 5.71s 2026-04-24 07:29:53.991569 | orchestrator | manila : Copying over manila-share.conf --------------------------------- 5.46s 2026-04-24 07:29:53.991575 | orchestrator | service-check-containers : manila | Check containers -------------------- 5.29s 2026-04-24 07:29:53.991595 | orchestrator | service-cert-copy : manila | Copying over extra CA certificates --------- 5.17s 2026-04-24 07:29:53.991600 | orchestrator | manila : Ensuring config directories exist ------------------------------ 3.57s 2026-04-24 07:29:53.991603 | orchestrator | manila : include_tasks -------------------------------------------------- 3.44s 2026-04-24 07:29:53.991607 | orchestrator | Group hosts based on enabled services ----------------------------------- 3.16s 2026-04-24 07:29:53.991611 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.83s 2026-04-24 07:29:53.991614 | orchestrator | service-cert-copy : manila | Copying over backend internal TLS key ------ 2.69s 2026-04-24 07:29:53.991618 | orchestrator | manila : Copying over existing policy file ------------------------------ 2.65s 2026-04-24 07:29:53.991622 | orchestrator | manila : Copy over multiple ceph configs for Manila --------------------- 2.62s 2026-04-24 07:29:53.991626 | orchestrator | service-cert-copy : manila | Copying over backend internal TLS certificate --- 2.50s 2026-04-24 07:29:53.991630 | orchestrator | manila : Copy over ceph Manila keyrings --------------------------------- 2.38s 2026-04-24 07:29:53.991634 | orchestrator | manila : include_tasks -------------------------------------------------- 2.36s 2026-04-24 07:29:54.323919 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-24 07:29:54.324193 | orchestrator | + osism migrate rabbitmq3to4 delete 2026-04-24 07:30:01.934522 | orchestrator | 2026-04-24 07:30:01 | ERROR  | Unable to get ansible vault password 2026-04-24 07:30:01.934616 | orchestrator | 2026-04-24 07:30:01 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-24 07:30:01.934625 | orchestrator | 2026-04-24 07:30:01 | ERROR  | Dropping encrypted entries 2026-04-24 07:30:01.983669 | orchestrator | 2026-04-24 07:30:01 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-24 07:30:02.263420 | orchestrator | 2026-04-24 07:30:02 | INFO  | Found 127 classic queue(s) in vhost '/' 2026-04-24 07:30:02.315779 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: alarm.all.sample 2026-04-24 07:30:02.363838 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: alarming.sample 2026-04-24 07:30:02.408232 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: barbican.workers 2026-04-24 07:30:02.463070 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: barbican.workers.barbican.queue 2026-04-24 07:30:02.502869 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: barbican.workers_fanout_5654fe38e51c413b8ca697c01813e421 2026-04-24 07:30:02.538601 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: barbican.workers_fanout_7730d1e7c1a540dc8f4a5a262198ece6 2026-04-24 07:30:02.606586 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: barbican.workers_fanout_927797a05f5548b1a995a3384d4f01b7 2026-04-24 07:30:02.664939 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: barbican_notifications.info 2026-04-24 07:30:02.713967 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: central 2026-04-24 07:30:02.769501 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: central.testbed-node-0 2026-04-24 07:30:02.814153 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: central.testbed-node-1 2026-04-24 07:30:02.854787 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: central.testbed-node-2 2026-04-24 07:30:02.889362 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: central_fanout_130da31f625b4731afc79c4855431b9f 2026-04-24 07:30:02.926408 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: central_fanout_151f71e4103642f383d713017715e3ac 2026-04-24 07:30:02.964596 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: central_fanout_3085af900251476aab7b40755ddfb61f 2026-04-24 07:30:03.001490 | orchestrator | 2026-04-24 07:30:02 | INFO  | Deleted queue: central_fanout_72603ae84ebe457a9a913cdb79d9f346 2026-04-24 07:30:03.049421 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: central_fanout_eafff618510b47d78b0a62076809ae04 2026-04-24 07:30:03.097665 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: central_fanout_f367dcde0390415894b159af18895703 2026-04-24 07:30:03.139502 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-backup 2026-04-24 07:30:03.187578 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-backup.testbed-node-0 2026-04-24 07:30:03.237707 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-backup.testbed-node-1 2026-04-24 07:30:03.290450 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-backup.testbed-node-2 2026-04-24 07:30:03.332495 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-scheduler 2026-04-24 07:30:03.379255 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-scheduler.testbed-node-0 2026-04-24 07:30:03.431216 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-scheduler.testbed-node-1 2026-04-24 07:30:03.477753 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-scheduler.testbed-node-2 2026-04-24 07:30:03.514743 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-volume 2026-04-24 07:30:03.557558 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-volume.testbed-node-0@rbd-volumes 2026-04-24 07:30:03.603613 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 2026-04-24 07:30:03.647139 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-volume.testbed-node-1@rbd-volumes 2026-04-24 07:30:03.706543 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 2026-04-24 07:30:03.754597 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-volume.testbed-node-2@rbd-volumes 2026-04-24 07:30:03.803519 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 2026-04-24 07:30:03.842463 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: compute 2026-04-24 07:30:03.890766 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: compute.testbed-node-3 2026-04-24 07:30:03.930473 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: compute.testbed-node-4 2026-04-24 07:30:03.984610 | orchestrator | 2026-04-24 07:30:03 | INFO  | Deleted queue: compute.testbed-node-5 2026-04-24 07:30:04.060501 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: conductor 2026-04-24 07:30:04.098796 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: conductor.testbed-node-0 2026-04-24 07:30:04.137996 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: conductor.testbed-node-1 2026-04-24 07:30:04.184531 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: conductor.testbed-node-2 2026-04-24 07:30:04.218351 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: event.sample 2026-04-24 07:30:04.245935 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.10:46562 -> 192.168.16.11:5672 2026-04-24 07:30:04.259618 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.10:55744 -> 192.168.16.10:5672 2026-04-24 07:30:04.275496 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.12:40488 -> 192.168.16.11:5672 2026-04-24 07:30:04.292835 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.12:40504 -> 192.168.16.11:5672 2026-04-24 07:30:04.306380 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.10:46554 -> 192.168.16.11:5672 2026-04-24 07:30:04.324486 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.11:56890 -> 192.168.16.10:5672 2026-04-24 07:30:04.337740 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.12:33262 -> 192.168.16.10:5672 2026-04-24 07:30:04.349465 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.11:56896 -> 192.168.16.10:5672 2026-04-24 07:30:04.366599 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed connection: 192.168.16.11:34268 -> 192.168.16.11:5672 2026-04-24 07:30:04.367069 | orchestrator | 2026-04-24 07:30:04 | INFO  | Closed 9 connection(s) for queue: magnum-conductor 2026-04-24 07:30:04.398545 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor 2026-04-24 07:30:04.443998 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor.4o55btlllkt4 2026-04-24 07:30:04.496699 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor.6pvc7wylozkj 2026-04-24 07:30:04.533197 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor.rmzip36to2n6 2026-04-24 07:30:04.568373 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_0250d2169be344f089f4ba0f5747d528 2026-04-24 07:30:04.602683 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_17b0a7ad71bb4a0b90de86fc11c8b5ff 2026-04-24 07:30:04.636567 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_36b8e58eee7643d497a0a6fd2ff342f9 2026-04-24 07:30:04.675368 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_4d59dcfc9ff249a7a65b7c57823b879d 2026-04-24 07:30:04.716011 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_6f06eae86ff0433eb842a1d2d4dd933d 2026-04-24 07:30:04.758134 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_979ee6972d9a4395accc561139e7aefd 2026-04-24 07:30:04.804534 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_dea39d31789a463dbf57dcf3f1112751 2026-04-24 07:30:04.836267 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_e176bacec11440ac9a91d173d1a91d01 2026-04-24 07:30:04.874826 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: magnum-conductor_fanout_f646013dfe354c1abcf666d37019e365 2026-04-24 07:30:04.921337 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: manila-data 2026-04-24 07:30:04.966309 | orchestrator | 2026-04-24 07:30:04 | INFO  | Deleted queue: manila-data.testbed-node-0 2026-04-24 07:30:05.014647 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-data.testbed-node-1 2026-04-24 07:30:05.064927 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-data.testbed-node-2 2026-04-24 07:30:05.110441 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-scheduler 2026-04-24 07:30:05.160688 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-scheduler.testbed-node-0 2026-04-24 07:30:05.203492 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-scheduler.testbed-node-1 2026-04-24 07:30:05.250316 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-scheduler.testbed-node-2 2026-04-24 07:30:05.301021 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-share 2026-04-24 07:30:05.350320 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-share.testbed-node-0@cephfsnative1 2026-04-24 07:30:05.394803 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-share.testbed-node-1@cephfsnative1 2026-04-24 07:30:05.432542 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-share.testbed-node-2@cephfsnative1 2026-04-24 07:30:05.466522 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-share_fanout_4859c8a75edd428bbdfcc76cf0e6c994 2026-04-24 07:30:05.506437 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-share_fanout_a64e989c852f41cdba33ffe08c29098a 2026-04-24 07:30:05.544540 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: manila-share_fanout_fc0e16881dfa441b87ba064c46afd1e3 2026-04-24 07:30:05.703404 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: notifications.audit 2026-04-24 07:30:05.890364 | orchestrator | 2026-04-24 07:30:05 | INFO  | Deleted queue: notifications.critical 2026-04-24 07:30:06.074404 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: notifications.debug 2026-04-24 07:30:06.228447 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: notifications.error 2026-04-24 07:30:06.404470 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: notifications.info 2026-04-24 07:30:06.554972 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: notifications.sample 2026-04-24 07:30:06.747645 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: notifications.warn 2026-04-24 07:30:06.786172 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: octavia_provisioning_v2 2026-04-24 07:30:06.832537 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-0 2026-04-24 07:30:06.874668 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-1 2026-04-24 07:30:06.929595 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-2 2026-04-24 07:30:06.977494 | orchestrator | 2026-04-24 07:30:06 | INFO  | Deleted queue: producer 2026-04-24 07:30:07.041314 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer.testbed-node-0 2026-04-24 07:30:07.118930 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer.testbed-node-1 2026-04-24 07:30:07.206435 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer.testbed-node-2 2026-04-24 07:30:07.248213 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer_fanout_32d58eb574ed496895f8b6dd541cab68 2026-04-24 07:30:07.288262 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer_fanout_67f6fdb198064747a9c5cc359bc95615 2026-04-24 07:30:07.327448 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer_fanout_69404dc8b79e4d028f2e56daa8c56dd8 2026-04-24 07:30:07.365954 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer_fanout_9b57ebcabaf5475cbcc7f9419034dbb7 2026-04-24 07:30:07.407550 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer_fanout_d0141389c0274ca9be4bb7d4ca8c926f 2026-04-24 07:30:07.454207 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: producer_fanout_ee2cbc0bb6fb43c4a9a08fda741160f0 2026-04-24 07:30:07.490930 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-plugin 2026-04-24 07:30:07.531373 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-plugin.testbed-node-0 2026-04-24 07:30:07.571823 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-plugin.testbed-node-1 2026-04-24 07:30:07.616351 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-plugin.testbed-node-2 2026-04-24 07:30:07.652350 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-reports-plugin 2026-04-24 07:30:07.695482 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-reports-plugin.testbed-node-0 2026-04-24 07:30:07.739528 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-reports-plugin.testbed-node-1 2026-04-24 07:30:07.783433 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-reports-plugin.testbed-node-2 2026-04-24 07:30:07.826334 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-server-resource-versions 2026-04-24 07:30:07.865789 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-0 2026-04-24 07:30:07.909908 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-1 2026-04-24 07:30:07.950100 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-2 2026-04-24 07:30:07.989509 | orchestrator | 2026-04-24 07:30:07 | INFO  | Deleted queue: reply_099342ec20334241925d8162aa5a8406 2026-04-24 07:30:08.027523 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_32c13bbfc19e4d31813135e6bc7211bd 2026-04-24 07:30:08.060763 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_55d545e4cd76447bb572274b07854ffc 2026-04-24 07:30:08.090191 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_60670aad13044e7aa97cb36ecf548d05 2026-04-24 07:30:08.133192 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_655c1395c6564114b7e90c9bed42c777 2026-04-24 07:30:08.166193 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_6ba5ab2ebfcc46fa8af234c9d864f7c6 2026-04-24 07:30:08.195469 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_cf2af1349c1e4dce9adb9c797a05384c 2026-04-24 07:30:08.234484 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_cfd076b46d6b4c3d88525b624226f31e 2026-04-24 07:30:08.268625 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_d7d9f4cadca04c82b5d7c0a9478101b5 2026-04-24 07:30:08.297557 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: reply_d8dd7fd4a70c44afbf27e59ad72e1976 2026-04-24 07:30:08.328458 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: scheduler 2026-04-24 07:30:08.365802 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: scheduler.testbed-node-0 2026-04-24 07:30:08.402503 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: scheduler.testbed-node-1 2026-04-24 07:30:08.436275 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: scheduler.testbed-node-2 2026-04-24 07:30:08.474498 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker 2026-04-24 07:30:08.512662 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker.testbed-node-0 2026-04-24 07:30:08.549311 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker.testbed-node-1 2026-04-24 07:30:08.585316 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker.testbed-node-2 2026-04-24 07:30:08.624381 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker_fanout_39481638dbf44f0c88322744e5063bf4 2026-04-24 07:30:08.657293 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker_fanout_40dec2040a11472d9b47a70e1df1e1fe 2026-04-24 07:30:08.697332 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker_fanout_64148232d6ee4e8a9ad52f7bd66d64c4 2026-04-24 07:30:08.728348 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker_fanout_6d8a9675b0444773b3d3f3812db1a6fa 2026-04-24 07:30:08.760511 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker_fanout_dfaf9b44999a4c069fba6c0b835d2121 2026-04-24 07:30:08.803355 | orchestrator | 2026-04-24 07:30:08 | INFO  | Deleted queue: worker_fanout_e9dd87dc80434cdf92870bfe5b04be07 2026-04-24 07:30:08.807234 | orchestrator | 2026-04-24 07:30:08 | INFO  | Successfully deleted 127 queue(s) in vhost '/' 2026-04-24 07:30:09.220769 | orchestrator | + osism migrate rabbitmq3to4 list 2026-04-24 07:30:16.911818 | orchestrator | 2026-04-24 07:30:16 | ERROR  | Unable to get ansible vault password 2026-04-24 07:30:16.911891 | orchestrator | 2026-04-24 07:30:16 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-24 07:30:16.911899 | orchestrator | 2026-04-24 07:30:16 | ERROR  | Dropping encrypted entries 2026-04-24 07:30:16.954178 | orchestrator | 2026-04-24 07:30:16 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-24 07:30:17.129453 | orchestrator | 2026-04-24 07:30:17 | INFO  | Found 13 classic queue(s) in vhost '/': 2026-04-24 07:30:17.129525 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor (vhost: /, messages: 0) 2026-04-24 07:30:17.129532 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor.4o55btlllkt4 (vhost: /, messages: 0) 2026-04-24 07:30:17.129537 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor.6pvc7wylozkj (vhost: /, messages: 0) 2026-04-24 07:30:17.129555 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor.rmzip36to2n6 (vhost: /, messages: 0) 2026-04-24 07:30:17.129588 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_0250d2169be344f089f4ba0f5747d528 (vhost: /, messages: 0) 2026-04-24 07:30:17.129724 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_17b0a7ad71bb4a0b90de86fc11c8b5ff (vhost: /, messages: 0) 2026-04-24 07:30:17.129900 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_36b8e58eee7643d497a0a6fd2ff342f9 (vhost: /, messages: 0) 2026-04-24 07:30:17.130103 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_4d59dcfc9ff249a7a65b7c57823b879d (vhost: /, messages: 0) 2026-04-24 07:30:17.130353 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_6f06eae86ff0433eb842a1d2d4dd933d (vhost: /, messages: 0) 2026-04-24 07:30:17.130584 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_979ee6972d9a4395accc561139e7aefd (vhost: /, messages: 0) 2026-04-24 07:30:17.132009 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_dea39d31789a463dbf57dcf3f1112751 (vhost: /, messages: 0) 2026-04-24 07:30:17.132046 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_e176bacec11440ac9a91d173d1a91d01 (vhost: /, messages: 0) 2026-04-24 07:30:17.132094 | orchestrator | 2026-04-24 07:30:17 | INFO  |  - magnum-conductor_fanout_f646013dfe354c1abcf666d37019e365 (vhost: /, messages: 0) 2026-04-24 07:30:17.488468 | orchestrator | + osism migrate rabbitmq3to4 list --vhost openstack --quorum 2026-04-24 07:30:25.450211 | orchestrator | 2026-04-24 07:30:25 | ERROR  | Unable to get ansible vault password 2026-04-24 07:30:25.450307 | orchestrator | 2026-04-24 07:30:25 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-24 07:30:25.450317 | orchestrator | 2026-04-24 07:30:25 | ERROR  | Dropping encrypted entries 2026-04-24 07:30:25.486970 | orchestrator | 2026-04-24 07:30:25 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-24 07:30:25.693104 | orchestrator | 2026-04-24 07:30:25 | INFO  | Found 192 quorum queue(s) in vhost 'openstack': 2026-04-24 07:30:25.693189 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - alarm.all.sample (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693198 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - alarming.sample (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693205 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - barbican.workers (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693214 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - barbican.workers.barbican.queue (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693222 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - barbican.workers_fanout_testbed-node-0:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693314 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - barbican.workers_fanout_testbed-node-1:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693324 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - barbican.workers_fanout_testbed-node-2:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693332 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - barbican_notifications.info (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693781 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693802 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.693810 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.694397 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.694561 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central_fanout_testbed-node-0:designate-central:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.694579 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central_fanout_testbed-node-0:designate-central:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.694637 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central_fanout_testbed-node-1:designate-central:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.694716 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central_fanout_testbed-node-1:designate-central:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.694727 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central_fanout_testbed-node-2:designate-central:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.694734 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - central_fanout_testbed-node-2:designate-central:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.695039 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-backup (vhost: openstack, messages: 0) 2026-04-24 07:30:25.695116 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-backup.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.695132 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-backup.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.695608 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-backup.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.695645 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-backup_fanout_testbed-node-0:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.695978 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-backup_fanout_testbed-node-1:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696047 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-backup_fanout_testbed-node-2:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696174 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-scheduler (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696521 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696547 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696555 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696562 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-scheduler_fanout_testbed-node-0:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696885 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-scheduler_fanout_testbed-node-1:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696978 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-scheduler_fanout_testbed-node-2:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.696996 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697007 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697144 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697162 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout_testbed-node-0:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697175 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697655 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697703 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout_testbed-node-1:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697713 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697723 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.697737 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout_testbed-node-2:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699169 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume_fanout_testbed-node-0:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699208 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume_fanout_testbed-node-1:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699243 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - cinder-volume_fanout_testbed-node-2:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699250 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - compute (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699466 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - compute.testbed-node-3 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699487 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - compute.testbed-node-4 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699690 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - compute.testbed-node-5 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699947 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - compute_fanout_testbed-node-3:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699959 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - compute_fanout_testbed-node-4:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.699965 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - compute_fanout_testbed-node-5:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.700044 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor (vhost: openstack, messages: 0) 2026-04-24 07:30:25.700377 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.700904 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.700930 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.700939 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor_fanout_testbed-node-0:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701112 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor_fanout_testbed-node-0:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701128 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor_fanout_testbed-node-1:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701749 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor_fanout_testbed-node-1:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701780 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor_fanout_testbed-node-2:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701791 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - conductor_fanout_testbed-node-2:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701802 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - event.sample (vhost: openstack, messages: 7) 2026-04-24 07:30:25.701811 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-data (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701821 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-data.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701830 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-data.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701839 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-data.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701849 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-data_fanout_testbed-node-0:manila-data:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.701859 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-data_fanout_testbed-node-1:manila-data:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.702190 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-data_fanout_testbed-node-2:manila-data:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.702260 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-scheduler (vhost: openstack, messages: 0) 2026-04-24 07:30:25.702273 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.702340 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.702706 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.702806 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-scheduler_fanout_testbed-node-0:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.703353 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-scheduler_fanout_testbed-node-1:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.703416 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-scheduler_fanout_testbed-node-2:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.703429 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-share (vhost: openstack, messages: 0) 2026-04-24 07:30:25.703658 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-share.testbed-node-0@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.703684 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-share.testbed-node-1@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.703696 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-share.testbed-node-2@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704031 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-share_fanout_testbed-node-0:manila-share:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704151 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-share_fanout_testbed-node-1:manila-share:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704164 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - manila-share_fanout_testbed-node-2:manila-share:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704171 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - notifications.audit (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704245 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - notifications.critical (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704588 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - notifications.debug (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704612 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - notifications.error (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704721 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - notifications.info (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704733 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - notifications.sample (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704740 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - notifications.warn (vhost: openstack, messages: 0) 2026-04-24 07:30:25.704949 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - octavia_provisioning_v2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.705262 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - octavia_provisioning_v2.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.705575 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - octavia_provisioning_v2.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.705605 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - octavia_provisioning_v2.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.705613 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-0:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.705650 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-1:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.705663 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-2:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.705838 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - osism-listener-cinder (vhost: openstack, messages: 0) 2026-04-24 07:30:25.705983 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - osism-listener-glance (vhost: openstack, messages: 0) 2026-04-24 07:30:25.706003 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - osism-listener-ironic (vhost: openstack, messages: 0) 2026-04-24 07:30:25.706197 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - osism-listener-keystone (vhost: openstack, messages: 0) 2026-04-24 07:30:25.706323 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - osism-listener-neutron (vhost: openstack, messages: 0) 2026-04-24 07:30:25.706337 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - osism-listener-nova (vhost: openstack, messages: 0) 2026-04-24 07:30:25.706425 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer (vhost: openstack, messages: 0) 2026-04-24 07:30:25.706437 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.706543 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.706838 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.707046 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer_fanout_testbed-node-0:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.707145 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer_fanout_testbed-node-0:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.707306 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer_fanout_testbed-node-1:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.707322 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer_fanout_testbed-node-1:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.707387 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer_fanout_testbed-node-2:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.707747 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - producer_fanout_testbed-node-2:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.707973 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin (vhost: openstack, messages: 0) 2026-04-24 07:30:25.708497 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.708550 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.708558 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.708779 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.708837 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.709206 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.709258 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.709553 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.709631 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.709838 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.710001 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.710176 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.710757 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin (vhost: openstack, messages: 0) 2026-04-24 07:30:25.710794 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.710835 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.711211 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.711845 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.711903 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.712186 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.712205 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.712734 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.712769 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.712928 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.713380 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.713499 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.713646 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.713849 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.714109 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.714341 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.714555 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.714793 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.714872 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.715009 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.715184 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.715298 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions (vhost: openstack, messages: 0) 2026-04-24 07:30:25.715827 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.715881 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.716017 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.716032 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.716247 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.716439 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.716453 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.716505 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.716513 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.716632 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717048 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717206 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717222 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-0:designate-manage:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717231 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-0:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717240 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-0:designate-producer:4 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717248 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-1:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717700 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-1:designate-producer:4 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717737 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-2:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717764 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-2:designate-producer:4 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717868 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-3:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.717932 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-4:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.718299 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - reply_testbed-node-5:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.718413 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler (vhost: openstack, messages: 0) 2026-04-24 07:30:25.718428 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.718711 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.718732 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.718740 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler_fanout_testbed-node-0:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.718944 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler_fanout_testbed-node-0:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719015 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler_fanout_testbed-node-1:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719317 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler_fanout_testbed-node-1:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719336 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler_fanout_testbed-node-2:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719631 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - scheduler_fanout_testbed-node-2:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719726 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719734 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719738 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719742 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.719923 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker_fanout_testbed-node-0:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.720008 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker_fanout_testbed-node-0:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.720368 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker_fanout_testbed-node-1:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.720408 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker_fanout_testbed-node-1:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.720521 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker_fanout_testbed-node-2:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-24 07:30:25.720766 | orchestrator | 2026-04-24 07:30:25 | INFO  |  - worker_fanout_testbed-node-2:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-24 07:30:26.095500 | orchestrator | + osism migrate rabbitmq3to4 delete-exchanges 2026-04-24 07:30:34.131208 | orchestrator | 2026-04-24 07:30:34 | ERROR  | Unable to get ansible vault password 2026-04-24 07:30:34.131308 | orchestrator | 2026-04-24 07:30:34 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-24 07:30:34.131355 | orchestrator | 2026-04-24 07:30:34 | ERROR  | Dropping encrypted entries 2026-04-24 07:30:34.173345 | orchestrator | 2026-04-24 07:30:34 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-24 07:30:34.195994 | orchestrator | 2026-04-24 07:30:34 | INFO  | Found 27 exchange(s) in vhost '/' 2026-04-24 07:30:34.230242 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: aodh 2026-04-24 07:30:34.259579 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: ceilometer 2026-04-24 07:30:34.291678 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: cinder 2026-04-24 07:30:34.326566 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: designate 2026-04-24 07:30:34.364327 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: dns 2026-04-24 07:30:34.395670 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: glance 2026-04-24 07:30:34.436672 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: heat 2026-04-24 07:30:34.469702 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: ironic 2026-04-24 07:30:34.519076 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: keystone 2026-04-24 07:30:34.549229 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: l3_agent_fanout 2026-04-24 07:30:34.605472 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: magnum 2026-04-24 07:30:34.683850 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: magnum-conductor_fanout 2026-04-24 07:30:34.731724 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: neutron 2026-04-24 07:30:34.762750 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: neutron-vo-Network-1.1_fanout 2026-04-24 07:30:34.797749 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: neutron-vo-Port-1.10_fanout 2026-04-24 07:30:34.835396 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: neutron-vo-SecurityGroup-1.6_fanout 2026-04-24 07:30:34.868291 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: neutron-vo-SecurityGroupRule-1.3_fanout 2026-04-24 07:30:34.900240 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: neutron-vo-Subnet-1.2_fanout 2026-04-24 07:30:34.935027 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: nova 2026-04-24 07:30:34.974825 | orchestrator | 2026-04-24 07:30:34 | INFO  | Deleted exchange: octavia 2026-04-24 07:30:35.020644 | orchestrator | 2026-04-24 07:30:35 | INFO  | Deleted exchange: openstack 2026-04-24 07:30:35.058580 | orchestrator | 2026-04-24 07:30:35 | INFO  | Deleted exchange: q-agent-notifier-port-update_fanout 2026-04-24 07:30:35.090786 | orchestrator | 2026-04-24 07:30:35 | INFO  | Deleted exchange: q-agent-notifier-security_group-update_fanout 2026-04-24 07:30:35.124148 | orchestrator | 2026-04-24 07:30:35 | INFO  | Deleted exchange: scheduler_fanout 2026-04-24 07:30:35.157595 | orchestrator | 2026-04-24 07:30:35 | INFO  | Deleted exchange: swift 2026-04-24 07:30:35.199538 | orchestrator | 2026-04-24 07:30:35 | INFO  | Deleted exchange: trove 2026-04-24 07:30:35.243695 | orchestrator | 2026-04-24 07:30:35 | INFO  | Deleted exchange: zaqar 2026-04-24 07:30:35.243770 | orchestrator | 2026-04-24 07:30:35 | INFO  | Successfully deleted 27 exchange(s) in vhost '/' 2026-04-24 07:30:35.611145 | orchestrator | + osism migrate rabbitmq3to4 list-exchanges 2026-04-24 07:30:43.246343 | orchestrator | 2026-04-24 07:30:43 | ERROR  | Unable to get ansible vault password 2026-04-24 07:30:43.246458 | orchestrator | 2026-04-24 07:30:43 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-24 07:30:43.247115 | orchestrator | 2026-04-24 07:30:43 | ERROR  | Dropping encrypted entries 2026-04-24 07:30:43.283849 | orchestrator | 2026-04-24 07:30:43 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-24 07:30:43.297084 | orchestrator | 2026-04-24 07:30:43 | INFO  | No exchanges found in vhost '/' 2026-04-24 07:30:43.632630 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-24 07:30:43.632730 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/400-monitoring.sh 2026-04-24 07:30:45.241374 | orchestrator | 2026-04-24 07:30:45 | INFO  | Prepare task for execution of prometheus. 2026-04-24 07:30:45.312055 | orchestrator | 2026-04-24 07:30:45 | INFO  | Task 3278aacd-f1d3-47a8-b1ec-1a09247e90a3 (prometheus) was prepared for execution. 2026-04-24 07:30:45.312123 | orchestrator | 2026-04-24 07:30:45 | INFO  | It takes a moment until task 3278aacd-f1d3-47a8-b1ec-1a09247e90a3 (prometheus) has been started and output is visible here. 2026-04-24 07:31:00.343144 | orchestrator | 2026-04-24 07:31:00.343348 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:31:00.343361 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 07:31:00.343368 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 07:31:00.343379 | orchestrator | 2026-04-24 07:31:00.343401 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:31:00.343409 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 07:31:00.343415 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 07:31:00.343428 | orchestrator | Friday 24 April 2026 07:30:51 +0000 (0:00:01.678) 0:00:01.678 ********** 2026-04-24 07:31:00.343434 | orchestrator | ok: [testbed-manager] 2026-04-24 07:31:00.343441 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:31:00.343448 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:31:00.343454 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:31:00.343467 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:31:00.343473 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:31:00.343479 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:31:00.343486 | orchestrator | 2026-04-24 07:31:00.343548 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:31:00.343558 | orchestrator | Friday 24 April 2026 07:30:52 +0000 (0:00:01.517) 0:00:03.195 ********** 2026-04-24 07:31:00.343564 | orchestrator | ok: [testbed-manager] => (item=enable_prometheus_True) 2026-04-24 07:31:00.343570 | orchestrator | ok: [testbed-node-0] => (item=enable_prometheus_True) 2026-04-24 07:31:00.343576 | orchestrator | ok: [testbed-node-1] => (item=enable_prometheus_True) 2026-04-24 07:31:00.343582 | orchestrator | ok: [testbed-node-2] => (item=enable_prometheus_True) 2026-04-24 07:31:00.343588 | orchestrator | ok: [testbed-node-3] => (item=enable_prometheus_True) 2026-04-24 07:31:00.343595 | orchestrator | ok: [testbed-node-4] => (item=enable_prometheus_True) 2026-04-24 07:31:00.343601 | orchestrator | ok: [testbed-node-5] => (item=enable_prometheus_True) 2026-04-24 07:31:00.343607 | orchestrator | 2026-04-24 07:31:00.343612 | orchestrator | PLAY [Apply role prometheus] *************************************************** 2026-04-24 07:31:00.343619 | orchestrator | 2026-04-24 07:31:00.343625 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-24 07:31:00.343631 | orchestrator | Friday 24 April 2026 07:30:54 +0000 (0:00:01.547) 0:00:04.743 ********** 2026-04-24 07:31:00.343661 | orchestrator | included: /ansible/roles/prometheus/tasks/upgrade.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 07:31:00.343670 | orchestrator | 2026-04-24 07:31:00.343677 | orchestrator | TASK [prometheus : Ensuring config directories exist] ************************** 2026-04-24 07:31:00.343681 | orchestrator | Friday 24 April 2026 07:30:56 +0000 (0:00:02.334) 0:00:07.077 ********** 2026-04-24 07:31:00.343688 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:00.343697 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-24 07:31:00.343719 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:00.343731 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:00.343735 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:00.343740 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:00.343753 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:00.343759 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:00.343766 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:00.343772 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:00.343827 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:01.101913 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:01.101989 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:01.102057 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:01.102066 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:01.102077 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:31:01.102088 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:01.102119 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:01.102124 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:01.102133 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:01.102138 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:01.102142 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:01.102146 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:01.102150 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:01.102153 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:01.102198 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:06.953940 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:06.954099 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:06.954112 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:06.954120 | orchestrator | 2026-04-24 07:31:06.954126 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-24 07:31:06.954131 | orchestrator | Friday 24 April 2026 07:31:01 +0000 (0:00:05.158) 0:00:12.236 ********** 2026-04-24 07:31:06.954136 | orchestrator | included: /ansible/roles/prometheus/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-24 07:31:06.954141 | orchestrator | 2026-04-24 07:31:06.954146 | orchestrator | TASK [service-cert-copy : prometheus | Copying over extra CA certificates] ***** 2026-04-24 07:31:06.954150 | orchestrator | Friday 24 April 2026 07:31:03 +0000 (0:00:02.319) 0:00:14.555 ********** 2026-04-24 07:31:06.954153 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:06.954171 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-24 07:31:06.954230 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:06.954241 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:06.954245 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:06.954249 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:06.954253 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:06.954256 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:06.954260 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:06.954268 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:06.954279 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:08.590596 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590672 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590680 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590685 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:08.590690 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590694 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:08.590730 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:08.590745 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590751 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590755 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590759 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590765 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:31:08.590774 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:08.590786 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:11.489789 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:11.489892 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:11.489904 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:11.489912 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:11.489919 | orchestrator | 2026-04-24 07:31:11.489928 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS certificate] *** 2026-04-24 07:31:11.489936 | orchestrator | Friday 24 April 2026 07:31:09 +0000 (0:00:05.617) 0:00:20.172 ********** 2026-04-24 07:31:11.489980 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-24 07:31:11.490071 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:11.490107 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:11.490116 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:11.490123 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:11.490129 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:11.490134 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:11.490144 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:11.490157 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:11.490170 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:12.075452 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:12.075530 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:31:12.075543 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:12.075553 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:12.075581 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:31:12.075588 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:31:12.075595 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:31:12.075614 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:12.075635 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:12.075642 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:12.075648 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:31:12.075655 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:12.075660 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:12.075672 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:12.075678 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:31:12.075686 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:12.075695 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:31:12.075702 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:31:12.075715 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:13.998164 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:13.998344 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:13.998363 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:13.998402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:13.998413 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:31:13.998426 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:31:13.998436 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:31:13.998444 | orchestrator | 2026-04-24 07:31:13.998453 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS key] *** 2026-04-24 07:31:13.998463 | orchestrator | Friday 24 April 2026 07:31:12 +0000 (0:00:02.914) 0:00:23.087 ********** 2026-04-24 07:31:13.998488 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:13.998499 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:13.998528 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:13.998539 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-24 07:31:13.998557 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:13.998563 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:13.998568 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:13.998578 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:13.998590 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:15.241148 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:15.241373 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:15.241419 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:15.241428 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:15.241436 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:15.241452 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:15.241457 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:15.241462 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:31:15.241489 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:15.241498 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:31:15.241512 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:31:15.241519 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:31:15.241525 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:15.241531 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:31:15.241554 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:31:15.241565 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:15.241580 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:19.888034 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:19.888136 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:19.888145 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:31:19.888154 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:31:19.888161 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:31:19.888167 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:31:19.888173 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:31:19.888179 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:31:19.888197 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:31:19.888204 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:31:19.888210 | orchestrator | 2026-04-24 07:31:19.888217 | orchestrator | TASK [prometheus : Copying over config.json files] ***************************** 2026-04-24 07:31:19.888261 | orchestrator | Friday 24 April 2026 07:31:16 +0000 (0:00:04.053) 0:00:27.141 ********** 2026-04-24 07:31:19.888281 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:19.888294 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:19.888302 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-24 07:31:19.888309 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:19.888315 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:19.888332 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:19.888338 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:19.888350 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:22.197189 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:22.197334 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:31:22.197346 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:22.197356 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197363 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197381 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197386 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:22.197423 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:22.197427 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197431 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:22.197435 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197439 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197446 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197450 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197458 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:22.197468 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:31:52.490556 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:31:52.490642 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:52.490650 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:52.490669 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:52.490699 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:31:52.490707 | orchestrator | 2026-04-24 07:31:52.490714 | orchestrator | TASK [prometheus : Find custom prometheus alert rules files] ******************* 2026-04-24 07:31:52.490722 | orchestrator | Friday 24 April 2026 07:31:23 +0000 (0:00:06.957) 0:00:34.098 ********** 2026-04-24 07:31:52.490728 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 07:31:52.490736 | orchestrator | 2026-04-24 07:31:52.490741 | orchestrator | TASK [prometheus : Copying over custom prometheus alert rules files] *********** 2026-04-24 07:31:52.490747 | orchestrator | Friday 24 April 2026 07:31:24 +0000 (0:00:01.432) 0:00:35.531 ********** 2026-04-24 07:31:52.490753 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:31:52.490760 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:31:52.490766 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:31:52.490772 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:31:52.490778 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:31:52.490784 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:31:52.490790 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:31:52.490796 | orchestrator | 2026-04-24 07:31:52.490800 | orchestrator | TASK [prometheus : Find prometheus common config overrides] ******************** 2026-04-24 07:31:52.490803 | orchestrator | Friday 24 April 2026 07:31:26 +0000 (0:00:01.116) 0:00:36.647 ********** 2026-04-24 07:31:52.490807 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 07:31:52.490811 | orchestrator | 2026-04-24 07:31:52.490815 | orchestrator | TASK [prometheus : Find prometheus host config overrides] ********************** 2026-04-24 07:31:52.490819 | orchestrator | Friday 24 April 2026 07:31:26 +0000 (0:00:00.971) 0:00:37.619 ********** 2026-04-24 07:31:52.490823 | orchestrator | [WARNING]: Skipped 2026-04-24 07:31:52.490828 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490833 | orchestrator | node-0/prometheus.yml.d' path due to this access issue: 2026-04-24 07:31:52.490837 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490841 | orchestrator | node-0/prometheus.yml.d' is not a directory 2026-04-24 07:31:52.490856 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:31:52.490860 | orchestrator | [WARNING]: Skipped 2026-04-24 07:31:52.490864 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490868 | orchestrator | manager/prometheus.yml.d' path due to this access issue: 2026-04-24 07:31:52.490872 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490875 | orchestrator | manager/prometheus.yml.d' is not a directory 2026-04-24 07:31:52.490879 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 07:31:52.490883 | orchestrator | [WARNING]: Skipped 2026-04-24 07:31:52.490887 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490890 | orchestrator | node-1/prometheus.yml.d' path due to this access issue: 2026-04-24 07:31:52.490894 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490898 | orchestrator | node-1/prometheus.yml.d' is not a directory 2026-04-24 07:31:52.490901 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-24 07:31:52.490905 | orchestrator | [WARNING]: Skipped 2026-04-24 07:31:52.490909 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490918 | orchestrator | node-3/prometheus.yml.d' path due to this access issue: 2026-04-24 07:31:52.490922 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490925 | orchestrator | node-3/prometheus.yml.d' is not a directory 2026-04-24 07:31:52.490929 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-24 07:31:52.490933 | orchestrator | [WARNING]: Skipped 2026-04-24 07:31:52.490937 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490940 | orchestrator | node-2/prometheus.yml.d' path due to this access issue: 2026-04-24 07:31:52.490944 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490948 | orchestrator | node-2/prometheus.yml.d' is not a directory 2026-04-24 07:31:52.490952 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-24 07:31:52.490955 | orchestrator | [WARNING]: Skipped 2026-04-24 07:31:52.490959 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490963 | orchestrator | node-4/prometheus.yml.d' path due to this access issue: 2026-04-24 07:31:52.490971 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490975 | orchestrator | node-4/prometheus.yml.d' is not a directory 2026-04-24 07:31:52.490978 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-24 07:31:52.490982 | orchestrator | [WARNING]: Skipped 2026-04-24 07:31:52.490986 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490990 | orchestrator | node-5/prometheus.yml.d' path due to this access issue: 2026-04-24 07:31:52.490994 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-24 07:31:52.490998 | orchestrator | node-5/prometheus.yml.d' is not a directory 2026-04-24 07:31:52.491001 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-24 07:31:52.491005 | orchestrator | 2026-04-24 07:31:52.491009 | orchestrator | TASK [prometheus : Copying over prometheus config file] ************************ 2026-04-24 07:31:52.491013 | orchestrator | Friday 24 April 2026 07:31:29 +0000 (0:00:02.314) 0:00:39.934 ********** 2026-04-24 07:31:52.491017 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 07:31:52.491022 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:31:52.491026 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 07:31:52.491029 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:31:52.491033 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 07:31:52.491037 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:31:52.491041 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 07:31:52.491044 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:31:52.491048 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 07:31:52.491052 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:31:52.491056 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-24 07:31:52.491059 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:31:52.491063 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2) 2026-04-24 07:31:52.491067 | orchestrator | 2026-04-24 07:31:52.491071 | orchestrator | TASK [prometheus : Copying over prometheus web config file] ******************** 2026-04-24 07:31:52.491074 | orchestrator | Friday 24 April 2026 07:31:50 +0000 (0:00:21.368) 0:01:01.302 ********** 2026-04-24 07:31:52.491078 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 07:31:52.491082 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:31:52.491089 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 07:31:52.491095 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:31:52.491101 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 07:31:52.491110 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:31:52.491117 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 07:31:52.491123 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:31:52.491134 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 07:32:21.133393 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.133524 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-24 07:32:21.133542 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.133548 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2) 2026-04-24 07:32:21.133555 | orchestrator | 2026-04-24 07:32:21.133563 | orchestrator | TASK [prometheus : Copying over prometheus alertmanager config file] *********** 2026-04-24 07:32:21.133601 | orchestrator | Friday 24 April 2026 07:31:54 +0000 (0:00:03.561) 0:01:04.864 ********** 2026-04-24 07:32:21.133610 | orchestrator | skipping: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 07:32:21.133618 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.133625 | orchestrator | skipping: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 07:32:21.133632 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.133639 | orchestrator | skipping: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 07:32:21.133646 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.133653 | orchestrator | skipping: [testbed-node-3] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 07:32:21.133659 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.133665 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml) 2026-04-24 07:32:21.133671 | orchestrator | skipping: [testbed-node-4] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 07:32:21.133676 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.133698 | orchestrator | skipping: [testbed-node-5] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-24 07:32:21.133708 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.133714 | orchestrator | 2026-04-24 07:32:21.133722 | orchestrator | TASK [prometheus : Find custom Alertmanager alert notification templates] ****** 2026-04-24 07:32:21.133728 | orchestrator | Friday 24 April 2026 07:31:56 +0000 (0:00:02.404) 0:01:07.269 ********** 2026-04-24 07:32:21.133736 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 07:32:21.133740 | orchestrator | 2026-04-24 07:32:21.133744 | orchestrator | TASK [prometheus : Copying over custom Alertmanager alert notification templates] *** 2026-04-24 07:32:21.133750 | orchestrator | Friday 24 April 2026 07:31:57 +0000 (0:00:00.941) 0:01:08.210 ********** 2026-04-24 07:32:21.133754 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:32:21.133758 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.133762 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.133766 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.133769 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.133773 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.133777 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.133781 | orchestrator | 2026-04-24 07:32:21.133784 | orchestrator | TASK [prometheus : Copying over my.cnf for mysqld_exporter] ******************** 2026-04-24 07:32:21.133806 | orchestrator | Friday 24 April 2026 07:31:58 +0000 (0:00:00.876) 0:01:09.087 ********** 2026-04-24 07:32:21.133810 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:32:21.133814 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.133818 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.133822 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.133826 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:32:21.133831 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:32:21.133834 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:32:21.133838 | orchestrator | 2026-04-24 07:32:21.133842 | orchestrator | TASK [prometheus : Copying cloud config file for openstack exporter] *********** 2026-04-24 07:32:21.133846 | orchestrator | Friday 24 April 2026 07:32:01 +0000 (0:00:02.670) 0:01:11.757 ********** 2026-04-24 07:32:21.133850 | orchestrator | skipping: [testbed-manager] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 07:32:21.133857 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 07:32:21.133863 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 07:32:21.133870 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:32:21.133876 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.133882 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.133889 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 07:32:21.133895 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.133901 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 07:32:21.133907 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.133914 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 07:32:21.133920 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.133926 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-24 07:32:21.133932 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.133942 | orchestrator | 2026-04-24 07:32:21.133953 | orchestrator | TASK [prometheus : Copying config file for blackbox exporter] ****************** 2026-04-24 07:32:21.133958 | orchestrator | Friday 24 April 2026 07:32:02 +0000 (0:00:01.857) 0:01:13.615 ********** 2026-04-24 07:32:21.133983 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 07:32:21.133992 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 07:32:21.133999 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.134006 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.134058 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 07:32:21.134069 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.134074 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 07:32:21.134081 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.134088 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 07:32:21.134094 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.134100 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-24 07:32:21.134106 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.134112 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2) 2026-04-24 07:32:21.134118 | orchestrator | 2026-04-24 07:32:21.134125 | orchestrator | TASK [prometheus : Find extra prometheus server config files] ****************** 2026-04-24 07:32:21.134146 | orchestrator | Friday 24 April 2026 07:32:05 +0000 (0:00:02.298) 0:01:15.914 ********** 2026-04-24 07:32:21.134153 | orchestrator | [WARNING]: Skipped 2026-04-24 07:32:21.134160 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' path 2026-04-24 07:32:21.134168 | orchestrator | due to this access issue: 2026-04-24 07:32:21.134174 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' is 2026-04-24 07:32:21.134181 | orchestrator | not a directory 2026-04-24 07:32:21.134187 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-24 07:32:21.134193 | orchestrator | 2026-04-24 07:32:21.134199 | orchestrator | TASK [prometheus : Create subdirectories for extra config files] *************** 2026-04-24 07:32:21.134213 | orchestrator | Friday 24 April 2026 07:32:07 +0000 (0:00:02.041) 0:01:17.956 ********** 2026-04-24 07:32:21.134220 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:32:21.134226 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.134233 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.134239 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.134245 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.134251 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.134257 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.134264 | orchestrator | 2026-04-24 07:32:21.134365 | orchestrator | TASK [prometheus : Template extra prometheus server config files] ************** 2026-04-24 07:32:21.134378 | orchestrator | Friday 24 April 2026 07:32:08 +0000 (0:00:00.991) 0:01:18.947 ********** 2026-04-24 07:32:21.134384 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:32:21.134391 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.134397 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.134404 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.134409 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.134415 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.134422 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.134428 | orchestrator | 2026-04-24 07:32:21.134450 | orchestrator | TASK [prometheus : Check for the existence of Prometheus v2 container volume] *** 2026-04-24 07:32:21.134457 | orchestrator | Friday 24 April 2026 07:32:09 +0000 (0:00:01.577) 0:01:20.525 ********** 2026-04-24 07:32:21.134463 | orchestrator | ok: [testbed-manager] 2026-04-24 07:32:21.134469 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:32:21.134475 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:32:21.134482 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:32:21.134496 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:32:21.134505 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:32:21.134516 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:32:21.134522 | orchestrator | 2026-04-24 07:32:21.134528 | orchestrator | TASK [prometheus : Gracefully stop Prometheus] ********************************* 2026-04-24 07:32:21.134534 | orchestrator | Friday 24 April 2026 07:32:11 +0000 (0:00:01.641) 0:01:22.166 ********** 2026-04-24 07:32:21.134540 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.134545 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.134550 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.134557 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.134563 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.134569 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.134575 | orchestrator | changed: [testbed-manager] 2026-04-24 07:32:21.134581 | orchestrator | 2026-04-24 07:32:21.134587 | orchestrator | TASK [prometheus : Create new Prometheus v3 volume] **************************** 2026-04-24 07:32:21.134592 | orchestrator | Friday 24 April 2026 07:32:18 +0000 (0:00:07.266) 0:01:29.433 ********** 2026-04-24 07:32:21.134597 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.134603 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.134609 | orchestrator | changed: [testbed-manager] 2026-04-24 07:32:21.134615 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.134620 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.134625 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.134644 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.134651 | orchestrator | 2026-04-24 07:32:21.134656 | orchestrator | TASK [prometheus : Move _data from old to new volume] ************************** 2026-04-24 07:32:21.134662 | orchestrator | Friday 24 April 2026 07:32:19 +0000 (0:00:01.139) 0:01:30.572 ********** 2026-04-24 07:32:21.134669 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:21.134675 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:21.134681 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:21.134688 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:21.134694 | orchestrator | changed: [testbed-manager] 2026-04-24 07:32:21.134699 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:21.134703 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:21.134707 | orchestrator | 2026-04-24 07:32:21.134711 | orchestrator | TASK [prometheus : Remove old Prometheus v2 volume] **************************** 2026-04-24 07:32:21.134727 | orchestrator | Friday 24 April 2026 07:32:21 +0000 (0:00:01.189) 0:01:31.761 ********** 2026-04-24 07:32:25.697766 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:25.697850 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:25.697861 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:25.697870 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:25.697878 | orchestrator | changed: [testbed-manager] 2026-04-24 07:32:25.697886 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:25.697894 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:32:25.697902 | orchestrator | 2026-04-24 07:32:25.697912 | orchestrator | TASK [service-check-containers : prometheus | Check containers] **************** 2026-04-24 07:32:25.697922 | orchestrator | Friday 24 April 2026 07:32:22 +0000 (0:00:01.412) 0:01:33.174 ********** 2026-04-24 07:32:25.697951 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-24 07:32:25.697965 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:32:25.697975 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:32:25.697984 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:32:25.698059 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:32:25.698086 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:32:25.698095 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:32:25.698103 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-24 07:32:25.698117 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:32:25.698126 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:25.698134 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:32:25.698150 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:32:25.698158 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:32:25.698173 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:28.438792 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:28.438960 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:32:28.438985 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:32:28.439012 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:32:28.439020 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:28.439027 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-24 07:32:28.439043 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:28.439048 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:28.439055 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:28.439059 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:32:28.439069 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:32:28.439073 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-24 07:32:28.439077 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:28.439081 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:28.439089 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-24 07:32:30.644502 | orchestrator | 2026-04-24 07:32:30.644595 | orchestrator | TASK [service-check-containers : prometheus | Notify handlers to restart containers] *** 2026-04-24 07:32:30.644607 | orchestrator | Friday 24 April 2026 07:32:28 +0000 (0:00:06.043) 0:01:39.218 ********** 2026-04-24 07:32:30.644615 | orchestrator | changed: [testbed-manager] => { 2026-04-24 07:32:30.644622 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:32:30.644629 | orchestrator | } 2026-04-24 07:32:30.644636 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:32:30.644642 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:32:30.644648 | orchestrator | } 2026-04-24 07:32:30.644654 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:32:30.644660 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:32:30.644666 | orchestrator | } 2026-04-24 07:32:30.644672 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:32:30.644678 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:32:30.644684 | orchestrator | } 2026-04-24 07:32:30.644691 | orchestrator | changed: [testbed-node-3] => { 2026-04-24 07:32:30.644697 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:32:30.644728 | orchestrator | } 2026-04-24 07:32:30.644733 | orchestrator | changed: [testbed-node-4] => { 2026-04-24 07:32:30.644749 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:32:30.644753 | orchestrator | } 2026-04-24 07:32:30.644757 | orchestrator | changed: [testbed-node-5] => { 2026-04-24 07:32:30.644761 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:32:30.644764 | orchestrator | } 2026-04-24 07:32:30.644768 | orchestrator | 2026-04-24 07:32:30.644772 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:32:30.644776 | orchestrator | Friday 24 April 2026 07:32:29 +0000 (0:00:01.188) 0:01:40.407 ********** 2026-04-24 07:32:30.644782 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:32:30.644790 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-24 07:32:30.644796 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:30.644801 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:32:30.644818 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:30.644830 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:32:30.644835 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:32:30.644839 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:32:30.644843 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:30.644848 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:30.644852 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:32:30.644856 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:32:30.644867 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:31.329467 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:31.329561 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:32:31.329574 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:31.329585 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:32:31.329595 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:32:31.329605 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:32:31.329614 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:31.329623 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:31.329632 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:32:31.329682 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-24 07:32:31.329691 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:32:31.329701 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:32:31.329710 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:32:31.329719 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:32:31.329728 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:32:31.329737 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:32:31.329746 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:32:31.329761 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:32:31.329770 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:32:31.329785 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-24 07:34:45.980002 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-24 07:34:45.980085 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-24 07:34:45.980093 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:34:45.980100 | orchestrator | 2026-04-24 07:34:45.980106 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 07:34:45.980112 | orchestrator | Friday 24 April 2026 07:32:32 +0000 (0:00:02.535) 0:01:42.942 ********** 2026-04-24 07:34:45.980116 | orchestrator | 2026-04-24 07:34:45.980121 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 07:34:45.980126 | orchestrator | Friday 24 April 2026 07:32:32 +0000 (0:00:00.092) 0:01:43.035 ********** 2026-04-24 07:34:45.980130 | orchestrator | 2026-04-24 07:34:45.980135 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 07:34:45.980139 | orchestrator | Friday 24 April 2026 07:32:32 +0000 (0:00:00.091) 0:01:43.126 ********** 2026-04-24 07:34:45.980144 | orchestrator | 2026-04-24 07:34:45.980148 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 07:34:45.980153 | orchestrator | Friday 24 April 2026 07:32:32 +0000 (0:00:00.092) 0:01:43.219 ********** 2026-04-24 07:34:45.980158 | orchestrator | 2026-04-24 07:34:45.980162 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 07:34:45.980167 | orchestrator | Friday 24 April 2026 07:32:32 +0000 (0:00:00.101) 0:01:43.320 ********** 2026-04-24 07:34:45.980171 | orchestrator | 2026-04-24 07:34:45.980176 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 07:34:45.980181 | orchestrator | Friday 24 April 2026 07:32:33 +0000 (0:00:00.371) 0:01:43.691 ********** 2026-04-24 07:34:45.980185 | orchestrator | 2026-04-24 07:34:45.980190 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-24 07:34:45.980209 | orchestrator | Friday 24 April 2026 07:32:33 +0000 (0:00:00.099) 0:01:43.791 ********** 2026-04-24 07:34:45.980214 | orchestrator | 2026-04-24 07:34:45.980219 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-server container] ************* 2026-04-24 07:34:45.980224 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 07:34:45.980229 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 07:34:45.980238 | orchestrator | Friday 24 April 2026 07:32:33 +0000 (0:00:00.119) 0:01:43.910 ********** 2026-04-24 07:34:45.980243 | orchestrator | changed: [testbed-manager] 2026-04-24 07:34:45.980248 | orchestrator | 2026-04-24 07:34:45.980296 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-node-exporter container] ****** 2026-04-24 07:34:45.980302 | orchestrator | Friday 24 April 2026 07:32:52 +0000 (0:00:18.950) 0:02:02.861 ********** 2026-04-24 07:34:45.980307 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:34:45.980312 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:34:45.980316 | orchestrator | changed: [testbed-manager] 2026-04-24 07:34:45.980321 | orchestrator | changed: [testbed-node-3] 2026-04-24 07:34:45.980325 | orchestrator | changed: [testbed-node-4] 2026-04-24 07:34:45.980330 | orchestrator | changed: [testbed-node-5] 2026-04-24 07:34:45.980338 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:34:45.980345 | orchestrator | 2026-04-24 07:34:45.980353 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-mysqld-exporter container] **** 2026-04-24 07:34:45.980361 | orchestrator | Friday 24 April 2026 07:33:11 +0000 (0:00:19.720) 0:02:22.582 ********** 2026-04-24 07:34:45.980368 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:34:45.980376 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:34:45.980383 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:34:45.980390 | orchestrator | 2026-04-24 07:34:45.980397 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-memcached-exporter container] *** 2026-04-24 07:34:45.980404 | orchestrator | Friday 24 April 2026 07:33:24 +0000 (0:00:12.825) 0:02:35.407 ********** 2026-04-24 07:34:45.980412 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:34:45.980419 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:34:45.980427 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:34:45.980434 | orchestrator | 2026-04-24 07:34:45.980442 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-cadvisor container] *********** 2026-04-24 07:34:45.980449 | orchestrator | Friday 24 April 2026 07:33:37 +0000 (0:00:12.499) 0:02:47.907 ********** 2026-04-24 07:34:45.980456 | orchestrator | changed: [testbed-manager] 2026-04-24 07:34:45.980463 | orchestrator | changed: [testbed-node-3] 2026-04-24 07:34:45.980471 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:34:45.980478 | orchestrator | changed: [testbed-node-4] 2026-04-24 07:34:45.980484 | orchestrator | changed: [testbed-node-5] 2026-04-24 07:34:45.980492 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:34:45.980514 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:34:45.980523 | orchestrator | 2026-04-24 07:34:45.980532 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-alertmanager container] ******* 2026-04-24 07:34:45.980547 | orchestrator | Friday 24 April 2026 07:33:54 +0000 (0:00:16.967) 0:03:04.874 ********** 2026-04-24 07:34:45.980554 | orchestrator | changed: [testbed-manager] 2026-04-24 07:34:45.980573 | orchestrator | 2026-04-24 07:34:45.980589 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-elasticsearch-exporter container] *** 2026-04-24 07:34:45.980597 | orchestrator | Friday 24 April 2026 07:34:07 +0000 (0:00:13.720) 0:03:18.594 ********** 2026-04-24 07:34:45.980605 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:34:45.980613 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:34:45.980620 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:34:45.980628 | orchestrator | 2026-04-24 07:34:45.980635 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-blackbox-exporter container] *** 2026-04-24 07:34:45.980643 | orchestrator | Friday 24 April 2026 07:34:20 +0000 (0:00:12.307) 0:03:30.902 ********** 2026-04-24 07:34:45.980660 | orchestrator | changed: [testbed-manager] 2026-04-24 07:34:45.980672 | orchestrator | 2026-04-24 07:34:45.980678 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-libvirt-exporter container] *** 2026-04-24 07:34:45.980683 | orchestrator | Friday 24 April 2026 07:34:32 +0000 (0:00:11.797) 0:03:42.700 ********** 2026-04-24 07:34:45.980688 | orchestrator | changed: [testbed-node-3] 2026-04-24 07:34:45.980694 | orchestrator | changed: [testbed-node-4] 2026-04-24 07:34:45.980699 | orchestrator | changed: [testbed-node-5] 2026-04-24 07:34:45.980712 | orchestrator | 2026-04-24 07:34:45.980717 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:34:45.980723 | orchestrator | testbed-manager : ok=28  changed=14  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 07:34:45.980730 | orchestrator | testbed-node-0 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-24 07:34:45.980736 | orchestrator | testbed-node-1 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-24 07:34:45.980741 | orchestrator | testbed-node-2 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-24 07:34:45.980746 | orchestrator | testbed-node-3 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 07:34:45.980752 | orchestrator | testbed-node-4 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 07:34:45.980758 | orchestrator | testbed-node-5 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 07:34:45.980764 | orchestrator | 2026-04-24 07:34:45.980770 | orchestrator | 2026-04-24 07:34:45.980776 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:34:45.980782 | orchestrator | Friday 24 April 2026 07:34:45 +0000 (0:00:13.393) 0:03:56.093 ********** 2026-04-24 07:34:45.980788 | orchestrator | =============================================================================== 2026-04-24 07:34:45.980794 | orchestrator | prometheus : Copying over prometheus config file ----------------------- 21.37s 2026-04-24 07:34:45.980799 | orchestrator | prometheus : Restart prometheus-node-exporter container ---------------- 19.72s 2026-04-24 07:34:45.980808 | orchestrator | prometheus : Restart prometheus-server container ----------------------- 18.95s 2026-04-24 07:34:45.980817 | orchestrator | prometheus : Restart prometheus-cadvisor container --------------------- 16.97s 2026-04-24 07:34:45.980830 | orchestrator | prometheus : Restart prometheus-alertmanager container ----------------- 13.72s 2026-04-24 07:34:45.980841 | orchestrator | prometheus : Restart prometheus-libvirt-exporter container ------------- 13.39s 2026-04-24 07:34:45.980848 | orchestrator | prometheus : Restart prometheus-mysqld-exporter container -------------- 12.83s 2026-04-24 07:34:45.980858 | orchestrator | prometheus : Restart prometheus-memcached-exporter container ----------- 12.50s 2026-04-24 07:34:45.980866 | orchestrator | prometheus : Restart prometheus-elasticsearch-exporter container ------- 12.31s 2026-04-24 07:34:45.980875 | orchestrator | prometheus : Restart prometheus-blackbox-exporter container ------------ 11.80s 2026-04-24 07:34:45.980883 | orchestrator | prometheus : Gracefully stop Prometheus --------------------------------- 7.27s 2026-04-24 07:34:45.980892 | orchestrator | prometheus : Copying over config.json files ----------------------------- 6.96s 2026-04-24 07:34:45.980901 | orchestrator | service-check-containers : prometheus | Check containers ---------------- 6.04s 2026-04-24 07:34:45.980910 | orchestrator | service-cert-copy : prometheus | Copying over extra CA certificates ----- 5.62s 2026-04-24 07:34:45.980918 | orchestrator | prometheus : Ensuring config directories exist -------------------------- 5.16s 2026-04-24 07:34:45.980927 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS key --- 4.05s 2026-04-24 07:34:45.980945 | orchestrator | prometheus : Copying over prometheus web config file -------------------- 3.56s 2026-04-24 07:34:45.980954 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS certificate --- 2.91s 2026-04-24 07:34:45.980963 | orchestrator | prometheus : Copying over my.cnf for mysqld_exporter -------------------- 2.67s 2026-04-24 07:34:45.980971 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.54s 2026-04-24 07:34:47.894958 | orchestrator | 2026-04-24 07:34:47 | INFO  | Prepare task for execution of grafana. 2026-04-24 07:34:47.975727 | orchestrator | 2026-04-24 07:34:47 | INFO  | Task d40c971d-ced0-4997-b1b0-a51a33139eb5 (grafana) was prepared for execution. 2026-04-24 07:34:47.975798 | orchestrator | 2026-04-24 07:34:47 | INFO  | It takes a moment until task d40c971d-ced0-4997-b1b0-a51a33139eb5 (grafana) has been started and output is visible here. 2026-04-24 07:35:04.287646 | orchestrator | 2026-04-24 07:35:04.287746 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:35:04.287758 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 07:35:04.287767 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 07:35:04.287782 | orchestrator | 2026-04-24 07:35:04.287789 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:35:04.287796 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 07:35:04.287803 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 07:35:04.287817 | orchestrator | Friday 24 April 2026 07:34:53 +0000 (0:00:01.230) 0:00:01.230 ********** 2026-04-24 07:35:04.287823 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:35:04.287831 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:35:04.287838 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:35:04.287844 | orchestrator | 2026-04-24 07:35:04.287850 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:35:04.287857 | orchestrator | Friday 24 April 2026 07:34:54 +0000 (0:00:01.192) 0:00:02.423 ********** 2026-04-24 07:35:04.287863 | orchestrator | ok: [testbed-node-0] => (item=enable_grafana_True) 2026-04-24 07:35:04.287870 | orchestrator | ok: [testbed-node-1] => (item=enable_grafana_True) 2026-04-24 07:35:04.287876 | orchestrator | ok: [testbed-node-2] => (item=enable_grafana_True) 2026-04-24 07:35:04.287883 | orchestrator | 2026-04-24 07:35:04.287890 | orchestrator | PLAY [Apply role grafana] ****************************************************** 2026-04-24 07:35:04.287897 | orchestrator | 2026-04-24 07:35:04.287903 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-24 07:35:04.287910 | orchestrator | Friday 24 April 2026 07:34:55 +0000 (0:00:00.849) 0:00:03.272 ********** 2026-04-24 07:35:04.287917 | orchestrator | included: /ansible/roles/grafana/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:35:04.287923 | orchestrator | 2026-04-24 07:35:04.287929 | orchestrator | TASK [grafana : Checking if Grafana container needs upgrading] ***************** 2026-04-24 07:35:04.287936 | orchestrator | Friday 24 April 2026 07:34:56 +0000 (0:00:01.470) 0:00:04.743 ********** 2026-04-24 07:35:04.287942 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:35:04.287949 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:35:04.287955 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:35:04.287962 | orchestrator | 2026-04-24 07:35:04.287968 | orchestrator | TASK [grafana : Ensuring config directories exist] ***************************** 2026-04-24 07:35:04.287975 | orchestrator | Friday 24 April 2026 07:34:59 +0000 (0:00:02.064) 0:00:06.808 ********** 2026-04-24 07:35:04.287985 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:04.288015 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:04.288049 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:04.288057 | orchestrator | 2026-04-24 07:35:04.288064 | orchestrator | TASK [grafana : Check if extra configuration file exists] ********************** 2026-04-24 07:35:04.288070 | orchestrator | Friday 24 April 2026 07:34:59 +0000 (0:00:00.914) 0:00:07.723 ********** 2026-04-24 07:35:04.288077 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:35:04.288084 | orchestrator | 2026-04-24 07:35:04.288090 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-24 07:35:04.288097 | orchestrator | Friday 24 April 2026 07:35:01 +0000 (0:00:01.456) 0:00:09.179 ********** 2026-04-24 07:35:04.288103 | orchestrator | included: /ansible/roles/grafana/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:35:04.288109 | orchestrator | 2026-04-24 07:35:04.288116 | orchestrator | TASK [service-cert-copy : grafana | Copying over extra CA certificates] ******** 2026-04-24 07:35:04.288122 | orchestrator | Friday 24 April 2026 07:35:02 +0000 (0:00:01.302) 0:00:10.481 ********** 2026-04-24 07:35:04.288129 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:04.288137 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:04.288178 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:04.288192 | orchestrator | 2026-04-24 07:35:04.288199 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS certificate] *** 2026-04-24 07:35:04.288205 | orchestrator | Friday 24 April 2026 07:35:03 +0000 (0:00:01.263) 0:00:11.745 ********** 2026-04-24 07:35:04.288235 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:35:04.288247 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:35:09.261632 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:35:09.261706 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:35:09.261714 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:35:09.261738 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:35:09.261743 | orchestrator | 2026-04-24 07:35:09.261747 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS key] ***** 2026-04-24 07:35:09.261753 | orchestrator | Friday 24 April 2026 07:35:04 +0000 (0:00:00.592) 0:00:12.338 ********** 2026-04-24 07:35:09.261758 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:35:09.261762 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:35:09.261766 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:35:09.261770 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:35:09.261794 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:35:09.261798 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:35:09.261802 | orchestrator | 2026-04-24 07:35:09.261806 | orchestrator | TASK [grafana : Copying over config.json files] ******************************** 2026-04-24 07:35:09.261810 | orchestrator | Friday 24 April 2026 07:35:05 +0000 (0:00:01.134) 0:00:13.472 ********** 2026-04-24 07:35:09.261814 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:09.261823 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:09.261827 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:09.261831 | orchestrator | 2026-04-24 07:35:09.261835 | orchestrator | TASK [grafana : Copying over grafana.ini] ************************************** 2026-04-24 07:35:09.261839 | orchestrator | Friday 24 April 2026 07:35:08 +0000 (0:00:02.385) 0:00:15.858 ********** 2026-04-24 07:35:09.261845 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:09.261861 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:19.335584 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:19.335682 | orchestrator | 2026-04-24 07:35:19.335690 | orchestrator | TASK [grafana : Copying over extra configuration file] ************************* 2026-04-24 07:35:19.335696 | orchestrator | Friday 24 April 2026 07:35:10 +0000 (0:00:01.945) 0:00:17.804 ********** 2026-04-24 07:35:19.335700 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:35:19.335705 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:35:19.335709 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:35:19.335713 | orchestrator | 2026-04-24 07:35:19.335717 | orchestrator | TASK [grafana : Configuring Prometheus as data source for Grafana] ************* 2026-04-24 07:35:19.335721 | orchestrator | Friday 24 April 2026 07:35:10 +0000 (0:00:00.426) 0:00:18.231 ********** 2026-04-24 07:35:19.335725 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-24 07:35:19.335729 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-24 07:35:19.335733 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-24 07:35:19.335738 | orchestrator | 2026-04-24 07:35:19.335744 | orchestrator | TASK [grafana : Configuring dashboards provisioning] *************************** 2026-04-24 07:35:19.335750 | orchestrator | Friday 24 April 2026 07:35:11 +0000 (0:00:01.395) 0:00:19.626 ********** 2026-04-24 07:35:19.335759 | orchestrator | ok: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-24 07:35:19.335768 | orchestrator | ok: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-24 07:35:19.335773 | orchestrator | ok: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-24 07:35:19.335779 | orchestrator | 2026-04-24 07:35:19.335786 | orchestrator | TASK [grafana : Check if the folder for custom grafana dashboards exists] ****** 2026-04-24 07:35:19.335792 | orchestrator | Friday 24 April 2026 07:35:13 +0000 (0:00:01.368) 0:00:20.995 ********** 2026-04-24 07:35:19.335798 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:35:19.335804 | orchestrator | 2026-04-24 07:35:19.335810 | orchestrator | TASK [grafana : Remove templated Grafana dashboards] *************************** 2026-04-24 07:35:19.335815 | orchestrator | Friday 24 April 2026 07:35:14 +0000 (0:00:00.928) 0:00:21.923 ********** 2026-04-24 07:35:19.335822 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:35:19.335828 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:35:19.335833 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:35:19.335839 | orchestrator | 2026-04-24 07:35:19.335845 | orchestrator | TASK [grafana : Copying over custom dashboards] ******************************** 2026-04-24 07:35:19.335852 | orchestrator | Friday 24 April 2026 07:35:15 +0000 (0:00:01.083) 0:00:23.007 ********** 2026-04-24 07:35:19.335858 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:35:19.335864 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:35:19.335870 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:35:19.335876 | orchestrator | 2026-04-24 07:35:19.335882 | orchestrator | TASK [service-check-containers : grafana | Check containers] ******************* 2026-04-24 07:35:19.335889 | orchestrator | Friday 24 April 2026 07:35:16 +0000 (0:00:01.649) 0:00:24.656 ********** 2026-04-24 07:35:19.335912 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:19.335942 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:19.335947 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:35:19.335951 | orchestrator | 2026-04-24 07:35:19.335955 | orchestrator | TASK [service-check-containers : grafana | Notify handlers to restart containers] *** 2026-04-24 07:35:19.335959 | orchestrator | Friday 24 April 2026 07:35:18 +0000 (0:00:01.409) 0:00:26.065 ********** 2026-04-24 07:35:19.335963 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:35:19.335969 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:35:19.335976 | orchestrator | } 2026-04-24 07:35:19.335982 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:35:19.335988 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:35:19.335994 | orchestrator | } 2026-04-24 07:35:19.336000 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:35:19.336006 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:35:19.336012 | orchestrator | } 2026-04-24 07:35:19.336018 | orchestrator | 2026-04-24 07:35:19.336024 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:35:19.336031 | orchestrator | Friday 24 April 2026 07:35:18 +0000 (0:00:00.662) 0:00:26.728 ********** 2026-04-24 07:35:19.336037 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:35:19.336044 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:35:19.336050 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:35:19.336058 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:35:19.336070 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:37:10.241191 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:37:10.241278 | orchestrator | 2026-04-24 07:37:10.241285 | orchestrator | TASK [grafana : Stopping all Grafana instances but the first node] ************* 2026-04-24 07:37:10.241291 | orchestrator | Friday 24 April 2026 07:35:19 +0000 (0:00:00.734) 0:00:27.462 ********** 2026-04-24 07:37:10.241296 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:37:10.241300 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:37:10.241304 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:37:10.241308 | orchestrator | 2026-04-24 07:37:10.241313 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-24 07:37:10.241317 | orchestrator | Friday 24 April 2026 07:35:25 +0000 (0:00:06.040) 0:00:33.503 ********** 2026-04-24 07:37:10.241320 | orchestrator | 2026-04-24 07:37:10.241324 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-24 07:37:10.241328 | orchestrator | Friday 24 April 2026 07:35:25 +0000 (0:00:00.083) 0:00:33.587 ********** 2026-04-24 07:37:10.241332 | orchestrator | 2026-04-24 07:37:10.241336 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-24 07:37:10.241340 | orchestrator | Friday 24 April 2026 07:35:25 +0000 (0:00:00.088) 0:00:33.675 ********** 2026-04-24 07:37:10.241344 | orchestrator | 2026-04-24 07:37:10.241350 | orchestrator | RUNNING HANDLER [grafana : Restart first grafana container] ******************** 2026-04-24 07:37:10.241356 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 07:37:10.241363 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 07:37:10.241376 | orchestrator | Friday 24 April 2026 07:35:26 +0000 (0:00:00.325) 0:00:34.001 ********** 2026-04-24 07:37:10.241382 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:37:10.241388 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:37:10.241393 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:37:10.241399 | orchestrator | 2026-04-24 07:37:10.241405 | orchestrator | RUNNING HANDLER [grafana : Waiting for grafana to start on first node] ********* 2026-04-24 07:37:10.241412 | orchestrator | Friday 24 April 2026 07:36:06 +0000 (0:00:40.435) 0:01:14.436 ********** 2026-04-24 07:37:10.241418 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:37:10.241423 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:37:10.241427 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (12 retries left). 2026-04-24 07:37:10.241432 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (11 retries left). 2026-04-24 07:37:10.241455 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:37:10.241460 | orchestrator | 2026-04-24 07:37:10.241464 | orchestrator | RUNNING HANDLER [grafana : Restart remaining grafana containers] *************** 2026-04-24 07:37:10.241468 | orchestrator | Friday 24 April 2026 07:36:33 +0000 (0:00:27.119) 0:01:41.556 ********** 2026-04-24 07:37:10.241471 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:37:10.241475 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:37:10.241479 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:37:10.241483 | orchestrator | 2026-04-24 07:37:10.241487 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:37:10.241492 | orchestrator | testbed-node-0 : ok=19  changed=6  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:37:10.241497 | orchestrator | testbed-node-1 : ok=17  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:37:10.241501 | orchestrator | testbed-node-2 : ok=17  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:37:10.241505 | orchestrator | 2026-04-24 07:37:10.241509 | orchestrator | 2026-04-24 07:37:10.241513 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:37:10.241517 | orchestrator | Friday 24 April 2026 07:37:09 +0000 (0:00:36.044) 0:02:17.600 ********** 2026-04-24 07:37:10.241520 | orchestrator | =============================================================================== 2026-04-24 07:37:10.241524 | orchestrator | grafana : Restart first grafana container ------------------------------ 40.44s 2026-04-24 07:37:10.241528 | orchestrator | grafana : Restart remaining grafana containers ------------------------- 36.04s 2026-04-24 07:37:10.241532 | orchestrator | grafana : Waiting for grafana to start on first node ------------------- 27.12s 2026-04-24 07:37:10.241535 | orchestrator | grafana : Stopping all Grafana instances but the first node ------------- 6.04s 2026-04-24 07:37:10.241539 | orchestrator | grafana : Copying over config.json files -------------------------------- 2.39s 2026-04-24 07:37:10.241543 | orchestrator | grafana : Checking if Grafana container needs upgrading ----------------- 2.07s 2026-04-24 07:37:10.241546 | orchestrator | grafana : Copying over grafana.ini -------------------------------------- 1.95s 2026-04-24 07:37:10.241584 | orchestrator | grafana : Copying over custom dashboards -------------------------------- 1.65s 2026-04-24 07:37:10.241598 | orchestrator | grafana : include_tasks ------------------------------------------------- 1.47s 2026-04-24 07:37:10.241603 | orchestrator | grafana : Check if extra configuration file exists ---------------------- 1.46s 2026-04-24 07:37:10.241609 | orchestrator | service-check-containers : grafana | Check containers ------------------- 1.41s 2026-04-24 07:37:10.241615 | orchestrator | grafana : Configuring Prometheus as data source for Grafana ------------- 1.40s 2026-04-24 07:37:10.241620 | orchestrator | grafana : Configuring dashboards provisioning --------------------------- 1.37s 2026-04-24 07:37:10.241626 | orchestrator | grafana : include_tasks ------------------------------------------------- 1.30s 2026-04-24 07:37:10.241646 | orchestrator | service-cert-copy : grafana | Copying over extra CA certificates -------- 1.26s 2026-04-24 07:37:10.241652 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.19s 2026-04-24 07:37:10.241658 | orchestrator | service-cert-copy : grafana | Copying over backend internal TLS key ----- 1.13s 2026-04-24 07:37:10.241665 | orchestrator | grafana : Remove templated Grafana dashboards --------------------------- 1.08s 2026-04-24 07:37:10.241671 | orchestrator | grafana : Check if the folder for custom grafana dashboards exists ------ 0.93s 2026-04-24 07:37:10.241676 | orchestrator | grafana : Ensuring config directories exist ----------------------------- 0.91s 2026-04-24 07:37:10.541896 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/510-clusterapi.sh 2026-04-24 07:37:10.548110 | orchestrator | + set -e 2026-04-24 07:37:10.548180 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 07:37:10.548188 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 07:37:10.548192 | orchestrator | ++ INTERACTIVE=false 2026-04-24 07:37:10.548216 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 07:37:10.548220 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 07:37:10.548224 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 07:37:10.548814 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 07:37:10.553071 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-24 07:37:10.553134 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-24 07:37:10.553509 | orchestrator | ++ semver 10.0.0 8.0.0 2026-04-24 07:37:10.593921 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-24 07:37:10.593993 | orchestrator | + osism apply clusterapi 2026-04-24 07:37:12.266130 | orchestrator | 2026-04-24 07:37:12 | INFO  | Prepare task for execution of clusterapi. 2026-04-24 07:37:12.353176 | orchestrator | 2026-04-24 07:37:12 | INFO  | Task 8205130c-45af-496f-955e-99e907ab80de (clusterapi) was prepared for execution. 2026-04-24 07:37:12.353250 | orchestrator | 2026-04-24 07:37:12 | INFO  | It takes a moment until task 8205130c-45af-496f-955e-99e907ab80de (clusterapi) has been started and output is visible here. 2026-04-24 07:38:33.957241 | orchestrator | 2026-04-24 07:38:33.957324 | orchestrator | PLAY [Apply cert_manager role] ************************************************* 2026-04-24 07:38:33.957330 | orchestrator | 2026-04-24 07:38:33.957335 | orchestrator | TASK [Include cert_manager role] *********************************************** 2026-04-24 07:38:33.957340 | orchestrator | Friday 24 April 2026 07:37:18 +0000 (0:00:01.626) 0:00:01.626 ********** 2026-04-24 07:38:33.957346 | orchestrator | included: cert_manager for testbed-manager 2026-04-24 07:38:33.957353 | orchestrator | 2026-04-24 07:38:33.957358 | orchestrator | TASK [cert_manager : Deploy cert-manager crds] ********************************* 2026-04-24 07:38:33.957364 | orchestrator | Friday 24 April 2026 07:37:20 +0000 (0:00:02.063) 0:00:03.690 ********** 2026-04-24 07:38:33.957374 | orchestrator | ok: [testbed-manager] 2026-04-24 07:38:33.957382 | orchestrator | 2026-04-24 07:38:33.957388 | orchestrator | TASK [cert_manager : Deploy cert-manager] ************************************** 2026-04-24 07:38:33.957395 | orchestrator | Friday 24 April 2026 07:37:25 +0000 (0:00:04.829) 0:00:08.520 ********** 2026-04-24 07:38:33.957401 | orchestrator | ok: [testbed-manager] 2026-04-24 07:38:33.957407 | orchestrator | 2026-04-24 07:38:33.957413 | orchestrator | PLAY [Initialize or upgrade the CAPI management cluster] *********************** 2026-04-24 07:38:33.957419 | orchestrator | 2026-04-24 07:38:33.957425 | orchestrator | TASK [Get capi-system namespace phase] ***************************************** 2026-04-24 07:38:33.957431 | orchestrator | Friday 24 April 2026 07:37:30 +0000 (0:00:04.927) 0:00:13.448 ********** 2026-04-24 07:38:33.957437 | orchestrator | ok: [testbed-manager] 2026-04-24 07:38:33.957443 | orchestrator | 2026-04-24 07:38:33.957449 | orchestrator | TASK [Set capi-system-phase fact] ********************************************** 2026-04-24 07:38:33.957456 | orchestrator | Friday 24 April 2026 07:37:33 +0000 (0:00:02.934) 0:00:16.382 ********** 2026-04-24 07:38:33.957462 | orchestrator | ok: [testbed-manager] 2026-04-24 07:38:33.957467 | orchestrator | 2026-04-24 07:38:33.957474 | orchestrator | TASK [Initialize the CAPI management cluster] ********************************** 2026-04-24 07:38:33.957480 | orchestrator | Friday 24 April 2026 07:37:34 +0000 (0:00:01.570) 0:00:17.953 ********** 2026-04-24 07:38:33.957487 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:38:33.957494 | orchestrator | 2026-04-24 07:38:33.957500 | orchestrator | TASK [Upgrade the CAPI management cluster] ************************************* 2026-04-24 07:38:33.957507 | orchestrator | Friday 24 April 2026 07:37:35 +0000 (0:00:01.256) 0:00:19.210 ********** 2026-04-24 07:38:33.957514 | orchestrator | ok: [testbed-manager] 2026-04-24 07:38:33.957520 | orchestrator | 2026-04-24 07:38:33.957527 | orchestrator | TASK [Install openstack-resource-controller] *********************************** 2026-04-24 07:38:33.957533 | orchestrator | Friday 24 April 2026 07:38:29 +0000 (0:00:53.801) 0:01:13.011 ********** 2026-04-24 07:38:33.957539 | orchestrator | changed: [testbed-manager] 2026-04-24 07:38:33.957547 | orchestrator | 2026-04-24 07:38:33.957555 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:38:33.957562 | orchestrator | testbed-manager : ok=7  changed=1  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-24 07:38:33.957590 | orchestrator | 2026-04-24 07:38:33.957596 | orchestrator | 2026-04-24 07:38:33.957602 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:38:33.957622 | orchestrator | Friday 24 April 2026 07:38:33 +0000 (0:00:03.787) 0:01:16.799 ********** 2026-04-24 07:38:33.957628 | orchestrator | =============================================================================== 2026-04-24 07:38:33.957634 | orchestrator | Upgrade the CAPI management cluster ------------------------------------ 53.80s 2026-04-24 07:38:33.957640 | orchestrator | cert_manager : Deploy cert-manager -------------------------------------- 4.93s 2026-04-24 07:38:33.957646 | orchestrator | cert_manager : Deploy cert-manager crds --------------------------------- 4.83s 2026-04-24 07:38:33.957652 | orchestrator | Install openstack-resource-controller ----------------------------------- 3.79s 2026-04-24 07:38:33.957658 | orchestrator | Get capi-system namespace phase ----------------------------------------- 2.93s 2026-04-24 07:38:33.957664 | orchestrator | Include cert_manager role ----------------------------------------------- 2.06s 2026-04-24 07:38:33.957670 | orchestrator | Set capi-system-phase fact ---------------------------------------------- 1.57s 2026-04-24 07:38:33.957676 | orchestrator | Initialize the CAPI management cluster ---------------------------------- 1.26s 2026-04-24 07:38:34.232610 | orchestrator | + osism apply -a upgrade magnum 2026-04-24 07:38:35.764117 | orchestrator | 2026-04-24 07:38:35 | INFO  | Prepare task for execution of magnum. 2026-04-24 07:38:35.841658 | orchestrator | 2026-04-24 07:38:35 | INFO  | Task 98b6c4bb-683c-4354-a625-cbe8c3027965 (magnum) was prepared for execution. 2026-04-24 07:38:35.841740 | orchestrator | 2026-04-24 07:38:35 | INFO  | It takes a moment until task 98b6c4bb-683c-4354-a625-cbe8c3027965 (magnum) has been started and output is visible here. 2026-04-24 07:38:50.840757 | orchestrator | 2026-04-24 07:38:50.840841 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:38:50.840849 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 07:38:50.840855 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 07:38:50.840863 | orchestrator | 2026-04-24 07:38:50.840868 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:38:50.840872 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 07:38:50.840876 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 07:38:50.840884 | orchestrator | Friday 24 April 2026 07:38:41 +0000 (0:00:01.420) 0:00:01.420 ********** 2026-04-24 07:38:50.840888 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:38:50.840892 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:38:50.840896 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:38:50.840900 | orchestrator | 2026-04-24 07:38:50.840904 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:38:50.840908 | orchestrator | Friday 24 April 2026 07:38:42 +0000 (0:00:01.086) 0:00:02.507 ********** 2026-04-24 07:38:50.840911 | orchestrator | ok: [testbed-node-0] => (item=enable_magnum_True) 2026-04-24 07:38:50.840915 | orchestrator | ok: [testbed-node-1] => (item=enable_magnum_True) 2026-04-24 07:38:50.840919 | orchestrator | ok: [testbed-node-2] => (item=enable_magnum_True) 2026-04-24 07:38:50.840923 | orchestrator | 2026-04-24 07:38:50.840927 | orchestrator | PLAY [Apply role magnum] ******************************************************* 2026-04-24 07:38:50.840930 | orchestrator | 2026-04-24 07:38:50.840934 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-24 07:38:50.840938 | orchestrator | Friday 24 April 2026 07:38:43 +0000 (0:00:01.078) 0:00:03.586 ********** 2026-04-24 07:38:50.840958 | orchestrator | included: /ansible/roles/magnum/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:38:50.840963 | orchestrator | 2026-04-24 07:38:50.840967 | orchestrator | TASK [magnum : Ensuring config directories exist] ****************************** 2026-04-24 07:38:50.840973 | orchestrator | Friday 24 April 2026 07:38:45 +0000 (0:00:01.540) 0:00:05.126 ********** 2026-04-24 07:38:50.840985 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:50.841057 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:50.841084 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:50.841093 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:50.841108 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:50.841119 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:50.841126 | orchestrator | 2026-04-24 07:38:50.841132 | orchestrator | TASK [magnum : Check if policies shall be overwritten] ************************* 2026-04-24 07:38:50.841139 | orchestrator | Friday 24 April 2026 07:38:47 +0000 (0:00:02.341) 0:00:07.468 ********** 2026-04-24 07:38:50.841145 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:38:50.841151 | orchestrator | 2026-04-24 07:38:50.841157 | orchestrator | TASK [magnum : Set magnum policy file] ***************************************** 2026-04-24 07:38:50.841164 | orchestrator | Friday 24 April 2026 07:38:47 +0000 (0:00:00.135) 0:00:07.603 ********** 2026-04-24 07:38:50.841168 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:38:50.841172 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:38:50.841175 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:38:50.841179 | orchestrator | 2026-04-24 07:38:50.841183 | orchestrator | TASK [magnum : Check if kubeconfig file is supplied] *************************** 2026-04-24 07:38:50.841186 | orchestrator | Friday 24 April 2026 07:38:47 +0000 (0:00:00.406) 0:00:08.009 ********** 2026-04-24 07:38:50.841190 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-24 07:38:50.841194 | orchestrator | 2026-04-24 07:38:50.841198 | orchestrator | TASK [magnum : Copying over kubeconfig file] *********************************** 2026-04-24 07:38:50.841201 | orchestrator | Friday 24 April 2026 07:38:49 +0000 (0:00:01.413) 0:00:09.423 ********** 2026-04-24 07:38:50.841211 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:55.731836 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:55.731944 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:55.731977 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:55.731992 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:55.732095 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:55.732136 | orchestrator | 2026-04-24 07:38:55.732149 | orchestrator | TASK [magnum : Set magnum kubeconfig file's path] ****************************** 2026-04-24 07:38:55.732162 | orchestrator | Friday 24 April 2026 07:38:52 +0000 (0:00:02.733) 0:00:12.156 ********** 2026-04-24 07:38:55.732174 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:38:55.732186 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:38:55.732197 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:38:55.732208 | orchestrator | 2026-04-24 07:38:55.732219 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-24 07:38:55.732230 | orchestrator | Friday 24 April 2026 07:38:52 +0000 (0:00:00.381) 0:00:12.537 ********** 2026-04-24 07:38:55.732242 | orchestrator | included: /ansible/roles/magnum/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:38:55.732253 | orchestrator | 2026-04-24 07:38:55.732264 | orchestrator | TASK [service-cert-copy : magnum | Copying over extra CA certificates] ********* 2026-04-24 07:38:55.732275 | orchestrator | Friday 24 April 2026 07:38:53 +0000 (0:00:01.258) 0:00:13.796 ********** 2026-04-24 07:38:55.732287 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:55.732306 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:55.732319 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:38:55.732343 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:57.591836 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:57.591923 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:38:57.591931 | orchestrator | 2026-04-24 07:38:57.591936 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS certificate] *** 2026-04-24 07:38:57.591941 | orchestrator | Friday 24 April 2026 07:38:56 +0000 (0:00:02.391) 0:00:16.188 ********** 2026-04-24 07:38:57.591949 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:38:57.591968 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:38:57.591972 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:38:57.591989 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:38:57.591993 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:38:57.591997 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:38:57.592059 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:38:57.592069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:38:57.592073 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:38:57.592077 | orchestrator | 2026-04-24 07:38:57.592081 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS key] ****** 2026-04-24 07:38:57.592085 | orchestrator | Friday 24 April 2026 07:38:57 +0000 (0:00:00.949) 0:00:17.137 ********** 2026-04-24 07:38:57.592093 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:01.072160 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:01.072252 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:39:01.072281 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:01.072312 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:01.072320 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:39:01.072329 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:01.072351 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:01.072360 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:39:01.072367 | orchestrator | 2026-04-24 07:39:01.072375 | orchestrator | TASK [magnum : Copying over config.json files for services] ******************** 2026-04-24 07:39:01.072384 | orchestrator | Friday 24 April 2026 07:38:58 +0000 (0:00:01.654) 0:00:18.791 ********** 2026-04-24 07:39:01.072395 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:01.072408 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:01.072417 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:01.072431 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:07.849314 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:07.849411 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:07.849433 | orchestrator | 2026-04-24 07:39:07.849439 | orchestrator | TASK [magnum : Copying over magnum.conf] *************************************** 2026-04-24 07:39:07.849445 | orchestrator | Friday 24 April 2026 07:39:01 +0000 (0:00:02.538) 0:00:21.330 ********** 2026-04-24 07:39:07.849451 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:07.849456 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:07.849470 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:07.849477 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:07.849486 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:07.849490 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:07.849494 | orchestrator | 2026-04-24 07:39:07.849498 | orchestrator | TASK [magnum : Copying over existing policy file] ****************************** 2026-04-24 07:39:07.849502 | orchestrator | Friday 24 April 2026 07:39:07 +0000 (0:00:06.156) 0:00:27.487 ********** 2026-04-24 07:39:07.849509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:11.474320 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:11.474426 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:39:11.474452 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:11.474461 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:11.474468 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:39:11.474475 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:11.474497 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:11.474504 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:39:11.474517 | orchestrator | 2026-04-24 07:39:11.474524 | orchestrator | TASK [service-check-containers : magnum | Check containers] ******************** 2026-04-24 07:39:11.474532 | orchestrator | Friday 24 April 2026 07:39:08 +0000 (0:00:01.511) 0:00:28.998 ********** 2026-04-24 07:39:11.474543 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:11.474550 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:11.474558 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-24 07:39:11.474571 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:35.863529 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:35.863645 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-24 07:39:35.863663 | orchestrator | 2026-04-24 07:39:35.863677 | orchestrator | TASK [service-check-containers : magnum | Notify handlers to restart containers] *** 2026-04-24 07:39:35.863690 | orchestrator | Friday 24 April 2026 07:39:11 +0000 (0:00:02.816) 0:00:31.814 ********** 2026-04-24 07:39:35.863702 | orchestrator | changed: [testbed-node-0] => { 2026-04-24 07:39:35.863714 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:39:35.863726 | orchestrator | } 2026-04-24 07:39:35.863737 | orchestrator | changed: [testbed-node-1] => { 2026-04-24 07:39:35.863748 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:39:35.863759 | orchestrator | } 2026-04-24 07:39:35.863770 | orchestrator | changed: [testbed-node-2] => { 2026-04-24 07:39:35.863780 | orchestrator |  "msg": "Notifying handlers" 2026-04-24 07:39:35.863791 | orchestrator | } 2026-04-24 07:39:35.863802 | orchestrator | 2026-04-24 07:39:35.863813 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-24 07:39:35.863824 | orchestrator | Friday 24 April 2026 07:39:12 +0000 (0:00:00.424) 0:00:32.239 ********** 2026-04-24 07:39:35.863839 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:35.863853 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:35.863888 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:39:35.863924 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:35.863938 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:35.863950 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:39:35.863962 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-24 07:39:35.863974 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-24 07:39:35.863993 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:39:35.864005 | orchestrator | 2026-04-24 07:39:35.864056 | orchestrator | TASK [magnum : Running Magnum bootstrap container] ***************************** 2026-04-24 07:39:35.864074 | orchestrator | Friday 24 April 2026 07:39:13 +0000 (0:00:01.594) 0:00:33.834 ********** 2026-04-24 07:39:35.864093 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:39:35.864112 | orchestrator | 2026-04-24 07:39:35.864130 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-24 07:39:35.864149 | orchestrator | Friday 24 April 2026 07:39:35 +0000 (0:00:21.983) 0:00:55.817 ********** 2026-04-24 07:39:35.864160 | orchestrator | 2026-04-24 07:39:35.864171 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-24 07:39:35.864191 | orchestrator | Friday 24 April 2026 07:39:35 +0000 (0:00:00.112) 0:00:55.930 ********** 2026-04-24 07:40:22.894977 | orchestrator | 2026-04-24 07:40:22.895142 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-24 07:40:22.895162 | orchestrator | Friday 24 April 2026 07:39:35 +0000 (0:00:00.091) 0:00:56.021 ********** 2026-04-24 07:40:22.895172 | orchestrator | 2026-04-24 07:40:22.895179 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-api container] ************************ 2026-04-24 07:40:22.895186 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 07:40:22.895194 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 07:40:22.895233 | orchestrator | Friday 24 April 2026 07:39:36 +0000 (0:00:00.085) 0:00:56.107 ********** 2026-04-24 07:40:22.895245 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:40:22.895256 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:40:22.895267 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:40:22.895277 | orchestrator | 2026-04-24 07:40:22.895287 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-conductor container] ****************** 2026-04-24 07:40:22.895298 | orchestrator | Friday 24 April 2026 07:39:58 +0000 (0:00:22.025) 0:01:18.132 ********** 2026-04-24 07:40:22.895309 | orchestrator | changed: [testbed-node-1] 2026-04-24 07:40:22.895320 | orchestrator | changed: [testbed-node-2] 2026-04-24 07:40:22.895333 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:40:22.895344 | orchestrator | 2026-04-24 07:40:22.895355 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:40:22.895369 | orchestrator | testbed-node-0 : ok=16  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-24 07:40:22.895379 | orchestrator | testbed-node-1 : ok=14  changed=6  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 07:40:22.895385 | orchestrator | testbed-node-2 : ok=14  changed=6  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-24 07:40:22.895392 | orchestrator | 2026-04-24 07:40:22.895399 | orchestrator | 2026-04-24 07:40:22.895406 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:40:22.895413 | orchestrator | Friday 24 April 2026 07:40:22 +0000 (0:00:24.310) 0:01:42.443 ********** 2026-04-24 07:40:22.895419 | orchestrator | =============================================================================== 2026-04-24 07:40:22.895426 | orchestrator | magnum : Restart magnum-conductor container ---------------------------- 24.31s 2026-04-24 07:40:22.895432 | orchestrator | magnum : Restart magnum-api container ---------------------------------- 22.03s 2026-04-24 07:40:22.895439 | orchestrator | magnum : Running Magnum bootstrap container ---------------------------- 21.98s 2026-04-24 07:40:22.895467 | orchestrator | magnum : Copying over magnum.conf --------------------------------------- 6.16s 2026-04-24 07:40:22.895474 | orchestrator | service-check-containers : magnum | Check containers -------------------- 2.82s 2026-04-24 07:40:22.895481 | orchestrator | magnum : Copying over kubeconfig file ----------------------------------- 2.73s 2026-04-24 07:40:22.895487 | orchestrator | magnum : Copying over config.json files for services -------------------- 2.54s 2026-04-24 07:40:22.895494 | orchestrator | service-cert-copy : magnum | Copying over extra CA certificates --------- 2.39s 2026-04-24 07:40:22.895501 | orchestrator | magnum : Ensuring config directories exist ------------------------------ 2.34s 2026-04-24 07:40:22.895507 | orchestrator | service-cert-copy : magnum | Copying over backend internal TLS key ------ 1.65s 2026-04-24 07:40:22.895514 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.59s 2026-04-24 07:40:22.895520 | orchestrator | magnum : include_tasks -------------------------------------------------- 1.54s 2026-04-24 07:40:22.895527 | orchestrator | magnum : Copying over existing policy file ------------------------------ 1.51s 2026-04-24 07:40:22.895534 | orchestrator | magnum : Check if kubeconfig file is supplied --------------------------- 1.41s 2026-04-24 07:40:22.895540 | orchestrator | magnum : include_tasks -------------------------------------------------- 1.26s 2026-04-24 07:40:22.895547 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.09s 2026-04-24 07:40:22.895553 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.08s 2026-04-24 07:40:22.895560 | orchestrator | service-cert-copy : magnum | Copying over backend internal TLS certificate --- 0.95s 2026-04-24 07:40:22.895567 | orchestrator | service-check-containers : magnum | Notify handlers to restart containers --- 0.42s 2026-04-24 07:40:22.895573 | orchestrator | magnum : Set magnum policy file ----------------------------------------- 0.41s 2026-04-24 07:40:23.757028 | orchestrator | ok: Runtime: 3:23:44.487531 2026-04-24 07:40:24.150915 | 2026-04-24 07:40:24.151056 | TASK [Bootstrap services] 2026-04-24 07:40:24.686349 | orchestrator | skipping: Conditional result was False 2026-04-24 07:40:24.714248 | 2026-04-24 07:40:24.714394 | TASK [Run checks after the upgrade] 2026-04-24 07:40:25.436516 | orchestrator | + set -e 2026-04-24 07:40:25.436676 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 07:40:25.436691 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 07:40:25.436700 | orchestrator | ++ INTERACTIVE=false 2026-04-24 07:40:25.436706 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 07:40:25.436710 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 07:40:25.436725 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 07:40:25.437521 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 07:40:25.442072 | orchestrator | 2026-04-24 07:40:25.442135 | orchestrator | # CHECK 2026-04-24 07:40:25.442144 | orchestrator | 2026-04-24 07:40:25.442151 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-24 07:40:25.442162 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-24 07:40:25.442169 | orchestrator | + echo 2026-04-24 07:40:25.442176 | orchestrator | + echo '# CHECK' 2026-04-24 07:40:25.442182 | orchestrator | + echo 2026-04-24 07:40:25.442193 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-24 07:40:25.442351 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-24 07:40:25.498847 | orchestrator | 2026-04-24 07:40:25.498931 | orchestrator | ## Containers @ testbed-manager 2026-04-24 07:40:25.498942 | orchestrator | 2026-04-24 07:40:25.498954 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 07:40:25.498962 | orchestrator | + echo 2026-04-24 07:40:25.498971 | orchestrator | + echo '## Containers @ testbed-manager' 2026-04-24 07:40:25.498981 | orchestrator | + echo 2026-04-24 07:40:25.498990 | orchestrator | + osism container testbed-manager ps 2026-04-24 07:40:27.107617 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-24 07:40:27.107728 | orchestrator | 16701301e874 registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328 "dumb-init --single-…" 5 minutes ago Up 5 minutes prometheus_blackbox_exporter 2026-04-24 07:40:27.107743 | orchestrator | c780d38b280d registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_alertmanager 2026-04-24 07:40:27.107751 | orchestrator | e0724336aac7 registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-24 07:40:27.107758 | orchestrator | d78d7c17fe41 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-24 07:40:27.107765 | orchestrator | 812886efa8a7 registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_server 2026-04-24 07:40:27.107773 | orchestrator | 7336bcf296a4 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-24 07:40:27.107784 | orchestrator | 975c24636296 registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-24 07:40:27.107791 | orchestrator | 55b4c29bc6fa registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-24 07:40:27.107823 | orchestrator | 67a40632e763 registry.osism.tech/osism/openstackclient:2025.1 "/usr/bin/dumb-init …" 3 hours ago Up 3 hours openstackclient 2026-04-24 07:40:27.107831 | orchestrator | fee2151febee registry.osism.tech/osism/inventory-reconciler:0.20260322.0 "/sbin/tini -- /entr…" 3 hours ago Up 3 hours (healthy) manager-inventory_reconciler-1 2026-04-24 07:40:27.107838 | orchestrator | a2474cabd6ea registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- sleep…" 3 hours ago Up 3 hours (healthy) osismclient 2026-04-24 07:40:27.107845 | orchestrator | 7540b85eafcb registry.osism.tech/osism/kolla-ansible:0.20260328.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) kolla-ansible 2026-04-24 07:40:27.107852 | orchestrator | 4aa063f27e55 registry.osism.tech/osism/osism-kubernetes:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) osism-kubernetes 2026-04-24 07:40:27.107876 | orchestrator | 26a1f9193c39 registry.osism.tech/osism/ceph-ansible:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) ceph-ansible 2026-04-24 07:40:27.107884 | orchestrator | 9a13ba3bb7e0 registry.osism.tech/osism/osism-ansible:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) osism-ansible 2026-04-24 07:40:27.107891 | orchestrator | aa57a002e61a registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-openstack-1 2026-04-24 07:40:27.107898 | orchestrator | 7be983fba0fd registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) 192.168.16.5:8000->8000/tcp manager-api-1 2026-04-24 07:40:27.107905 | orchestrator | 39d88a165f7a registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up About an hour (healthy) manager-listener-1 2026-04-24 07:40:27.107912 | orchestrator | 01bf1b8c0a95 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-beat-1 2026-04-24 07:40:27.107919 | orchestrator | e0fcc819ae63 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-flower-1 2026-04-24 07:40:27.107925 | orchestrator | abc4b9dbfa36 registry.osism.tech/osism/osism-frontend:0.20260320.0 "docker-entrypoint.s…" 3 hours ago Up 3 hours 192.168.16.5:3000->3000/tcp osism-frontend 2026-04-24 07:40:27.107932 | orchestrator | ded06adbc6d5 registry.osism.tech/osism/cephclient:18.2.7 "/usr/bin/dumb-init …" 5 hours ago Up 5 hours cephclient 2026-04-24 07:40:27.107945 | orchestrator | d9d994b69a15 phpmyadmin/phpmyadmin:5.2 "/docker-entrypoint.…" 5 hours ago Up 5 hours (healthy) 80/tcp phpmyadmin 2026-04-24 07:40:27.107952 | orchestrator | 2d45fac1fbcc registry.osism.tech/osism/homer:v25.10.1 "/bin/sh /entrypoint…" 5 hours ago Up 5 hours (healthy) 8080/tcp homer 2026-04-24 07:40:27.107958 | orchestrator | ee71182ab23e registry.osism.tech/osism/cgit:1.2.3 "httpd-foreground" 5 hours ago Up 5 hours 80/tcp cgit 2026-04-24 07:40:27.107965 | orchestrator | 823702b5df8d registry.osism.tech/dockerhub/ubuntu/squid:6.1-23.10_beta "entrypoint.sh -f /e…" 6 hours ago Up 6 hours (healthy) 192.168.16.5:3128->3128/tcp squid 2026-04-24 07:40:27.107975 | orchestrator | 1e829c287255 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" 6 hours ago Up 3 hours (healthy) 8000/tcp manager-ara-server-1 2026-04-24 07:40:27.107982 | orchestrator | 4db9bda21d93 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" 6 hours ago Up 3 hours (healthy) 6379/tcp manager-redis-1 2026-04-24 07:40:27.107989 | orchestrator | b79e0c55e4d1 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" 6 hours ago Up 3 hours (healthy) 3306/tcp manager-mariadb-1 2026-04-24 07:40:27.108001 | orchestrator | b38237654c04 registry.osism.tech/dockerhub/library/traefik:v3.5.0 "/entrypoint.sh trae…" 6 hours ago Up 6 hours (healthy) 192.168.16.5:80->80/tcp, 192.168.16.5:443->443/tcp, 192.168.16.5:8122->8080/tcp traefik 2026-04-24 07:40:27.271936 | orchestrator | + echo 2026-04-24 07:40:27.272035 | orchestrator | 2026-04-24 07:40:27.272050 | orchestrator | ## Images @ testbed-manager 2026-04-24 07:40:27.272057 | orchestrator | 2026-04-24 07:40:27.272064 | orchestrator | + echo '## Images @ testbed-manager' 2026-04-24 07:40:27.272072 | orchestrator | + echo 2026-04-24 07:40:27.272078 | orchestrator | + osism container testbed-manager images 2026-04-24 07:40:28.814884 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-24 07:40:28.814975 | orchestrator | registry.osism.tech/osism/openstackclient 2024.2 80968bd64c90 28 hours ago 238MB 2026-04-24 07:40:28.814989 | orchestrator | registry.osism.tech/osism/openstackclient 2025.1 40ed33884512 28 hours ago 212MB 2026-04-24 07:40:28.814998 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20260328.0 38f6ca42e9a0 3 weeks ago 635MB 2026-04-24 07:40:28.815006 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 3 weeks ago 590MB 2026-04-24 07:40:28.815014 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 3 weeks ago 683MB 2026-04-24 07:40:28.815039 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 3 weeks ago 277MB 2026-04-24 07:40:28.815047 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter 0.25.0.20260328 1bf017fd7bf3 3 weeks ago 319MB 2026-04-24 07:40:28.815083 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager 0.28.1.20260328 d1986023a383 3 weeks ago 415MB 2026-04-24 07:40:28.815093 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 3 weeks ago 368MB 2026-04-24 07:40:28.815103 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-server 3.2.1.20260328 4f5732d5eb69 3 weeks ago 860MB 2026-04-24 07:40:28.815109 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 3 weeks ago 317MB 2026-04-24 07:40:28.815113 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20260322.0 3e18c5de9bc5 4 weeks ago 634MB 2026-04-24 07:40:28.815119 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20260322.0 c68c1f5728ae 4 weeks ago 1.24GB 2026-04-24 07:40:28.815124 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20260322.0 f6e7e0d58bb1 4 weeks ago 585MB 2026-04-24 07:40:28.815129 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20260322.0 9806642932fd 4 weeks ago 357MB 2026-04-24 07:40:28.815134 | orchestrator | registry.osism.tech/osism/osism 0.20260320.0 5d0420989a40 4 weeks ago 408MB 2026-04-24 07:40:28.815139 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20260320.0 80b833af5991 4 weeks ago 232MB 2026-04-24 07:40:28.815144 | orchestrator | registry.osism.tech/dockerhub/library/redis 7.4.7-alpine e08bd8d5a677 2 months ago 41.4MB 2026-04-24 07:40:28.815159 | orchestrator | registry.osism.tech/osism/homer v25.10.1 ea34b371c716 4 months ago 11.5MB 2026-04-24 07:40:28.815164 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20251130.0 0f140ec71e5f 4 months ago 608MB 2026-04-24 07:40:28.815175 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-24 07:40:28.815180 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-24 07:40:28.815185 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-24 07:40:28.815190 | orchestrator | registry.osism.tech/kolla/release/prometheus-blackbox-exporter 0.25.0.20251130 7bbb4f6f4831 4 months ago 308MB 2026-04-24 07:40:28.815195 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-24 07:40:28.815200 | orchestrator | registry.osism.tech/kolla/release/prometheus-alertmanager 0.28.0.20251130 ba994ea4acda 4 months ago 404MB 2026-04-24 07:40:28.815205 | orchestrator | registry.osism.tech/kolla/release/prometheus-v2-server 2.55.1.20251130 56b43d5c716a 4 months ago 839MB 2026-04-24 07:40:28.815210 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-24 07:40:28.815215 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20251130.0 1bfc1dadeee1 4 months ago 330MB 2026-04-24 07:40:28.815220 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20251130.0 42988b2d229c 4 months ago 613MB 2026-04-24 07:40:28.815225 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20251130.0 a212d8ca4a50 4 months ago 560MB 2026-04-24 07:40:28.815246 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20251130.0 9beff03cb77b 4 months ago 1.23GB 2026-04-24 07:40:28.815251 | orchestrator | registry.osism.tech/osism/osism 0.20251130.1 95213af683ec 4 months ago 383MB 2026-04-24 07:40:28.815256 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20251130.1 2cb6e7609620 4 months ago 238MB 2026-04-24 07:40:28.815266 | orchestrator | registry.osism.tech/dockerhub/library/mariadb 11.8.4 70745dd8f1d0 5 months ago 334MB 2026-04-24 07:40:28.815271 | orchestrator | phpmyadmin/phpmyadmin 5.2 e66b1f5a8c58 6 months ago 742MB 2026-04-24 07:40:28.815276 | orchestrator | registry.osism.tech/osism/ara-server 1.7.3 d1b687333f2f 8 months ago 275MB 2026-04-24 07:40:28.815281 | orchestrator | registry.osism.tech/dockerhub/library/traefik v3.5.0 11cc59587f6a 9 months ago 226MB 2026-04-24 07:40:28.815286 | orchestrator | registry.osism.tech/osism/cephclient 18.2.7 ae977aa79826 11 months ago 453MB 2026-04-24 07:40:28.815291 | orchestrator | registry.osism.tech/dockerhub/ubuntu/squid 6.1-23.10_beta 34b6bbbcf74b 22 months ago 146MB 2026-04-24 07:40:28.815296 | orchestrator | registry.osism.tech/osism/cgit 1.2.3 16e7285642b1 2 years ago 545MB 2026-04-24 07:40:28.982790 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-24 07:40:28.983355 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-24 07:40:29.050871 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 07:40:29.051345 | orchestrator | 2026-04-24 07:40:29.051388 | orchestrator | ## Containers @ testbed-node-0 2026-04-24 07:40:29.051409 | orchestrator | 2026-04-24 07:40:29.051429 | orchestrator | + echo 2026-04-24 07:40:29.051447 | orchestrator | + echo '## Containers @ testbed-node-0' 2026-04-24 07:40:29.051466 | orchestrator | + echo 2026-04-24 07:40:29.051485 | orchestrator | + osism container testbed-node-0 ps 2026-04-24 07:40:30.708859 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-24 07:40:30.708967 | orchestrator | a44bff9335de registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 11 seconds ago Up 9 seconds (health: starting) magnum_conductor 2026-04-24 07:40:30.709001 | orchestrator | 1690b86fcbc4 registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 44 seconds ago Up 43 seconds (healthy) magnum_api 2026-04-24 07:40:30.709011 | orchestrator | a0ec8014a433 registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 4 minutes ago Up 4 minutes grafana 2026-04-24 07:40:30.709076 | orchestrator | 6cb6fdf0af58 registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_elasticsearch_exporter 2026-04-24 07:40:30.709087 | orchestrator | bba2718bc8dc registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-24 07:40:30.709095 | orchestrator | 1730205cebb6 registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_memcached_exporter 2026-04-24 07:40:30.709102 | orchestrator | dbb4cbcf6d3f registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_mysqld_exporter 2026-04-24 07:40:30.709109 | orchestrator | aef499fce142 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-24 07:40:30.709116 | orchestrator | 2aa5d04f0014 registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-24 07:40:30.709145 | orchestrator | 10bbaeeef21f registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_scheduler 2026-04-24 07:40:30.709207 | orchestrator | 42896b020554 registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_data 2026-04-24 07:40:30.709216 | orchestrator | d8956de1708f registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-24 07:40:30.709222 | orchestrator | 1b9dd8909733 registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-24 07:40:30.709229 | orchestrator | 081ec92f93fc registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_housekeeping 2026-04-24 07:40:30.709235 | orchestrator | 15b057de0a9c registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_health_manager 2026-04-24 07:40:30.709241 | orchestrator | bdafcb4efb85 registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes octavia_driver_agent 2026-04-24 07:40:30.709247 | orchestrator | eaeb5440160e registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-24 07:40:30.709814 | orchestrator | d32c41ca777a registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_notifier 2026-04-24 07:40:30.709861 | orchestrator | 060fd762fc3d registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_listener 2026-04-24 07:40:30.709867 | orchestrator | 87d287a12a26 registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) aodh_evaluator 2026-04-24 07:40:30.709872 | orchestrator | 34ece3c4e70d registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) aodh_api 2026-04-24 07:40:30.709885 | orchestrator | 9375c6552e9a registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 23 minutes ago Up 23 minutes ceilometer_central 2026-04-24 07:40:30.709890 | orchestrator | 03e03ce8e981 registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 23 minutes ago Up 23 minutes (healthy) ceilometer_notification 2026-04-24 07:40:30.709894 | orchestrator | 1e660a650acf registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_worker 2026-04-24 07:40:30.709898 | orchestrator | f3ce872f3074 registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_mdns 2026-04-24 07:40:30.709902 | orchestrator | 1661914fad0b registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_producer 2026-04-24 07:40:30.709915 | orchestrator | 89ee6fd2ae83 registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_central 2026-04-24 07:40:30.709920 | orchestrator | 07aaf0cd3363 registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_api 2026-04-24 07:40:30.709923 | orchestrator | bc8338ec0f4b registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_backend_bind9 2026-04-24 07:40:30.709927 | orchestrator | 121a6d3bb5a6 registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_worker 2026-04-24 07:40:30.709931 | orchestrator | 60c2d494a186 registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_keystone_listener 2026-04-24 07:40:30.709935 | orchestrator | e34d9cb2dbee registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 31 minutes ago Up 31 minutes (healthy) barbican_api 2026-04-24 07:40:30.709940 | orchestrator | fd171240fa56 registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 36 minutes ago Up 35 minutes (healthy) cinder_backup 2026-04-24 07:40:30.709946 | orchestrator | 59f322545552 registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 36 minutes ago Up 35 minutes (healthy) cinder_volume 2026-04-24 07:40:30.709952 | orchestrator | 5a554f059116 registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 37 minutes ago Up 35 minutes (healthy) cinder_scheduler 2026-04-24 07:40:30.709958 | orchestrator | 3cd6d00d8e01 registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 37 minutes ago Up 35 minutes (healthy) cinder_api 2026-04-24 07:40:30.709974 | orchestrator | f9c8af17ac11 registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) glance_api 2026-04-24 07:40:30.709980 | orchestrator | 0c4c8f888827 registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 47 minutes ago Up 47 minutes (healthy) skyline_console 2026-04-24 07:40:30.709985 | orchestrator | a0ee6ec13c9c registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 48 minutes ago Up 48 minutes (healthy) skyline_apiserver 2026-04-24 07:40:30.709991 | orchestrator | f48d643c189f registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 49 minutes ago Up 49 minutes (healthy) horizon 2026-04-24 07:40:30.709997 | orchestrator | f30e4c7dbee1 registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_novncproxy 2026-04-24 07:40:30.710003 | orchestrator | 8c2790f9dcbc registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_conductor 2026-04-24 07:40:30.710009 | orchestrator | 10894e5e8b8c registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-24 07:40:30.710073 | orchestrator | 749aeaa20ce4 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 52 minutes (healthy) nova_api 2026-04-24 07:40:30.710081 | orchestrator | fdc3c60a2e9d registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_scheduler 2026-04-24 07:40:30.710087 | orchestrator | 277e21ec29db registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-24 07:40:30.710094 | orchestrator | 74613567a4a7 registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-24 07:40:30.710106 | orchestrator | 7e9ef45cc26c registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-24 07:40:30.710114 | orchestrator | 3edbbc036582 registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-24 07:40:30.710118 | orchestrator | 028ba774b1d1 registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-24 07:40:30.710122 | orchestrator | 003f3afffdc2 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-0 2026-04-24 07:40:30.710126 | orchestrator | 51311499a7fd registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-0 2026-04-24 07:40:30.710130 | orchestrator | 720ea55c4301 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-0 2026-04-24 07:40:30.710134 | orchestrator | 04a361c90b6d registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-24 07:40:30.710138 | orchestrator | 8c8760bbd15a registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-24 07:40:30.710141 | orchestrator | 7a9cc722345f registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-24 07:40:30.710153 | orchestrator | 3fbbe8eba51a registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-24 07:40:30.710157 | orchestrator | 95cd6356be08 registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-24 07:40:30.710161 | orchestrator | a202254da5e9 registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-24 07:40:30.710165 | orchestrator | 8f4d3f099ca9 registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-24 07:40:30.710172 | orchestrator | bc949f0cda5f registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-24 07:40:30.710177 | orchestrator | 5a7d583e41c5 registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-24 07:40:30.710184 | orchestrator | 1064d2292d92 registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-24 07:40:30.710188 | orchestrator | a8bb005ba837 registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-24 07:40:30.710192 | orchestrator | a2ab9652231f registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-24 07:40:30.710196 | orchestrator | adbaa25a3a54 registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-24 07:40:30.710199 | orchestrator | ab6d3f23b019 registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-24 07:40:30.710203 | orchestrator | b72bb344aa99 registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-24 07:40:30.710207 | orchestrator | 8fed342f8e0c registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-24 07:40:30.710211 | orchestrator | 5f7ab6056969 registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-24 07:40:30.710214 | orchestrator | 58c22150026d registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-24 07:40:30.710218 | orchestrator | 882da6815ea5 registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-24 07:40:30.710222 | orchestrator | 20e222485f89 registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-24 07:40:30.911378 | orchestrator | 2026-04-24 07:40:31.197816 | orchestrator | ## Images @ testbed-node-0 2026-04-24 07:40:31.197883 | orchestrator | 2026-04-24 07:40:31.197906 | orchestrator | + echo 2026-04-24 07:40:31.197912 | orchestrator | + echo '## Images @ testbed-node-0' 2026-04-24 07:40:31.197917 | orchestrator | + echo 2026-04-24 07:40:31.197922 | orchestrator | + osism container testbed-node-0 images 2026-04-24 07:40:32.563581 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-24 07:40:32.563669 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 3 weeks ago 288MB 2026-04-24 07:40:32.563684 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 3 weeks ago 1.54GB 2026-04-24 07:40:32.563721 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 3 weeks ago 1.57GB 2026-04-24 07:40:32.563733 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 3 weeks ago 590MB 2026-04-24 07:40:32.563744 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 3 weeks ago 277MB 2026-04-24 07:40:32.563755 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 3 weeks ago 1.04GB 2026-04-24 07:40:32.563766 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 3 weeks ago 350MB 2026-04-24 07:40:32.563777 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 3 weeks ago 427MB 2026-04-24 07:40:32.563787 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 3 weeks ago 683MB 2026-04-24 07:40:32.563812 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 3 weeks ago 277MB 2026-04-24 07:40:32.563824 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 3 weeks ago 285MB 2026-04-24 07:40:32.563835 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 3 weeks ago 293MB 2026-04-24 07:40:32.563846 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 3 weeks ago 293MB 2026-04-24 07:40:32.563857 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 3 weeks ago 284MB 2026-04-24 07:40:32.563868 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 3 weeks ago 284MB 2026-04-24 07:40:32.563878 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 3 weeks ago 1.2GB 2026-04-24 07:40:32.563890 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 3 weeks ago 463MB 2026-04-24 07:40:32.563900 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 3 weeks ago 309MB 2026-04-24 07:40:32.563911 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 3 weeks ago 368MB 2026-04-24 07:40:32.563922 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 3 weeks ago 303MB 2026-04-24 07:40:32.564004 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 3 weeks ago 312MB 2026-04-24 07:40:32.564017 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 3 weeks ago 317MB 2026-04-24 07:40:32.564054 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 3 weeks ago 301MB 2026-04-24 07:40:32.564065 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 3 weeks ago 301MB 2026-04-24 07:40:32.564085 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 3 weeks ago 301MB 2026-04-24 07:40:32.564096 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 3 weeks ago 301MB 2026-04-24 07:40:32.564107 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 3 weeks ago 1.09GB 2026-04-24 07:40:32.564128 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 3 weeks ago 1.06GB 2026-04-24 07:40:32.564139 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 3 weeks ago 1.05GB 2026-04-24 07:40:32.564165 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 3 weeks ago 997MB 2026-04-24 07:40:32.564177 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 3 weeks ago 996MB 2026-04-24 07:40:32.564188 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 3 weeks ago 1.07GB 2026-04-24 07:40:32.564199 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 3 weeks ago 1.07GB 2026-04-24 07:40:32.564210 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 3 weeks ago 1.05GB 2026-04-24 07:40:32.564221 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 3 weeks ago 1.05GB 2026-04-24 07:40:32.564232 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 3 weeks ago 1.05GB 2026-04-24 07:40:32.564243 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 3 weeks ago 996MB 2026-04-24 07:40:32.564253 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 3 weeks ago 995MB 2026-04-24 07:40:32.564264 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 3 weeks ago 995MB 2026-04-24 07:40:32.564282 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 3 weeks ago 995MB 2026-04-24 07:40:32.564293 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 3 weeks ago 994MB 2026-04-24 07:40:32.564304 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 3 weeks ago 1.12GB 2026-04-24 07:40:32.564315 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 3 weeks ago 1.79GB 2026-04-24 07:40:32.564326 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 3 weeks ago 1.43GB 2026-04-24 07:40:32.564337 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 3 weeks ago 1.43GB 2026-04-24 07:40:32.564347 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 3 weeks ago 1.44GB 2026-04-24 07:40:32.564358 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 3 weeks ago 1.24GB 2026-04-24 07:40:32.564369 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 3 weeks ago 1.07GB 2026-04-24 07:40:32.564380 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 3 weeks ago 1.02GB 2026-04-24 07:40:32.564391 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 3 weeks ago 1GB 2026-04-24 07:40:32.564401 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 3 weeks ago 1GB 2026-04-24 07:40:32.564412 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 3 weeks ago 1GB 2026-04-24 07:40:32.564429 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 3 weeks ago 1.27GB 2026-04-24 07:40:32.564440 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 3 weeks ago 1.15GB 2026-04-24 07:40:32.564451 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 3 weeks ago 1.01GB 2026-04-24 07:40:32.564462 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 3 weeks ago 1GB 2026-04-24 07:40:32.564477 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 3 weeks ago 1GB 2026-04-24 07:40:32.564488 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 3 weeks ago 1.01GB 2026-04-24 07:40:32.564499 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 3 weeks ago 1GB 2026-04-24 07:40:32.564510 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 3 weeks ago 1GB 2026-04-24 07:40:32.564531 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 3 weeks ago 1.23GB 2026-04-24 07:40:32.564543 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 3 weeks ago 1.39GB 2026-04-24 07:40:32.564554 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 3 weeks ago 1.23GB 2026-04-24 07:40:32.564565 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 3 weeks ago 1.23GB 2026-04-24 07:40:32.564576 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 3 weeks ago 1.07GB 2026-04-24 07:40:32.564587 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 3 weeks ago 1.07GB 2026-04-24 07:40:32.564598 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 3 weeks ago 1.07GB 2026-04-24 07:40:32.564609 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 3 weeks ago 1.24GB 2026-04-24 07:40:32.564620 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 3 weeks ago 301MB 2026-04-24 07:40:32.564631 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-24 07:40:32.564642 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-24 07:40:32.564653 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-24 07:40:32.564664 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-24 07:40:32.564680 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-24 07:40:32.564692 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-24 07:40:32.564703 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-24 07:40:32.564714 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-24 07:40:32.564725 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-24 07:40:32.564742 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-24 07:40:32.564754 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-24 07:40:32.564765 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-24 07:40:32.564776 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-24 07:40:32.564787 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-24 07:40:32.564798 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-24 07:40:32.564808 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-24 07:40:32.564819 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-24 07:40:32.565008 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-24 07:40:32.565042 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-24 07:40:32.565055 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-24 07:40:32.565066 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-24 07:40:32.565086 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-24 07:40:32.565097 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-24 07:40:32.565108 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-24 07:40:32.565119 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-24 07:40:32.565130 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-24 07:40:32.565141 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-24 07:40:32.565151 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-24 07:40:32.565162 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-24 07:40:32.565173 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-24 07:40:32.565184 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-24 07:40:32.565195 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-24 07:40:32.565206 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-24 07:40:32.565217 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-24 07:40:32.565237 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-24 07:40:32.565248 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-24 07:40:32.565259 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-24 07:40:32.565273 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-24 07:40:32.565290 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-24 07:40:32.565307 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-24 07:40:32.565326 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-24 07:40:32.565343 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-24 07:40:32.565370 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-24 07:40:32.565389 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-24 07:40:32.565405 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-24 07:40:32.565421 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-24 07:40:32.565432 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-24 07:40:32.565443 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-24 07:40:32.565455 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-24 07:40:32.565465 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-24 07:40:32.565476 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-24 07:40:32.565494 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-24 07:40:32.565505 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-24 07:40:32.565516 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-24 07:40:32.565526 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-24 07:40:32.565537 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-24 07:40:32.565548 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-24 07:40:32.565559 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-24 07:40:32.565570 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-24 07:40:32.565602 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-24 07:40:32.565613 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-24 07:40:32.565623 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-24 07:40:32.565634 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-24 07:40:32.565645 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-24 07:40:32.565656 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-24 07:40:32.565667 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-24 07:40:32.565678 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-24 07:40:32.565689 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-24 07:40:32.565700 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-24 07:40:32.736116 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-24 07:40:32.737248 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-24 07:40:32.804567 | orchestrator | 2026-04-24 07:40:32.804622 | orchestrator | ## Containers @ testbed-node-1 2026-04-24 07:40:32.804628 | orchestrator | 2026-04-24 07:40:32.804632 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 07:40:32.804637 | orchestrator | + echo 2026-04-24 07:40:32.804642 | orchestrator | + echo '## Containers @ testbed-node-1' 2026-04-24 07:40:32.804647 | orchestrator | + echo 2026-04-24 07:40:32.804651 | orchestrator | + osism container testbed-node-1 ps 2026-04-24 07:40:34.414787 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-24 07:40:34.414872 | orchestrator | 3e186b7be291 registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 15 seconds ago Up 13 seconds (health: starting) magnum_conductor 2026-04-24 07:40:34.414887 | orchestrator | 3aa5f7147dc0 registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 37 seconds ago Up 36 seconds (healthy) magnum_api 2026-04-24 07:40:34.414894 | orchestrator | 123ae4a4340a registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 3 minutes ago Up 3 minutes grafana 2026-04-24 07:40:34.414901 | orchestrator | 2523cc3743b1 registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_elasticsearch_exporter 2026-04-24 07:40:34.414909 | orchestrator | 36bd1579290a registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-24 07:40:34.414915 | orchestrator | 2a1e42f5da9e registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_memcached_exporter 2026-04-24 07:40:34.414922 | orchestrator | 60a950fb5876 registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_mysqld_exporter 2026-04-24 07:40:34.414955 | orchestrator | b7cc61846e65 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-24 07:40:34.414979 | orchestrator | 18a3c750eaab registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-24 07:40:34.414986 | orchestrator | d2ee987511b0 registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_scheduler 2026-04-24 07:40:34.414994 | orchestrator | 4d94e321cc14 registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_data 2026-04-24 07:40:34.414998 | orchestrator | ea0a24177ab4 registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-24 07:40:34.415003 | orchestrator | 021364eca156 registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-24 07:40:34.415007 | orchestrator | 3ab3170fc7fd registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_housekeeping 2026-04-24 07:40:34.415011 | orchestrator | 3d0e62ba5145 registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_health_manager 2026-04-24 07:40:34.415014 | orchestrator | 70c7871fe908 registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes octavia_driver_agent 2026-04-24 07:40:34.415060 | orchestrator | 7317c62b9257 registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-24 07:40:34.415080 | orchestrator | 0d63c45efff0 registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_notifier 2026-04-24 07:40:34.415085 | orchestrator | 22b06052817d registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_listener 2026-04-24 07:40:34.415089 | orchestrator | c9a2b524ca2e registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) aodh_evaluator 2026-04-24 07:40:34.415092 | orchestrator | a2f29e667c4c registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) aodh_api 2026-04-24 07:40:34.415096 | orchestrator | f1de81eb0371 registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 23 minutes ago Up 23 minutes ceilometer_central 2026-04-24 07:40:34.415100 | orchestrator | 05d492bca3e9 registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 23 minutes ago Up 23 minutes (healthy) ceilometer_notification 2026-04-24 07:40:34.415104 | orchestrator | 7e15ca35e636 registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_worker 2026-04-24 07:40:34.415113 | orchestrator | 7c03f5a83d94 registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_mdns 2026-04-24 07:40:34.415117 | orchestrator | 78169646b9e4 registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_producer 2026-04-24 07:40:34.415121 | orchestrator | c964d4cb4861 registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_central 2026-04-24 07:40:34.415125 | orchestrator | 471a00ca2283 registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_api 2026-04-24 07:40:34.415129 | orchestrator | cef8c30ff0c5 registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_backend_bind9 2026-04-24 07:40:34.415133 | orchestrator | ef19bbf0c3b3 registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_worker 2026-04-24 07:40:34.415137 | orchestrator | 9978ce52681d registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_keystone_listener 2026-04-24 07:40:34.415140 | orchestrator | 65613ade3849 registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 31 minutes ago Up 31 minutes (healthy) barbican_api 2026-04-24 07:40:34.415144 | orchestrator | 6bba5b2f5546 registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 36 minutes ago Up 35 minutes (healthy) cinder_backup 2026-04-24 07:40:34.415546 | orchestrator | 7bf1b8e5de16 registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 36 minutes ago Up 35 minutes (healthy) cinder_volume 2026-04-24 07:40:34.415568 | orchestrator | a5e01d36d796 registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 37 minutes ago Up 35 minutes (healthy) cinder_scheduler 2026-04-24 07:40:34.415573 | orchestrator | f87b01588e05 registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 37 minutes ago Up 35 minutes (healthy) cinder_api 2026-04-24 07:40:34.415577 | orchestrator | 4698b3ec9159 registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) glance_api 2026-04-24 07:40:34.415581 | orchestrator | 0dedf156fa94 registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 48 minutes ago Up 47 minutes (healthy) skyline_console 2026-04-24 07:40:34.415585 | orchestrator | 80505b425ce5 registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 48 minutes ago Up 48 minutes (healthy) skyline_apiserver 2026-04-24 07:40:34.415598 | orchestrator | 270053d356c2 registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 49 minutes ago Up 49 minutes (healthy) horizon 2026-04-24 07:40:34.415610 | orchestrator | f8859dd1a334 registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_novncproxy 2026-04-24 07:40:34.415614 | orchestrator | ff39aba83379 registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_conductor 2026-04-24 07:40:34.415617 | orchestrator | 3f2e29b1b887 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-24 07:40:34.415621 | orchestrator | 37848b7f5b53 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_api 2026-04-24 07:40:34.415625 | orchestrator | 0d27c09e0417 registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_scheduler 2026-04-24 07:40:34.415628 | orchestrator | 3f9a3f8b89b9 registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-24 07:40:34.415632 | orchestrator | f4fb7a02c6ce registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-24 07:40:34.415636 | orchestrator | 8d31d9ba9bb2 registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-24 07:40:34.415640 | orchestrator | 2e8427ce5915 registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-24 07:40:34.415644 | orchestrator | bcda897784eb registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-24 07:40:34.415649 | orchestrator | 9dfa87a4cad9 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-1 2026-04-24 07:40:34.415655 | orchestrator | 9a2d4193c8e6 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-1 2026-04-24 07:40:34.415669 | orchestrator | 95908a2faae5 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-1 2026-04-24 07:40:34.415675 | orchestrator | 641a091804eb registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-24 07:40:34.415682 | orchestrator | 2faf3c2a75f3 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-24 07:40:34.415688 | orchestrator | e5d41d175b5b registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-24 07:40:34.415694 | orchestrator | 5383fa345410 registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-24 07:40:34.415709 | orchestrator | 96b3322a2e1d registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-24 07:40:34.415715 | orchestrator | 0b9c66d48439 registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-24 07:40:34.415722 | orchestrator | 24dc71fa1aeb registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-24 07:40:34.415729 | orchestrator | 2c16084ab82c registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-24 07:40:34.415736 | orchestrator | 5cffacdc57c2 registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-24 07:40:34.415742 | orchestrator | 61639c739539 registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-24 07:40:34.415749 | orchestrator | 4dfd22705d97 registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-24 07:40:34.415756 | orchestrator | d828874ade65 registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-24 07:40:34.415763 | orchestrator | 7dc3a2c8852b registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-24 07:40:34.415770 | orchestrator | ac4b497bb034 registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-24 07:40:34.415777 | orchestrator | 2bc1cd33869d registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-24 07:40:34.415784 | orchestrator | 317a336e704e registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-24 07:40:34.415790 | orchestrator | 1becd10f3b8f registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-24 07:40:34.415798 | orchestrator | 21cf4d767752 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-24 07:40:34.415802 | orchestrator | 4e29cac6f0fb registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-24 07:40:34.415810 | orchestrator | dec738be6d49 registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-24 07:40:34.602878 | orchestrator | 2026-04-24 07:40:34.603018 | orchestrator | ## Images @ testbed-node-1 2026-04-24 07:40:34.603104 | orchestrator | 2026-04-24 07:40:34.603115 | orchestrator | + echo 2026-04-24 07:40:34.603126 | orchestrator | + echo '## Images @ testbed-node-1' 2026-04-24 07:40:34.603164 | orchestrator | + echo 2026-04-24 07:40:34.603174 | orchestrator | + osism container testbed-node-1 images 2026-04-24 07:40:36.276713 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-24 07:40:36.276792 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 3 weeks ago 288MB 2026-04-24 07:40:36.276800 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 3 weeks ago 1.54GB 2026-04-24 07:40:36.276806 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 3 weeks ago 1.57GB 2026-04-24 07:40:36.276811 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 3 weeks ago 590MB 2026-04-24 07:40:36.276817 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 3 weeks ago 277MB 2026-04-24 07:40:36.276822 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 3 weeks ago 1.04GB 2026-04-24 07:40:36.276829 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 3 weeks ago 350MB 2026-04-24 07:40:36.276834 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 3 weeks ago 427MB 2026-04-24 07:40:36.276839 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 3 weeks ago 683MB 2026-04-24 07:40:36.276845 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 3 weeks ago 277MB 2026-04-24 07:40:36.276850 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 3 weeks ago 285MB 2026-04-24 07:40:36.276855 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 3 weeks ago 293MB 2026-04-24 07:40:36.276860 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 3 weeks ago 293MB 2026-04-24 07:40:36.276865 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 3 weeks ago 284MB 2026-04-24 07:40:36.276870 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 3 weeks ago 284MB 2026-04-24 07:40:36.276875 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 3 weeks ago 1.2GB 2026-04-24 07:40:36.276880 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 3 weeks ago 463MB 2026-04-24 07:40:36.276885 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 3 weeks ago 309MB 2026-04-24 07:40:36.276890 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 3 weeks ago 368MB 2026-04-24 07:40:36.276895 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 3 weeks ago 303MB 2026-04-24 07:40:36.276900 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 3 weeks ago 312MB 2026-04-24 07:40:36.276905 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 3 weeks ago 317MB 2026-04-24 07:40:36.276910 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 3 weeks ago 301MB 2026-04-24 07:40:36.276915 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 3 weeks ago 301MB 2026-04-24 07:40:36.276932 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 3 weeks ago 301MB 2026-04-24 07:40:36.276937 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 3 weeks ago 301MB 2026-04-24 07:40:36.276942 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 3 weeks ago 1.09GB 2026-04-24 07:40:36.276947 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 3 weeks ago 1.06GB 2026-04-24 07:40:36.276952 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 3 weeks ago 1.05GB 2026-04-24 07:40:36.276968 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 3 weeks ago 997MB 2026-04-24 07:40:36.276974 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 3 weeks ago 996MB 2026-04-24 07:40:36.276979 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 3 weeks ago 1.07GB 2026-04-24 07:40:36.276984 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 3 weeks ago 1.07GB 2026-04-24 07:40:36.276988 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 3 weeks ago 1.05GB 2026-04-24 07:40:36.276993 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 3 weeks ago 1.05GB 2026-04-24 07:40:36.276998 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 3 weeks ago 1.05GB 2026-04-24 07:40:36.277003 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 3 weeks ago 996MB 2026-04-24 07:40:36.277008 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 3 weeks ago 995MB 2026-04-24 07:40:36.277013 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 3 weeks ago 995MB 2026-04-24 07:40:36.277018 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 3 weeks ago 995MB 2026-04-24 07:40:36.277048 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 3 weeks ago 994MB 2026-04-24 07:40:36.277053 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 3 weeks ago 1.12GB 2026-04-24 07:40:36.277058 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 3 weeks ago 1.79GB 2026-04-24 07:40:36.277063 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 3 weeks ago 1.43GB 2026-04-24 07:40:36.277068 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 3 weeks ago 1.43GB 2026-04-24 07:40:36.277073 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 3 weeks ago 1.44GB 2026-04-24 07:40:36.277078 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 3 weeks ago 1.24GB 2026-04-24 07:40:36.277083 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 3 weeks ago 1.07GB 2026-04-24 07:40:36.277088 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 3 weeks ago 1.02GB 2026-04-24 07:40:36.277097 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 3 weeks ago 1GB 2026-04-24 07:40:36.277102 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 3 weeks ago 1GB 2026-04-24 07:40:36.277107 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 3 weeks ago 1GB 2026-04-24 07:40:36.277112 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 3 weeks ago 1.27GB 2026-04-24 07:40:36.277117 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 3 weeks ago 1.15GB 2026-04-24 07:40:36.277122 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 3 weeks ago 1.01GB 2026-04-24 07:40:36.277127 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 3 weeks ago 1GB 2026-04-24 07:40:36.277132 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 3 weeks ago 1GB 2026-04-24 07:40:36.277137 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 3 weeks ago 1.01GB 2026-04-24 07:40:36.277142 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 3 weeks ago 1GB 2026-04-24 07:40:36.277148 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 3 weeks ago 1GB 2026-04-24 07:40:36.277156 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 3 weeks ago 1.23GB 2026-04-24 07:40:36.277162 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 3 weeks ago 1.39GB 2026-04-24 07:40:36.277169 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 3 weeks ago 1.23GB 2026-04-24 07:40:36.277174 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 3 weeks ago 1.23GB 2026-04-24 07:40:36.277179 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 3 weeks ago 1.07GB 2026-04-24 07:40:36.277184 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 3 weeks ago 1.07GB 2026-04-24 07:40:36.277189 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 3 weeks ago 1.07GB 2026-04-24 07:40:36.277196 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 3 weeks ago 1.24GB 2026-04-24 07:40:36.277201 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 3 weeks ago 301MB 2026-04-24 07:40:36.277206 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-24 07:40:36.277211 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-24 07:40:36.277216 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-24 07:40:36.277221 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-24 07:40:36.277226 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-24 07:40:36.277234 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-24 07:40:36.277239 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-24 07:40:36.277245 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-24 07:40:36.277250 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-24 07:40:36.277255 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-24 07:40:36.277260 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-24 07:40:36.277265 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-24 07:40:36.277272 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-24 07:40:36.277277 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-24 07:40:36.277282 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-24 07:40:36.277287 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-24 07:40:36.277294 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-24 07:40:36.277300 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-24 07:40:36.277306 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-24 07:40:36.277312 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-24 07:40:36.277317 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-24 07:40:36.277326 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-24 07:40:36.277332 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-24 07:40:36.277337 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-24 07:40:36.277343 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-24 07:40:36.277349 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-24 07:40:36.277354 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-24 07:40:36.277360 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-24 07:40:36.277366 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-24 07:40:36.277375 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-24 07:40:36.277383 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-24 07:40:36.277389 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-24 07:40:36.277395 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-24 07:40:36.277401 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-24 07:40:36.277407 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-24 07:40:36.277413 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-24 07:40:36.277419 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-24 07:40:36.277424 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-24 07:40:36.277430 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-24 07:40:36.277436 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-24 07:40:36.277441 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-24 07:40:36.277447 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-24 07:40:36.277453 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-24 07:40:36.277459 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-24 07:40:36.277465 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-24 07:40:36.277470 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-24 07:40:36.277476 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-24 07:40:36.277482 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-24 07:40:36.277488 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-24 07:40:36.277494 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-24 07:40:36.277499 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-24 07:40:36.277508 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-24 07:40:36.277514 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-24 07:40:36.277520 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-24 07:40:36.277526 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-24 07:40:36.277536 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-24 07:40:36.277542 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-24 07:40:36.277548 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-24 07:40:36.277554 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-24 07:40:36.277560 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-24 07:40:36.277566 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-24 07:40:36.277572 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-24 07:40:36.277580 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-24 07:40:36.277586 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-24 07:40:36.277592 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-24 07:40:36.277598 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-24 07:40:36.277603 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-24 07:40:36.277609 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-24 07:40:36.277615 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-24 07:40:36.446723 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-24 07:40:36.447790 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-24 07:40:36.503797 | orchestrator | 2026-04-24 07:40:36.503919 | orchestrator | ## Containers @ testbed-node-2 2026-04-24 07:40:36.503930 | orchestrator | 2026-04-24 07:40:36.503937 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 07:40:36.503944 | orchestrator | + echo 2026-04-24 07:40:36.503951 | orchestrator | + echo '## Containers @ testbed-node-2' 2026-04-24 07:40:36.503959 | orchestrator | + echo 2026-04-24 07:40:36.503966 | orchestrator | + osism container testbed-node-2 ps 2026-04-24 07:40:38.068898 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-24 07:40:38.069003 | orchestrator | 58b5a36f2271 registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 19 seconds ago Up 17 seconds (health: starting) magnum_conductor 2026-04-24 07:40:38.069046 | orchestrator | d2864435d869 registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 42 seconds ago Up 40 seconds (healthy) magnum_api 2026-04-24 07:40:38.069059 | orchestrator | b6911d7f8beb registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 3 minutes ago Up 3 minutes grafana 2026-04-24 07:40:38.069070 | orchestrator | db9325763f81 registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_elasticsearch_exporter 2026-04-24 07:40:38.069108 | orchestrator | fe2a2cba193a registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-24 07:40:38.069120 | orchestrator | 5d058f7310f9 registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_memcached_exporter 2026-04-24 07:40:38.069131 | orchestrator | e95aa2ff9bac registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_mysqld_exporter 2026-04-24 07:40:38.069155 | orchestrator | 57daec980376 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-24 07:40:38.069166 | orchestrator | b0a749fa1ad8 registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-24 07:40:38.069177 | orchestrator | e17132bcbee9 registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_scheduler 2026-04-24 07:40:38.069188 | orchestrator | e6b78d1995ec registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_data 2026-04-24 07:40:38.069213 | orchestrator | 82fb2223e4f6 registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-24 07:40:38.069225 | orchestrator | 25b73abb42a0 registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-24 07:40:38.069236 | orchestrator | 37646a858442 registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_housekeeping 2026-04-24 07:40:38.069247 | orchestrator | 2150bd92a2c1 registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_health_manager 2026-04-24 07:40:38.069257 | orchestrator | 8904c64f9e12 registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes octavia_driver_agent 2026-04-24 07:40:38.069268 | orchestrator | 34758df30043 registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-24 07:40:38.069298 | orchestrator | 3cd3c0627ea4 registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_notifier 2026-04-24 07:40:38.069310 | orchestrator | baca4b484529 registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_listener 2026-04-24 07:40:38.069321 | orchestrator | ca44b00fce33 registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) aodh_evaluator 2026-04-24 07:40:38.069332 | orchestrator | c91eba1a23f9 registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) aodh_api 2026-04-24 07:40:38.069351 | orchestrator | aa64939b8083 registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 23 minutes ago Up 23 minutes ceilometer_central 2026-04-24 07:40:38.069362 | orchestrator | 5ec1912f8f21 registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 23 minutes ago Up 23 minutes (healthy) ceilometer_notification 2026-04-24 07:40:38.069373 | orchestrator | 47b64e723fd3 registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_worker 2026-04-24 07:40:38.069384 | orchestrator | 176318d0608c registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_mdns 2026-04-24 07:40:38.069394 | orchestrator | 3f1c3907d59d registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 27 minutes ago Up 26 minutes (healthy) designate_producer 2026-04-24 07:40:38.069405 | orchestrator | c9c7ee34975a registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 27 minutes (healthy) designate_central 2026-04-24 07:40:38.069470 | orchestrator | 392669c16560 registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_api 2026-04-24 07:40:38.069484 | orchestrator | 9a994611373c registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_backend_bind9 2026-04-24 07:40:38.069497 | orchestrator | d21d43df874f registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_worker 2026-04-24 07:40:38.069511 | orchestrator | d2437204dd49 registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_keystone_listener 2026-04-24 07:40:38.069524 | orchestrator | e7b1f5214e24 registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 31 minutes ago Up 31 minutes (healthy) barbican_api 2026-04-24 07:40:38.069537 | orchestrator | 83612ece6fe1 registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 36 minutes ago Up 35 minutes (healthy) cinder_backup 2026-04-24 07:40:38.069550 | orchestrator | 2fef4de8ff4a registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 36 minutes ago Up 35 minutes (healthy) cinder_volume 2026-04-24 07:40:38.069563 | orchestrator | 8d7a86e0775d registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 37 minutes ago Up 35 minutes (healthy) cinder_scheduler 2026-04-24 07:40:38.069577 | orchestrator | 9dcbf61fda44 registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 37 minutes ago Up 35 minutes (healthy) cinder_api 2026-04-24 07:40:38.069789 | orchestrator | 60265dcddd06 registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 42 minutes ago Up 42 minutes (healthy) glance_api 2026-04-24 07:40:38.069810 | orchestrator | 92ed971a6621 registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 48 minutes ago Up 48 minutes (healthy) skyline_console 2026-04-24 07:40:38.069834 | orchestrator | 6ab52b433e8c registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 48 minutes ago Up 48 minutes (healthy) skyline_apiserver 2026-04-24 07:40:38.069845 | orchestrator | a759ebd3c9a0 registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 49 minutes ago Up 49 minutes (healthy) horizon 2026-04-24 07:40:38.069856 | orchestrator | 764b038252a9 registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_novncproxy 2026-04-24 07:40:38.069867 | orchestrator | ddec68f70658 registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_conductor 2026-04-24 07:40:38.069888 | orchestrator | acdb0bf46357 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-24 07:40:38.069899 | orchestrator | 69cc0f2fe3ff registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_api 2026-04-24 07:40:38.069910 | orchestrator | 0e04e93ad983 registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 53 minutes (healthy) nova_scheduler 2026-04-24 07:40:38.069921 | orchestrator | 05857b01d0e0 registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-24 07:40:38.069932 | orchestrator | c487cf095a93 registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-24 07:40:38.069943 | orchestrator | 1ffe38822d51 registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-24 07:40:38.069953 | orchestrator | e809b60c4b07 registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-24 07:40:38.069969 | orchestrator | dd478da582ff registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-24 07:40:38.069980 | orchestrator | 4de6f1edf6f4 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-2 2026-04-24 07:40:38.070188 | orchestrator | e107460f85dc registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-2 2026-04-24 07:40:38.070201 | orchestrator | b915fa5df795 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-2 2026-04-24 07:40:38.070212 | orchestrator | 5864d00bb7b3 registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-24 07:40:38.070223 | orchestrator | 739689377f42 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-24 07:40:38.070296 | orchestrator | e4319f9a6e02 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-24 07:40:38.070308 | orchestrator | 49d8fd8c75d6 registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-24 07:40:38.070318 | orchestrator | d8cf13fa6005 registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-24 07:40:38.070329 | orchestrator | c3dd1387bbcc registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-24 07:40:38.070340 | orchestrator | b1b50925385f registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-24 07:40:38.070351 | orchestrator | df934e56f95c registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-24 07:40:38.070362 | orchestrator | eaf829cb2c32 registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-24 07:40:38.070373 | orchestrator | 499a8dcb00cc registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-24 07:40:38.070384 | orchestrator | f68f00fa1e5c registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-24 07:40:38.070395 | orchestrator | fb0501aed469 registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-24 07:40:38.070406 | orchestrator | a88223b931d0 registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-24 07:40:38.070417 | orchestrator | 0993ddb9c6d4 registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-24 07:40:38.070428 | orchestrator | 2e885587e7f2 registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-24 07:40:38.070444 | orchestrator | 945dcb0e2b58 registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-24 07:40:38.070456 | orchestrator | f9a045d88280 registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-24 07:40:38.070467 | orchestrator | 5d7975d97ac9 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-24 07:40:38.070478 | orchestrator | b9c84ce57f56 registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-24 07:40:38.070496 | orchestrator | 36c23bc5b518 registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-24 07:40:38.229895 | orchestrator | 2026-04-24 07:40:38.230137 | orchestrator | ## Images @ testbed-node-2 2026-04-24 07:40:38.230183 | orchestrator | 2026-04-24 07:40:38.230206 | orchestrator | + echo 2026-04-24 07:40:38.230228 | orchestrator | + echo '## Images @ testbed-node-2' 2026-04-24 07:40:38.230250 | orchestrator | + echo 2026-04-24 07:40:38.230272 | orchestrator | + osism container testbed-node-2 images 2026-04-24 07:40:39.829524 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-24 07:40:39.829622 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 3 weeks ago 288MB 2026-04-24 07:40:39.829637 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 3 weeks ago 1.54GB 2026-04-24 07:40:39.829649 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 3 weeks ago 1.57GB 2026-04-24 07:40:39.829660 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 3 weeks ago 590MB 2026-04-24 07:40:39.829671 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 3 weeks ago 277MB 2026-04-24 07:40:39.829682 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 3 weeks ago 1.04GB 2026-04-24 07:40:39.829692 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 3 weeks ago 427MB 2026-04-24 07:40:39.829703 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 3 weeks ago 350MB 2026-04-24 07:40:39.829714 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 3 weeks ago 683MB 2026-04-24 07:40:39.829724 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 3 weeks ago 277MB 2026-04-24 07:40:39.829823 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 3 weeks ago 285MB 2026-04-24 07:40:39.829835 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 3 weeks ago 293MB 2026-04-24 07:40:39.829845 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 3 weeks ago 293MB 2026-04-24 07:40:39.829856 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 3 weeks ago 284MB 2026-04-24 07:40:39.829867 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 3 weeks ago 284MB 2026-04-24 07:40:39.829894 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 3 weeks ago 1.2GB 2026-04-24 07:40:39.829906 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 3 weeks ago 463MB 2026-04-24 07:40:39.829929 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 3 weeks ago 309MB 2026-04-24 07:40:39.829939 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 3 weeks ago 368MB 2026-04-24 07:40:39.829950 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 3 weeks ago 303MB 2026-04-24 07:40:39.829987 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 3 weeks ago 312MB 2026-04-24 07:40:39.830000 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 3 weeks ago 317MB 2026-04-24 07:40:39.830012 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 3 weeks ago 301MB 2026-04-24 07:40:39.830247 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 3 weeks ago 301MB 2026-04-24 07:40:39.830263 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 3 weeks ago 301MB 2026-04-24 07:40:39.830275 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 3 weeks ago 301MB 2026-04-24 07:40:39.830287 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 3 weeks ago 1.09GB 2026-04-24 07:40:39.830301 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 3 weeks ago 1.06GB 2026-04-24 07:40:39.830313 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 3 weeks ago 1.05GB 2026-04-24 07:40:39.830361 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 3 weeks ago 997MB 2026-04-24 07:40:39.830375 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 3 weeks ago 996MB 2026-04-24 07:40:39.830387 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 3 weeks ago 1.07GB 2026-04-24 07:40:39.830399 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 3 weeks ago 1.07GB 2026-04-24 07:40:39.830412 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 3 weeks ago 1.05GB 2026-04-24 07:40:39.830425 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 3 weeks ago 1.05GB 2026-04-24 07:40:39.830437 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 3 weeks ago 1.05GB 2026-04-24 07:40:39.830447 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 3 weeks ago 996MB 2026-04-24 07:40:39.830458 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 3 weeks ago 995MB 2026-04-24 07:40:39.830487 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 3 weeks ago 995MB 2026-04-24 07:40:39.830509 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 3 weeks ago 995MB 2026-04-24 07:40:39.830520 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 3 weeks ago 994MB 2026-04-24 07:40:39.830531 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 3 weeks ago 1.12GB 2026-04-24 07:40:39.830542 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 3 weeks ago 1.79GB 2026-04-24 07:40:39.830553 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 3 weeks ago 1.43GB 2026-04-24 07:40:39.830564 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 3 weeks ago 1.43GB 2026-04-24 07:40:39.830588 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 3 weeks ago 1.44GB 2026-04-24 07:40:39.830599 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 3 weeks ago 1.24GB 2026-04-24 07:40:39.830610 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 3 weeks ago 1.07GB 2026-04-24 07:40:39.830621 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 3 weeks ago 1.02GB 2026-04-24 07:40:39.830632 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 3 weeks ago 1GB 2026-04-24 07:40:39.830643 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 3 weeks ago 1GB 2026-04-24 07:40:39.830654 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 3 weeks ago 1GB 2026-04-24 07:40:39.830670 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 3 weeks ago 1.27GB 2026-04-24 07:40:39.830681 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 3 weeks ago 1.15GB 2026-04-24 07:40:39.830692 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 3 weeks ago 1.01GB 2026-04-24 07:40:39.830702 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 3 weeks ago 1GB 2026-04-24 07:40:39.830713 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 3 weeks ago 1GB 2026-04-24 07:40:39.830724 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 3 weeks ago 1.01GB 2026-04-24 07:40:39.830735 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 3 weeks ago 1GB 2026-04-24 07:40:39.830746 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 3 weeks ago 1GB 2026-04-24 07:40:39.830765 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 3 weeks ago 1.23GB 2026-04-24 07:40:39.830776 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 3 weeks ago 1.39GB 2026-04-24 07:40:39.830787 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 3 weeks ago 1.23GB 2026-04-24 07:40:39.830798 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 3 weeks ago 1.23GB 2026-04-24 07:40:39.830808 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 3 weeks ago 1.07GB 2026-04-24 07:40:39.830819 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 3 weeks ago 1.07GB 2026-04-24 07:40:39.830830 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 3 weeks ago 1.07GB 2026-04-24 07:40:39.830841 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 3 weeks ago 1.24GB 2026-04-24 07:40:39.830852 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 3 weeks ago 301MB 2026-04-24 07:40:39.830863 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-24 07:40:39.830880 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-24 07:40:39.830891 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-24 07:40:39.830902 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-24 07:40:39.830913 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-24 07:40:39.830924 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-24 07:40:39.830935 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-24 07:40:39.830945 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-24 07:40:39.830956 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-24 07:40:39.830967 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-24 07:40:39.830977 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-24 07:40:39.830988 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-24 07:40:39.830999 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-24 07:40:39.831015 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-24 07:40:39.831053 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-24 07:40:39.831065 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-24 07:40:39.831077 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-24 07:40:39.831087 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-24 07:40:39.831098 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-24 07:40:39.831109 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-24 07:40:39.831120 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-24 07:40:39.831137 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-24 07:40:39.831148 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-24 07:40:39.831159 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-24 07:40:39.831170 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-24 07:40:39.831181 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-24 07:40:39.831202 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-24 07:40:39.831213 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-24 07:40:39.831224 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-24 07:40:39.831235 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-24 07:40:39.831245 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-24 07:40:39.831257 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-24 07:40:39.831267 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-24 07:40:39.831278 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-24 07:40:39.831289 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-24 07:40:39.831300 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-24 07:40:39.831311 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-24 07:40:39.831322 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-24 07:40:39.831333 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-24 07:40:39.831344 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-24 07:40:39.831355 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-24 07:40:39.831366 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-24 07:40:39.831377 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-24 07:40:39.831388 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-24 07:40:39.831399 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-24 07:40:39.831410 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-24 07:40:39.831421 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-24 07:40:39.831432 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-24 07:40:39.831443 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-24 07:40:39.831454 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-24 07:40:39.831465 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-24 07:40:39.831488 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-24 07:40:39.831499 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-24 07:40:39.831510 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-24 07:40:39.831521 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-24 07:40:39.831532 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-24 07:40:39.831543 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-24 07:40:39.831554 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-24 07:40:39.831565 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-24 07:40:39.831576 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-24 07:40:39.831587 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-24 07:40:39.831598 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-24 07:40:39.831609 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-24 07:40:39.831620 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-24 07:40:39.831631 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-24 07:40:39.831641 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-24 07:40:39.831652 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-24 07:40:39.831663 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-24 07:40:39.831710 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-24 07:40:39.994221 | orchestrator | + sh -c /opt/configuration/scripts/check-services.sh 2026-04-24 07:40:40.002852 | orchestrator | + set -e 2026-04-24 07:40:40.003656 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 07:40:40.003703 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 07:40:40.003724 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 07:40:40.003743 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 07:40:40.003757 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 07:40:40.003769 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 07:40:40.003781 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 07:40:40.003792 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 07:40:40.003805 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 07:40:40.003824 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 07:40:40.003842 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 07:40:40.003861 | orchestrator | ++ export ARA=false 2026-04-24 07:40:40.003879 | orchestrator | ++ ARA=false 2026-04-24 07:40:40.003898 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 07:40:40.003917 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 07:40:40.003936 | orchestrator | ++ export TEMPEST=false 2026-04-24 07:40:40.003954 | orchestrator | ++ TEMPEST=false 2026-04-24 07:40:40.003971 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 07:40:40.003982 | orchestrator | ++ IS_ZUUL=true 2026-04-24 07:40:40.004020 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 07:40:40.004082 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 07:40:40.004094 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 07:40:40.004105 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 07:40:40.004115 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 07:40:40.004126 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 07:40:40.004150 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 07:40:40.004162 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 07:40:40.004173 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 07:40:40.004183 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 07:40:40.004194 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-24 07:40:40.004205 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-24 07:40:40.004216 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-24 07:40:40.004227 | orchestrator | + sh -c /opt/configuration/scripts/check/100-ceph-with-ansible.sh 2026-04-24 07:40:40.013337 | orchestrator | + set -e 2026-04-24 07:40:40.013424 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 07:40:40.013439 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 07:40:40.013450 | orchestrator | ++ INTERACTIVE=false 2026-04-24 07:40:40.013460 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 07:40:40.013470 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 07:40:40.013480 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 07:40:40.014859 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 07:40:40.022758 | orchestrator | 2026-04-24 07:40:40.022820 | orchestrator | # Ceph status 2026-04-24 07:40:40.022833 | orchestrator | 2026-04-24 07:40:40.022845 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-24 07:40:40.022857 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-24 07:40:40.022868 | orchestrator | + echo 2026-04-24 07:40:40.022882 | orchestrator | + echo '# Ceph status' 2026-04-24 07:40:40.022902 | orchestrator | + echo 2026-04-24 07:40:40.022921 | orchestrator | + ceph -s 2026-04-24 07:40:40.750511 | orchestrator | cluster: 2026-04-24 07:40:40.750627 | orchestrator | id: 11111111-1111-1111-1111-111111111111 2026-04-24 07:40:40.750650 | orchestrator | health: HEALTH_OK 2026-04-24 07:40:40.750669 | orchestrator | 2026-04-24 07:40:40.750687 | orchestrator | services: 2026-04-24 07:40:40.750706 | orchestrator | mon: 3 daemons, quorum testbed-node-0,testbed-node-1,testbed-node-2 (age 2h) 2026-04-24 07:40:40.750739 | orchestrator | mgr: testbed-node-0(active, since 2h), standbys: testbed-node-1, testbed-node-2 2026-04-24 07:40:40.750758 | orchestrator | mds: 1/1 daemons up, 2 standby 2026-04-24 07:40:40.750775 | orchestrator | osd: 6 osds: 6 up (since 110m), 6 in (since 4h) 2026-04-24 07:40:40.750792 | orchestrator | rgw: 3 daemons active (3 hosts, 1 zones) 2026-04-24 07:40:40.750809 | orchestrator | 2026-04-24 07:40:40.750826 | orchestrator | data: 2026-04-24 07:40:40.750843 | orchestrator | volumes: 1/1 healthy 2026-04-24 07:40:40.750861 | orchestrator | pools: 14 pools, 401 pgs 2026-04-24 07:40:40.750879 | orchestrator | objects: 821 objects, 2.8 GiB 2026-04-24 07:40:40.750897 | orchestrator | usage: 7.9 GiB used, 112 GiB / 120 GiB avail 2026-04-24 07:40:40.750914 | orchestrator | pgs: 401 active+clean 2026-04-24 07:40:40.750933 | orchestrator | 2026-04-24 07:40:40.750952 | orchestrator | io: 2026-04-24 07:40:40.750970 | orchestrator | client: 1022 B/s rd, 0 op/s rd, 0 op/s wr 2026-04-24 07:40:40.750987 | orchestrator | 2026-04-24 07:40:40.797926 | orchestrator | 2026-04-24 07:40:40.798000 | orchestrator | # Ceph versions 2026-04-24 07:40:40.798006 | orchestrator | 2026-04-24 07:40:40.798054 | orchestrator | + echo 2026-04-24 07:40:40.798062 | orchestrator | + echo '# Ceph versions' 2026-04-24 07:40:40.798067 | orchestrator | + echo 2026-04-24 07:40:40.798072 | orchestrator | + ceph versions 2026-04-24 07:40:41.418568 | orchestrator | { 2026-04-24 07:40:41.418698 | orchestrator | "mon": { 2026-04-24 07:40:41.418728 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-24 07:40:41.418748 | orchestrator | }, 2026-04-24 07:40:41.418767 | orchestrator | "mgr": { 2026-04-24 07:40:41.418779 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-24 07:40:41.418790 | orchestrator | }, 2026-04-24 07:40:41.418801 | orchestrator | "osd": { 2026-04-24 07:40:41.418812 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 6 2026-04-24 07:40:41.418823 | orchestrator | }, 2026-04-24 07:40:41.418833 | orchestrator | "mds": { 2026-04-24 07:40:41.418844 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-24 07:40:41.418880 | orchestrator | }, 2026-04-24 07:40:41.418892 | orchestrator | "rgw": { 2026-04-24 07:40:41.418902 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-24 07:40:41.418913 | orchestrator | }, 2026-04-24 07:40:41.418924 | orchestrator | "overall": { 2026-04-24 07:40:41.418935 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 18 2026-04-24 07:40:41.418946 | orchestrator | } 2026-04-24 07:40:41.418956 | orchestrator | } 2026-04-24 07:40:41.476893 | orchestrator | 2026-04-24 07:40:41.476995 | orchestrator | # Ceph OSD tree 2026-04-24 07:40:41.477014 | orchestrator | 2026-04-24 07:40:41.477088 | orchestrator | + echo 2026-04-24 07:40:41.477103 | orchestrator | + echo '# Ceph OSD tree' 2026-04-24 07:40:41.477116 | orchestrator | + echo 2026-04-24 07:40:41.477130 | orchestrator | + ceph osd df tree 2026-04-24 07:40:41.991519 | orchestrator | ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME 2026-04-24 07:40:41.991619 | orchestrator | -1 0.11691 - 120 GiB 7.9 GiB 7.6 GiB 46 KiB 305 MiB 112 GiB 6.61 1.00 - root default 2026-04-24 07:40:41.991635 | orchestrator | -5 0.03897 - 40 GiB 2.6 GiB 2.5 GiB 15 KiB 96 MiB 37 GiB 6.60 1.00 - host testbed-node-3 2026-04-24 07:40:41.991646 | orchestrator | 0 hdd 0.01949 1.00000 20 GiB 1.3 GiB 1.3 GiB 7 KiB 46 MiB 19 GiB 6.54 0.99 190 up osd.0 2026-04-24 07:40:41.991657 | orchestrator | 4 hdd 0.01949 1.00000 20 GiB 1.3 GiB 1.3 GiB 8 KiB 50 MiB 19 GiB 6.66 1.01 202 up osd.4 2026-04-24 07:40:41.991668 | orchestrator | -3 0.03897 - 40 GiB 2.7 GiB 2.5 GiB 16 KiB 113 MiB 37 GiB 6.64 1.00 - host testbed-node-4 2026-04-24 07:40:41.991679 | orchestrator | 2 hdd 0.01949 1.00000 20 GiB 1.2 GiB 1.1 GiB 9 KiB 54 MiB 19 GiB 5.80 0.88 196 up osd.2 2026-04-24 07:40:41.991690 | orchestrator | 3 hdd 0.01949 1.00000 20 GiB 1.5 GiB 1.4 GiB 7 KiB 58 MiB 18 GiB 7.48 1.13 194 up osd.3 2026-04-24 07:40:41.991701 | orchestrator | -7 0.03897 - 40 GiB 2.6 GiB 2.5 GiB 15 KiB 96 MiB 37 GiB 6.60 1.00 - host testbed-node-5 2026-04-24 07:40:41.991712 | orchestrator | 1 hdd 0.01949 1.00000 20 GiB 1.6 GiB 1.6 GiB 9 KiB 50 MiB 18 GiB 8.00 1.21 197 up osd.1 2026-04-24 07:40:41.991722 | orchestrator | 5 hdd 0.01949 1.00000 20 GiB 1.0 GiB 1017 MiB 6 KiB 46 MiB 19 GiB 5.19 0.79 191 up osd.5 2026-04-24 07:40:41.991733 | orchestrator | TOTAL 120 GiB 7.9 GiB 7.6 GiB 48 KiB 305 MiB 112 GiB 6.61 2026-04-24 07:40:41.991744 | orchestrator | MIN/MAX VAR: 0.79/1.21 STDDEV: 0.95 2026-04-24 07:40:42.038272 | orchestrator | 2026-04-24 07:40:42.038361 | orchestrator | # Ceph monitor status 2026-04-24 07:40:42.038375 | orchestrator | 2026-04-24 07:40:42.038386 | orchestrator | + echo 2026-04-24 07:40:42.038398 | orchestrator | + echo '# Ceph monitor status' 2026-04-24 07:40:42.038409 | orchestrator | + echo 2026-04-24 07:40:42.038420 | orchestrator | + ceph mon stat 2026-04-24 07:40:42.615994 | orchestrator | e1: 3 mons at {testbed-node-0=[v2:192.168.16.10:3300/0,v1:192.168.16.10:6789/0],testbed-node-1=[v2:192.168.16.11:3300/0,v1:192.168.16.11:6789/0],testbed-node-2=[v2:192.168.16.12:3300/0,v1:192.168.16.12:6789/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 42, leader 0 testbed-node-0, quorum 0,1,2 testbed-node-0,testbed-node-1,testbed-node-2 2026-04-24 07:40:42.660604 | orchestrator | 2026-04-24 07:40:42.660679 | orchestrator | # Ceph quorum status 2026-04-24 07:40:42.660688 | orchestrator | 2026-04-24 07:40:42.660694 | orchestrator | + echo 2026-04-24 07:40:42.660701 | orchestrator | + echo '# Ceph quorum status' 2026-04-24 07:40:42.660707 | orchestrator | + echo 2026-04-24 07:40:42.661401 | orchestrator | + ceph quorum_status 2026-04-24 07:40:42.661423 | orchestrator | + jq 2026-04-24 07:40:43.292443 | orchestrator | { 2026-04-24 07:40:43.292796 | orchestrator | "election_epoch": 42, 2026-04-24 07:40:43.292828 | orchestrator | "quorum": [ 2026-04-24 07:40:43.292850 | orchestrator | 0, 2026-04-24 07:40:43.292869 | orchestrator | 1, 2026-04-24 07:40:43.292889 | orchestrator | 2 2026-04-24 07:40:43.292910 | orchestrator | ], 2026-04-24 07:40:43.292930 | orchestrator | "quorum_names": [ 2026-04-24 07:40:43.292995 | orchestrator | "testbed-node-0", 2026-04-24 07:40:43.293015 | orchestrator | "testbed-node-1", 2026-04-24 07:40:43.293095 | orchestrator | "testbed-node-2" 2026-04-24 07:40:43.293106 | orchestrator | ], 2026-04-24 07:40:43.293118 | orchestrator | "quorum_leader_name": "testbed-node-0", 2026-04-24 07:40:43.293130 | orchestrator | "quorum_age": 8404, 2026-04-24 07:40:43.293140 | orchestrator | "features": { 2026-04-24 07:40:43.293152 | orchestrator | "quorum_con": "4540138322906710015", 2026-04-24 07:40:43.293162 | orchestrator | "quorum_mon": [ 2026-04-24 07:40:43.293173 | orchestrator | "kraken", 2026-04-24 07:40:43.293183 | orchestrator | "luminous", 2026-04-24 07:40:43.293194 | orchestrator | "mimic", 2026-04-24 07:40:43.293205 | orchestrator | "osdmap-prune", 2026-04-24 07:40:43.293216 | orchestrator | "nautilus", 2026-04-24 07:40:43.293226 | orchestrator | "octopus", 2026-04-24 07:40:43.293237 | orchestrator | "pacific", 2026-04-24 07:40:43.293247 | orchestrator | "elector-pinging", 2026-04-24 07:40:43.293258 | orchestrator | "quincy", 2026-04-24 07:40:43.293268 | orchestrator | "reef" 2026-04-24 07:40:43.293279 | orchestrator | ] 2026-04-24 07:40:43.293290 | orchestrator | }, 2026-04-24 07:40:43.293301 | orchestrator | "monmap": { 2026-04-24 07:40:43.293313 | orchestrator | "epoch": 1, 2026-04-24 07:40:43.293325 | orchestrator | "fsid": "11111111-1111-1111-1111-111111111111", 2026-04-24 07:40:43.293338 | orchestrator | "modified": "2026-04-24T02:58:52.898625Z", 2026-04-24 07:40:43.293351 | orchestrator | "created": "2026-04-24T02:58:52.898625Z", 2026-04-24 07:40:43.293363 | orchestrator | "min_mon_release": 18, 2026-04-24 07:40:43.293375 | orchestrator | "min_mon_release_name": "reef", 2026-04-24 07:40:43.293387 | orchestrator | "election_strategy": 1, 2026-04-24 07:40:43.293399 | orchestrator | "disallowed_leaders: ": "", 2026-04-24 07:40:43.293411 | orchestrator | "stretch_mode": false, 2026-04-24 07:40:43.293423 | orchestrator | "tiebreaker_mon": "", 2026-04-24 07:40:43.293435 | orchestrator | "removed_ranks: ": "", 2026-04-24 07:40:43.293447 | orchestrator | "features": { 2026-04-24 07:40:43.293459 | orchestrator | "persistent": [ 2026-04-24 07:40:43.293471 | orchestrator | "kraken", 2026-04-24 07:40:43.293482 | orchestrator | "luminous", 2026-04-24 07:40:43.293494 | orchestrator | "mimic", 2026-04-24 07:40:43.293506 | orchestrator | "osdmap-prune", 2026-04-24 07:40:43.293518 | orchestrator | "nautilus", 2026-04-24 07:40:43.293531 | orchestrator | "octopus", 2026-04-24 07:40:43.293543 | orchestrator | "pacific", 2026-04-24 07:40:43.293555 | orchestrator | "elector-pinging", 2026-04-24 07:40:43.293567 | orchestrator | "quincy", 2026-04-24 07:40:43.293580 | orchestrator | "reef" 2026-04-24 07:40:43.293591 | orchestrator | ], 2026-04-24 07:40:43.293601 | orchestrator | "optional": [] 2026-04-24 07:40:43.293612 | orchestrator | }, 2026-04-24 07:40:43.293623 | orchestrator | "mons": [ 2026-04-24 07:40:43.293633 | orchestrator | { 2026-04-24 07:40:43.293644 | orchestrator | "rank": 0, 2026-04-24 07:40:43.293655 | orchestrator | "name": "testbed-node-0", 2026-04-24 07:40:43.293665 | orchestrator | "public_addrs": { 2026-04-24 07:40:43.293675 | orchestrator | "addrvec": [ 2026-04-24 07:40:43.293686 | orchestrator | { 2026-04-24 07:40:43.293696 | orchestrator | "type": "v2", 2026-04-24 07:40:43.293707 | orchestrator | "addr": "192.168.16.10:3300", 2026-04-24 07:40:43.293717 | orchestrator | "nonce": 0 2026-04-24 07:40:43.293728 | orchestrator | }, 2026-04-24 07:40:43.293738 | orchestrator | { 2026-04-24 07:40:43.293749 | orchestrator | "type": "v1", 2026-04-24 07:40:43.293759 | orchestrator | "addr": "192.168.16.10:6789", 2026-04-24 07:40:43.293770 | orchestrator | "nonce": 0 2026-04-24 07:40:43.293780 | orchestrator | } 2026-04-24 07:40:43.293791 | orchestrator | ] 2026-04-24 07:40:43.293802 | orchestrator | }, 2026-04-24 07:40:43.293812 | orchestrator | "addr": "192.168.16.10:6789/0", 2026-04-24 07:40:43.293823 | orchestrator | "public_addr": "192.168.16.10:6789/0", 2026-04-24 07:40:43.293833 | orchestrator | "priority": 0, 2026-04-24 07:40:43.293844 | orchestrator | "weight": 0, 2026-04-24 07:40:43.293855 | orchestrator | "crush_location": "{}" 2026-04-24 07:40:43.293865 | orchestrator | }, 2026-04-24 07:40:43.293876 | orchestrator | { 2026-04-24 07:40:43.293886 | orchestrator | "rank": 1, 2026-04-24 07:40:43.293897 | orchestrator | "name": "testbed-node-1", 2026-04-24 07:40:43.293908 | orchestrator | "public_addrs": { 2026-04-24 07:40:43.293918 | orchestrator | "addrvec": [ 2026-04-24 07:40:43.293929 | orchestrator | { 2026-04-24 07:40:43.293939 | orchestrator | "type": "v2", 2026-04-24 07:40:43.293950 | orchestrator | "addr": "192.168.16.11:3300", 2026-04-24 07:40:43.293974 | orchestrator | "nonce": 0 2026-04-24 07:40:43.293985 | orchestrator | }, 2026-04-24 07:40:43.293996 | orchestrator | { 2026-04-24 07:40:43.294007 | orchestrator | "type": "v1", 2026-04-24 07:40:43.294136 | orchestrator | "addr": "192.168.16.11:6789", 2026-04-24 07:40:43.294151 | orchestrator | "nonce": 0 2026-04-24 07:40:43.294162 | orchestrator | } 2026-04-24 07:40:43.294172 | orchestrator | ] 2026-04-24 07:40:43.294183 | orchestrator | }, 2026-04-24 07:40:43.294194 | orchestrator | "addr": "192.168.16.11:6789/0", 2026-04-24 07:40:43.294220 | orchestrator | "public_addr": "192.168.16.11:6789/0", 2026-04-24 07:40:43.294232 | orchestrator | "priority": 0, 2026-04-24 07:40:43.294242 | orchestrator | "weight": 0, 2026-04-24 07:40:43.294267 | orchestrator | "crush_location": "{}" 2026-04-24 07:40:43.294278 | orchestrator | }, 2026-04-24 07:40:43.294288 | orchestrator | { 2026-04-24 07:40:43.294299 | orchestrator | "rank": 2, 2026-04-24 07:40:43.294326 | orchestrator | "name": "testbed-node-2", 2026-04-24 07:40:43.294382 | orchestrator | "public_addrs": { 2026-04-24 07:40:43.294400 | orchestrator | "addrvec": [ 2026-04-24 07:40:43.294419 | orchestrator | { 2026-04-24 07:40:43.294457 | orchestrator | "type": "v2", 2026-04-24 07:40:43.294506 | orchestrator | "addr": "192.168.16.12:3300", 2026-04-24 07:40:43.294519 | orchestrator | "nonce": 0 2026-04-24 07:40:43.294529 | orchestrator | }, 2026-04-24 07:40:43.294540 | orchestrator | { 2026-04-24 07:40:43.294551 | orchestrator | "type": "v1", 2026-04-24 07:40:43.294575 | orchestrator | "addr": "192.168.16.12:6789", 2026-04-24 07:40:43.294586 | orchestrator | "nonce": 0 2026-04-24 07:40:43.294597 | orchestrator | } 2026-04-24 07:40:43.294608 | orchestrator | ] 2026-04-24 07:40:43.294618 | orchestrator | }, 2026-04-24 07:40:43.294629 | orchestrator | "addr": "192.168.16.12:6789/0", 2026-04-24 07:40:43.294639 | orchestrator | "public_addr": "192.168.16.12:6789/0", 2026-04-24 07:40:43.294650 | orchestrator | "priority": 0, 2026-04-24 07:40:43.294661 | orchestrator | "weight": 0, 2026-04-24 07:40:43.294671 | orchestrator | "crush_location": "{}" 2026-04-24 07:40:43.294682 | orchestrator | } 2026-04-24 07:40:43.294693 | orchestrator | ] 2026-04-24 07:40:43.294703 | orchestrator | } 2026-04-24 07:40:43.294714 | orchestrator | } 2026-04-24 07:40:43.294742 | orchestrator | 2026-04-24 07:40:43.294753 | orchestrator | # Ceph free space status 2026-04-24 07:40:43.294778 | orchestrator | 2026-04-24 07:40:43.294789 | orchestrator | + echo 2026-04-24 07:40:43.294813 | orchestrator | + echo '# Ceph free space status' 2026-04-24 07:40:43.294825 | orchestrator | + echo 2026-04-24 07:40:43.294836 | orchestrator | + ceph df 2026-04-24 07:40:43.894383 | orchestrator | --- RAW STORAGE --- 2026-04-24 07:40:43.894501 | orchestrator | CLASS SIZE AVAIL USED RAW USED %RAW USED 2026-04-24 07:40:43.894532 | orchestrator | hdd 120 GiB 112 GiB 7.9 GiB 7.9 GiB 6.61 2026-04-24 07:40:43.894544 | orchestrator | TOTAL 120 GiB 112 GiB 7.9 GiB 7.9 GiB 6.61 2026-04-24 07:40:43.894556 | orchestrator | 2026-04-24 07:40:43.894567 | orchestrator | --- POOLS --- 2026-04-24 07:40:43.894579 | orchestrator | POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL 2026-04-24 07:40:43.894591 | orchestrator | .mgr 1 1 577 KiB 2 1.1 MiB 0 52 GiB 2026-04-24 07:40:43.894602 | orchestrator | cephfs_data 2 32 0 B 0 0 B 0 35 GiB 2026-04-24 07:40:43.894613 | orchestrator | cephfs_metadata 3 16 11 KiB 22 125 KiB 0 35 GiB 2026-04-24 07:40:43.894624 | orchestrator | default.rgw.buckets.data 4 32 0 B 0 0 B 0 35 GiB 2026-04-24 07:40:43.894635 | orchestrator | default.rgw.buckets.index 5 32 0 B 0 0 B 0 35 GiB 2026-04-24 07:40:43.894645 | orchestrator | default.rgw.control 6 32 0 B 8 0 B 0 35 GiB 2026-04-24 07:40:43.894656 | orchestrator | default.rgw.log 7 32 3.6 KiB 209 408 KiB 0 35 GiB 2026-04-24 07:40:43.894666 | orchestrator | default.rgw.meta 8 32 0 B 0 0 B 0 35 GiB 2026-04-24 07:40:43.894689 | orchestrator | .rgw.root 9 32 3.9 KiB 8 64 KiB 0 52 GiB 2026-04-24 07:40:43.894701 | orchestrator | backups 10 32 19 B 2 12 KiB 0 35 GiB 2026-04-24 07:40:43.894711 | orchestrator | volumes 11 32 325 MiB 267 974 MiB 0.90 35 GiB 2026-04-24 07:40:43.894743 | orchestrator | images 12 32 2.2 GiB 299 6.7 GiB 6.00 35 GiB 2026-04-24 07:40:43.894762 | orchestrator | metrics 13 32 19 B 2 12 KiB 0 35 GiB 2026-04-24 07:40:43.894779 | orchestrator | vms 14 32 19 B 2 12 KiB 0 35 GiB 2026-04-24 07:40:43.942538 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-24 07:40:44.015110 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-24 07:40:44.015209 | orchestrator | + osism apply facts 2026-04-24 07:40:45.358714 | orchestrator | 2026-04-24 07:40:45 | INFO  | Prepare task for execution of facts. 2026-04-24 07:40:45.429275 | orchestrator | 2026-04-24 07:40:45 | INFO  | Task 10b30c6e-196e-4fc1-b843-ccac3fd7022c (facts) was prepared for execution. 2026-04-24 07:40:45.429388 | orchestrator | 2026-04-24 07:40:45 | INFO  | It takes a moment until task 10b30c6e-196e-4fc1-b843-ccac3fd7022c (facts) has been started and output is visible here. 2026-04-24 07:41:11.018133 | orchestrator | 2026-04-24 07:41:11.018247 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-24 07:41:11.018263 | orchestrator | 2026-04-24 07:41:11.018275 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-24 07:41:11.018288 | orchestrator | Friday 24 April 2026 07:40:51 +0000 (0:00:02.621) 0:00:02.621 ********** 2026-04-24 07:41:11.018300 | orchestrator | ok: [testbed-manager] 2026-04-24 07:41:11.018312 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:11.018323 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:41:11.018346 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:41:11.018357 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:41:11.018368 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:41:11.018379 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:41:11.018390 | orchestrator | 2026-04-24 07:41:11.018401 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-24 07:41:11.018412 | orchestrator | Friday 24 April 2026 07:40:55 +0000 (0:00:03.441) 0:00:06.063 ********** 2026-04-24 07:41:11.018423 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:41:11.018435 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:11.018445 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:41:11.018456 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:41:11.018467 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:41:11.018478 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:41:11.018489 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:41:11.018500 | orchestrator | 2026-04-24 07:41:11.018511 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-24 07:41:11.018522 | orchestrator | 2026-04-24 07:41:11.018533 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-24 07:41:11.018544 | orchestrator | Friday 24 April 2026 07:40:58 +0000 (0:00:03.199) 0:00:09.262 ********** 2026-04-24 07:41:11.018555 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:41:11.018566 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:41:11.018576 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:11.018587 | orchestrator | ok: [testbed-manager] 2026-04-24 07:41:11.018599 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:41:11.018612 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:41:11.018624 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:41:11.018636 | orchestrator | 2026-04-24 07:41:11.018649 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-24 07:41:11.018662 | orchestrator | 2026-04-24 07:41:11.018675 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-24 07:41:11.018688 | orchestrator | Friday 24 April 2026 07:41:06 +0000 (0:00:08.436) 0:00:17.698 ********** 2026-04-24 07:41:11.018701 | orchestrator | skipping: [testbed-manager] 2026-04-24 07:41:11.018714 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:11.018726 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:41:11.018738 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:41:11.018751 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:41:11.018763 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:41:11.018803 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:41:11.018816 | orchestrator | 2026-04-24 07:41:11.018829 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:41:11.018842 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:11.018856 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:11.018869 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:11.018881 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:11.018894 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:11.018906 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:11.018919 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:11.018931 | orchestrator | 2026-04-24 07:41:11.018944 | orchestrator | 2026-04-24 07:41:11.018956 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:41:11.018967 | orchestrator | Friday 24 April 2026 07:41:10 +0000 (0:00:03.885) 0:00:21.584 ********** 2026-04-24 07:41:11.018978 | orchestrator | =============================================================================== 2026-04-24 07:41:11.018989 | orchestrator | Gathers facts about hosts ----------------------------------------------- 8.44s 2026-04-24 07:41:11.019000 | orchestrator | Gather facts for all hosts ---------------------------------------------- 3.89s 2026-04-24 07:41:11.019010 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 3.44s 2026-04-24 07:41:11.019021 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 3.20s 2026-04-24 07:41:11.214722 | orchestrator | + osism validate ceph-mons 2026-04-24 07:41:44.856726 | orchestrator | 2026-04-24 07:41:44.856810 | orchestrator | PLAY [Ceph validate mons] ****************************************************** 2026-04-24 07:41:44.856818 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 07:41:44.856824 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 07:41:44.856833 | orchestrator | 2026-04-24 07:41:44.856837 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-24 07:41:44.856842 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 07:41:44.856846 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 07:41:44.856854 | orchestrator | Friday 24 April 2026 07:41:27 +0000 (0:00:01.665) 0:00:01.665 ********** 2026-04-24 07:41:44.856858 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:41:44.856862 | orchestrator | 2026-04-24 07:41:44.856866 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-24 07:41:44.856869 | orchestrator | Friday 24 April 2026 07:41:29 +0000 (0:00:01.804) 0:00:03.469 ********** 2026-04-24 07:41:44.856873 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:41:44.856877 | orchestrator | 2026-04-24 07:41:44.856881 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-24 07:41:44.856884 | orchestrator | Friday 24 April 2026 07:41:30 +0000 (0:00:00.760) 0:00:04.230 ********** 2026-04-24 07:41:44.856904 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.856909 | orchestrator | 2026-04-24 07:41:44.856913 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-24 07:41:44.856916 | orchestrator | Friday 24 April 2026 07:41:30 +0000 (0:00:00.148) 0:00:04.379 ********** 2026-04-24 07:41:44.856921 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.856936 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:41:44.856940 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:41:44.856944 | orchestrator | 2026-04-24 07:41:44.856947 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-24 07:41:44.856951 | orchestrator | Friday 24 April 2026 07:41:31 +0000 (0:00:00.600) 0:00:04.979 ********** 2026-04-24 07:41:44.856955 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:41:44.856959 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.856962 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:41:44.856966 | orchestrator | 2026-04-24 07:41:44.856970 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-24 07:41:44.856973 | orchestrator | Friday 24 April 2026 07:41:32 +0000 (0:00:01.600) 0:00:06.580 ********** 2026-04-24 07:41:44.856977 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.856981 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:41:44.856985 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:41:44.856988 | orchestrator | 2026-04-24 07:41:44.856992 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-24 07:41:44.856996 | orchestrator | Friday 24 April 2026 07:41:33 +0000 (0:00:00.314) 0:00:06.894 ********** 2026-04-24 07:41:44.857000 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857003 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:41:44.857007 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:41:44.857011 | orchestrator | 2026-04-24 07:41:44.857014 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 07:41:44.857018 | orchestrator | Friday 24 April 2026 07:41:33 +0000 (0:00:00.327) 0:00:07.222 ********** 2026-04-24 07:41:44.857022 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857026 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:41:44.857029 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:41:44.857033 | orchestrator | 2026-04-24 07:41:44.857037 | orchestrator | TASK [Set test result to failed if ceph-mon is not running] ******************** 2026-04-24 07:41:44.857059 | orchestrator | Friday 24 April 2026 07:41:33 +0000 (0:00:00.491) 0:00:07.714 ********** 2026-04-24 07:41:44.857063 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857067 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:41:44.857071 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:41:44.857075 | orchestrator | 2026-04-24 07:41:44.857079 | orchestrator | TASK [Set test result to passed if ceph-mon is running] ************************ 2026-04-24 07:41:44.857082 | orchestrator | Friday 24 April 2026 07:41:34 +0000 (0:00:00.318) 0:00:08.033 ********** 2026-04-24 07:41:44.857086 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857090 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:41:44.857093 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:41:44.857097 | orchestrator | 2026-04-24 07:41:44.857101 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 07:41:44.857105 | orchestrator | Friday 24 April 2026 07:41:34 +0000 (0:00:00.317) 0:00:08.350 ********** 2026-04-24 07:41:44.857108 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857112 | orchestrator | 2026-04-24 07:41:44.857116 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 07:41:44.857119 | orchestrator | Friday 24 April 2026 07:41:34 +0000 (0:00:00.266) 0:00:08.617 ********** 2026-04-24 07:41:44.857123 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857127 | orchestrator | 2026-04-24 07:41:44.857130 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 07:41:44.857134 | orchestrator | Friday 24 April 2026 07:41:35 +0000 (0:00:00.272) 0:00:08.889 ********** 2026-04-24 07:41:44.857138 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857146 | orchestrator | 2026-04-24 07:41:44.857152 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:41:44.857156 | orchestrator | Friday 24 April 2026 07:41:35 +0000 (0:00:00.285) 0:00:09.175 ********** 2026-04-24 07:41:44.857159 | orchestrator | 2026-04-24 07:41:44.857163 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:41:44.857167 | orchestrator | Friday 24 April 2026 07:41:35 +0000 (0:00:00.073) 0:00:09.249 ********** 2026-04-24 07:41:44.857170 | orchestrator | 2026-04-24 07:41:44.857174 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:41:44.857190 | orchestrator | Friday 24 April 2026 07:41:35 +0000 (0:00:00.272) 0:00:09.522 ********** 2026-04-24 07:41:44.857194 | orchestrator | 2026-04-24 07:41:44.857198 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 07:41:44.857202 | orchestrator | Friday 24 April 2026 07:41:35 +0000 (0:00:00.076) 0:00:09.598 ********** 2026-04-24 07:41:44.857205 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857209 | orchestrator | 2026-04-24 07:41:44.857213 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-24 07:41:44.857217 | orchestrator | Friday 24 April 2026 07:41:36 +0000 (0:00:00.275) 0:00:09.873 ********** 2026-04-24 07:41:44.857220 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857224 | orchestrator | 2026-04-24 07:41:44.857228 | orchestrator | TASK [Prepare quorum test vars] ************************************************ 2026-04-24 07:41:44.857232 | orchestrator | Friday 24 April 2026 07:41:36 +0000 (0:00:00.268) 0:00:10.142 ********** 2026-04-24 07:41:44.857235 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857239 | orchestrator | 2026-04-24 07:41:44.857243 | orchestrator | TASK [Get monmap info from one mon container] ********************************** 2026-04-24 07:41:44.857247 | orchestrator | Friday 24 April 2026 07:41:36 +0000 (0:00:00.134) 0:00:10.276 ********** 2026-04-24 07:41:44.857250 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:41:44.857254 | orchestrator | 2026-04-24 07:41:44.857258 | orchestrator | TASK [Set quorum test data] **************************************************** 2026-04-24 07:41:44.857262 | orchestrator | Friday 24 April 2026 07:41:38 +0000 (0:00:01.666) 0:00:11.942 ********** 2026-04-24 07:41:44.857266 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857269 | orchestrator | 2026-04-24 07:41:44.857273 | orchestrator | TASK [Fail quorum test if not all monitors are in quorum] ********************** 2026-04-24 07:41:44.857277 | orchestrator | Friday 24 April 2026 07:41:38 +0000 (0:00:00.446) 0:00:12.388 ********** 2026-04-24 07:41:44.857281 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857284 | orchestrator | 2026-04-24 07:41:44.857288 | orchestrator | TASK [Pass quorum test if all monitors are in quorum] ************************** 2026-04-24 07:41:44.857292 | orchestrator | Friday 24 April 2026 07:41:38 +0000 (0:00:00.174) 0:00:12.562 ********** 2026-04-24 07:41:44.857297 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857301 | orchestrator | 2026-04-24 07:41:44.857306 | orchestrator | TASK [Set fsid test vars] ****************************************************** 2026-04-24 07:41:44.857310 | orchestrator | Friday 24 April 2026 07:41:39 +0000 (0:00:00.322) 0:00:12.885 ********** 2026-04-24 07:41:44.857315 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857319 | orchestrator | 2026-04-24 07:41:44.857323 | orchestrator | TASK [Fail Cluster FSID test if FSID does not match configuration] ************* 2026-04-24 07:41:44.857327 | orchestrator | Friday 24 April 2026 07:41:39 +0000 (0:00:00.330) 0:00:13.216 ********** 2026-04-24 07:41:44.857331 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857336 | orchestrator | 2026-04-24 07:41:44.857340 | orchestrator | TASK [Pass Cluster FSID test if it matches configuration] ********************** 2026-04-24 07:41:44.857344 | orchestrator | Friday 24 April 2026 07:41:39 +0000 (0:00:00.129) 0:00:13.345 ********** 2026-04-24 07:41:44.857349 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857353 | orchestrator | 2026-04-24 07:41:44.857358 | orchestrator | TASK [Prepare status test vars] ************************************************ 2026-04-24 07:41:44.857362 | orchestrator | Friday 24 April 2026 07:41:39 +0000 (0:00:00.152) 0:00:13.498 ********** 2026-04-24 07:41:44.857370 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857374 | orchestrator | 2026-04-24 07:41:44.857378 | orchestrator | TASK [Gather status data] ****************************************************** 2026-04-24 07:41:44.857383 | orchestrator | Friday 24 April 2026 07:41:39 +0000 (0:00:00.317) 0:00:13.815 ********** 2026-04-24 07:41:44.857387 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:41:44.857391 | orchestrator | 2026-04-24 07:41:44.857396 | orchestrator | TASK [Set health test data] **************************************************** 2026-04-24 07:41:44.857400 | orchestrator | Friday 24 April 2026 07:41:41 +0000 (0:00:01.384) 0:00:15.200 ********** 2026-04-24 07:41:44.857405 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857409 | orchestrator | 2026-04-24 07:41:44.857413 | orchestrator | TASK [Fail cluster-health if health is not acceptable] ************************* 2026-04-24 07:41:44.857418 | orchestrator | Friday 24 April 2026 07:41:41 +0000 (0:00:00.320) 0:00:15.521 ********** 2026-04-24 07:41:44.857422 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857426 | orchestrator | 2026-04-24 07:41:44.857431 | orchestrator | TASK [Pass cluster-health if health is acceptable] ***************************** 2026-04-24 07:41:44.857435 | orchestrator | Friday 24 April 2026 07:41:41 +0000 (0:00:00.144) 0:00:15.666 ********** 2026-04-24 07:41:44.857439 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:41:44.857443 | orchestrator | 2026-04-24 07:41:44.857448 | orchestrator | TASK [Fail cluster-health if health is not acceptable (strict)] **************** 2026-04-24 07:41:44.857452 | orchestrator | Friday 24 April 2026 07:41:41 +0000 (0:00:00.169) 0:00:15.835 ********** 2026-04-24 07:41:44.857456 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857461 | orchestrator | 2026-04-24 07:41:44.857465 | orchestrator | TASK [Pass cluster-health if status is OK (strict)] **************************** 2026-04-24 07:41:44.857469 | orchestrator | Friday 24 April 2026 07:41:42 +0000 (0:00:00.166) 0:00:16.002 ********** 2026-04-24 07:41:44.857473 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857478 | orchestrator | 2026-04-24 07:41:44.857482 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-24 07:41:44.857486 | orchestrator | Friday 24 April 2026 07:41:42 +0000 (0:00:00.137) 0:00:16.139 ********** 2026-04-24 07:41:44.857491 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:41:44.857495 | orchestrator | 2026-04-24 07:41:44.857502 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-24 07:41:44.857506 | orchestrator | Friday 24 April 2026 07:41:42 +0000 (0:00:00.273) 0:00:16.413 ********** 2026-04-24 07:41:44.857511 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:41:44.857515 | orchestrator | 2026-04-24 07:41:44.857521 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 07:41:44.857527 | orchestrator | Friday 24 April 2026 07:41:42 +0000 (0:00:00.315) 0:00:16.728 ********** 2026-04-24 07:41:44.857534 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:41:44.857544 | orchestrator | 2026-04-24 07:41:44.857554 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 07:41:49.275131 | orchestrator | Friday 24 April 2026 07:41:44 +0000 (0:00:01.972) 0:00:18.701 ********** 2026-04-24 07:41:49.275229 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:41:49.275242 | orchestrator | 2026-04-24 07:41:49.275254 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 07:41:49.275266 | orchestrator | Friday 24 April 2026 07:41:45 +0000 (0:00:00.506) 0:00:19.207 ********** 2026-04-24 07:41:49.275278 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:41:49.275290 | orchestrator | 2026-04-24 07:41:49.275301 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:41:49.275312 | orchestrator | Friday 24 April 2026 07:41:46 +0000 (0:00:00.707) 0:00:19.915 ********** 2026-04-24 07:41:49.275323 | orchestrator | 2026-04-24 07:41:49.275335 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:41:49.275346 | orchestrator | Friday 24 April 2026 07:41:46 +0000 (0:00:00.072) 0:00:19.988 ********** 2026-04-24 07:41:49.275380 | orchestrator | 2026-04-24 07:41:49.275391 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:41:49.275401 | orchestrator | Friday 24 April 2026 07:41:46 +0000 (0:00:00.076) 0:00:20.064 ********** 2026-04-24 07:41:49.275412 | orchestrator | 2026-04-24 07:41:49.275422 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-24 07:41:49.275433 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 07:41:49.275444 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 07:41:49.275465 | orchestrator | Friday 24 April 2026 07:41:46 +0000 (0:00:00.075) 0:00:20.140 ********** 2026-04-24 07:41:49.275476 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:41:49.275487 | orchestrator | 2026-04-24 07:41:49.275497 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 07:41:49.275507 | orchestrator | Friday 24 April 2026 07:41:47 +0000 (0:00:01.413) 0:00:21.554 ********** 2026-04-24 07:41:49.275518 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-24 07:41:49.275529 | orchestrator |  "msg": [ 2026-04-24 07:41:49.275540 | orchestrator |  "Validator run completed.", 2026-04-24 07:41:49.275549 | orchestrator |  "You can find the report file here:", 2026-04-24 07:41:49.275558 | orchestrator |  "/opt/reports/validator/ceph-mons-validator-2026-04-24T07:41:28+00:00-report.json", 2026-04-24 07:41:49.275568 | orchestrator |  "on the following host:", 2026-04-24 07:41:49.275577 | orchestrator |  "testbed-manager" 2026-04-24 07:41:49.275586 | orchestrator |  ] 2026-04-24 07:41:49.275594 | orchestrator | } 2026-04-24 07:41:49.275604 | orchestrator | 2026-04-24 07:41:49.275612 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:41:49.275623 | orchestrator | testbed-node-0 : ok=24  changed=4  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026-04-24 07:41:49.275633 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:49.275643 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:41:49.275651 | orchestrator | 2026-04-24 07:41:49.275661 | orchestrator | 2026-04-24 07:41:49.275670 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:41:49.275679 | orchestrator | Friday 24 April 2026 07:41:48 +0000 (0:00:01.151) 0:00:22.705 ********** 2026-04-24 07:41:49.275688 | orchestrator | =============================================================================== 2026-04-24 07:41:49.275697 | orchestrator | Aggregate test results step one ----------------------------------------- 1.97s 2026-04-24 07:41:49.275706 | orchestrator | Get timestamp for report file ------------------------------------------- 1.80s 2026-04-24 07:41:49.275715 | orchestrator | Get monmap info from one mon container ---------------------------------- 1.67s 2026-04-24 07:41:49.275724 | orchestrator | Get container info ------------------------------------------------------ 1.60s 2026-04-24 07:41:49.275733 | orchestrator | Write report file ------------------------------------------------------- 1.41s 2026-04-24 07:41:49.275741 | orchestrator | Gather status data ------------------------------------------------------ 1.39s 2026-04-24 07:41:49.275750 | orchestrator | Print report file information ------------------------------------------- 1.15s 2026-04-24 07:41:49.275759 | orchestrator | Create report output directory ------------------------------------------ 0.76s 2026-04-24 07:41:49.275768 | orchestrator | Aggregate test results step three --------------------------------------- 0.71s 2026-04-24 07:41:49.275778 | orchestrator | Prepare test data for container existance test -------------------------- 0.60s 2026-04-24 07:41:49.275793 | orchestrator | Aggregate test results step two ----------------------------------------- 0.51s 2026-04-24 07:41:49.275817 | orchestrator | Prepare test data ------------------------------------------------------- 0.49s 2026-04-24 07:41:49.275826 | orchestrator | Set quorum test data ---------------------------------------------------- 0.45s 2026-04-24 07:41:49.275835 | orchestrator | Flush handlers ---------------------------------------------------------- 0.42s 2026-04-24 07:41:49.275844 | orchestrator | Set fsid test vars ------------------------------------------------------ 0.33s 2026-04-24 07:41:49.275853 | orchestrator | Set test result to passed if container is existing ---------------------- 0.33s 2026-04-24 07:41:49.275861 | orchestrator | Pass quorum test if all monitors are in quorum -------------------------- 0.32s 2026-04-24 07:41:49.275887 | orchestrator | Set health test data ---------------------------------------------------- 0.32s 2026-04-24 07:41:49.275898 | orchestrator | Set test result to failed if ceph-mon is not running -------------------- 0.32s 2026-04-24 07:41:49.275907 | orchestrator | Set test result to passed if ceph-mon is running ------------------------ 0.32s 2026-04-24 07:41:49.517006 | orchestrator | + osism validate ceph-mgrs 2026-04-24 07:42:22.250389 | orchestrator | 2026-04-24 07:42:22.250506 | orchestrator | PLAY [Ceph validate mgrs] ****************************************************** 2026-04-24 07:42:22.250524 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-24 07:42:22.250537 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-24 07:42:22.250560 | orchestrator | 2026-04-24 07:42:22.250571 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-24 07:42:22.250582 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-24 07:42:22.250593 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-24 07:42:22.250615 | orchestrator | Friday 24 April 2026 07:42:06 +0000 (0:00:01.596) 0:00:01.596 ********** 2026-04-24 07:42:22.250626 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:22.250637 | orchestrator | 2026-04-24 07:42:22.250649 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-24 07:42:22.250660 | orchestrator | Friday 24 April 2026 07:42:07 +0000 (0:00:01.758) 0:00:03.355 ********** 2026-04-24 07:42:22.250671 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:22.250682 | orchestrator | 2026-04-24 07:42:22.250692 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-24 07:42:22.250703 | orchestrator | Friday 24 April 2026 07:42:08 +0000 (0:00:00.745) 0:00:04.100 ********** 2026-04-24 07:42:22.250714 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.250726 | orchestrator | 2026-04-24 07:42:22.250737 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-24 07:42:22.250748 | orchestrator | Friday 24 April 2026 07:42:08 +0000 (0:00:00.132) 0:00:04.233 ********** 2026-04-24 07:42:22.250759 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.250770 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:42:22.250780 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:42:22.250791 | orchestrator | 2026-04-24 07:42:22.250802 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-24 07:42:22.250813 | orchestrator | Friday 24 April 2026 07:42:09 +0000 (0:00:00.641) 0:00:04.875 ********** 2026-04-24 07:42:22.250824 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:42:22.250835 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:42:22.250864 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.250875 | orchestrator | 2026-04-24 07:42:22.250897 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-24 07:42:22.250908 | orchestrator | Friday 24 April 2026 07:42:10 +0000 (0:00:01.602) 0:00:06.477 ********** 2026-04-24 07:42:22.250919 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.250965 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:42:22.250985 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:42:22.251004 | orchestrator | 2026-04-24 07:42:22.251022 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-24 07:42:22.251041 | orchestrator | Friday 24 April 2026 07:42:11 +0000 (0:00:00.305) 0:00:06.782 ********** 2026-04-24 07:42:22.251087 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.251107 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:42:22.251124 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:42:22.251142 | orchestrator | 2026-04-24 07:42:22.251163 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 07:42:22.251184 | orchestrator | Friday 24 April 2026 07:42:11 +0000 (0:00:00.334) 0:00:07.117 ********** 2026-04-24 07:42:22.251219 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.251240 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:42:22.251258 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:42:22.251276 | orchestrator | 2026-04-24 07:42:22.251296 | orchestrator | TASK [Set test result to failed if ceph-mgr is not running] ******************** 2026-04-24 07:42:22.251314 | orchestrator | Friday 24 April 2026 07:42:11 +0000 (0:00:00.328) 0:00:07.446 ********** 2026-04-24 07:42:22.251332 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.251344 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:42:22.251355 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:42:22.251365 | orchestrator | 2026-04-24 07:42:22.251376 | orchestrator | TASK [Set test result to passed if ceph-mgr is running] ************************ 2026-04-24 07:42:22.251387 | orchestrator | Friday 24 April 2026 07:42:12 +0000 (0:00:00.496) 0:00:07.943 ********** 2026-04-24 07:42:22.251398 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.251409 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:42:22.251419 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:42:22.251430 | orchestrator | 2026-04-24 07:42:22.251440 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 07:42:22.251451 | orchestrator | Friday 24 April 2026 07:42:12 +0000 (0:00:00.309) 0:00:08.252 ********** 2026-04-24 07:42:22.251462 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.251472 | orchestrator | 2026-04-24 07:42:22.251483 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 07:42:22.251494 | orchestrator | Friday 24 April 2026 07:42:13 +0000 (0:00:00.318) 0:00:08.571 ********** 2026-04-24 07:42:22.251505 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.251515 | orchestrator | 2026-04-24 07:42:22.251526 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 07:42:22.251537 | orchestrator | Friday 24 April 2026 07:42:13 +0000 (0:00:00.263) 0:00:08.835 ********** 2026-04-24 07:42:22.251548 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.251559 | orchestrator | 2026-04-24 07:42:22.251570 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:42:22.251580 | orchestrator | Friday 24 April 2026 07:42:13 +0000 (0:00:00.268) 0:00:09.103 ********** 2026-04-24 07:42:22.251591 | orchestrator | 2026-04-24 07:42:22.251601 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:42:22.251612 | orchestrator | Friday 24 April 2026 07:42:13 +0000 (0:00:00.074) 0:00:09.178 ********** 2026-04-24 07:42:22.251623 | orchestrator | 2026-04-24 07:42:22.251633 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:42:22.251663 | orchestrator | Friday 24 April 2026 07:42:13 +0000 (0:00:00.077) 0:00:09.255 ********** 2026-04-24 07:42:22.251675 | orchestrator | 2026-04-24 07:42:22.251686 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 07:42:22.251696 | orchestrator | Friday 24 April 2026 07:42:13 +0000 (0:00:00.236) 0:00:09.491 ********** 2026-04-24 07:42:22.251707 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.251718 | orchestrator | 2026-04-24 07:42:22.251729 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-24 07:42:22.251739 | orchestrator | Friday 24 April 2026 07:42:14 +0000 (0:00:00.299) 0:00:09.791 ********** 2026-04-24 07:42:22.251762 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.251773 | orchestrator | 2026-04-24 07:42:22.251783 | orchestrator | TASK [Define mgr module test vars] ********************************************* 2026-04-24 07:42:22.251794 | orchestrator | Friday 24 April 2026 07:42:14 +0000 (0:00:00.287) 0:00:10.078 ********** 2026-04-24 07:42:22.251805 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.251816 | orchestrator | 2026-04-24 07:42:22.251826 | orchestrator | TASK [Gather list of mgr modules] ********************************************** 2026-04-24 07:42:22.251837 | orchestrator | Friday 24 April 2026 07:42:14 +0000 (0:00:00.140) 0:00:10.219 ********** 2026-04-24 07:42:22.251848 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:42:22.251859 | orchestrator | 2026-04-24 07:42:22.251870 | orchestrator | TASK [Parse mgr module list from json] ***************************************** 2026-04-24 07:42:22.251881 | orchestrator | Friday 24 April 2026 07:42:16 +0000 (0:00:01.963) 0:00:12.182 ********** 2026-04-24 07:42:22.251891 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.251902 | orchestrator | 2026-04-24 07:42:22.251913 | orchestrator | TASK [Extract list of enabled mgr modules] ************************************* 2026-04-24 07:42:22.251923 | orchestrator | Friday 24 April 2026 07:42:16 +0000 (0:00:00.276) 0:00:12.458 ********** 2026-04-24 07:42:22.251934 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.251945 | orchestrator | 2026-04-24 07:42:22.251955 | orchestrator | TASK [Fail test if mgr modules are disabled that should be enabled] ************ 2026-04-24 07:42:22.251966 | orchestrator | Friday 24 April 2026 07:42:17 +0000 (0:00:00.342) 0:00:12.801 ********** 2026-04-24 07:42:22.251977 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.251988 | orchestrator | 2026-04-24 07:42:22.252016 | orchestrator | TASK [Pass test if required mgr modules are enabled] *************************** 2026-04-24 07:42:22.252028 | orchestrator | Friday 24 April 2026 07:42:17 +0000 (0:00:00.166) 0:00:12.967 ********** 2026-04-24 07:42:22.252038 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:42:22.252068 | orchestrator | 2026-04-24 07:42:22.252080 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-24 07:42:22.252091 | orchestrator | Friday 24 April 2026 07:42:17 +0000 (0:00:00.160) 0:00:13.129 ********** 2026-04-24 07:42:22.252102 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:22.252113 | orchestrator | 2026-04-24 07:42:22.252123 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-24 07:42:22.252139 | orchestrator | Friday 24 April 2026 07:42:17 +0000 (0:00:00.275) 0:00:13.404 ********** 2026-04-24 07:42:22.252158 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:42:22.252175 | orchestrator | 2026-04-24 07:42:22.252192 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 07:42:22.252209 | orchestrator | Friday 24 April 2026 07:42:18 +0000 (0:00:00.694) 0:00:14.098 ********** 2026-04-24 07:42:22.252226 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:22.252243 | orchestrator | 2026-04-24 07:42:22.252264 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 07:42:22.252282 | orchestrator | Friday 24 April 2026 07:42:19 +0000 (0:00:01.276) 0:00:15.375 ********** 2026-04-24 07:42:22.252300 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:22.252321 | orchestrator | 2026-04-24 07:42:22.252342 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 07:42:22.252364 | orchestrator | Friday 24 April 2026 07:42:20 +0000 (0:00:00.272) 0:00:15.647 ********** 2026-04-24 07:42:22.252376 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:22.252386 | orchestrator | 2026-04-24 07:42:22.252397 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:42:22.252407 | orchestrator | Friday 24 April 2026 07:42:20 +0000 (0:00:00.298) 0:00:15.946 ********** 2026-04-24 07:42:22.252418 | orchestrator | 2026-04-24 07:42:22.252429 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:42:22.252449 | orchestrator | Friday 24 April 2026 07:42:20 +0000 (0:00:00.076) 0:00:16.022 ********** 2026-04-24 07:42:22.252460 | orchestrator | 2026-04-24 07:42:22.252471 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:42:22.252481 | orchestrator | Friday 24 April 2026 07:42:20 +0000 (0:00:00.076) 0:00:16.099 ********** 2026-04-24 07:42:22.252492 | orchestrator | 2026-04-24 07:42:22.252503 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-24 07:42:22.252520 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-24 07:42:22.252531 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-24 07:42:22.252553 | orchestrator | Friday 24 April 2026 07:42:20 +0000 (0:00:00.079) 0:00:16.179 ********** 2026-04-24 07:42:22.252563 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:22.252574 | orchestrator | 2026-04-24 07:42:22.252584 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 07:42:22.252595 | orchestrator | Friday 24 April 2026 07:42:22 +0000 (0:00:01.416) 0:00:17.595 ********** 2026-04-24 07:42:22.252605 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-24 07:42:22.252616 | orchestrator |  "msg": [ 2026-04-24 07:42:22.252627 | orchestrator |  "Validator run completed.", 2026-04-24 07:42:22.252638 | orchestrator |  "You can find the report file here:", 2026-04-24 07:42:22.252659 | orchestrator |  "/opt/reports/validator/ceph-mgrs-validator-2026-04-24T07:42:06+00:00-report.json", 2026-04-24 07:42:23.714553 | orchestrator |  "on the following host:", 2026-04-24 07:42:23.714650 | orchestrator |  "testbed-manager" 2026-04-24 07:42:23.714666 | orchestrator |  ] 2026-04-24 07:42:23.714678 | orchestrator | } 2026-04-24 07:42:23.714689 | orchestrator | 2026-04-24 07:42:23.714701 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:42:23.714714 | orchestrator | testbed-node-0 : ok=19  changed=3  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 07:42:23.714726 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:42:23.714737 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:42:23.714748 | orchestrator | 2026-04-24 07:42:23.714759 | orchestrator | 2026-04-24 07:42:23.714770 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:42:23.714781 | orchestrator | Friday 24 April 2026 07:42:23 +0000 (0:00:01.250) 0:00:18.846 ********** 2026-04-24 07:42:23.714792 | orchestrator | =============================================================================== 2026-04-24 07:42:23.714802 | orchestrator | Gather list of mgr modules ---------------------------------------------- 1.96s 2026-04-24 07:42:23.714813 | orchestrator | Get timestamp for report file ------------------------------------------- 1.76s 2026-04-24 07:42:23.714824 | orchestrator | Get container info ------------------------------------------------------ 1.60s 2026-04-24 07:42:23.714834 | orchestrator | Write report file ------------------------------------------------------- 1.42s 2026-04-24 07:42:23.714845 | orchestrator | Aggregate test results step one ----------------------------------------- 1.28s 2026-04-24 07:42:23.714856 | orchestrator | Print report file information ------------------------------------------- 1.25s 2026-04-24 07:42:23.714866 | orchestrator | Create report output directory ------------------------------------------ 0.75s 2026-04-24 07:42:23.714877 | orchestrator | Set validation result to failed if a test failed ------------------------ 0.69s 2026-04-24 07:42:23.714888 | orchestrator | Prepare test data for container existance test -------------------------- 0.64s 2026-04-24 07:42:23.714899 | orchestrator | Set test result to failed if ceph-mgr is not running -------------------- 0.50s 2026-04-24 07:42:23.714935 | orchestrator | Flush handlers ---------------------------------------------------------- 0.39s 2026-04-24 07:42:23.714947 | orchestrator | Extract list of enabled mgr modules ------------------------------------- 0.34s 2026-04-24 07:42:23.714957 | orchestrator | Set test result to passed if container is existing ---------------------- 0.33s 2026-04-24 07:42:23.714998 | orchestrator | Prepare test data ------------------------------------------------------- 0.33s 2026-04-24 07:42:23.715010 | orchestrator | Aggregate test results step one ----------------------------------------- 0.32s 2026-04-24 07:42:23.715021 | orchestrator | Set test result to passed if ceph-mgr is running ------------------------ 0.31s 2026-04-24 07:42:23.715032 | orchestrator | Set test result to failed if container is missing ----------------------- 0.31s 2026-04-24 07:42:23.715043 | orchestrator | Print report file information ------------------------------------------- 0.30s 2026-04-24 07:42:23.715124 | orchestrator | Aggregate test results step three --------------------------------------- 0.30s 2026-04-24 07:42:23.715138 | orchestrator | Fail due to missing containers ------------------------------------------ 0.29s 2026-04-24 07:42:23.919113 | orchestrator | + osism validate ceph-osds 2026-04-24 07:42:56.955583 | orchestrator | 2026-04-24 07:42:56.955683 | orchestrator | PLAY [Ceph validate OSDs] ****************************************************** 2026-04-24 07:42:56.955696 | orchestrator | 2026-04-24 07:42:56.955702 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-24 07:42:56.955709 | orchestrator | Friday 24 April 2026 07:42:40 +0000 (0:00:01.930) 0:00:01.930 ********** 2026-04-24 07:42:56.955716 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:56.955722 | orchestrator | 2026-04-24 07:42:56.955729 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-24 07:42:56.955735 | orchestrator | Friday 24 April 2026 07:42:43 +0000 (0:00:02.794) 0:00:04.725 ********** 2026-04-24 07:42:56.955742 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:56.955748 | orchestrator | 2026-04-24 07:42:56.955755 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-24 07:42:56.955763 | orchestrator | Friday 24 April 2026 07:42:44 +0000 (0:00:01.292) 0:00:06.018 ********** 2026-04-24 07:42:56.955784 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 07:42:56.955792 | orchestrator | 2026-04-24 07:42:56.955798 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-24 07:42:56.955805 | orchestrator | Friday 24 April 2026 07:42:46 +0000 (0:00:01.750) 0:00:07.768 ********** 2026-04-24 07:42:56.955811 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:42:56.955819 | orchestrator | 2026-04-24 07:42:56.955827 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-24 07:42:56.955833 | orchestrator | Friday 24 April 2026 07:42:47 +0000 (0:00:01.186) 0:00:08.955 ********** 2026-04-24 07:42:56.955839 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:42:56.955846 | orchestrator | 2026-04-24 07:42:56.955852 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-24 07:42:56.955858 | orchestrator | Friday 24 April 2026 07:42:49 +0000 (0:00:01.165) 0:00:10.121 ********** 2026-04-24 07:42:56.955865 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:42:56.955871 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:42:56.955878 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:42:56.955884 | orchestrator | 2026-04-24 07:42:56.955891 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-24 07:42:56.955897 | orchestrator | Friday 24 April 2026 07:42:50 +0000 (0:00:01.891) 0:00:12.012 ********** 2026-04-24 07:42:56.955904 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:42:56.955910 | orchestrator | 2026-04-24 07:42:56.955917 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-24 07:42:56.955924 | orchestrator | Friday 24 April 2026 07:42:52 +0000 (0:00:01.253) 0:00:13.266 ********** 2026-04-24 07:42:56.955931 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:42:56.955938 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:42:56.955963 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:42:56.955970 | orchestrator | 2026-04-24 07:42:56.955977 | orchestrator | TASK [Calculate total number of OSDs in cluster] ******************************* 2026-04-24 07:42:56.955983 | orchestrator | Friday 24 April 2026 07:42:53 +0000 (0:00:01.405) 0:00:14.671 ********** 2026-04-24 07:42:56.955990 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:42:56.955997 | orchestrator | 2026-04-24 07:42:56.956003 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 07:42:56.956010 | orchestrator | Friday 24 April 2026 07:42:55 +0000 (0:00:01.417) 0:00:16.088 ********** 2026-04-24 07:42:56.956017 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:42:56.956024 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:42:56.956031 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:42:56.956038 | orchestrator | 2026-04-24 07:42:56.956044 | orchestrator | TASK [Get list of ceph-osd containers on host] ********************************* 2026-04-24 07:42:56.956051 | orchestrator | Friday 24 April 2026 07:42:56 +0000 (0:00:01.421) 0:00:17.510 ********** 2026-04-24 07:42:56.956120 | orchestrator | skipping: [testbed-node-3] => (item={'id': '5e2d35e313303f1da3b54faec178c59cc1f80905d5253bf9ecc79d0f0ebbee7b', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-24 07:42:56.956132 | orchestrator | skipping: [testbed-node-3] => (item={'id': '78a0533b326d22f75bd14b89b9c361617540028fc3431874843aca0fe5f5c111', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-24 07:42:56.956139 | orchestrator | skipping: [testbed-node-3] => (item={'id': '2cd98deadb4061ab40593344f434b4c198e576b115aaf5ea9ed498f97ec21da5', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-24 07:42:56.956147 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'd088dbf29e55a136799a2c7194534143648cd7ada50471a6cb24707bd09e00af', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 23 minutes'})  2026-04-24 07:42:56.956154 | orchestrator | skipping: [testbed-node-3] => (item={'id': '1c2b0c27dc96f55eec108b30a3c17a3723c5b06125dc90b43e719890644279b5', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 54 minutes (healthy)'})  2026-04-24 07:42:56.956179 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'b9f0e0b7cb833e87d77b66b087a70dbef87251881ffd6a45727989d3f4e6ec72', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:56.956188 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'ac853f5e11915c2e1f391ccf3385fbcb5510c47536003e51e6067f2a31228556', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:56.956201 | orchestrator | skipping: [testbed-node-3] => (item={'id': '2f420c2e847d7c8dcd8f571e2fa0b856e0195e24eec45526595ceb3189ada8a8', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:56.956217 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'e3eb8c0b7464b005f183fafecb07c8e3c1929186e4a50a1ae99251bcc55903c6', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 07:42:56.956224 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'cac9ca980a559b71333f8c75b10f4d5773c17c37681191143d36f2f7ec6c28e1', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-3-rgw0', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 07:42:56.956239 | orchestrator | skipping: [testbed-node-3] => (item={'id': '352e2c7a5bfdc6da98b27521630e83a584cfb363b7d43f3103c7bc157b6aa4d5', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-3', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 07:42:56.956248 | orchestrator | ok: [testbed-node-3] => (item={'id': '97d07e72b48e1b64686adbbe0ed9d0e1431aa166e9a9968fa2e9f86e4758a16d', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-0', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-24 07:42:56.956256 | orchestrator | ok: [testbed-node-3] => (item={'id': 'a6c6c4220c8c7d0eb66d93a59da38f3744996906b6859d1e0acdd470ab76e0d7', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-4', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-24 07:42:56.956264 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'df9979f5287aa3c909d0dcff0721ecd455fa9bbd6eaeceafd0a6143916376220', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:42:56.956270 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'b487a1d659b74263b0aaf817f8ac5f51b63113714922f72b8ae237bc44eea47b', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-24 07:42:56.956276 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'ea7bcef28fe1d273400f3ffba04194496d641c833e68bac161396fe5403519a3', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-24 07:42:56.956283 | orchestrator | skipping: [testbed-node-3] => (item={'id': '06c2e6e32a2d2c87f965e86c906b0cee409bafa00b2103a4264ae8eb4d7d214b', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-24 07:42:56.956290 | orchestrator | skipping: [testbed-node-4] => (item={'id': '0161133cad1e8588453bcc8742ab8f60862758f25a68c8779e1be2e9410afa40', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-24 07:42:56.956296 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'f5f0c628891db6b232d83e167ee477e5e0412546e62b002f4edad808e35f1155', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:42:56.956313 | orchestrator | skipping: [testbed-node-3] => (item={'id': '6d20707f4325276015b30ac657b30f0c528585cfc48980c74e15e1131333d1d8', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:42:56.956333 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'e83ec0b59a04dc73a514422e2e07d9f4f1eb59f6b9f1f0bb0cd1910983943d84', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-24 07:42:57.239809 | orchestrator | skipping: [testbed-node-4] => (item={'id': '63dbd803e53427e2aee5cbc73abba812e43ed0e88c8be1a869df3ff28eb03182', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 23 minutes'})  2026-04-24 07:42:57.239938 | orchestrator | skipping: [testbed-node-3] => (item={'id': '1199882082e310840e58445f74e227bbf6ced5b9dff1aaa9ddf023337a1386f3', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:42:57.239975 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'dea889b452bec716a39227858e3440e940a85d7bc411cf52b95801606a7a20de', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 54 minutes (healthy)'})  2026-04-24 07:42:57.239988 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'dd88270ffd1f6afae888a1922c0bccbaa6af9ad917a26defe44108edda6dcb52', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:57.240001 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'ea113dd29aa4f2ac645122f5566300a748d823402a7a66ad21fcbf15beb28e41', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:57.240013 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'cffb10af59f263bdc7a9a5525442dd863399077e2204dc259f133155dafa48d8', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:57.240025 | orchestrator | skipping: [testbed-node-4] => (item={'id': '2fe40a31d10c79e94b25a21ebca3e40276f4edc584b8b555df88417d075743f0', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 07:42:57.240036 | orchestrator | skipping: [testbed-node-4] => (item={'id': '1084e8fa1ad49561cf26414b0b03b5b7a70bf9839680521ce28c2555b29e920f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-4-rgw0', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 07:42:57.240048 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'fb90392ef66ffce666dea48d4b0ff3b1699dad110dc008a060b4523c639e053c', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-4', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 07:42:57.240115 | orchestrator | skipping: [testbed-node-5] => (item={'id': '888fe2db1b183d317e262bea686821d4d702460afabcc4f00ca68cde09292e97', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-24 07:42:57.240127 | orchestrator | skipping: [testbed-node-5] => (item={'id': '06898665e3affe40d387a9c16d7fee0e70db56b00a100ad4bd9b79251fefc8c0', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-24 07:42:57.240137 | orchestrator | skipping: [testbed-node-5] => (item={'id': '7c61e9a0bbadab0a098b19fe5a1e12a685367b34a20869a3182b48d48c5a203e', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-24 07:42:57.240148 | orchestrator | skipping: [testbed-node-5] => (item={'id': '9c5f94c19444144b58a0fd0f36c6eaea4a6ae261ea385118002515d4ed2dfacc', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 23 minutes'})  2026-04-24 07:42:57.240160 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'dc34ea9dacc7752ea2159dd31899b7faa652cc06e1ee548ea46f3b801ae18ba4', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 54 minutes (healthy)'})  2026-04-24 07:42:57.240190 | orchestrator | skipping: [testbed-node-5] => (item={'id': '2d81083de6d588fd82b2ec19e9623600221c8fa73141fcf320b78acb728f7ca3', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:57.240210 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'dfe8a87b42505127753f280b9f60efef26b9075273c84aa3842e203b8f1ee7f4', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:57.240222 | orchestrator | skipping: [testbed-node-5] => (item={'id': '703e7d8b9d1c83582d8b5aa8ebdc30dc8f998eddff68d20a88e9d6d107b2acf3', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-24 07:42:57.240233 | orchestrator | skipping: [testbed-node-5] => (item={'id': '5ac1ab8b10030ada70b0be529201dcd1d955001f067555325ce4dc7d849d4f49', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 07:42:57.240253 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'dacf576cf47761c30efe413e02bf7223e3306293e4cdc969dd4f8036c794eb09', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-5-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-24 07:42:57.240264 | orchestrator | skipping: [testbed-node-5] => (item={'id': '921dc6ce35a0ba3d62ddcb60f0c9ce6f2d7bc23b03207430dab6cef5a5ab4474', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-5', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-24 07:42:57.240278 | orchestrator | ok: [testbed-node-5] => (item={'id': '0b78b5bbe93ed0f66018ee0c678787d733addbf76a253eeb9caa58961542d1d3', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-5', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-24 07:42:57.240289 | orchestrator | ok: [testbed-node-5] => (item={'id': '6d1a5765b260ff187f3bdbfd100b7629dfff3efe4eaff181a73981848ee1ce9e', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-1', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-24 07:42:57.240300 | orchestrator | ok: [testbed-node-4] => (item={'id': '8b803912c12595117f1db5dd60ebf26445d650e7800006841747fca52e6e73bd', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-2', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-24 07:42:57.240311 | orchestrator | skipping: [testbed-node-5] => (item={'id': '613c725ac31c45abf38eb4d7fbc1631ab546e76fb292755eaacdeee8f5d7c0cc', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:42:57.240323 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'df2d1e9bb7d42b6b26a94f5c9fa3d19df8e91eb61bf3e4070a77f4554547ee67', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-24 07:42:57.240334 | orchestrator | skipping: [testbed-node-5] => (item={'id': '58c1db76cf8b9ccf218afe1325798705446079ba9a2a1a1c11317cd519b58420', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-24 07:42:57.240347 | orchestrator | skipping: [testbed-node-5] => (item={'id': '22448b58f2538a202d28e68c7c148b33c5baabcab9c1759891233de50f7c39df', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:42:57.240361 | orchestrator | ok: [testbed-node-4] => (item={'id': 'e218a636a51e7b841cff887c8925efaa076400ae8e826253c42fd5fe279585b0', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-3', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-24 07:42:57.240374 | orchestrator | skipping: [testbed-node-5] => (item={'id': '8e5b06816f01f1986880e72b0e8a7d894c083a0622ef01902e1535025294bfc9', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:42:57.240401 | orchestrator | skipping: [testbed-node-4] => (item={'id': '0b66a159a0feef5da04c2c535c27c22fcce0d5eb0b41d8d4b280c4cd6ea48cbc', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:43:34.834722 | orchestrator | skipping: [testbed-node-5] => (item={'id': '14d6265820305c95e2100ddd11d77cbd2263bb736e8e6bc4e994b1949d14b330', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:43:34.834873 | orchestrator | skipping: [testbed-node-4] => (item={'id': '1d2a667796935a12504aa6f5b6d42979bbfdba1c88a2a8eb535d17b800aed795', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-24 07:43:34.834892 | orchestrator | skipping: [testbed-node-4] => (item={'id': '438b3bcaff8a27f12111b54101a26385177eac439f0c86e70ad59f0ab315f168', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-24 07:43:34.834912 | orchestrator | skipping: [testbed-node-4] => (item={'id': '5ba91b87f79d71819ae734a6e8ac630a326e18e7d40910fdfb31673c861340aa', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:43:34.834934 | orchestrator | skipping: [testbed-node-4] => (item={'id': '98aef62501d169a4aa301b061ffee3fad89709a5ff9d02a0f07ef0e1f616312f', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:43:34.834956 | orchestrator | skipping: [testbed-node-4] => (item={'id': '9fdf0b7c1c5b88286368ea6bf872f18914e1b355b1bfae3c5ce87d0e79c5b8b2', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-24 07:43:34.834976 | orchestrator | 2026-04-24 07:43:34.834999 | orchestrator | TASK [Get count of ceph-osd containers on host] ******************************** 2026-04-24 07:43:34.835021 | orchestrator | Friday 24 April 2026 07:42:58 +0000 (0:00:01.869) 0:00:19.380 ********** 2026-04-24 07:43:34.835040 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.835147 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:43:34.835163 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:43:34.835174 | orchestrator | 2026-04-24 07:43:34.835185 | orchestrator | TASK [Set test result to failed when count of containers is wrong] ************* 2026-04-24 07:43:34.835196 | orchestrator | Friday 24 April 2026 07:42:59 +0000 (0:00:01.367) 0:00:20.748 ********** 2026-04-24 07:43:34.835207 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.835219 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:43:34.835230 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:43:34.835241 | orchestrator | 2026-04-24 07:43:34.835253 | orchestrator | TASK [Set test result to passed if count matches] ****************************** 2026-04-24 07:43:34.835266 | orchestrator | Friday 24 April 2026 07:43:01 +0000 (0:00:01.360) 0:00:22.108 ********** 2026-04-24 07:43:34.835278 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.835291 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:43:34.835303 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:43:34.835315 | orchestrator | 2026-04-24 07:43:34.835328 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 07:43:34.835341 | orchestrator | Friday 24 April 2026 07:43:02 +0000 (0:00:01.339) 0:00:23.448 ********** 2026-04-24 07:43:34.835353 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.835365 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:43:34.835377 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:43:34.835410 | orchestrator | 2026-04-24 07:43:34.835424 | orchestrator | TASK [Get list of ceph-osd containers that are not running] ******************** 2026-04-24 07:43:34.835436 | orchestrator | Friday 24 April 2026 07:43:03 +0000 (0:00:01.427) 0:00:24.875 ********** 2026-04-24 07:43:34.835450 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-0', 'osd_id': '0', 'state': 'running'})  2026-04-24 07:43:34.835464 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-4', 'osd_id': '4', 'state': 'running'})  2026-04-24 07:43:34.835476 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.835489 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-2', 'osd_id': '2', 'state': 'running'})  2026-04-24 07:43:34.835502 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-3', 'osd_id': '3', 'state': 'running'})  2026-04-24 07:43:34.835514 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:43:34.835527 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-5', 'osd_id': '5', 'state': 'running'})  2026-04-24 07:43:34.835539 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-1', 'osd_id': '1', 'state': 'running'})  2026-04-24 07:43:34.835552 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:43:34.835564 | orchestrator | 2026-04-24 07:43:34.835576 | orchestrator | TASK [Get count of ceph-osd containers that are not running] ******************* 2026-04-24 07:43:34.835590 | orchestrator | Friday 24 April 2026 07:43:05 +0000 (0:00:01.398) 0:00:26.274 ********** 2026-04-24 07:43:34.835602 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.835614 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:43:34.835625 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:43:34.835636 | orchestrator | 2026-04-24 07:43:34.835646 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-24 07:43:34.835657 | orchestrator | Friday 24 April 2026 07:43:06 +0000 (0:00:01.444) 0:00:27.719 ********** 2026-04-24 07:43:34.835668 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.835699 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:43:34.835711 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:43:34.835722 | orchestrator | 2026-04-24 07:43:34.835732 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-24 07:43:34.835743 | orchestrator | Friday 24 April 2026 07:43:08 +0000 (0:00:01.695) 0:00:29.414 ********** 2026-04-24 07:43:34.835754 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.835764 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:43:34.835783 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:43:34.835794 | orchestrator | 2026-04-24 07:43:34.835805 | orchestrator | TASK [Set test result to passed if all containers are running] ***************** 2026-04-24 07:43:34.835815 | orchestrator | Friday 24 April 2026 07:43:09 +0000 (0:00:01.362) 0:00:30.777 ********** 2026-04-24 07:43:34.835826 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.835837 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:43:34.835848 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:43:34.835859 | orchestrator | 2026-04-24 07:43:34.835869 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 07:43:34.835880 | orchestrator | Friday 24 April 2026 07:43:11 +0000 (0:00:01.347) 0:00:32.124 ********** 2026-04-24 07:43:34.835891 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.835902 | orchestrator | 2026-04-24 07:43:34.835913 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 07:43:34.835923 | orchestrator | Friday 24 April 2026 07:43:12 +0000 (0:00:01.340) 0:00:33.465 ********** 2026-04-24 07:43:34.835934 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.835945 | orchestrator | 2026-04-24 07:43:34.835956 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 07:43:34.835970 | orchestrator | Friday 24 April 2026 07:43:13 +0000 (0:00:01.275) 0:00:34.741 ********** 2026-04-24 07:43:34.835989 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.836007 | orchestrator | 2026-04-24 07:43:34.836027 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:43:34.836084 | orchestrator | Friday 24 April 2026 07:43:15 +0000 (0:00:01.538) 0:00:36.279 ********** 2026-04-24 07:43:34.836102 | orchestrator | 2026-04-24 07:43:34.836113 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:43:34.836123 | orchestrator | Friday 24 April 2026 07:43:15 +0000 (0:00:00.633) 0:00:36.913 ********** 2026-04-24 07:43:34.836134 | orchestrator | 2026-04-24 07:43:34.836145 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:43:34.836156 | orchestrator | Friday 24 April 2026 07:43:16 +0000 (0:00:00.514) 0:00:37.428 ********** 2026-04-24 07:43:34.836167 | orchestrator | 2026-04-24 07:43:34.836177 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 07:43:34.836188 | orchestrator | Friday 24 April 2026 07:43:17 +0000 (0:00:00.804) 0:00:38.232 ********** 2026-04-24 07:43:34.836199 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.836209 | orchestrator | 2026-04-24 07:43:34.836220 | orchestrator | TASK [Fail early due to containers not running] ******************************** 2026-04-24 07:43:34.836231 | orchestrator | Friday 24 April 2026 07:43:18 +0000 (0:00:01.300) 0:00:39.533 ********** 2026-04-24 07:43:34.836242 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.836252 | orchestrator | 2026-04-24 07:43:34.836263 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 07:43:34.836274 | orchestrator | Friday 24 April 2026 07:43:19 +0000 (0:00:01.243) 0:00:40.777 ********** 2026-04-24 07:43:34.836284 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.836296 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:43:34.836306 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:43:34.836317 | orchestrator | 2026-04-24 07:43:34.836328 | orchestrator | TASK [Set _mon_hostname fact] ************************************************** 2026-04-24 07:43:34.836339 | orchestrator | Friday 24 April 2026 07:43:21 +0000 (0:00:01.376) 0:00:42.154 ********** 2026-04-24 07:43:34.836349 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.836360 | orchestrator | 2026-04-24 07:43:34.836371 | orchestrator | TASK [Get ceph osd tree] ******************************************************* 2026-04-24 07:43:34.836381 | orchestrator | Friday 24 April 2026 07:43:22 +0000 (0:00:01.291) 0:00:43.446 ********** 2026-04-24 07:43:34.836392 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-24 07:43:34.836403 | orchestrator | 2026-04-24 07:43:34.836414 | orchestrator | TASK [Parse osd tree from JSON] ************************************************ 2026-04-24 07:43:34.836425 | orchestrator | Friday 24 April 2026 07:43:26 +0000 (0:00:03.640) 0:00:47.086 ********** 2026-04-24 07:43:34.836436 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.836447 | orchestrator | 2026-04-24 07:43:34.836457 | orchestrator | TASK [Get OSDs that are not up or in] ****************************************** 2026-04-24 07:43:34.836468 | orchestrator | Friday 24 April 2026 07:43:27 +0000 (0:00:01.158) 0:00:48.245 ********** 2026-04-24 07:43:34.836479 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.836489 | orchestrator | 2026-04-24 07:43:34.836500 | orchestrator | TASK [Fail test if OSDs are not up or in] ************************************** 2026-04-24 07:43:34.836511 | orchestrator | Friday 24 April 2026 07:43:28 +0000 (0:00:01.353) 0:00:49.598 ********** 2026-04-24 07:43:34.836522 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:43:34.836532 | orchestrator | 2026-04-24 07:43:34.836543 | orchestrator | TASK [Pass test if OSDs are all up and in] ************************************* 2026-04-24 07:43:34.836554 | orchestrator | Friday 24 April 2026 07:43:29 +0000 (0:00:01.175) 0:00:50.774 ********** 2026-04-24 07:43:34.836565 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.836576 | orchestrator | 2026-04-24 07:43:34.836586 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 07:43:34.836597 | orchestrator | Friday 24 April 2026 07:43:30 +0000 (0:00:01.128) 0:00:51.902 ********** 2026-04-24 07:43:34.836608 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:43:34.836619 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:43:34.836629 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:43:34.836640 | orchestrator | 2026-04-24 07:43:34.836651 | orchestrator | TASK [List ceph LVM volumes and collect data] ********************************** 2026-04-24 07:43:34.836671 | orchestrator | Friday 24 April 2026 07:43:32 +0000 (0:00:01.392) 0:00:53.294 ********** 2026-04-24 07:43:34.836682 | orchestrator | changed: [testbed-node-3] 2026-04-24 07:43:34.836693 | orchestrator | changed: [testbed-node-4] 2026-04-24 07:43:34.836712 | orchestrator | changed: [testbed-node-5] 2026-04-24 07:44:06.951684 | orchestrator | 2026-04-24 07:44:06.951803 | orchestrator | TASK [Parse LVM data as JSON] ************************************************** 2026-04-24 07:44:06.951820 | orchestrator | Friday 24 April 2026 07:43:35 +0000 (0:00:03.707) 0:00:57.002 ********** 2026-04-24 07:44:06.951832 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:44:06.951844 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:44:06.951855 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:44:06.951866 | orchestrator | 2026-04-24 07:44:06.951892 | orchestrator | TASK [Get unencrypted and encrypted OSDs] ************************************** 2026-04-24 07:44:06.951904 | orchestrator | Friday 24 April 2026 07:43:37 +0000 (0:00:01.628) 0:00:58.630 ********** 2026-04-24 07:44:06.951915 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:44:06.951925 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:44:06.951936 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:44:06.951947 | orchestrator | 2026-04-24 07:44:06.951958 | orchestrator | TASK [Fail if count of encrypted OSDs does not match] ************************** 2026-04-24 07:44:06.951969 | orchestrator | Friday 24 April 2026 07:43:39 +0000 (0:00:01.578) 0:01:00.209 ********** 2026-04-24 07:44:06.951980 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:44:06.951992 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:44:06.952002 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:44:06.952013 | orchestrator | 2026-04-24 07:44:06.952024 | orchestrator | TASK [Pass if count of encrypted OSDs equals count of OSDs] ******************** 2026-04-24 07:44:06.952035 | orchestrator | Friday 24 April 2026 07:43:40 +0000 (0:00:01.509) 0:01:01.718 ********** 2026-04-24 07:44:06.952045 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:44:06.952090 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:44:06.952110 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:44:06.952128 | orchestrator | 2026-04-24 07:44:06.952145 | orchestrator | TASK [Fail if count of unencrypted OSDs does not match] ************************ 2026-04-24 07:44:06.952162 | orchestrator | Friday 24 April 2026 07:43:42 +0000 (0:00:01.395) 0:01:03.114 ********** 2026-04-24 07:44:06.952181 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:44:06.952198 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:44:06.952217 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:44:06.952236 | orchestrator | 2026-04-24 07:44:06.952253 | orchestrator | TASK [Pass if count of unencrypted OSDs equals count of OSDs] ****************** 2026-04-24 07:44:06.952273 | orchestrator | Friday 24 April 2026 07:43:43 +0000 (0:00:01.595) 0:01:04.710 ********** 2026-04-24 07:44:06.952292 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:44:06.952312 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:44:06.952331 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:44:06.952350 | orchestrator | 2026-04-24 07:44:06.952369 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-24 07:44:06.952389 | orchestrator | Friday 24 April 2026 07:43:45 +0000 (0:00:01.362) 0:01:06.072 ********** 2026-04-24 07:44:06.952409 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:44:06.952429 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:44:06.952449 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:44:06.952467 | orchestrator | 2026-04-24 07:44:06.952488 | orchestrator | TASK [Get CRUSH node data of each OSD host and root node childs] *************** 2026-04-24 07:44:06.952508 | orchestrator | Friday 24 April 2026 07:43:46 +0000 (0:00:01.575) 0:01:07.648 ********** 2026-04-24 07:44:06.952528 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:44:06.952546 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:44:06.952565 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:44:06.952585 | orchestrator | 2026-04-24 07:44:06.952604 | orchestrator | TASK [Calculate sub test expression results] *********************************** 2026-04-24 07:44:06.952624 | orchestrator | Friday 24 April 2026 07:43:48 +0000 (0:00:01.821) 0:01:09.470 ********** 2026-04-24 07:44:06.952672 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:44:06.952691 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:44:06.952711 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:44:06.952729 | orchestrator | 2026-04-24 07:44:06.952748 | orchestrator | TASK [Fail test if any sub test failed] **************************************** 2026-04-24 07:44:06.952766 | orchestrator | Friday 24 April 2026 07:43:49 +0000 (0:00:01.358) 0:01:10.829 ********** 2026-04-24 07:44:06.952785 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:44:06.952804 | orchestrator | skipping: [testbed-node-4] 2026-04-24 07:44:06.952822 | orchestrator | skipping: [testbed-node-5] 2026-04-24 07:44:06.952842 | orchestrator | 2026-04-24 07:44:06.952858 | orchestrator | TASK [Pass test if no sub test failed] ***************************************** 2026-04-24 07:44:06.952876 | orchestrator | Friday 24 April 2026 07:43:51 +0000 (0:00:01.347) 0:01:12.177 ********** 2026-04-24 07:44:06.952894 | orchestrator | ok: [testbed-node-3] 2026-04-24 07:44:06.952912 | orchestrator | ok: [testbed-node-4] 2026-04-24 07:44:06.952929 | orchestrator | ok: [testbed-node-5] 2026-04-24 07:44:06.952947 | orchestrator | 2026-04-24 07:44:06.952964 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-24 07:44:06.952982 | orchestrator | Friday 24 April 2026 07:43:52 +0000 (0:00:01.333) 0:01:13.510 ********** 2026-04-24 07:44:06.952999 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 07:44:06.953017 | orchestrator | 2026-04-24 07:44:06.953035 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-24 07:44:06.953080 | orchestrator | Friday 24 April 2026 07:43:54 +0000 (0:00:01.558) 0:01:15.069 ********** 2026-04-24 07:44:06.953100 | orchestrator | skipping: [testbed-node-3] 2026-04-24 07:44:06.953118 | orchestrator | 2026-04-24 07:44:06.953137 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-24 07:44:06.953155 | orchestrator | Friday 24 April 2026 07:43:55 +0000 (0:00:01.269) 0:01:16.338 ********** 2026-04-24 07:44:06.953172 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 07:44:06.953190 | orchestrator | 2026-04-24 07:44:06.953208 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-24 07:44:06.953225 | orchestrator | Friday 24 April 2026 07:43:58 +0000 (0:00:02.807) 0:01:19.146 ********** 2026-04-24 07:44:06.953243 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 07:44:06.953260 | orchestrator | 2026-04-24 07:44:06.953278 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-24 07:44:06.953296 | orchestrator | Friday 24 April 2026 07:43:59 +0000 (0:00:01.301) 0:01:20.448 ********** 2026-04-24 07:44:06.953314 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 07:44:06.953331 | orchestrator | 2026-04-24 07:44:06.953377 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:44:06.953396 | orchestrator | Friday 24 April 2026 07:44:00 +0000 (0:00:01.281) 0:01:21.730 ********** 2026-04-24 07:44:06.953413 | orchestrator | 2026-04-24 07:44:06.953431 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:44:06.953449 | orchestrator | Friday 24 April 2026 07:44:01 +0000 (0:00:00.457) 0:01:22.187 ********** 2026-04-24 07:44:06.953484 | orchestrator | 2026-04-24 07:44:06.953514 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-24 07:44:06.953533 | orchestrator | Friday 24 April 2026 07:44:01 +0000 (0:00:00.448) 0:01:22.635 ********** 2026-04-24 07:44:06.953550 | orchestrator | 2026-04-24 07:44:06.953568 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-24 07:44:06.953587 | orchestrator | Friday 24 April 2026 07:44:02 +0000 (0:00:00.817) 0:01:23.453 ********** 2026-04-24 07:44:06.953606 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-24 07:44:06.953623 | orchestrator | 2026-04-24 07:44:06.953641 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-24 07:44:06.953659 | orchestrator | Friday 24 April 2026 07:44:04 +0000 (0:00:02.402) 0:01:25.856 ********** 2026-04-24 07:44:06.953693 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => { 2026-04-24 07:44:06.953711 | orchestrator |  "msg": [ 2026-04-24 07:44:06.953729 | orchestrator |  "Validator run completed.", 2026-04-24 07:44:06.953746 | orchestrator |  "You can find the report file here:", 2026-04-24 07:44:06.953764 | orchestrator |  "/opt/reports/validator/ceph-osds-validator-2026-04-24T07:42:41+00:00-report.json", 2026-04-24 07:44:06.953784 | orchestrator |  "on the following host:", 2026-04-24 07:44:06.953803 | orchestrator |  "testbed-manager" 2026-04-24 07:44:06.953822 | orchestrator |  ] 2026-04-24 07:44:06.953840 | orchestrator | } 2026-04-24 07:44:06.953858 | orchestrator | 2026-04-24 07:44:06.953876 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:44:06.953896 | orchestrator | testbed-node-3 : ok=35  changed=4  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-24 07:44:06.953918 | orchestrator | testbed-node-4 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 07:44:06.953937 | orchestrator | testbed-node-5 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-24 07:44:06.953956 | orchestrator | 2026-04-24 07:44:06.953974 | orchestrator | 2026-04-24 07:44:06.953992 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:44:06.954012 | orchestrator | Friday 24 April 2026 07:44:06 +0000 (0:00:01.813) 0:01:27.669 ********** 2026-04-24 07:44:06.954174 | orchestrator | =============================================================================== 2026-04-24 07:44:06.954195 | orchestrator | List ceph LVM volumes and collect data ---------------------------------- 3.71s 2026-04-24 07:44:06.954215 | orchestrator | Get ceph osd tree ------------------------------------------------------- 3.64s 2026-04-24 07:44:06.954234 | orchestrator | Aggregate test results step one ----------------------------------------- 2.81s 2026-04-24 07:44:06.954255 | orchestrator | Get timestamp for report file ------------------------------------------- 2.79s 2026-04-24 07:44:06.954276 | orchestrator | Write report file ------------------------------------------------------- 2.40s 2026-04-24 07:44:06.954296 | orchestrator | Flush handlers ---------------------------------------------------------- 1.95s 2026-04-24 07:44:06.954316 | orchestrator | Calculate OSD devices for each host ------------------------------------- 1.89s 2026-04-24 07:44:06.954335 | orchestrator | Get list of ceph-osd containers on host --------------------------------- 1.87s 2026-04-24 07:44:06.954356 | orchestrator | Get CRUSH node data of each OSD host and root node childs --------------- 1.82s 2026-04-24 07:44:06.954377 | orchestrator | Print report file information ------------------------------------------- 1.81s 2026-04-24 07:44:06.954397 | orchestrator | Create report output directory ------------------------------------------ 1.75s 2026-04-24 07:44:06.954418 | orchestrator | Flush handlers ---------------------------------------------------------- 1.72s 2026-04-24 07:44:06.954438 | orchestrator | Set test result to failed if an OSD is not running ---------------------- 1.70s 2026-04-24 07:44:06.954460 | orchestrator | Parse LVM data as JSON -------------------------------------------------- 1.63s 2026-04-24 07:44:06.954481 | orchestrator | Fail if count of unencrypted OSDs does not match ------------------------ 1.60s 2026-04-24 07:44:06.954501 | orchestrator | Get unencrypted and encrypted OSDs -------------------------------------- 1.58s 2026-04-24 07:44:06.954523 | orchestrator | Prepare test data ------------------------------------------------------- 1.58s 2026-04-24 07:44:06.954543 | orchestrator | Set validation result to passed if no test failed ----------------------- 1.56s 2026-04-24 07:44:06.954563 | orchestrator | Aggregate test results step three --------------------------------------- 1.54s 2026-04-24 07:44:06.954583 | orchestrator | Fail if count of encrypted OSDs does not match -------------------------- 1.51s 2026-04-24 07:44:07.205828 | orchestrator | + sh -c /opt/configuration/scripts/check/200-infrastructure.sh 2026-04-24 07:44:07.211967 | orchestrator | + set -e 2026-04-24 07:44:07.212047 | orchestrator | + source /opt/manager-vars.sh 2026-04-24 07:44:07.212091 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-24 07:44:07.212103 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-24 07:44:07.212114 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-24 07:44:07.212125 | orchestrator | ++ CEPH_VERSION=reef 2026-04-24 07:44:07.212136 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-24 07:44:07.212148 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-24 07:44:07.212159 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-24 07:44:07.212170 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-24 07:44:07.212181 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-24 07:44:07.212192 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-24 07:44:07.212202 | orchestrator | ++ export ARA=false 2026-04-24 07:44:07.212213 | orchestrator | ++ ARA=false 2026-04-24 07:44:07.212224 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-24 07:44:07.212235 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-24 07:44:07.212246 | orchestrator | ++ export TEMPEST=false 2026-04-24 07:44:07.212256 | orchestrator | ++ TEMPEST=false 2026-04-24 07:44:07.212267 | orchestrator | ++ export IS_ZUUL=true 2026-04-24 07:44:07.212278 | orchestrator | ++ IS_ZUUL=true 2026-04-24 07:44:07.212289 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 07:44:07.212300 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.193.218 2026-04-24 07:44:07.212324 | orchestrator | ++ export EXTERNAL_API=false 2026-04-24 07:44:07.212335 | orchestrator | ++ EXTERNAL_API=false 2026-04-24 07:44:07.212345 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-24 07:44:07.212356 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-24 07:44:07.212368 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-24 07:44:07.212378 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-24 07:44:07.212389 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-24 07:44:07.212400 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-24 07:44:07.212411 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-24 07:44:07.212422 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-24 07:44:07.212432 | orchestrator | + source /etc/os-release 2026-04-24 07:44:07.212443 | orchestrator | ++ PRETTY_NAME='Ubuntu 24.04.4 LTS' 2026-04-24 07:44:07.212454 | orchestrator | ++ NAME=Ubuntu 2026-04-24 07:44:07.212464 | orchestrator | ++ VERSION_ID=24.04 2026-04-24 07:44:07.212475 | orchestrator | ++ VERSION='24.04.4 LTS (Noble Numbat)' 2026-04-24 07:44:07.212486 | orchestrator | ++ VERSION_CODENAME=noble 2026-04-24 07:44:07.212496 | orchestrator | ++ ID=ubuntu 2026-04-24 07:44:07.212507 | orchestrator | ++ ID_LIKE=debian 2026-04-24 07:44:07.212518 | orchestrator | ++ HOME_URL=https://www.ubuntu.com/ 2026-04-24 07:44:07.212529 | orchestrator | ++ SUPPORT_URL=https://help.ubuntu.com/ 2026-04-24 07:44:07.212542 | orchestrator | ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 2026-04-24 07:44:07.212555 | orchestrator | ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 2026-04-24 07:44:07.212568 | orchestrator | ++ UBUNTU_CODENAME=noble 2026-04-24 07:44:07.212580 | orchestrator | ++ LOGO=ubuntu-logo 2026-04-24 07:44:07.212592 | orchestrator | + [[ ubuntu == \u\b\u\n\t\u ]] 2026-04-24 07:44:07.212605 | orchestrator | + packages='libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client' 2026-04-24 07:44:07.212618 | orchestrator | + dpkg -s libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-24 07:44:07.238869 | orchestrator | 2026-04-24 07:44:07.238957 | orchestrator | # Status of Elasticsearch 2026-04-24 07:44:07.238972 | orchestrator | 2026-04-24 07:44:07.238984 | orchestrator | + pushd /opt/configuration/contrib 2026-04-24 07:44:07.238997 | orchestrator | + echo 2026-04-24 07:44:07.239009 | orchestrator | + echo '# Status of Elasticsearch' 2026-04-24 07:44:07.239020 | orchestrator | + echo 2026-04-24 07:44:07.239032 | orchestrator | + bash nagios-plugins/check_elasticsearch -H api-int.testbed.osism.xyz -s 2026-04-24 07:44:07.412387 | orchestrator | OK - elasticsearch (kolla_logging) is running. status: green; timed_out: false; number_of_nodes: 3; number_of_data_nodes: 3; active_primary_shards: 9; active_shards: 22; relocating_shards: 0; initializing_shards: 0; delayed_unassigned_shards: 0; unassigned_shards: 0 | 'active_primary'=9 'active'=22 'relocating'=0 'init'=0 'delay_unass'=0 'unass'=0 2026-04-24 07:44:07.412524 | orchestrator | 2026-04-24 07:44:07.412536 | orchestrator | + echo 2026-04-24 07:44:07.412544 | orchestrator | + echo '# Status of MariaDB' 2026-04-24 07:44:07.412552 | orchestrator | # Status of MariaDB 2026-04-24 07:44:07.412558 | orchestrator | 2026-04-24 07:44:07.412565 | orchestrator | + echo 2026-04-24 07:44:07.413675 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-24 07:44:07.472217 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-24 07:44:07.472306 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-24 07:44:07.472320 | orchestrator | + MARIADB_USER=root_shard_0 2026-04-24 07:44:07.472353 | orchestrator | + bash nagios-plugins/check_galera_cluster -u root_shard_0 -p password -H api-int.testbed.osism.xyz -c 1 2026-04-24 07:44:07.661521 | orchestrator | Reading package lists... 2026-04-24 07:44:08.048196 | orchestrator | Building dependency tree... 2026-04-24 07:44:08.050872 | orchestrator | Reading state information... 2026-04-24 07:44:08.551564 | orchestrator | bc is already the newest version (1.07.1-3ubuntu4). 2026-04-24 07:44:08.551681 | orchestrator | 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2026-04-24 07:44:09.287507 | orchestrator | OK: number of NODES = 3 (wsrep_cluster_size) 2026-04-24 07:44:09.288799 | orchestrator | 2026-04-24 07:44:09.288850 | orchestrator | # Status of Prometheus 2026-04-24 07:44:09.288862 | orchestrator | 2026-04-24 07:44:09.288877 | orchestrator | + echo 2026-04-24 07:44:09.288887 | orchestrator | + echo '# Status of Prometheus' 2026-04-24 07:44:09.288896 | orchestrator | + echo 2026-04-24 07:44:09.288905 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/healthy 2026-04-24 07:44:09.356949 | orchestrator | Unauthorized 2026-04-24 07:44:09.357560 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/ready 2026-04-24 07:44:09.409525 | orchestrator | Unauthorized 2026-04-24 07:44:09.413027 | orchestrator | 2026-04-24 07:44:09.413121 | orchestrator | # Status of RabbitMQ 2026-04-24 07:44:09.413136 | orchestrator | 2026-04-24 07:44:09.413148 | orchestrator | + echo 2026-04-24 07:44:09.413159 | orchestrator | + echo '# Status of RabbitMQ' 2026-04-24 07:44:09.413170 | orchestrator | + echo 2026-04-24 07:44:09.413466 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-24 07:44:09.462277 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-24 07:44:09.462375 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-24 07:44:09.462392 | orchestrator | + perl nagios-plugins/check_rabbitmq_cluster --ssl 1 -H api-int.testbed.osism.xyz -u openstack -p password 2026-04-24 07:44:10.059243 | orchestrator | RABBITMQ_CLUSTER OK - nb_running_node OK (3) nb_running_disc_node OK (3) nb_running_ram_node OK (0) 2026-04-24 07:44:10.068579 | orchestrator | 2026-04-24 07:44:10.068684 | orchestrator | # Status of Redis 2026-04-24 07:44:10.068709 | orchestrator | 2026-04-24 07:44:10.068731 | orchestrator | + echo 2026-04-24 07:44:10.068752 | orchestrator | + echo '# Status of Redis' 2026-04-24 07:44:10.068774 | orchestrator | + echo 2026-04-24 07:44:10.068796 | orchestrator | + /usr/lib/nagios/plugins/check_tcp -H 192.168.16.10 -p 6379 -A -E -s 'AUTH QHNA1SZRlOKzLADhUd5ZDgpHfQe6dNfr3bwEdY24\r\nPING\r\nINFO replication\r\nQUIT\r\n' -e PONG -e role:master -e slave0:ip=192.168.16.1 -e,port=6379 -j 2026-04-24 07:44:10.078193 | orchestrator | TCP OK - 0.002 second response time on 192.168.16.10 port 6379|time=0.001638s;;;0.000000;10.000000 2026-04-24 07:44:10.078434 | orchestrator | + popd 2026-04-24 07:44:10.079853 | orchestrator | 2026-04-24 07:44:10.079912 | orchestrator | # Create backup of MariaDB database 2026-04-24 07:44:10.079934 | orchestrator | 2026-04-24 07:44:10.079953 | orchestrator | + echo 2026-04-24 07:44:10.079972 | orchestrator | + echo '# Create backup of MariaDB database' 2026-04-24 07:44:10.079992 | orchestrator | + echo 2026-04-24 07:44:10.080011 | orchestrator | + osism apply mariadb_backup -e mariadb_backup_type=full 2026-04-24 07:44:11.413782 | orchestrator | 2026-04-24 07:44:11 | INFO  | Prepare task for execution of mariadb_backup. 2026-04-24 07:44:11.482990 | orchestrator | 2026-04-24 07:44:11 | INFO  | Task 2c82542b-6220-4451-aa43-ef05dae562ec (mariadb_backup) was prepared for execution. 2026-04-24 07:44:11.483145 | orchestrator | 2026-04-24 07:44:11 | INFO  | It takes a moment until task 2c82542b-6220-4451-aa43-ef05dae562ec (mariadb_backup) has been started and output is visible here. 2026-04-24 07:45:09.490670 | orchestrator | 2026-04-24 07:45:09.490740 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-24 07:45:09.490751 | orchestrator | 2026-04-24 07:45:09.490759 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-24 07:45:09.490768 | orchestrator | Friday 24 April 2026 07:44:16 +0000 (0:00:01.632) 0:00:01.632 ********** 2026-04-24 07:45:09.490777 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:45:09.490786 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:45:09.490794 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:45:09.490802 | orchestrator | 2026-04-24 07:45:09.490810 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-24 07:45:09.490833 | orchestrator | Friday 24 April 2026 07:44:18 +0000 (0:00:02.047) 0:00:03.679 ********** 2026-04-24 07:45:09.490841 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-24 07:45:09.490849 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-24 07:45:09.490867 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-24 07:45:09.490875 | orchestrator | 2026-04-24 07:45:09.490882 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-24 07:45:09.490890 | orchestrator | 2026-04-24 07:45:09.490898 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-24 07:45:09.490906 | orchestrator | Friday 24 April 2026 07:44:20 +0000 (0:00:01.890) 0:00:05.570 ********** 2026-04-24 07:45:09.490914 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-24 07:45:09.490923 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-24 07:45:09.490930 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-24 07:45:09.490938 | orchestrator | 2026-04-24 07:45:09.490946 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-24 07:45:09.490953 | orchestrator | Friday 24 April 2026 07:44:22 +0000 (0:00:01.840) 0:00:07.410 ********** 2026-04-24 07:45:09.490961 | orchestrator | included: /ansible/roles/mariadb/tasks/backup.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-24 07:45:09.490971 | orchestrator | 2026-04-24 07:45:09.490980 | orchestrator | TASK [mariadb : Get MariaDB container facts] *********************************** 2026-04-24 07:45:09.490989 | orchestrator | Friday 24 April 2026 07:44:24 +0000 (0:00:02.591) 0:00:10.001 ********** 2026-04-24 07:45:09.490997 | orchestrator | ok: [testbed-node-0] 2026-04-24 07:45:09.491005 | orchestrator | ok: [testbed-node-1] 2026-04-24 07:45:09.491013 | orchestrator | ok: [testbed-node-2] 2026-04-24 07:45:09.491021 | orchestrator | 2026-04-24 07:45:09.491028 | orchestrator | TASK [mariadb : Taking full database backup via Mariabackup] ******************* 2026-04-24 07:45:09.491065 | orchestrator | Friday 24 April 2026 07:44:29 +0000 (0:00:04.809) 0:00:14.811 ********** 2026-04-24 07:45:09.491075 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:45:09.491084 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:45:09.491092 | orchestrator | changed: [testbed-node-0] 2026-04-24 07:45:09.491100 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-24 07:45:09.491109 | orchestrator | 2026-04-24 07:45:09.491116 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-24 07:45:09.491124 | orchestrator | skipping: no hosts matched 2026-04-24 07:45:09.491132 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-24 07:45:09.491140 | orchestrator | 2026-04-24 07:45:09.491148 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-24 07:45:09.491156 | orchestrator | skipping: no hosts matched 2026-04-24 07:45:09.491164 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-24 07:45:09.491173 | orchestrator | mariadb_bootstrap_restart 2026-04-24 07:45:09.491181 | orchestrator | 2026-04-24 07:45:09.491190 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-24 07:45:09.491198 | orchestrator | skipping: no hosts matched 2026-04-24 07:45:09.491206 | orchestrator | 2026-04-24 07:45:09.491214 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-24 07:45:09.491222 | orchestrator | 2026-04-24 07:45:09.491230 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-24 07:45:09.491238 | orchestrator | Friday 24 April 2026 07:45:06 +0000 (0:00:36.324) 0:00:51.136 ********** 2026-04-24 07:45:09.491246 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:45:09.491254 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:45:09.491260 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:45:09.491267 | orchestrator | 2026-04-24 07:45:09.491273 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-24 07:45:09.491281 | orchestrator | Friday 24 April 2026 07:45:07 +0000 (0:00:01.334) 0:00:52.470 ********** 2026-04-24 07:45:09.491298 | orchestrator | skipping: [testbed-node-0] 2026-04-24 07:45:09.491306 | orchestrator | skipping: [testbed-node-1] 2026-04-24 07:45:09.491315 | orchestrator | skipping: [testbed-node-2] 2026-04-24 07:45:09.491323 | orchestrator | 2026-04-24 07:45:09.491332 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:45:09.491341 | orchestrator | testbed-node-0 : ok=6  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-24 07:45:09.491351 | orchestrator | testbed-node-1 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 07:45:09.491359 | orchestrator | testbed-node-2 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-24 07:45:09.491368 | orchestrator | 2026-04-24 07:45:09.491377 | orchestrator | 2026-04-24 07:45:09.491385 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:45:09.491394 | orchestrator | Friday 24 April 2026 07:45:09 +0000 (0:00:01.819) 0:00:54.289 ********** 2026-04-24 07:45:09.491403 | orchestrator | =============================================================================== 2026-04-24 07:45:09.491411 | orchestrator | mariadb : Taking full database backup via Mariabackup ------------------ 36.32s 2026-04-24 07:45:09.491433 | orchestrator | mariadb : Get MariaDB container facts ----------------------------------- 4.81s 2026-04-24 07:45:09.491442 | orchestrator | mariadb : include_tasks ------------------------------------------------- 2.59s 2026-04-24 07:45:09.491450 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.05s 2026-04-24 07:45:09.491459 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.89s 2026-04-24 07:45:09.491467 | orchestrator | mariadb : Group MariaDB hosts based on shards --------------------------- 1.84s 2026-04-24 07:45:09.491475 | orchestrator | Include mariadb post-upgrade.yml ---------------------------------------- 1.82s 2026-04-24 07:45:09.491484 | orchestrator | Include mariadb post-deploy.yml ----------------------------------------- 1.33s 2026-04-24 07:45:09.624830 | orchestrator | + sh -c /opt/configuration/scripts/check/300-openstack.sh 2026-04-24 07:45:09.634514 | orchestrator | + set -e 2026-04-24 07:45:09.634571 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-24 07:45:09.634591 | orchestrator | ++ export INTERACTIVE=false 2026-04-24 07:45:09.634599 | orchestrator | ++ INTERACTIVE=false 2026-04-24 07:45:09.634605 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-24 07:45:09.634612 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-24 07:45:09.634618 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-24 07:45:09.634953 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-24 07:45:09.638531 | orchestrator | 2026-04-24 07:45:09.638559 | orchestrator | # OpenStack endpoints 2026-04-24 07:45:09.638564 | orchestrator | 2026-04-24 07:45:09.638568 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-24 07:45:09.638572 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-24 07:45:09.638576 | orchestrator | + export OS_CLOUD=admin 2026-04-24 07:45:09.638580 | orchestrator | + OS_CLOUD=admin 2026-04-24 07:45:09.638584 | orchestrator | + echo 2026-04-24 07:45:09.638588 | orchestrator | + echo '# OpenStack endpoints' 2026-04-24 07:45:09.638592 | orchestrator | + echo 2026-04-24 07:45:09.638599 | orchestrator | + openstack endpoint list 2026-04-24 07:45:12.556431 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-24 07:45:12.556486 | orchestrator | | ID | Region | Service Name | Service Type | Enabled | Interface | URL | 2026-04-24 07:45:12.556492 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-24 07:45:12.556497 | orchestrator | | 0488740c03ac4485be3063afa0835ce6 | RegionOne | neutron | network | True | internal | https://api-int.testbed.osism.xyz:9696 | 2026-04-24 07:45:12.556516 | orchestrator | | 059b89c7bbab4b96b15d61763b278903 | RegionOne | nova | compute | True | internal | https://api-int.testbed.osism.xyz:8774/v2.1 | 2026-04-24 07:45:12.556521 | orchestrator | | 0a59d05fb4ea4638b7351e9cfa409bb4 | RegionOne | neutron | network | True | public | https://api.testbed.osism.xyz:9696 | 2026-04-24 07:45:12.556525 | orchestrator | | 1a8db2cfe1234ddf8843f3dae79fcd75 | RegionOne | barbican | key-manager | True | internal | https://api-int.testbed.osism.xyz:9311 | 2026-04-24 07:45:12.556529 | orchestrator | | 203dc339e24847edaf9208c5e99af84c | RegionOne | swift | object-store | True | public | https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-24 07:45:12.556534 | orchestrator | | 20aefd688048416faf483420ac257303 | RegionOne | manilav2 | sharev2 | True | internal | https://api-int.testbed.osism.xyz:8786/v2 | 2026-04-24 07:45:12.556539 | orchestrator | | 21a9eb54cece4b1dbbd4e7e3ca0db457 | RegionOne | glance | image | True | public | https://api.testbed.osism.xyz:9292 | 2026-04-24 07:45:12.556543 | orchestrator | | 225ff6fda47742859338c0ffe3c3c464 | RegionOne | manilav2 | sharev2 | True | public | https://api.testbed.osism.xyz:8786/v2 | 2026-04-24 07:45:12.556547 | orchestrator | | 2684d32070c1409993136e80f54274f1 | RegionOne | manila | share | True | internal | https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-24 07:45:12.556551 | orchestrator | | 2732c94c68a645ed944156a10f89c15a | RegionOne | skyline | panel | True | public | https://api.testbed.osism.xyz:9998 | 2026-04-24 07:45:12.556556 | orchestrator | | 3620a5ee47ca452d8b3066760469be71 | RegionOne | barbican | key-manager | True | public | https://api.testbed.osism.xyz:9311 | 2026-04-24 07:45:12.556560 | orchestrator | | 36548f7c139b44acac1b27f43a779d87 | RegionOne | placement | placement | True | public | https://api.testbed.osism.xyz:8780 | 2026-04-24 07:45:12.556564 | orchestrator | | 3a843f62c7984dc69f5f4fc7091804ba | RegionOne | designate | dns | True | public | https://api.testbed.osism.xyz:9001 | 2026-04-24 07:45:12.556568 | orchestrator | | 416af38802c54605b2bcb4d9b9a7d2fd | RegionOne | keystone | identity | True | internal | https://api-int.testbed.osism.xyz:5000 | 2026-04-24 07:45:12.556573 | orchestrator | | 42291067b2214877a6df693b7e3b2cc5 | RegionOne | aodh | alarming | True | internal | https://api-int.testbed.osism.xyz:8042 | 2026-04-24 07:45:12.556577 | orchestrator | | 434431f5cda841e29d4eee15d7cc5fba | RegionOne | skyline | panel | True | internal | https://api-int.testbed.osism.xyz:9998 | 2026-04-24 07:45:12.556581 | orchestrator | | 50c8bf9cafd043cd8cb622dab2757f2f | RegionOne | aodh | alarming | True | public | https://api.testbed.osism.xyz:8042 | 2026-04-24 07:45:12.556592 | orchestrator | | 5d87b164c1c94b288cdb14a528038cb9 | RegionOne | octavia | load-balancer | True | internal | https://api-int.testbed.osism.xyz:9876 | 2026-04-24 07:45:12.556597 | orchestrator | | 5dd6fe17b0e14c59905cf4a2a2ab79a1 | RegionOne | magnum | container-infra | True | public | https://api.testbed.osism.xyz:9511/v1 | 2026-04-24 07:45:12.556601 | orchestrator | | 5df38fb6815b436ba7f9c31a770d5cef | RegionOne | magnum | container-infra | True | internal | https://api-int.testbed.osism.xyz:9511/v1 | 2026-04-24 07:45:12.556613 | orchestrator | | 61708d2ad8354b8fb594f518150cdec0 | RegionOne | designate | dns | True | internal | https://api-int.testbed.osism.xyz:9001 | 2026-04-24 07:45:12.556621 | orchestrator | | 6aeb6f63d6534a2d8ffaeb5f178b7a48 | RegionOne | glance | image | True | internal | https://api-int.testbed.osism.xyz:9292 | 2026-04-24 07:45:12.556626 | orchestrator | | 70fe650f88044a148f6448d9e47d6b9b | RegionOne | cinderv3 | volumev3 | True | public | https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-24 07:45:12.556630 | orchestrator | | 8a54348f528243c7afb44e6ef498fcb6 | RegionOne | placement | placement | True | internal | https://api-int.testbed.osism.xyz:8780 | 2026-04-24 07:45:12.556634 | orchestrator | | a1ebcb58fca948e88fcc22ddf7a0e3b5 | RegionOne | swift | object-store | True | internal | https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-24 07:45:12.556638 | orchestrator | | ab0a2bdf69824acd82dfd009d8fd7a44 | RegionOne | keystone | identity | True | public | https://api.testbed.osism.xyz:5000 | 2026-04-24 07:45:12.556643 | orchestrator | | d27580cea43646a1a8399ded44b990d8 | RegionOne | manila | share | True | public | https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-24 07:45:12.556647 | orchestrator | | d7befd2e02504faa8d36efad8cc1cbd1 | RegionOne | octavia | load-balancer | True | public | https://api.testbed.osism.xyz:9876 | 2026-04-24 07:45:12.556651 | orchestrator | | df34ac1163704b4b8e0289b7a849979c | RegionOne | nova | compute | True | public | https://api.testbed.osism.xyz:8774/v2.1 | 2026-04-24 07:45:12.556656 | orchestrator | | e965d1cb2ddc49e9bc0bbab6d506c70e | RegionOne | cinderv3 | volumev3 | True | internal | https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-24 07:45:12.556660 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-24 07:45:12.748068 | orchestrator | 2026-04-24 07:45:12.748182 | orchestrator | # Cinder 2026-04-24 07:45:12.748206 | orchestrator | 2026-04-24 07:45:12.748226 | orchestrator | + echo 2026-04-24 07:45:12.748245 | orchestrator | + echo '# Cinder' 2026-04-24 07:45:12.748263 | orchestrator | + echo 2026-04-24 07:45:12.748274 | orchestrator | + openstack volume service list 2026-04-24 07:45:15.358131 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-24 07:45:15.358211 | orchestrator | | Binary | Host | Zone | Status | State | Updated At | 2026-04-24 07:45:15.358217 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-24 07:45:15.358222 | orchestrator | | cinder-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-24T07:45:11.000000 | 2026-04-24 07:45:15.358226 | orchestrator | | cinder-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-24T07:45:11.000000 | 2026-04-24 07:45:15.358230 | orchestrator | | cinder-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-24T07:45:11.000000 | 2026-04-24 07:45:15.358234 | orchestrator | | cinder-volume | testbed-node-0@rbd-volumes | nova | enabled | up | 2026-04-24T07:45:05.000000 | 2026-04-24 07:45:15.358238 | orchestrator | | cinder-volume | testbed-node-2@rbd-volumes | nova | enabled | up | 2026-04-24T07:45:10.000000 | 2026-04-24 07:45:15.358242 | orchestrator | | cinder-volume | testbed-node-1@rbd-volumes | nova | enabled | up | 2026-04-24T07:45:11.000000 | 2026-04-24 07:45:15.358245 | orchestrator | | cinder-backup | testbed-node-0 | nova | enabled | up | 2026-04-24T07:45:12.000000 | 2026-04-24 07:45:15.358249 | orchestrator | | cinder-backup | testbed-node-1 | nova | enabled | up | 2026-04-24T07:45:13.000000 | 2026-04-24 07:45:15.358253 | orchestrator | | cinder-backup | testbed-node-2 | nova | enabled | up | 2026-04-24T07:45:12.000000 | 2026-04-24 07:45:15.358257 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-24 07:45:15.621543 | orchestrator | 2026-04-24 07:45:15.621643 | orchestrator | # Neutron 2026-04-24 07:45:15.621664 | orchestrator | 2026-04-24 07:45:15.621678 | orchestrator | + echo 2026-04-24 07:45:15.621692 | orchestrator | + echo '# Neutron' 2026-04-24 07:45:15.621707 | orchestrator | + echo 2026-04-24 07:45:15.621721 | orchestrator | + openstack network agent list 2026-04-24 07:45:18.425717 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-24 07:45:18.425847 | orchestrator | | ID | Agent Type | Host | Availability Zone | Alive | State | Binary | 2026-04-24 07:45:18.425863 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-24 07:45:18.425910 | orchestrator | | testbed-node-1 | OVN Controller Gateway agent | testbed-node-1 | nova | :-) | UP | ovn-controller | 2026-04-24 07:45:18.425922 | orchestrator | | testbed-node-2 | OVN Controller Gateway agent | testbed-node-2 | nova | :-) | UP | ovn-controller | 2026-04-24 07:45:18.425932 | orchestrator | | testbed-node-5 | OVN Controller agent | testbed-node-5 | | :-) | UP | ovn-controller | 2026-04-24 07:45:18.425942 | orchestrator | | 36b9d21c-9928-5c0a-9b27-73ac7a3e770c | OVN Metadata agent | testbed-node-5 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-24 07:45:18.425952 | orchestrator | | testbed-node-3 | OVN Controller agent | testbed-node-3 | | :-) | UP | ovn-controller | 2026-04-24 07:45:18.425962 | orchestrator | | e645415a-98f5-5758-8cd1-c47af282b5c0 | OVN Metadata agent | testbed-node-3 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-24 07:45:18.425971 | orchestrator | | testbed-node-0 | OVN Controller Gateway agent | testbed-node-0 | nova | :-) | UP | ovn-controller | 2026-04-24 07:45:18.425981 | orchestrator | | testbed-node-4 | OVN Controller agent | testbed-node-4 | | :-) | UP | ovn-controller | 2026-04-24 07:45:18.425991 | orchestrator | | 4939696e-6092-5a33-bb73-b850064684df | OVN Metadata agent | testbed-node-4 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-24 07:45:18.426000 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-24 07:45:18.706954 | orchestrator | + openstack network service provider list 2026-04-24 07:45:21.177226 | orchestrator | +---------------+------+---------+ 2026-04-24 07:45:21.177297 | orchestrator | | Service Type | Name | Default | 2026-04-24 07:45:21.177304 | orchestrator | +---------------+------+---------+ 2026-04-24 07:45:21.177308 | orchestrator | | L3_ROUTER_NAT | ovn | True | 2026-04-24 07:45:21.177313 | orchestrator | +---------------+------+---------+ 2026-04-24 07:45:21.445849 | orchestrator | 2026-04-24 07:45:21.445943 | orchestrator | # Nova 2026-04-24 07:45:21.445960 | orchestrator | 2026-04-24 07:45:21.445972 | orchestrator | + echo 2026-04-24 07:45:21.445984 | orchestrator | + echo '# Nova' 2026-04-24 07:45:21.445997 | orchestrator | + echo 2026-04-24 07:45:21.446010 | orchestrator | + openstack compute service list 2026-04-24 07:45:24.162824 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-24 07:45:24.162929 | orchestrator | | ID | Binary | Host | Zone | Status | State | Updated At | 2026-04-24 07:45:24.162946 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-24 07:45:24.162958 | orchestrator | | e9e18870-3f37-4faa-83aa-edcebbc892ad | nova-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-24T07:45:18.000000 | 2026-04-24 07:45:24.162969 | orchestrator | | afbb5932-9f2f-46d0-ad45-b79501604e5a | nova-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-24T07:45:18.000000 | 2026-04-24 07:45:24.163018 | orchestrator | | e8d21d5f-bb00-4c60-bb7f-3857a1fb3a80 | nova-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-24T07:45:18.000000 | 2026-04-24 07:45:24.163090 | orchestrator | | 399e938c-cbb3-407a-8dee-ff3c93ea37c6 | nova-conductor | testbed-node-0 | internal | enabled | up | 2026-04-24T07:45:23.000000 | 2026-04-24 07:45:24.163114 | orchestrator | | ed078005-f8bf-4eb0-9e72-567d4cf4e3ae | nova-conductor | testbed-node-1 | internal | enabled | up | 2026-04-24T07:45:16.000000 | 2026-04-24 07:45:24.163129 | orchestrator | | 9fef3259-aa5a-468e-bf56-a80697c99b61 | nova-conductor | testbed-node-2 | internal | enabled | up | 2026-04-24T07:45:21.000000 | 2026-04-24 07:45:24.163140 | orchestrator | | 15149229-cd40-4c98-9332-18cee7229971 | nova-compute | testbed-node-3 | nova | enabled | up | 2026-04-24T07:45:18.000000 | 2026-04-24 07:45:24.163151 | orchestrator | | 3f48bb21-4298-4a42-b4b4-e9c16ed49b0a | nova-compute | testbed-node-5 | nova | enabled | up | 2026-04-24T07:45:22.000000 | 2026-04-24 07:45:24.163162 | orchestrator | | 5de0a6b5-d622-485e-a8e9-ebc9c0f678e9 | nova-compute | testbed-node-4 | nova | enabled | up | 2026-04-24T07:45:22.000000 | 2026-04-24 07:45:24.163172 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-24 07:45:24.446128 | orchestrator | + openstack hypervisor list 2026-04-24 07:45:27.084881 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-24 07:45:27.084996 | orchestrator | | ID | Hypervisor Hostname | Hypervisor Type | Host IP | State | 2026-04-24 07:45:27.085012 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-24 07:45:27.085115 | orchestrator | | 5f3c14b2-26b7-49e9-9281-8a7cb4163b5b | testbed-node-3 | QEMU | 192.168.16.13 | up | 2026-04-24 07:45:27.085130 | orchestrator | | d04f7abf-2d4c-4c2c-869d-62a5459c1287 | testbed-node-5 | QEMU | 192.168.16.15 | up | 2026-04-24 07:45:27.085141 | orchestrator | | 38ab19bd-ec59-43f5-a8a1-db353dc53241 | testbed-node-4 | QEMU | 192.168.16.14 | up | 2026-04-24 07:45:27.085152 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-24 07:45:27.370405 | orchestrator | 2026-04-24 07:45:27.370528 | orchestrator | # Run OpenStack test play 2026-04-24 07:45:27.370554 | orchestrator | 2026-04-24 07:45:27.370568 | orchestrator | + echo 2026-04-24 07:45:27.370581 | orchestrator | + echo '# Run OpenStack test play' 2026-04-24 07:45:27.370593 | orchestrator | + echo 2026-04-24 07:45:27.370605 | orchestrator | + osism apply --environment openstack test 2026-04-24 07:45:28.670372 | orchestrator | 2026-04-24 07:45:28 | INFO  | Trying to run play test in environment openstack 2026-04-24 07:45:38.855620 | orchestrator | 2026-04-24 07:45:38 | INFO  | Prepare task for execution of test. 2026-04-24 07:45:38.934743 | orchestrator | 2026-04-24 07:45:38 | INFO  | Task d40088c4-e451-4bed-98e5-96d81ca04e77 (test) was prepared for execution. 2026-04-24 07:45:38.934838 | orchestrator | 2026-04-24 07:45:38 | INFO  | It takes a moment until task d40088c4-e451-4bed-98e5-96d81ca04e77 (test) has been started and output is visible here. 2026-04-24 07:48:18.878268 | orchestrator | 2026-04-24 07:48:18.878417 | orchestrator | PLAY [Create test project] ***************************************************** 2026-04-24 07:48:18.878429 | orchestrator | 2026-04-24 07:48:18.878436 | orchestrator | TASK [Create test domain] ****************************************************** 2026-04-24 07:48:18.878443 | orchestrator | Friday 24 April 2026 07:45:43 +0000 (0:00:01.286) 0:00:01.286 ********** 2026-04-24 07:48:18.878450 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878458 | orchestrator | 2026-04-24 07:48:18.878464 | orchestrator | TASK [Create test-admin user] ************************************************** 2026-04-24 07:48:18.878470 | orchestrator | Friday 24 April 2026 07:45:50 +0000 (0:00:06.404) 0:00:07.690 ********** 2026-04-24 07:48:18.878477 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878500 | orchestrator | 2026-04-24 07:48:18.878507 | orchestrator | TASK [Add manager role to user test-admin] ************************************* 2026-04-24 07:48:18.878513 | orchestrator | Friday 24 April 2026 07:45:55 +0000 (0:00:05.209) 0:00:12.900 ********** 2026-04-24 07:48:18.878520 | orchestrator | changed: [localhost] 2026-04-24 07:48:18.878527 | orchestrator | 2026-04-24 07:48:18.878533 | orchestrator | TASK [Create test project] ***************************************************** 2026-04-24 07:48:18.878540 | orchestrator | Friday 24 April 2026 07:46:05 +0000 (0:00:09.744) 0:00:22.644 ********** 2026-04-24 07:48:18.878546 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878552 | orchestrator | 2026-04-24 07:48:18.878558 | orchestrator | TASK [Create test user] ******************************************************** 2026-04-24 07:48:18.878564 | orchestrator | Friday 24 April 2026 07:46:10 +0000 (0:00:05.354) 0:00:27.999 ********** 2026-04-24 07:48:18.878570 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878577 | orchestrator | 2026-04-24 07:48:18.878583 | orchestrator | TASK [Add member roles to user test] ******************************************* 2026-04-24 07:48:18.878589 | orchestrator | Friday 24 April 2026 07:46:15 +0000 (0:00:05.235) 0:00:33.234 ********** 2026-04-24 07:48:18.878595 | orchestrator | changed: [localhost] => (item=load-balancer_member) 2026-04-24 07:48:18.878602 | orchestrator | ok: [localhost] => (item=member) 2026-04-24 07:48:18.878609 | orchestrator | changed: [localhost] => (item=creator) 2026-04-24 07:48:18.878615 | orchestrator | 2026-04-24 07:48:18.878622 | orchestrator | TASK [Create test server group] ************************************************ 2026-04-24 07:48:18.878628 | orchestrator | Friday 24 April 2026 07:46:29 +0000 (0:00:13.645) 0:00:46.880 ********** 2026-04-24 07:48:18.878634 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878640 | orchestrator | 2026-04-24 07:48:18.878646 | orchestrator | TASK [Create ssh security group] *********************************************** 2026-04-24 07:48:18.878652 | orchestrator | Friday 24 April 2026 07:46:35 +0000 (0:00:05.726) 0:00:52.607 ********** 2026-04-24 07:48:18.878658 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878664 | orchestrator | 2026-04-24 07:48:18.878670 | orchestrator | TASK [Add rule to ssh security group] ****************************************** 2026-04-24 07:48:18.878676 | orchestrator | Friday 24 April 2026 07:46:40 +0000 (0:00:05.270) 0:00:57.877 ********** 2026-04-24 07:48:18.878683 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878689 | orchestrator | 2026-04-24 07:48:18.878695 | orchestrator | TASK [Create icmp security group] ********************************************** 2026-04-24 07:48:18.878701 | orchestrator | Friday 24 April 2026 07:46:45 +0000 (0:00:05.277) 0:01:03.155 ********** 2026-04-24 07:48:18.878707 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878713 | orchestrator | 2026-04-24 07:48:18.878719 | orchestrator | TASK [Add rule to icmp security group] ***************************************** 2026-04-24 07:48:18.878725 | orchestrator | Friday 24 April 2026 07:46:50 +0000 (0:00:04.839) 0:01:07.994 ********** 2026-04-24 07:48:18.878731 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878738 | orchestrator | 2026-04-24 07:48:18.878744 | orchestrator | TASK [Create test keypair] ***************************************************** 2026-04-24 07:48:18.878750 | orchestrator | Friday 24 April 2026 07:46:55 +0000 (0:00:04.974) 0:01:12.969 ********** 2026-04-24 07:48:18.878756 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878763 | orchestrator | 2026-04-24 07:48:18.878769 | orchestrator | TASK [Create test networks] **************************************************** 2026-04-24 07:48:18.878775 | orchestrator | Friday 24 April 2026 07:47:00 +0000 (0:00:04.987) 0:01:17.957 ********** 2026-04-24 07:48:18.878781 | orchestrator | ok: [localhost] => (item={'name': 'test-1'}) 2026-04-24 07:48:18.878787 | orchestrator | ok: [localhost] => (item={'name': 'test-2'}) 2026-04-24 07:48:18.878794 | orchestrator | ok: [localhost] => (item={'name': 'test-3'}) 2026-04-24 07:48:18.878800 | orchestrator | 2026-04-24 07:48:18.878806 | orchestrator | TASK [Create test subnets] ***************************************************** 2026-04-24 07:48:18.878813 | orchestrator | Friday 24 April 2026 07:47:13 +0000 (0:00:12.876) 0:01:30.834 ********** 2026-04-24 07:48:18.878819 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'subnet': 'subnet-test-1', 'cidr': '192.168.200.0/24'}) 2026-04-24 07:48:18.878832 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'subnet': 'subnet-test-2', 'cidr': '192.168.201.0/24'}) 2026-04-24 07:48:18.878840 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'subnet': 'subnet-test-3', 'cidr': '192.168.202.0/24'}) 2026-04-24 07:48:18.878847 | orchestrator | 2026-04-24 07:48:18.878854 | orchestrator | TASK [Create test routers] ***************************************************** 2026-04-24 07:48:18.878861 | orchestrator | Friday 24 April 2026 07:47:26 +0000 (0:00:12.952) 0:01:43.787 ********** 2026-04-24 07:48:18.878868 | orchestrator | ok: [localhost] => (item={'router': 'router-test-1', 'subnet': 'subnet-test-1'}) 2026-04-24 07:48:18.878877 | orchestrator | ok: [localhost] => (item={'router': 'router-test-2', 'subnet': 'subnet-test-2'}) 2026-04-24 07:48:18.878883 | orchestrator | ok: [localhost] => (item={'router': 'router-test-3', 'subnet': 'subnet-test-3'}) 2026-04-24 07:48:18.878891 | orchestrator | 2026-04-24 07:48:18.878898 | orchestrator | PLAY [Manage test instances and volumes] *************************************** 2026-04-24 07:48:18.878904 | orchestrator | 2026-04-24 07:48:18.878911 | orchestrator | TASK [Get test server group] *************************************************** 2026-04-24 07:48:18.878918 | orchestrator | Friday 24 April 2026 07:47:40 +0000 (0:00:14.450) 0:01:58.237 ********** 2026-04-24 07:48:18.878925 | orchestrator | ok: [localhost] 2026-04-24 07:48:18.878933 | orchestrator | 2026-04-24 07:48:18.878964 | orchestrator | TASK [Detach test volume] ****************************************************** 2026-04-24 07:48:18.878972 | orchestrator | Friday 24 April 2026 07:47:46 +0000 (0:00:05.232) 0:02:03.470 ********** 2026-04-24 07:48:18.878980 | orchestrator | skipping: [localhost] 2026-04-24 07:48:18.878987 | orchestrator | 2026-04-24 07:48:18.878994 | orchestrator | TASK [Delete test volume] ****************************************************** 2026-04-24 07:48:18.879001 | orchestrator | Friday 24 April 2026 07:47:47 +0000 (0:00:01.199) 0:02:04.670 ********** 2026-04-24 07:48:18.879011 | orchestrator | skipping: [localhost] 2026-04-24 07:48:18.879021 | orchestrator | 2026-04-24 07:48:18.879032 | orchestrator | TASK [Delete test instances] *************************************************** 2026-04-24 07:48:18.879042 | orchestrator | Friday 24 April 2026 07:47:48 +0000 (0:00:01.118) 0:02:05.788 ********** 2026-04-24 07:48:18.879052 | orchestrator | skipping: [localhost] => (item={'name': 'test-4', 'network': 'test-3'})  2026-04-24 07:48:18.879063 | orchestrator | skipping: [localhost] => (item={'name': 'test-3', 'network': 'test-2'})  2026-04-24 07:48:18.879072 | orchestrator | skipping: [localhost] => (item={'name': 'test-2', 'network': 'test-2'})  2026-04-24 07:48:18.879083 | orchestrator | skipping: [localhost] => (item={'name': 'test-1', 'network': 'test-1'})  2026-04-24 07:48:18.879093 | orchestrator | skipping: [localhost] => (item={'name': 'test', 'network': 'test-1'})  2026-04-24 07:48:18.879103 | orchestrator | skipping: [localhost] 2026-04-24 07:48:18.879114 | orchestrator | 2026-04-24 07:48:18.879126 | orchestrator | TASK [Wait for instance deletion to complete] ********************************** 2026-04-24 07:48:18.879136 | orchestrator | Friday 24 April 2026 07:47:49 +0000 (0:00:01.273) 0:02:07.062 ********** 2026-04-24 07:48:18.879147 | orchestrator | skipping: [localhost] 2026-04-24 07:48:18.879155 | orchestrator | 2026-04-24 07:48:18.879162 | orchestrator | TASK [Create test instances] *************************************************** 2026-04-24 07:48:18.879169 | orchestrator | Friday 24 April 2026 07:47:50 +0000 (0:00:01.288) 0:02:08.350 ********** 2026-04-24 07:48:18.879176 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-24 07:48:18.879184 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-24 07:48:18.879191 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-24 07:48:18.879197 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-24 07:48:18.879204 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-24 07:48:18.879210 | orchestrator | 2026-04-24 07:48:18.879216 | orchestrator | TASK [Wait for instance creation to complete] ********************************** 2026-04-24 07:48:18.879232 | orchestrator | Friday 24 April 2026 07:47:57 +0000 (0:00:06.139) 0:02:14.489 ********** 2026-04-24 07:48:18.879238 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (60 retries left). 2026-04-24 07:48:18.879246 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j706208557257.4182', 'results_file': '/ansible/.ansible_async/j706208557257.4182', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:48:18.879255 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j222663286048.4207', 'results_file': '/ansible/.ansible_async/j222663286048.4207', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:48:18.879261 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j27594797228.4232', 'results_file': '/ansible/.ansible_async/j27594797228.4232', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:48:18.879273 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j163113884194.4257', 'results_file': '/ansible/.ansible_async/j163113884194.4257', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:48:18.879284 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j152004191238.4282', 'results_file': '/ansible/.ansible_async/j152004191238.4282', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:48:18.879294 | orchestrator | 2026-04-24 07:48:18.879322 | orchestrator | TASK [Add metadata to instances] *********************************************** 2026-04-24 07:48:18.879332 | orchestrator | Friday 24 April 2026 07:48:13 +0000 (0:00:16.043) 0:02:30.532 ********** 2026-04-24 07:48:18.879343 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-24 07:48:18.879353 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-24 07:48:18.879364 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-24 07:48:18.879374 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-24 07:48:18.879384 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-24 07:48:18.879395 | orchestrator | 2026-04-24 07:48:18.879406 | orchestrator | TASK [Wait for metadata to be added] ******************************************* 2026-04-24 07:48:18.879424 | orchestrator | Friday 24 April 2026 07:48:18 +0000 (0:00:05.746) 0:02:36.279 ********** 2026-04-24 07:49:20.364962 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j957620671549.4360', 'results_file': '/ansible/.ansible_async/j957620671549.4360', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365078 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j244932093419.4385', 'results_file': '/ansible/.ansible_async/j244932093419.4385', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365096 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j925879817725.4410', 'results_file': '/ansible/.ansible_async/j925879817725.4410', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365109 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j474665016070.4435', 'results_file': '/ansible/.ansible_async/j474665016070.4435', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365145 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j498047309900.4460', 'results_file': '/ansible/.ansible_async/j498047309900.4460', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365158 | orchestrator | 2026-04-24 07:49:20.365171 | orchestrator | TASK [Add tag to instances] **************************************************** 2026-04-24 07:49:20.365183 | orchestrator | Friday 24 April 2026 07:48:24 +0000 (0:00:05.156) 0:02:41.435 ********** 2026-04-24 07:49:20.365194 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-24 07:49:20.365204 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-24 07:49:20.365215 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-24 07:49:20.365225 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-24 07:49:20.365236 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-24 07:49:20.365263 | orchestrator | 2026-04-24 07:49:20.365274 | orchestrator | TASK [Wait for tags to be added] *********************************************** 2026-04-24 07:49:20.365285 | orchestrator | Friday 24 April 2026 07:48:29 +0000 (0:00:05.846) 0:02:47.282 ********** 2026-04-24 07:49:20.365296 | orchestrator | FAILED - RETRYING: [localhost]: Wait for tags to be added (30 retries left). 2026-04-24 07:49:20.365319 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j201157916778.4524', 'results_file': '/ansible/.ansible_async/j201157916778.4524', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365331 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j758106446373.4549', 'results_file': '/ansible/.ansible_async/j758106446373.4549', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365357 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j772458396381.4575', 'results_file': '/ansible/.ansible_async/j772458396381.4575', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365369 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j925634155335.4601', 'results_file': '/ansible/.ansible_async/j925634155335.4601', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365381 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j720007819951.4627', 'results_file': '/ansible/.ansible_async/j720007819951.4627', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-24 07:49:20.365391 | orchestrator | 2026-04-24 07:49:20.365402 | orchestrator | TASK [Create test volume] ****************************************************** 2026-04-24 07:49:20.365413 | orchestrator | Friday 24 April 2026 07:48:41 +0000 (0:00:11.462) 0:02:58.744 ********** 2026-04-24 07:49:20.365424 | orchestrator | ok: [localhost] 2026-04-24 07:49:20.365436 | orchestrator | 2026-04-24 07:49:20.365447 | orchestrator | TASK [Attach test volume] ****************************************************** 2026-04-24 07:49:20.365480 | orchestrator | Friday 24 April 2026 07:48:46 +0000 (0:00:05.099) 0:03:03.844 ********** 2026-04-24 07:49:20.365494 | orchestrator | ok: [localhost] 2026-04-24 07:49:20.365506 | orchestrator | 2026-04-24 07:49:20.365519 | orchestrator | TASK [Create floating ip addresses] ******************************************** 2026-04-24 07:49:20.365549 | orchestrator | Friday 24 April 2026 07:48:52 +0000 (0:00:05.993) 0:03:09.837 ********** 2026-04-24 07:49:20.365563 | orchestrator | ok: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-24 07:49:20.365576 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-24 07:49:20.365597 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-24 07:49:20.365617 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-24 07:49:20.365638 | orchestrator | ok: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-24 07:49:20.365657 | orchestrator | 2026-04-24 07:49:20.365688 | orchestrator | TASK [Print floating ip addresses] ********************************************* 2026-04-24 07:49:20.365710 | orchestrator | Friday 24 April 2026 07:49:18 +0000 (0:00:26.076) 0:03:35.914 ********** 2026-04-24 07:49:20.365732 | orchestrator | ok: [localhost] => (item=test) => { 2026-04-24 07:49:20.365753 | orchestrator |  "msg": "test: 192.168.112.152" 2026-04-24 07:49:20.365773 | orchestrator | } 2026-04-24 07:49:20.365793 | orchestrator | ok: [localhost] => (item=test-1) => { 2026-04-24 07:49:20.365811 | orchestrator |  "msg": "test-1: 192.168.112.157" 2026-04-24 07:49:20.365832 | orchestrator | } 2026-04-24 07:49:20.365853 | orchestrator | ok: [localhost] => (item=test-2) => { 2026-04-24 07:49:20.365873 | orchestrator |  "msg": "test-2: 192.168.112.198" 2026-04-24 07:49:20.365893 | orchestrator | } 2026-04-24 07:49:20.365905 | orchestrator | ok: [localhost] => (item=test-3) => { 2026-04-24 07:49:20.365917 | orchestrator |  "msg": "test-3: 192.168.112.156" 2026-04-24 07:49:20.365936 | orchestrator | } 2026-04-24 07:49:20.365952 | orchestrator | ok: [localhost] => (item=test-4) => { 2026-04-24 07:49:20.365968 | orchestrator |  "msg": "test-4: 192.168.112.154" 2026-04-24 07:49:20.365984 | orchestrator | } 2026-04-24 07:49:20.366000 | orchestrator | 2026-04-24 07:49:20.366096 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-24 07:49:20.366119 | orchestrator | localhost : ok=26  changed=8  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-24 07:49:20.366139 | orchestrator | 2026-04-24 07:49:20.366158 | orchestrator | 2026-04-24 07:49:20.366176 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-24 07:49:20.366195 | orchestrator | Friday 24 April 2026 07:49:20 +0000 (0:00:01.577) 0:03:37.491 ********** 2026-04-24 07:49:20.366215 | orchestrator | =============================================================================== 2026-04-24 07:49:20.366234 | orchestrator | Create floating ip addresses ------------------------------------------- 26.08s 2026-04-24 07:49:20.366254 | orchestrator | Wait for instance creation to complete --------------------------------- 16.04s 2026-04-24 07:49:20.366273 | orchestrator | Create test routers ---------------------------------------------------- 14.45s 2026-04-24 07:49:20.366290 | orchestrator | Add member roles to user test ------------------------------------------ 13.65s 2026-04-24 07:49:20.366310 | orchestrator | Create test subnets ---------------------------------------------------- 12.95s 2026-04-24 07:49:20.366328 | orchestrator | Create test networks --------------------------------------------------- 12.88s 2026-04-24 07:49:20.366346 | orchestrator | Wait for tags to be added ---------------------------------------------- 11.46s 2026-04-24 07:49:20.366362 | orchestrator | Add manager role to user test-admin ------------------------------------- 9.74s 2026-04-24 07:49:20.366378 | orchestrator | Create test domain ------------------------------------------------------ 6.40s 2026-04-24 07:49:20.366396 | orchestrator | Create test instances --------------------------------------------------- 6.14s 2026-04-24 07:49:20.366416 | orchestrator | Attach test volume ------------------------------------------------------ 5.99s 2026-04-24 07:49:20.366435 | orchestrator | Add tag to instances ---------------------------------------------------- 5.85s 2026-04-24 07:49:20.366483 | orchestrator | Add metadata to instances ----------------------------------------------- 5.75s 2026-04-24 07:49:20.366504 | orchestrator | Create test server group ------------------------------------------------ 5.73s 2026-04-24 07:49:20.366523 | orchestrator | Create test project ----------------------------------------------------- 5.35s 2026-04-24 07:49:20.366540 | orchestrator | Add rule to ssh security group ------------------------------------------ 5.28s 2026-04-24 07:49:20.366559 | orchestrator | Create ssh security group ----------------------------------------------- 5.27s 2026-04-24 07:49:20.366607 | orchestrator | Create test user -------------------------------------------------------- 5.24s 2026-04-24 07:49:20.366626 | orchestrator | Get test server group --------------------------------------------------- 5.23s 2026-04-24 07:49:20.366644 | orchestrator | Create test-admin user -------------------------------------------------- 5.21s 2026-04-24 07:49:20.601598 | orchestrator | + server_list 2026-04-24 07:49:20.601693 | orchestrator | + openstack --os-cloud test server list 2026-04-24 07:49:24.362966 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-24 07:49:24.363101 | orchestrator | | ID | Name | Status | Networks | Image | Flavor | 2026-04-24 07:49:24.363118 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-24 07:49:24.363129 | orchestrator | | 5f4a659a-edce-4cff-8b45-0bde33698973 | test-4 | ACTIVE | test-3=192.168.112.154, 192.168.202.91 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 07:49:24.363140 | orchestrator | | d45cb391-5e9b-414f-9591-6f9d670b0318 | test-3 | ACTIVE | test-2=192.168.112.156, 192.168.201.248 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 07:49:24.363151 | orchestrator | | 05f2fb8d-6493-4264-8f4b-8434c880e215 | test-1 | ACTIVE | test-1=192.168.112.157, 192.168.200.14 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 07:49:24.363162 | orchestrator | | 17ef2d07-a4bf-4690-bcd8-6db22c8534fa | test-2 | ACTIVE | test-2=192.168.112.198, 192.168.201.20 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 07:49:24.363173 | orchestrator | | 5c172fc5-b958-4855-b1a9-5c8d349ff15d | test | ACTIVE | test-1=192.168.112.152, 192.168.200.229 | N/A (booted from volume) | SCS-1L-1 | 2026-04-24 07:49:24.363184 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-24 07:49:24.669680 | orchestrator | + openstack --os-cloud test server show test 2026-04-24 07:49:28.160531 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:28.160654 | orchestrator | | Field | Value | 2026-04-24 07:49:28.160672 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:28.160684 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 07:49:28.160697 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 07:49:28.160728 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 07:49:28.160746 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test | 2026-04-24 07:49:28.160758 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 07:49:28.160769 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 07:49:28.160796 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 07:49:28.160808 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 07:49:28.160819 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 07:49:28.160831 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 07:49:28.160842 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 07:49:28.160861 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 07:49:28.160876 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 07:49:28.160888 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 07:49:28.160899 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 07:49:28.160910 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:23.000000 | 2026-04-24 07:49:28.160927 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 07:49:28.160939 | orchestrator | | accessIPv4 | | 2026-04-24 07:49:28.160950 | orchestrator | | accessIPv6 | | 2026-04-24 07:49:28.160961 | orchestrator | | addresses | test-1=192.168.112.152, 192.168.200.229 | 2026-04-24 07:49:28.160972 | orchestrator | | config_drive | | 2026-04-24 07:49:28.160989 | orchestrator | | created | 2026-04-24T04:13:56Z | 2026-04-24 07:49:28.161001 | orchestrator | | description | None | 2026-04-24 07:49:28.161012 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 07:49:28.161025 | orchestrator | | hostId | 9d84bece4141ce992672cd49578e0103207c410225513520729b6d9a | 2026-04-24 07:49:28.161038 | orchestrator | | host_status | None | 2026-04-24 07:49:28.161058 | orchestrator | | id | 5c172fc5-b958-4855-b1a9-5c8d349ff15d | 2026-04-24 07:49:28.161071 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 07:49:28.161085 | orchestrator | | key_name | test | 2026-04-24 07:49:28.161097 | orchestrator | | locked | False | 2026-04-24 07:49:28.161116 | orchestrator | | locked_reason | None | 2026-04-24 07:49:28.161554 | orchestrator | | name | test | 2026-04-24 07:49:28.161582 | orchestrator | | pinned_availability_zone | None | 2026-04-24 07:49:28.161594 | orchestrator | | progress | 0 | 2026-04-24 07:49:28.161605 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 07:49:28.161616 | orchestrator | | properties | hostname='test' | 2026-04-24 07:49:28.161638 | orchestrator | | security_groups | name='icmp' | 2026-04-24 07:49:28.161650 | orchestrator | | | name='ssh' | 2026-04-24 07:49:28.161661 | orchestrator | | server_groups | None | 2026-04-24 07:49:28.161686 | orchestrator | | status | ACTIVE | 2026-04-24 07:49:28.161698 | orchestrator | | tags | test | 2026-04-24 07:49:28.161709 | orchestrator | | trusted_image_certificates | None | 2026-04-24 07:49:28.161720 | orchestrator | | updated | 2026-04-24T07:48:19Z | 2026-04-24 07:49:28.161731 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 07:49:28.161742 | orchestrator | | volumes_attached | delete_on_termination='True', id='b218890f-74d1-46ff-89e1-1c386f3099a3' | 2026-04-24 07:49:28.161753 | orchestrator | | | delete_on_termination='False', id='cf485be9-0353-4c39-bf82-19de5539869c' | 2026-04-24 07:49:28.163559 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:28.451321 | orchestrator | + openstack --os-cloud test server show test-1 2026-04-24 07:49:31.453327 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:31.453538 | orchestrator | | Field | Value | 2026-04-24 07:49:31.453596 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:31.453620 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 07:49:31.453632 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 07:49:31.453645 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 07:49:31.453657 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-1 | 2026-04-24 07:49:31.453668 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 07:49:31.453679 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 07:49:31.453727 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 07:49:31.453761 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 07:49:31.453773 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 07:49:31.453790 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 07:49:31.453801 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 07:49:31.453812 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 07:49:31.453823 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 07:49:31.453835 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 07:49:31.453846 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 07:49:31.453858 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:22.000000 | 2026-04-24 07:49:31.453878 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 07:49:31.453899 | orchestrator | | accessIPv4 | | 2026-04-24 07:49:31.453912 | orchestrator | | accessIPv6 | | 2026-04-24 07:49:31.453930 | orchestrator | | addresses | test-1=192.168.112.157, 192.168.200.14 | 2026-04-24 07:49:31.453943 | orchestrator | | config_drive | | 2026-04-24 07:49:31.453956 | orchestrator | | created | 2026-04-24T04:13:57Z | 2026-04-24 07:49:31.453969 | orchestrator | | description | None | 2026-04-24 07:49:31.453981 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 07:49:31.453994 | orchestrator | | hostId | 9d84bece4141ce992672cd49578e0103207c410225513520729b6d9a | 2026-04-24 07:49:31.454007 | orchestrator | | host_status | None | 2026-04-24 07:49:31.454098 | orchestrator | | id | 05f2fb8d-6493-4264-8f4b-8434c880e215 | 2026-04-24 07:49:31.454113 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 07:49:31.454126 | orchestrator | | key_name | test | 2026-04-24 07:49:31.454144 | orchestrator | | locked | False | 2026-04-24 07:49:31.454158 | orchestrator | | locked_reason | None | 2026-04-24 07:49:31.454171 | orchestrator | | name | test-1 | 2026-04-24 07:49:31.454184 | orchestrator | | pinned_availability_zone | None | 2026-04-24 07:49:31.454197 | orchestrator | | progress | 0 | 2026-04-24 07:49:31.454210 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 07:49:31.454229 | orchestrator | | properties | hostname='test-1' | 2026-04-24 07:49:31.454248 | orchestrator | | security_groups | name='icmp' | 2026-04-24 07:49:31.454260 | orchestrator | | | name='ssh' | 2026-04-24 07:49:31.454271 | orchestrator | | server_groups | None | 2026-04-24 07:49:31.454287 | orchestrator | | status | ACTIVE | 2026-04-24 07:49:31.454298 | orchestrator | | tags | test | 2026-04-24 07:49:31.454309 | orchestrator | | trusted_image_certificates | None | 2026-04-24 07:49:31.454321 | orchestrator | | updated | 2026-04-24T07:48:19Z | 2026-04-24 07:49:31.454332 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 07:49:31.454349 | orchestrator | | volumes_attached | delete_on_termination='True', id='e7a6f4bc-a41e-4ffe-a7e1-926bdf5d11ff' | 2026-04-24 07:49:31.457432 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:31.748595 | orchestrator | + openstack --os-cloud test server show test-2 2026-04-24 07:49:34.603362 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:34.603510 | orchestrator | | Field | Value | 2026-04-24 07:49:34.603532 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:34.603546 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 07:49:34.603559 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 07:49:34.603570 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 07:49:34.603581 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-2 | 2026-04-24 07:49:34.603619 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 07:49:34.603741 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 07:49:34.603801 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 07:49:34.603823 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 07:49:34.603842 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 07:49:34.603872 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 07:49:34.603892 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 07:49:34.603914 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 07:49:34.603931 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 07:49:34.603945 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 07:49:34.603971 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 07:49:34.603984 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:23.000000 | 2026-04-24 07:49:34.604006 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 07:49:34.604019 | orchestrator | | accessIPv4 | | 2026-04-24 07:49:34.604050 | orchestrator | | accessIPv6 | | 2026-04-24 07:49:34.604079 | orchestrator | | addresses | test-2=192.168.112.198, 192.168.201.20 | 2026-04-24 07:49:34.604092 | orchestrator | | config_drive | | 2026-04-24 07:49:34.604105 | orchestrator | | created | 2026-04-24T04:13:57Z | 2026-04-24 07:49:34.604117 | orchestrator | | description | None | 2026-04-24 07:49:34.604137 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 07:49:34.604151 | orchestrator | | hostId | 9d84bece4141ce992672cd49578e0103207c410225513520729b6d9a | 2026-04-24 07:49:34.604164 | orchestrator | | host_status | None | 2026-04-24 07:49:34.604185 | orchestrator | | id | 17ef2d07-a4bf-4690-bcd8-6db22c8534fa | 2026-04-24 07:49:34.604198 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 07:49:34.604211 | orchestrator | | key_name | test | 2026-04-24 07:49:34.604229 | orchestrator | | locked | False | 2026-04-24 07:49:34.604242 | orchestrator | | locked_reason | None | 2026-04-24 07:49:34.604256 | orchestrator | | name | test-2 | 2026-04-24 07:49:34.604276 | orchestrator | | pinned_availability_zone | None | 2026-04-24 07:49:34.604287 | orchestrator | | progress | 0 | 2026-04-24 07:49:34.604298 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 07:49:34.604309 | orchestrator | | properties | hostname='test-2' | 2026-04-24 07:49:34.604328 | orchestrator | | security_groups | name='icmp' | 2026-04-24 07:49:34.604340 | orchestrator | | | name='ssh' | 2026-04-24 07:49:34.604351 | orchestrator | | server_groups | None | 2026-04-24 07:49:34.604367 | orchestrator | | status | ACTIVE | 2026-04-24 07:49:34.604378 | orchestrator | | tags | test | 2026-04-24 07:49:34.604399 | orchestrator | | trusted_image_certificates | None | 2026-04-24 07:49:34.604419 | orchestrator | | updated | 2026-04-24T07:48:20Z | 2026-04-24 07:49:34.604450 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 07:49:34.604496 | orchestrator | | volumes_attached | delete_on_termination='True', id='ce502b5a-e4f3-4883-a517-4add09db06b8' | 2026-04-24 07:49:34.608831 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:34.877786 | orchestrator | + openstack --os-cloud test server show test-3 2026-04-24 07:49:37.875604 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:37.875711 | orchestrator | | Field | Value | 2026-04-24 07:49:37.875729 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:37.875758 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 07:49:37.875792 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 07:49:37.875803 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 07:49:37.875815 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-3 | 2026-04-24 07:49:37.875826 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 07:49:37.875837 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 07:49:37.875867 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 07:49:37.875879 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 07:49:37.875890 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 07:49:37.875927 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 07:49:37.875944 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 07:49:37.875963 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 07:49:37.875974 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 07:49:37.875985 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 07:49:37.875996 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 07:49:37.876007 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:25.000000 | 2026-04-24 07:49:37.876026 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 07:49:37.876037 | orchestrator | | accessIPv4 | | 2026-04-24 07:49:37.876049 | orchestrator | | accessIPv6 | | 2026-04-24 07:49:37.876061 | orchestrator | | addresses | test-2=192.168.112.156, 192.168.201.248 | 2026-04-24 07:49:37.876090 | orchestrator | | config_drive | | 2026-04-24 07:49:37.876103 | orchestrator | | created | 2026-04-24T04:13:58Z | 2026-04-24 07:49:37.876117 | orchestrator | | description | None | 2026-04-24 07:49:37.876130 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 07:49:37.876144 | orchestrator | | hostId | 9d84bece4141ce992672cd49578e0103207c410225513520729b6d9a | 2026-04-24 07:49:37.876157 | orchestrator | | host_status | None | 2026-04-24 07:49:37.876177 | orchestrator | | id | d45cb391-5e9b-414f-9591-6f9d670b0318 | 2026-04-24 07:49:37.876191 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 07:49:37.876204 | orchestrator | | key_name | test | 2026-04-24 07:49:37.876222 | orchestrator | | locked | False | 2026-04-24 07:49:37.876236 | orchestrator | | locked_reason | None | 2026-04-24 07:49:37.876248 | orchestrator | | name | test-3 | 2026-04-24 07:49:37.876261 | orchestrator | | pinned_availability_zone | None | 2026-04-24 07:49:37.876273 | orchestrator | | progress | 0 | 2026-04-24 07:49:37.876286 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 07:49:37.876298 | orchestrator | | properties | hostname='test-3' | 2026-04-24 07:49:37.876319 | orchestrator | | security_groups | name='icmp' | 2026-04-24 07:49:37.876404 | orchestrator | | | name='ssh' | 2026-04-24 07:49:37.876428 | orchestrator | | server_groups | None | 2026-04-24 07:49:37.876515 | orchestrator | | status | ACTIVE | 2026-04-24 07:49:37.876533 | orchestrator | | tags | test | 2026-04-24 07:49:37.876544 | orchestrator | | trusted_image_certificates | None | 2026-04-24 07:49:37.876555 | orchestrator | | updated | 2026-04-24T07:48:21Z | 2026-04-24 07:49:37.876566 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 07:49:37.876577 | orchestrator | | volumes_attached | delete_on_termination='True', id='c41e9875-88d3-4a1a-b9b6-b4d9adb0d129' | 2026-04-24 07:49:37.879548 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:38.153460 | orchestrator | + openstack --os-cloud test server show test-4 2026-04-24 07:49:41.177148 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:41.177247 | orchestrator | | Field | Value | 2026-04-24 07:49:41.177261 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:41.177283 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-24 07:49:41.177294 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-24 07:49:41.177302 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-24 07:49:41.177309 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-4 | 2026-04-24 07:49:41.177314 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-24 07:49:41.177319 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-24 07:49:41.177336 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-24 07:49:41.177341 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-24 07:49:41.177352 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-24 07:49:41.177356 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-24 07:49:41.177365 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-24 07:49:41.177369 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-24 07:49:41.177374 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-24 07:49:41.177379 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-24 07:49:41.177384 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-24 07:49:41.177389 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-24T04:14:25.000000 | 2026-04-24 07:49:41.177397 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-24 07:49:41.177406 | orchestrator | | accessIPv4 | | 2026-04-24 07:49:41.177411 | orchestrator | | accessIPv6 | | 2026-04-24 07:49:41.177415 | orchestrator | | addresses | test-3=192.168.112.154, 192.168.202.91 | 2026-04-24 07:49:41.177424 | orchestrator | | config_drive | | 2026-04-24 07:49:41.177429 | orchestrator | | created | 2026-04-24T04:14:00Z | 2026-04-24 07:49:41.177434 | orchestrator | | description | None | 2026-04-24 07:49:41.177438 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-24 07:49:41.177443 | orchestrator | | hostId | cd5597e5a70304b7bed36fc408e8e25c4b6519cec084a045b6f99dd7 | 2026-04-24 07:49:41.177448 | orchestrator | | host_status | None | 2026-04-24 07:49:41.177461 | orchestrator | | id | 5f4a659a-edce-4cff-8b45-0bde33698973 | 2026-04-24 07:49:41.177466 | orchestrator | | image | N/A (booted from volume) | 2026-04-24 07:49:41.177471 | orchestrator | | key_name | test | 2026-04-24 07:49:41.177475 | orchestrator | | locked | False | 2026-04-24 07:49:41.177528 | orchestrator | | locked_reason | None | 2026-04-24 07:49:41.177538 | orchestrator | | name | test-4 | 2026-04-24 07:49:41.177546 | orchestrator | | pinned_availability_zone | None | 2026-04-24 07:49:41.177553 | orchestrator | | progress | 0 | 2026-04-24 07:49:41.177562 | orchestrator | | project_id | 59ff1a98b82c47c8b9e2e67db95e64c3 | 2026-04-24 07:49:41.177572 | orchestrator | | properties | hostname='test-4' | 2026-04-24 07:49:41.177582 | orchestrator | | security_groups | name='icmp' | 2026-04-24 07:49:41.177587 | orchestrator | | | name='ssh' | 2026-04-24 07:49:41.177591 | orchestrator | | server_groups | None | 2026-04-24 07:49:41.177596 | orchestrator | | status | ACTIVE | 2026-04-24 07:49:41.177604 | orchestrator | | tags | test | 2026-04-24 07:49:41.177608 | orchestrator | | trusted_image_certificates | None | 2026-04-24 07:49:41.177613 | orchestrator | | updated | 2026-04-24T07:48:22Z | 2026-04-24 07:49:41.177618 | orchestrator | | user_id | 6e4d6ace0cad4ecdae868b45e20d5704 | 2026-04-24 07:49:41.177623 | orchestrator | | volumes_attached | delete_on_termination='True', id='c21374b5-887b-4330-b43a-96a0e89796a0' | 2026-04-24 07:49:41.181328 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-24 07:49:41.463274 | orchestrator | + server_ping 2026-04-24 07:49:41.465321 | orchestrator | ++ openstack --os-cloud test floating ip list --status ACTIVE -f value -c 'Floating IP Address' 2026-04-24 07:49:41.465369 | orchestrator | ++ tr -d '\r' 2026-04-24 07:49:44.298745 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 07:49:44.298869 | orchestrator | + ping -c3 192.168.112.198 2026-04-24 07:49:44.314740 | orchestrator | PING 192.168.112.198 (192.168.112.198) 56(84) bytes of data. 2026-04-24 07:49:44.314830 | orchestrator | 64 bytes from 192.168.112.198: icmp_seq=1 ttl=63 time=9.74 ms 2026-04-24 07:49:45.309393 | orchestrator | 64 bytes from 192.168.112.198: icmp_seq=2 ttl=63 time=2.28 ms 2026-04-24 07:49:46.310481 | orchestrator | 64 bytes from 192.168.112.198: icmp_seq=3 ttl=63 time=1.82 ms 2026-04-24 07:49:46.310681 | orchestrator | 2026-04-24 07:49:46.310710 | orchestrator | --- 192.168.112.198 ping statistics --- 2026-04-24 07:49:46.310732 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-24 07:49:46.310751 | orchestrator | rtt min/avg/max/mdev = 1.817/4.612/9.739/3.630 ms 2026-04-24 07:49:46.311204 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 07:49:46.311244 | orchestrator | + ping -c3 192.168.112.152 2026-04-24 07:49:46.326660 | orchestrator | PING 192.168.112.152 (192.168.112.152) 56(84) bytes of data. 2026-04-24 07:49:46.326739 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=1 ttl=63 time=10.5 ms 2026-04-24 07:49:47.320844 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=2 ttl=63 time=2.72 ms 2026-04-24 07:49:48.322583 | orchestrator | 64 bytes from 192.168.112.152: icmp_seq=3 ttl=63 time=1.82 ms 2026-04-24 07:49:48.322662 | orchestrator | 2026-04-24 07:49:48.322670 | orchestrator | --- 192.168.112.152 ping statistics --- 2026-04-24 07:49:48.322675 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-24 07:49:48.322679 | orchestrator | rtt min/avg/max/mdev = 1.815/5.003/10.475/3.886 ms 2026-04-24 07:49:48.322854 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 07:49:48.322864 | orchestrator | + ping -c3 192.168.112.154 2026-04-24 07:49:48.337083 | orchestrator | PING 192.168.112.154 (192.168.112.154) 56(84) bytes of data. 2026-04-24 07:49:48.337146 | orchestrator | 64 bytes from 192.168.112.154: icmp_seq=1 ttl=63 time=9.65 ms 2026-04-24 07:49:49.332735 | orchestrator | 64 bytes from 192.168.112.154: icmp_seq=2 ttl=63 time=4.00 ms 2026-04-24 07:49:50.331489 | orchestrator | 64 bytes from 192.168.112.154: icmp_seq=3 ttl=63 time=1.76 ms 2026-04-24 07:49:50.331736 | orchestrator | 2026-04-24 07:49:50.331756 | orchestrator | --- 192.168.112.154 ping statistics --- 2026-04-24 07:49:50.331768 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2002ms 2026-04-24 07:49:50.331797 | orchestrator | rtt min/avg/max/mdev = 1.759/5.135/9.651/3.321 ms 2026-04-24 07:49:50.331808 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 07:49:50.332448 | orchestrator | + ping -c3 192.168.112.157 2026-04-24 07:49:50.343344 | orchestrator | PING 192.168.112.157 (192.168.112.157) 56(84) bytes of data. 2026-04-24 07:49:50.343440 | orchestrator | 64 bytes from 192.168.112.157: icmp_seq=1 ttl=63 time=7.42 ms 2026-04-24 07:49:51.340599 | orchestrator | 64 bytes from 192.168.112.157: icmp_seq=2 ttl=63 time=2.54 ms 2026-04-24 07:49:52.341199 | orchestrator | 64 bytes from 192.168.112.157: icmp_seq=3 ttl=63 time=1.84 ms 2026-04-24 07:49:52.341299 | orchestrator | 2026-04-24 07:49:52.341308 | orchestrator | --- 192.168.112.157 ping statistics --- 2026-04-24 07:49:52.341315 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-24 07:49:52.341321 | orchestrator | rtt min/avg/max/mdev = 1.841/3.933/7.424/2.484 ms 2026-04-24 07:49:52.341328 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-24 07:49:52.341334 | orchestrator | + ping -c3 192.168.112.156 2026-04-24 07:49:52.352192 | orchestrator | PING 192.168.112.156 (192.168.112.156) 56(84) bytes of data. 2026-04-24 07:49:52.352316 | orchestrator | 64 bytes from 192.168.112.156: icmp_seq=1 ttl=63 time=7.18 ms 2026-04-24 07:49:53.349348 | orchestrator | 64 bytes from 192.168.112.156: icmp_seq=2 ttl=63 time=2.54 ms 2026-04-24 07:49:54.350404 | orchestrator | 64 bytes from 192.168.112.156: icmp_seq=3 ttl=63 time=1.70 ms 2026-04-24 07:49:54.350547 | orchestrator | 2026-04-24 07:49:54.350563 | orchestrator | --- 192.168.112.156 ping statistics --- 2026-04-24 07:49:54.350575 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-24 07:49:54.350587 | orchestrator | rtt min/avg/max/mdev = 1.704/3.808/7.184/2.410 ms 2026-04-24 07:49:54.351371 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-24 07:49:54.645484 | orchestrator | ok: Runtime: 0:09:29.315082 2026-04-24 07:49:54.691497 | 2026-04-24 07:49:54.691644 | PLAY RECAP 2026-04-24 07:49:54.691730 | orchestrator | ok: 32 changed: 13 unreachable: 0 failed: 0 skipped: 7 rescued: 0 ignored: 0 2026-04-24 07:49:54.691769 | 2026-04-24 07:49:54.978324 | RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/upgrade-stable.yml@main] 2026-04-24 07:49:54.982310 | POST-RUN START: [untrusted : github.com/osism/testbed/playbooks/post.yml@main] 2026-04-24 07:49:55.751588 | 2026-04-24 07:49:55.751775 | PLAY [Post output play] 2026-04-24 07:49:55.770353 | 2026-04-24 07:49:55.770528 | LOOP [stage-output : Register sources] 2026-04-24 07:49:55.843456 | 2026-04-24 07:49:55.843843 | TASK [stage-output : Check sudo] 2026-04-24 07:49:56.720426 | orchestrator | sudo: a password is required 2026-04-24 07:49:56.887248 | orchestrator | ok: Runtime: 0:00:00.016162 2026-04-24 07:49:56.902585 | 2026-04-24 07:49:56.902752 | LOOP [stage-output : Set source and destination for files and folders] 2026-04-24 07:49:56.953861 | 2026-04-24 07:49:56.954145 | TASK [stage-output : Build a list of source, dest dictionaries] 2026-04-24 07:49:57.022754 | orchestrator | ok 2026-04-24 07:49:57.031679 | 2026-04-24 07:49:57.031841 | LOOP [stage-output : Ensure target folders exist] 2026-04-24 07:49:57.508355 | orchestrator | ok: "docs" 2026-04-24 07:49:57.508884 | 2026-04-24 07:49:57.786006 | orchestrator | ok: "artifacts" 2026-04-24 07:49:58.045281 | orchestrator | ok: "logs" 2026-04-24 07:49:58.061654 | 2026-04-24 07:49:58.061843 | LOOP [stage-output : Copy files and folders to staging folder] 2026-04-24 07:49:58.096983 | 2026-04-24 07:49:58.097251 | TASK [stage-output : Make all log files readable] 2026-04-24 07:49:58.390134 | orchestrator | ok 2026-04-24 07:49:58.396441 | 2026-04-24 07:49:58.396618 | TASK [stage-output : Rename log files that match extensions_to_txt] 2026-04-24 07:49:58.420350 | orchestrator | skipping: Conditional result was False 2026-04-24 07:49:58.428041 | 2026-04-24 07:49:58.428154 | TASK [stage-output : Discover log files for compression] 2026-04-24 07:49:58.451642 | orchestrator | skipping: Conditional result was False 2026-04-24 07:49:58.458587 | 2026-04-24 07:49:58.458695 | LOOP [stage-output : Archive everything from logs] 2026-04-24 07:49:58.493877 | 2026-04-24 07:49:58.494024 | PLAY [Post cleanup play] 2026-04-24 07:49:58.501870 | 2026-04-24 07:49:58.501976 | TASK [Set cloud fact (Zuul deployment)] 2026-04-24 07:49:58.559042 | orchestrator | ok 2026-04-24 07:49:58.569995 | 2026-04-24 07:49:58.570128 | TASK [Set cloud fact (local deployment)] 2026-04-24 07:49:58.594670 | orchestrator | skipping: Conditional result was False 2026-04-24 07:49:58.602280 | 2026-04-24 07:49:58.602384 | TASK [Clean the cloud environment] 2026-04-24 07:49:59.207399 | orchestrator | 2026-04-24 07:49:59 - clean up servers 2026-04-24 07:49:59.951464 | orchestrator | 2026-04-24 07:49:59 - testbed-manager 2026-04-24 07:50:00.037549 | orchestrator | 2026-04-24 07:50:00 - testbed-node-4 2026-04-24 07:50:00.134288 | orchestrator | 2026-04-24 07:50:00 - testbed-node-5 2026-04-24 07:50:00.226647 | orchestrator | 2026-04-24 07:50:00 - testbed-node-0 2026-04-24 07:50:00.319604 | orchestrator | 2026-04-24 07:50:00 - testbed-node-1 2026-04-24 07:50:00.411564 | orchestrator | 2026-04-24 07:50:00 - testbed-node-2 2026-04-24 07:50:00.492978 | orchestrator | 2026-04-24 07:50:00 - testbed-node-3 2026-04-24 07:50:00.586671 | orchestrator | 2026-04-24 07:50:00 - clean up keypairs 2026-04-24 07:50:00.603599 | orchestrator | 2026-04-24 07:50:00 - testbed 2026-04-24 07:50:00.628867 | orchestrator | 2026-04-24 07:50:00 - wait for servers to be gone 2026-04-24 07:50:09.651126 | orchestrator | 2026-04-24 07:50:09 - clean up ports 2026-04-24 07:50:09.882657 | orchestrator | 2026-04-24 07:50:09 - 1a004b2a-5d55-401d-bf1d-eef45024d8b4 2026-04-24 07:50:10.147126 | orchestrator | 2026-04-24 07:50:10 - 639f2fea-06f4-4057-bda4-696e567fd778 2026-04-24 07:50:10.624705 | orchestrator | 2026-04-24 07:50:10 - 7eaf8618-9607-4e80-b84c-b3fcbdaf4e67 2026-04-24 07:50:10.847374 | orchestrator | 2026-04-24 07:50:10 - 8921d982-7de3-4524-bdef-68e1f9dcff0c 2026-04-24 07:50:11.063660 | orchestrator | 2026-04-24 07:50:11 - ac95dbee-5a18-48d2-977b-2de524c0948d 2026-04-24 07:50:11.374661 | orchestrator | 2026-04-24 07:50:11 - b0e6edce-05a6-429c-a73f-ee02bd5cc852 2026-04-24 07:50:11.594986 | orchestrator | 2026-04-24 07:50:11 - bc479451-32bf-4741-8d9a-ad356eba78c9 2026-04-24 07:50:11.887513 | orchestrator | 2026-04-24 07:50:11 - clean up volumes 2026-04-24 07:50:12.011847 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-2-node-base 2026-04-24 07:50:12.052463 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-4-node-base 2026-04-24 07:50:12.098151 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-0-node-base 2026-04-24 07:50:12.142064 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-5-node-base 2026-04-24 07:50:12.185480 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-3-node-base 2026-04-24 07:50:12.233317 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-manager-base 2026-04-24 07:50:12.281094 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-7-node-4 2026-04-24 07:50:12.324766 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-1-node-4 2026-04-24 07:50:12.368270 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-3-node-3 2026-04-24 07:50:12.408425 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-6-node-3 2026-04-24 07:50:12.445875 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-1-node-base 2026-04-24 07:50:12.490351 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-5-node-5 2026-04-24 07:50:12.536614 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-2-node-5 2026-04-24 07:50:12.578329 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-4-node-4 2026-04-24 07:50:12.620346 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-0-node-3 2026-04-24 07:50:12.667313 | orchestrator | 2026-04-24 07:50:12 - testbed-volume-8-node-5 2026-04-24 07:50:12.708936 | orchestrator | 2026-04-24 07:50:12 - disconnect routers 2026-04-24 07:50:12.826358 | orchestrator | 2026-04-24 07:50:12 - testbed 2026-04-24 07:50:14.432172 | orchestrator | 2026-04-24 07:50:14 - clean up subnets 2026-04-24 07:50:14.480671 | orchestrator | 2026-04-24 07:50:14 - subnet-testbed-management 2026-04-24 07:50:14.663684 | orchestrator | 2026-04-24 07:50:14 - clean up networks 2026-04-24 07:50:14.848330 | orchestrator | 2026-04-24 07:50:14 - net-testbed-management 2026-04-24 07:50:15.134238 | orchestrator | 2026-04-24 07:50:15 - clean up security groups 2026-04-24 07:50:15.179029 | orchestrator | 2026-04-24 07:50:15 - testbed-node 2026-04-24 07:50:15.305741 | orchestrator | 2026-04-24 07:50:15 - testbed-management 2026-04-24 07:50:15.424281 | orchestrator | 2026-04-24 07:50:15 - clean up floating ips 2026-04-24 07:50:15.459442 | orchestrator | 2026-04-24 07:50:15 - 81.163.193.218 2026-04-24 07:50:15.835757 | orchestrator | 2026-04-24 07:50:15 - clean up routers 2026-04-24 07:50:15.895834 | orchestrator | 2026-04-24 07:50:15 - testbed 2026-04-24 07:50:17.157249 | orchestrator | ok: Runtime: 0:00:17.848330 2026-04-24 07:50:17.162310 | 2026-04-24 07:50:17.162500 | PLAY RECAP 2026-04-24 07:50:17.162642 | orchestrator | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 7 rescued: 0 ignored: 0 2026-04-24 07:50:17.162716 | 2026-04-24 07:50:17.303859 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/post.yml@main] 2026-04-24 07:50:17.306294 | POST-RUN START: [untrusted : github.com/osism/testbed/playbooks/cleanup.yml@main] 2026-04-24 07:50:18.096677 | 2026-04-24 07:50:18.096860 | PLAY [Cleanup play] 2026-04-24 07:50:18.113108 | 2026-04-24 07:50:18.113249 | TASK [Set cloud fact (Zuul deployment)] 2026-04-24 07:50:18.165731 | orchestrator | ok 2026-04-24 07:50:18.173407 | 2026-04-24 07:50:18.173538 | TASK [Set cloud fact (local deployment)] 2026-04-24 07:50:18.197325 | orchestrator | skipping: Conditional result was False 2026-04-24 07:50:18.206352 | 2026-04-24 07:50:18.206463 | TASK [Clean the cloud environment] 2026-04-24 07:50:19.381849 | orchestrator | 2026-04-24 07:50:19 - clean up servers 2026-04-24 07:50:19.914476 | orchestrator | 2026-04-24 07:50:19 - clean up keypairs 2026-04-24 07:50:19.932195 | orchestrator | 2026-04-24 07:50:19 - wait for servers to be gone 2026-04-24 07:50:19.973479 | orchestrator | 2026-04-24 07:50:19 - clean up ports 2026-04-24 07:50:20.055998 | orchestrator | 2026-04-24 07:50:20 - clean up volumes 2026-04-24 07:50:20.133925 | orchestrator | 2026-04-24 07:50:20 - disconnect routers 2026-04-24 07:50:20.166834 | orchestrator | 2026-04-24 07:50:20 - clean up subnets 2026-04-24 07:50:20.191851 | orchestrator | 2026-04-24 07:50:20 - clean up networks 2026-04-24 07:50:20.356977 | orchestrator | 2026-04-24 07:50:20 - clean up security groups 2026-04-24 07:50:20.393726 | orchestrator | 2026-04-24 07:50:20 - clean up floating ips 2026-04-24 07:50:20.421870 | orchestrator | 2026-04-24 07:50:20 - clean up routers 2026-04-24 07:50:20.745365 | orchestrator | ok: Runtime: 0:00:01.461983 2026-04-24 07:50:20.748848 | 2026-04-24 07:50:20.749002 | PLAY RECAP 2026-04-24 07:50:20.749125 | orchestrator | ok: 2 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-24 07:50:20.749187 | 2026-04-24 07:50:20.886231 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/cleanup.yml@main] 2026-04-24 07:50:20.889291 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-04-24 07:50:21.718903 | 2026-04-24 07:50:21.719093 | PLAY [Base post-fetch] 2026-04-24 07:50:21.736365 | 2026-04-24 07:50:21.736533 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-24 07:50:21.803554 | orchestrator | skipping: Conditional result was False 2026-04-24 07:50:21.821072 | 2026-04-24 07:50:21.821376 | TASK [fetch-output : Set log path for single node] 2026-04-24 07:50:21.872580 | orchestrator | ok 2026-04-24 07:50:21.881803 | 2026-04-24 07:50:21.881984 | LOOP [fetch-output : Ensure local output dirs] 2026-04-24 07:50:22.380588 | orchestrator -> localhost | ok: "/var/lib/zuul/builds/c7092bc154f64b45bd6781508d54d3bb/work/logs" 2026-04-24 07:50:22.693206 | orchestrator -> localhost | changed: "/var/lib/zuul/builds/c7092bc154f64b45bd6781508d54d3bb/work/artifacts" 2026-04-24 07:50:22.969512 | orchestrator -> localhost | changed: "/var/lib/zuul/builds/c7092bc154f64b45bd6781508d54d3bb/work/docs" 2026-04-24 07:50:22.989252 | 2026-04-24 07:50:22.989428 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-24 07:50:23.991809 | orchestrator | changed: .d..t...... ./ 2026-04-24 07:50:23.992084 | orchestrator | changed: All items complete 2026-04-24 07:50:23.992123 | 2026-04-24 07:50:24.768442 | orchestrator | changed: .d..t...... ./ 2026-04-24 07:50:25.519908 | orchestrator | changed: .d..t...... ./ 2026-04-24 07:50:25.539037 | 2026-04-24 07:50:25.539171 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-24 07:50:25.580591 | orchestrator | skipping: Conditional result was False 2026-04-24 07:50:25.586592 | orchestrator | skipping: Conditional result was False 2026-04-24 07:50:25.610418 | 2026-04-24 07:50:25.610545 | PLAY RECAP 2026-04-24 07:50:25.610627 | orchestrator | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-04-24 07:50:25.610671 | 2026-04-24 07:50:25.737488 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-04-24 07:50:25.739733 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-04-24 07:50:26.561674 | 2026-04-24 07:50:26.562073 | PLAY [Base post] 2026-04-24 07:50:26.607447 | 2026-04-24 07:50:26.607926 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-24 07:50:27.612552 | orchestrator | changed 2026-04-24 07:50:27.629532 | 2026-04-24 07:50:27.629678 | PLAY RECAP 2026-04-24 07:50:27.629839 | orchestrator | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-24 07:50:27.630295 | 2026-04-24 07:50:27.812155 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-04-24 07:50:27.814617 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-24 07:50:28.608458 | 2026-04-24 07:50:28.608631 | PLAY [Base post-logs] 2026-04-24 07:50:28.619848 | 2026-04-24 07:50:28.619999 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-24 07:50:29.093136 | localhost | changed 2026-04-24 07:50:29.109361 | 2026-04-24 07:50:29.109529 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-24 07:50:29.136190 | localhost | ok 2026-04-24 07:50:29.141400 | 2026-04-24 07:50:29.141545 | TASK [Set zuul-log-path fact] 2026-04-24 07:50:29.157721 | localhost | ok 2026-04-24 07:50:29.169135 | 2026-04-24 07:50:29.169255 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-24 07:50:29.196263 | localhost | ok 2026-04-24 07:50:29.203053 | 2026-04-24 07:50:29.203227 | TASK [upload-logs : Create log directories] 2026-04-24 07:50:29.708658 | localhost | changed 2026-04-24 07:50:29.711799 | 2026-04-24 07:50:29.711914 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-24 07:50:30.224278 | localhost -> localhost | ok: Runtime: 0:00:00.007425 2026-04-24 07:50:30.228601 | 2026-04-24 07:50:30.228755 | TASK [upload-logs : Upload logs to log server] 2026-04-24 07:50:30.795642 | localhost | Output suppressed because no_log was given 2026-04-24 07:50:30.798792 | 2026-04-24 07:50:30.798984 | LOOP [upload-logs : Compress console log and json output] 2026-04-24 07:50:30.845503 | localhost | skipping: Conditional result was False 2026-04-24 07:50:30.859208 | localhost | skipping: Conditional result was False 2026-04-24 07:50:30.870274 | 2026-04-24 07:50:30.870519 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-24 07:50:30.919664 | localhost | skipping: Conditional result was False 2026-04-24 07:50:30.920319 | 2026-04-24 07:50:30.923816 | localhost | skipping: Conditional result was False 2026-04-24 07:50:30.933293 | 2026-04-24 07:50:30.933539 | LOOP [upload-logs : Upload console log and json output]